Transformer version problem with evaluation code

[soonchangAI]

I install vlm-eval using transformers==4.34.1
Yet I face the following errors.
I tried to use different version of transformers, but it seems there is a conflict between llavarepository and the llava in later versions of Transformers.

    from transformers import PhiForCausalLM
ImportError: cannot import name 'PhiForCausalLM' from 'transformers'```