Working with own local agent (vLLM)

[ofaucoz]

Hi Emilie,

I want to use aster with a locally hosted llm on my HPC. It works for the conversation but not with the tools on my HPC.

To make it work I've changed the agent with this :

agent = Agent(
    llm=VLLM(model="model_name", host="http://xxx.cnes.fr:8081"),
    tools=tools,
    tool_hooks=hooks,
    system_prompt=system_prompt
)

At first it seems to work, the agent answers :

Me : 
I want to do a retrieval with taurex of K2-18b based on the spectra that I have saved here :    /xx/xx "

Agent answers : 
To perform a retrieval with TauREx for K2-18b using the spectra you have saved, I'll need to
follow these steps:
1 Set up TauREx paths: We need to configure the paths for opacity and CIA files.
2 Prepare the observation data: Ensure the spectrum file is in the correct format and path.
3 Run the retrieval: Use the SimulateTaurexRetrieval tool with the appropriate parameters.
Let's start by setting up the TauREx paths. First, I need to check if the linelists directory
exists and then get the absolute path to set the opacity and CIA paths correctly.
I'll run the following commands to check the linelists directory and get the current working
directory:
ls linelists/
pwd
Let me execute these commands to get the necessary
information.[TOOL_CALLS]runcommand{"command": "ls linelists/"}[TOOL_CALLS] runcommand{"command":
"pwd"}

Then it hangs and nothing happen. There was an error with the agent for the conversation name but by providing a local vllm it's now gone. I cannot see what's happening.

Do you have an idea, or a flag to see more debug ?