Does Vscode Copilot extension in Agent mode only works with Claude?

Question

New agent mode for GitHub Copilot extension in VSCode using Claude as LLM is great but I want to try with other models.

Even OpenAI model 4o is not working as Agent. I tried with Ollama and OpenRouter too. The problem is that once you connect using any other than Claude you can get the response from first request as text or as code depending on what you are asking but when it refers to a process that needs to execute and evaluate nothing happens. As example I took the example of asking

Create a meal-planning web app using React and Node.js

As documentation shows in https://code.visualstudio.com/docs/copilot/chat/chat-agent-mode

The only way, as far as I tested, is to get it done using Claude model.

Thomas Mechelke · Accepted Answer · 2025-04-18 18:42:46Z

1

I just tried this with the prompt from your question and model GPT-4.1 (Preview). For me it's working.

I had to watch for confirmation prompts in the terminal (e.g. npx express-generator server --no-view asked if it was ok to proceed) and in GitHub Copilot chat I had to say "ok" for it to take the next step at different times.

It wasn't super clear that this is what needed to happen, though. So maybe it's not so much a model selection issue as much as the UX not making it easy enough for the user to find where they need to intervene.

answered Apr 18 at 18:42

Thomas Mechelke

113 bronze badges

Sign up to request clarification or add additional context in comments.

Collectives™ on Stack Overflow

Does Vscode Copilot extension in Agent mode only works with Claude?

1 Answer 1

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

Comments

Your Answer

Sign up or log in

Post as a guest

Related