Comparison Table of all supported Language Models

Provider	Streaming	Tools (sync/streaming)	JSON Schema	JSON Mode	Supported Modalities (Input)	Observability	Customizable HTTP Client	Local Deployment	Supports Native Image	Comments
Amazon Bedrock (Converse API)	✅	✅/✅			text, image, PDF	✅
Amazon Bedrock (Invoke API)	✅	✅/❌			text	✅
Anthropic	✅	✅/✅			text, image	✅	🆘 #2469		✅
Azure OpenAI	✅	✅/✅	✅	✅	text, image	✅
ChatGLM					text
DashScope	✅	✅/✅			text, image, audio	✅
GitHub Models	✅	✅/✅	🔜 #1911	✅	text, image	✅
Google AI Gemini	✅	✅/✅	✅	✅	text, image, audio, video, PDF	✅
Google Vertex AI Gemini	✅	✅/✅	🆘 #1717	✅	text, image, audio, video, PDF	✅
Google Vertex AI PaLM 2					text				✅
Hugging Face					text
Jlama	✅	✅/✅			text			✅	✅
LocalAI	✅	✅/✅			text, image, audio			✅
Mistral AI	✅	✅/✅	✅	✅	text		🆘 #2524
Ollama	✅	✅/✅	✅	✅	text, image	✅	✅	✅
OpenAI	✅	✅/✅	✅	✅	text, image, audio	✅	✅	Compatible with: Ollama, LM Studio, GPT4All, etc.	✅	Compatible with: Groq, etc.
Qianfan	✅	✅/✅			text
Cloudflare Workers AI					text
Zhipu AI	✅	✅/✅			text, image	✅

Legend:

• ✅ means "supported"
• 🆘 means "not supported yet; please help us implement it"
• 🔜 means "it is being implemented; please wait"
• ❌ means "not supported by the LLM provider"
• no mark means "not sure, need to double-check"