📄️ Comparison Table of all supported Language Models
| Provider | Streaming | Tools (sync/streaming) | JSON Schema | JSON Mode | Supported Modalities (Input) | Observability | Customizable HTTP Client | Local Deployment | Supports Native Image | Comments |
📄️ Amazon Bedrock
Maven 依赖
📄️ Anthropic
- Anthropic 文档
📄️ Azure OpenAI
这是 Azure OpenAI 集成的文档，它使用来自微软的 Azure SDK，如果您使用的是微软 Java 技术栈（包括高级 Azure 身份验证机制），它会工作得最好。
📄️ ChatGLM
https://github.com/THUDM/ChatGLM-6B
📄️ DashScope (通义千问)
DashScope 是由阿里云开发的平台。
📄️ GitHub Models
This is the documentation for the GitHub Models integration, that uses the Azure AI Inference API to access GitHub Models.
📄️ Google AI Gemini
https://ai.google.dev/gemini-api/docs
📄️ Google Vertex AI Gemini
Vertex AI is Google Cloud's fully-managed AI development platform that provides access to Google's large generative models, including the older generation (PaLM2) and the newer generation (Gemini).
📄️ Google Vertex AI PaLM 2
Get started
📄️ Hugging Face
HuggingFace Inference API
📄️ Jlama
Jlama Project
📄️ LocalAI
https://localai.io/
📄️ MistralAI
MistralAI Documentation
📄️ Ollama
What is Ollama?
📄️ OpenAI
This is the documentation for the OpenAI integration, that uses a custom Java implementation of the OpenAI REST API, that works best with Quarkus (as it uses the Quarkus REST client) and Spring (as it uses Spring's RestClient).
📄️ OpenAI Official SDK
This is the documentation for the OpenAI Official SDK integration, that uses the official OpenAI Java SDK.
📄️ Qianfan
百度智能云千帆 大模型
📄️ Cloudflare Workers AI
https://developers.cloudflare.com/workers-ai/
📄️ ZhiPu AI
ZhiPu AI is a platform to provide model service including text generation, text embedding,
📄️ Xinference
- https://inference.readthedocs.io/