Xinference

• https://inference.readthedocs.io/

Maven 依赖

1.0.0-alpha1 及之后：

<dependency>
    <groupId>dev.langchain4j</groupId>
    <artifactId>langchain4j-community-xinference</artifactId>
    <version>1.0.0-beta3</version>
</dependency>

或者，您可以使用 BOM 来一致地管理依赖项：

<dependencyManagement>
    <dependency>
        <groupId>dev.langchain4j</groupId>
        <artifactId>langchain4j-community-bom</artifactId>
        <version>1.0.0-beta3</version>
        <typ>pom</typ>
        <scope>import</scope>
    </dependency>
</dependencyManagement>

API

• XinferenceChatModel
• XinferenceStreamingChatModel

示例

• XinferenceChatModelIT
• XinferenceStreamingChatModelIT