Skip to main content

HuggingFaceInference

以下是将 HugggingFaceInference 模型作为 LLM 调用的示例：

¥Here's an example of calling a HugggingFaceInference model as an LLM:

npm install @langchain/community @langchain/core @huggingface/inference@4
tip

我们正在统一所有软件包的模型参数。我们现在建议使用 model 代替 modelName，并使用 apiKey 作为 API 密钥。

¥We're unifying model params across all packages. We now suggest using model instead of modelName, and apiKey for API keys.

import { HuggingFaceInference } from "@langchain/community/llms/hf";

const model = new HuggingFaceInference({
  model: "gpt2",
  apiKey: "YOUR-API-KEY", // In Node.js defaults to process.env.HUGGINGFACEHUB_API_KEY
});
const res = await model.invoke("1 + 1 =");
console.log({ res });

¥Related