Skip to main content

如何加载 CSV 数据

¥How to load CSV data

逗号分隔值 (CSV) 文件是一个带分隔符的文本文件,使用逗号分隔值。文件的每一行都是一条数据记录。每条记录由一个或多个字段组成,字段之间用逗号分隔。

¥A comma-separated values (CSV) file is a delimited text file that uses a comma to separate values. Each line of the file is a data record. Each record consists of one or more fields, separated by commas.

加载 CSV 数据,每个文档占一行。

¥Load CSV data with a single row per document.

设置

¥Setup

npm install d3-dsv@2

用法,提取所有列

¥Usage, extracting all columns

CSV 文件示例:

¥Example CSV file:

id,text
1,This is a sentence.
2,This is another sentence.

代码示例:

¥Example code:

import { CSVLoader } from "@langchain/community/document_loaders/fs/csv";

const loader = new CSVLoader("src/document_loaders/example_data/example.csv");

const docs = await loader.load();
/*
[
Document {
"metadata": {
"line": 1,
"source": "src/document_loaders/example_data/example.csv",
},
"pageContent": "id: 1
text: This is a sentence.",
},
Document {
"metadata": {
"line": 2,
"source": "src/document_loaders/example_data/example.csv",
},
"pageContent": "id: 2
text: This is another sentence.",
},
]
*/

用法,提取单列

¥Usage, extracting a single column

CSV 文件示例:

¥Example CSV file:

id,text
1,This is a sentence.
2,This is another sentence.

代码示例:

¥Example code:

import { CSVLoader } from "@langchain/community/document_loaders/fs/csv";

const loader = new CSVLoader(
"src/document_loaders/example_data/example.csv",
"text"
);

const docs = await loader.load();
/*
[
Document {
"metadata": {
"line": 1,
"source": "src/document_loaders/example_data/example.csv",
},
"pageContent": "This is a sentence.",
},
Document {
"metadata": {
"line": 2,
"source": "src/document_loaders/example_data/example.csv",
},
"pageContent": "This is another sentence.",
},
]
*/