如何编写自定义文档加载器
¥How to write a custom document loader
如果你想实现自己的文档加载器,你有几种选择。
¥If you want to implement your own Document Loader, you have a few options.
BaseDocumentLoader 子类化
¥Subclassing BaseDocumentLoader
你可以直接扩展 BaseDocumentLoader 类。BaseDocumentLoader 类提供了一些便捷的方法,用于从各种来源加载文档。
¥You can extend the BaseDocumentLoader class directly. The BaseDocumentLoader class provides a few convenience methods for loading documents from a variety of sources.
abstract class BaseDocumentLoader implements DocumentLoader {
abstract load(): Promise<Document[]>;
}
TextLoader 子类化
¥Subclassing TextLoader
如果你想从文本文件加载文档,可以扩展 TextLoader 类。TextLoader 类负责读取文件,因此你只需实现一个解析方法即可。
¥If you want to load documents from a text file, you can extend the TextLoader class. The TextLoader class takes care of reading the file, so all you have to do is implement a parse method.
abstract class TextLoader extends BaseDocumentLoader {
abstract parse(raw: string): Promise<string[]>;
}
BufferLoader 子类化
¥Subclassing BufferLoader
如果你想从二进制文件加载文档,可以扩展 BufferLoader 类。BufferLoader 类负责读取文件,因此你只需实现一个解析方法即可。
¥If you want to load documents from a binary file, you can extend the BufferLoader class. The BufferLoader class takes care of reading the file, so all you have to do is implement a parse method.
abstract class BufferLoader extends BaseDocumentLoader {
abstract parse(
raw: Buffer,
metadata: Document["metadata"]
): Promise<Document[]>;
}