Package com.hw.langchain.text.splitter

Class CharacterTextSplitter

java.lang.Object

com.hw.langchain.text.splitter.TextSplitter

com.hw.langchain.text.splitter.CharacterTextSplitter

All Implemented Interfaces:

BaseDocumentTransformer

public class CharacterTextSplitter
extends TextSplitter

Implementation of splitting text that looks at characters.

Author:

HamaWhite

Field Summary

Fields

Modifier and Type	Field	Description
protected String	separator

Fields inherited from class com.hw.langchain.text.splitter.TextSplitter

addStartIndex, chunkOverlap, chunkSize, keepSeparator, lengthFunction

Constructor Summary

Constructors

Constructor	Description
CharacterTextSplitter()

Method Summary

Modifier and Type	Method	Description
List<String>	splitText(String text)	Split incoming text and return chunks.

Methods inherited from class com.hw.langchain.text.splitter.TextSplitter

createDocuments, mergeSplits, splitDocuments, transformDocuments

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Details

separator

protected String separator

Constructor Details

CharacterTextSplitter

public CharacterTextSplitter()

Method Details

splitText

public List<String> splitText(String text)

Split incoming text and return chunks.

Specified by:

splitText in class TextSplitter