Package org.apache.camel.model.tokenizer

Class LangChain4jTokenizerDefinition

java.lang.Object

org.apache.camel.model.IdentifiedType

org.apache.camel.model.TokenizerImplementationDefinition

org.apache.camel.model.tokenizer.LangChain4jTokenizerDefinition

All Implemented Interfaces:

CopyableDefinition<TokenizerImplementationDefinition>

Direct Known Subclasses:

LangChain4jCharacterTokenizerDefinition, LangChain4jLineTokenizerDefinition, LangChain4jParagraphTokenizerDefinition, LangChain4jSentenceTokenizerDefinition, LangChain4jWordTokenizerDefinition

@Metadata(firstVersion="4.8.0",
          label="eip,transformation,ai",
          title="LangChain4J Tokenizer")
public class LangChain4jTokenizerDefinition
extends TokenizerImplementationDefinition

Tokenizer that uses LangChain4j for tokenization.

Nested Class Summary

Nested Classes

Modifier and Type	Class	Description
static class	LangChain4jTokenizerDefinition.Builder
static enum	LangChain4jTokenizerDefinition.TokenizerType

Constructor Summary

Constructors

Constructor	Description
LangChain4jTokenizerDefinition()
LangChain4jTokenizerDefinition(LangChain4jTokenizerDefinition source)

Method Summary

Modifier and Type	Method	Description
LangChain4jTokenizerDefinition	copyDefinition()	Makes a copy of this definition.
String	getMaxOverlap()	Gets the maximum number of tokens that can overlap in each segment
String	getMaxTokens()	The maximum number of tokens on each segment
String	getTokenizerType()	Gets the tokenizer type
void	setMaxOverlap(String maxOverlap)	Sets the maximum number of tokens that can overlap in each segment
void	setMaxTokens(String maxTokens)	Sets the maximum number of tokens on each segment
void	setTokenizerType(String tokenizerType)	Sets the tokenizer type
protected static String	toName(String name)

Methods inherited from class org.apache.camel.model.TokenizerImplementationDefinition

configuration, setConfiguration, setTokenizerName, tokenizerName

Methods inherited from class org.apache.camel.model.IdentifiedType

getId, setId

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Details

LangChain4jTokenizerDefinition

public LangChain4jTokenizerDefinition()

LangChain4jTokenizerDefinition

public LangChain4jTokenizerDefinition(LangChain4jTokenizerDefinition source)

Method Details

getMaxTokens

public String getMaxTokens()

The maximum number of tokens on each segment

setMaxTokens

public void setMaxTokens(String maxTokens)

Sets the maximum number of tokens on each segment

getMaxOverlap

public String getMaxOverlap()

Gets the maximum number of tokens that can overlap in each segment

setMaxOverlap

public void setMaxOverlap(String maxOverlap)

Sets the maximum number of tokens that can overlap in each segment

getTokenizerType

public String getTokenizerType()

Gets the tokenizer type

setTokenizerType

public void setTokenizerType(String tokenizerType)

Sets the tokenizer type

copyDefinition

public LangChain4jTokenizerDefinition copyDefinition()

Description copied from interface: CopyableDefinition

Makes a copy of this definition.

Specified by:

copyDefinition in interface CopyableDefinition<TokenizerImplementationDefinition>

Overrides:

copyDefinition in class TokenizerImplementationDefinition

toName

protected static String toName(String name)