Package org.apache.camel.model.tokenizer

Class LangChain4jTokenizerDefinition.Builder

java.lang.Object

org.apache.camel.model.tokenizer.LangChain4jTokenizerDefinition.Builder

All Implemented Interfaces:

TokenizerBuilder<LangChain4jTokenizerDefinition>

Direct Known Subclasses:

LangChain4jCharacterTokenizerDefinition.CharacterBuilder, LangChain4jLineTokenizerDefinition.LineBuilder, LangChain4jParagraphTokenizerDefinition.ParagraphBuilder, LangChain4jSentenceTokenizerDefinition.SentenceBuilder, LangChain4jWordTokenizerDefinition.WordBuilder

Enclosing class:

LangChain4jTokenizerDefinition

public abstract static class LangChain4jTokenizerDefinition.Builder
extends Object
implements TokenizerBuilder<LangChain4jTokenizerDefinition>

Constructor Summary

Constructors

Constructor	Description
Builder()

Method Summary

Modifier and Type	Method	Description
LangChain4jTokenizerDefinition.Builder	configuration(org.apache.camel.spi.Tokenizer.Configuration configuration)
LangChain4jTokenizerDefinition.Builder	maxOverlap(int maxOverlap)	Sets the maximum number of tokens that can overlap in each segment
LangChain4jTokenizerDefinition.Builder	maxTokens(int maxTokens)	Sets the maximum number of tokens in each segment
protected abstract String	name()
protected void	setup(LangChain4jTokenizerDefinition tokenizer)
LangChain4jTokenizerDefinition.Builder	using(LangChain4jTokenizerDefinition.TokenizerType tokenizer)	Sets the tokenizer type.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.camel.builder.TokenizerBuilder

end

Constructor Details

Builder

public Builder()

Method Details

maxTokens

public LangChain4jTokenizerDefinition.Builder maxTokens(int maxTokens)

Sets the maximum number of tokens in each segment

maxOverlap

public LangChain4jTokenizerDefinition.Builder maxOverlap(int maxOverlap)

Sets the maximum number of tokens that can overlap in each segment

using

public LangChain4jTokenizerDefinition.Builder using(LangChain4jTokenizerDefinition.TokenizerType tokenizer)

Sets the tokenizer type. Must be one of TokenizerType.OPEN_AI (the default), TokenizerType.AZURE or TokenizerType.QWEN

configuration

public LangChain4jTokenizerDefinition.Builder configuration(org.apache.camel.spi.Tokenizer.Configuration configuration)

setup

protected void setup(LangChain4jTokenizerDefinition tokenizer)

name

protected abstract String name()