WhiteSpaceConfig

@Serializable

data class WhiteSpaceConfig(val maxTokensPerChunk: Int? = null, val maxOverlapTokens: Int? = null)

Config for white space chunking.

Constructors

constructor(maxTokensPerChunk: Int? = null, maxOverlapTokens: Int? = null)

The maximum number of overlap tokens.

The maximum number of tokens per chunk.