SlidingWindow

@PublicPreviewAPI
class SlidingWindow


Configures the sliding window context compression mechanism.

The context window will be truncated by keeping only a suffix of it.

Summary

Public constructors

SlidingWindow(targetTokens: Int?)

Public properties

Int?

The session reduction target, i.e., how many tokens we should keep.

Public constructors

SlidingWindow

SlidingWindow(targetTokens: Int? = null)

Public properties

targetTokens

val targetTokensInt?

The session reduction target, i.e., how many tokens we should keep.