Thanks to visit codestin.com
Credit goes to github.com

Skip to content

server : print the samplers chain for each request #17070

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
merged 1 commit into from
Nov 7, 2025
Merged

server : print the samplers chain for each request #17070

merged 1 commit into from
Nov 7, 2025

Conversation

@ggerganov
Copy link
Member

@ggerganov ggerganov commented Nov 7, 2025

This is useful for debugging to track which samplers are being used:

0.06.413.534 I slot get_availabl: id  3 | task -1 | selected slot by LCP similarity, sim_best = 1.000 (> 0.100 thold), f_keep = 0.687
0.06.413.669 I slot launch_slot_: id  3 | task -1 | sampler chain: logits -> logit-bias -> penalties -> dry -> top-n-sigma -> top-k -> typical -> top-p -> min-p -> xtc -> temp-ext -> dist 
0.06.413.690 I slot launch_slot_: id  3 | task 38 | processing task

@ggerganov ggerganov requested a review from ngxson as a code owner November 7, 2025 08:53
@DajanaV DajanaV mentioned this pull request Nov 7, 2025
Open
@ggerganov ggerganov merged commit 8c0d6bb into master Nov 7, 2025
67 of 71 checks passed
@ggerganov ggerganov deleted the gg/server-print-samplers branch November 7, 2025 10:24
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@ngxson ngxson ngxson approved these changes

Assignees

No one assigned

Labels

examples server

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

3 participants

@ggerganov @ngxson