Thanks to visit codestin.com
Credit goes to github.com

Skip to content

feat(backend): add sglang lora params of gpu#272

Merged
wasamtc merged 7 commits into
mainfrom
tangcong/sglanglora
Nov 25, 2025
Merged

feat(backend): add sglang lora params of gpu#272
wasamtc merged 7 commits into
mainfrom
tangcong/sglanglora

Conversation

@wasamtc

@wasamtc wasamtc commented Nov 24, 2025

Copy link
Copy Markdown
Collaborator

📋 PR Title Format

The PR title should follow the format:

type(scope): concise message (max 50 chars)

Where:

  • type is one of: feat, fix, docs, refactor, perf, test, chore.
  • scope is optional and describes the part of the codebase affected (e.g., auth, ui, api).
  • concise message is a short description of the change (max 50 chars).

📝 Change Type

Please select the type of change this PR introduces (choose one or more):

  • feat: New feature.
  • fix: Bug fix.
  • docs: Documentation only changes.
  • refactor: A code change that neither fixes a bug nor adds a feature.
  • perf: Performance improvement.
  • test: Adding missing tests or correcting existing tests.
  • chore: Maintenance tasks (e.g., updating dependencies).

💡 Description

Briefly describe the change, its purpose, and the problem it solves.
Before parallax could not support lora, now it can use sglang's lora.

Key Changes

1.add sglang's lora params
2.transfer params to sglang

🔗 Related Issues

List any issues this PR closes or relates to:

✅ Checklist

Please ensure the following points are addressed before merging:

  • I have performed a self-review of my own code.
  • I have added/updated tests that prove my fix or feature works (if applicable).
  • I have updated the documentation (if necessary).
  • My code follows the project's style guidelines.

@wasamtc wasamtc requested a review from a team November 24, 2025 06:07
@wasamtc wasamtc changed the title feat(backend): add sglang lora params of GPU feat(backend): add sglang lora params of gpu Nov 24, 2025
Comment thread src/parallax/cli.py Outdated
@gufengc

gufengc commented Nov 25, 2025

Copy link
Copy Markdown
Collaborator

unit test failed due to transformers version incompatible, set transformers version to 4.55.2 works

Comment thread src/parallax/cli.py
@wasamtc wasamtc enabled auto-merge (squash) November 25, 2025 09:19
@wasamtc wasamtc merged commit 4e61ff1 into main Nov 25, 2025
3 checks passed
@wasamtc wasamtc deleted the tangcong/sglanglora branch November 25, 2025 09:19
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[Feature]: Support LoRA Adapters

2 participants