Thanks to visit codestin.com
Credit goes to github.com

Skip to content

Support the free threaded build #2807

@ngoldbaum

Description

@ngoldbaum

Currently, mlx and any package that depends on mlx fails to install on the free-threaded build:

goldbaum at Nathans-MBP in ~/Documents/guidance on implicit-event-loop
± python -VV
Python 3.14.0 free-threading build (main, Oct  8 2025, 10:32:29) [Clang 17.0.0 (clang-1700.3.19.1)]

goldbaum at Nathans-MBP in ~/Documents/guidance on implicit-event-loop
± pip install mlx
ERROR: Could not find a version that satisfies the requirement mlx (from versions: none)

[notice] A new release of pip is available: 25.2 -> 25.3
[notice] To update, run: pip install --upgrade pip
ERROR: No matching distribution found for mlx

And indeed, there aren't any cp314t wheels on PyPI.

It'd be really nice to be able to use mlx on the free-threaded build. Both PyTorch and jaxlib ship free-threaded wheels.

Also see https://py-free-threading.github.io for more about using the free-threaded build and https://py-free-threading.github.io/porting-extensions/ for more about updating extensions.

Myself and my team at Quansight have been actively working on adding support for the free-threaded build in community packages for the past year and a half. I can also loop in CPython core devs and other experts who can offer advice.

Currently our short-term goal is to get vLLM running on the free-threaded build. This is in support of that, since mlx is an indirect dependency on apple silicon macs, via xgrammar. See vllm-project/vllm#28762.

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or request

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions