Pytorch 2.7 Wheels for v0.2.6.post1

[sundar24295s]

Issue

• For previous flash_infer versions like 0.2.5 we found the wheels here https://github.com/flashinfer-ai/flashinfer/releases/download/v0.2.5/flashinfer_python-0.2.5+cu124torch2.6-cp38-abi3-linux_x86_64.whl.
• But the new versions don't seemt to publish wheels in the release page .
• Google search led me to this https://flashinfer.ai/whl/cu126/, but I don't the torch 2.7 wheels here.
• Latest sglang version is using flashinfer_python==0.2.6.post1 with "torch==2.7.1",.

srt = [
    "sglang[runtime_common]",
    "sgl-kernel==0.1.7",
    "flashinfer_python==0.2.6.post1",
    "torch==2.7.1",
    "torchaudio==2.7.1",
    "torchvision==0.22.1",
    "cuda-python",
    "outlines>=0.0.44,<=0.1.11",
    "einops",
]

[yzh119]

Hi @sundar24295s , we are about to remove the cuda specific release and all installation should go through pypi (which do not depend on specific torch/cuda versions):

pip install flashinfer-python

[Yeok-c]

pip install flashinfer-python
Would this still be the JIT version? Or the version with pre-compiled wheels?

[yzh119]

JIT and AOT will be unified in the next release (wheels itself don't include any kernels, you can choose to download the kernel binary from artifactory or JIT compile), a prototype would be ready next Monday as a v0.2.7.rc release candidate.

[Yeok-c]

Bro doing God's work 👍

[athms]

@yzh119 I wanted to follow up on this and check in about the availability of a torch 2.7 (and cuda 12.8) compatible release (as mentioned above as a 0.2.7.rc release candidate). Is this candidate available and if yes, how can it be installed?

[jiangtaozh]

what's the progress?

[xsank]

pip install flashinfer-python==0.2.6

with the exception below:

#pip install flashinfer-python==0.2.6
Looking in indexes: https://mirrors.aliyun.com/pypi/simple/
Collecting flashinfer-python==0.2.6
  Downloading https://mirrors.aliyun.com/pypi/packages/95/4a/a3109d57463d25a153b16c0d0f06495e4d18b727c81f8e08e42e97faaf45/flashinfer_python-0.2.6.tar.gz (2.9 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 2.9/2.9 MB 7.3 MB/s eta 0:00:00
  Installing build dependencies ... done
  Getting requirements to build wheel ... done
  Installing backend dependencies ... done
  Preparing metadata (pyproject.toml) ... error
  error: subprocess-exited-with-error
  
  × Preparing metadata (pyproject.toml) did not run successfully.
  │ exit code: 1
  ╰─> [23 lines of output]
      /tmp/pip-build-env-6m8sghny/overlay/lib/python3.10/site-packages/setuptools/config/_apply_pyprojecttoml.py:82: SetuptoolsDeprecationWarning: `project.license` as a TOML table is deprecated
      !!
      
              ********************************************************************************
              Please use a simple string containing a SPDX expression for `project.license`. You can also use `project.license-files`. (Both options available on setuptools>=77.0.0).
      
              By 2026-Feb-18, you need to update your project and remove deprecated calls
              or your builds will no longer be supported.
      
              See https://packaging.python.org/en/latest/guides/writing-pyproject-toml/#license for details.
              ********************************************************************************
      
      !!
        corresp(dist, value, root_dir)
      0 AOT ops found in /tmp/pip-install-37ettc8z/flashinfer-python_e489b4820f854b5e812623bd31a9d6b2/aot-ops
      running dist_info
      creating /tmp/pip-modern-metadata-izmltgts/flashinfer_python.egg-info
      writing /tmp/pip-modern-metadata-izmltgts/flashinfer_python.egg-info/PKG-INFO
      writing dependency_links to /tmp/pip-modern-metadata-izmltgts/flashinfer_python.egg-info/dependency_links.txt
      writing requirements to /tmp/pip-modern-metadata-izmltgts/flashinfer_python.egg-info/requires.txt
      writing top-level names to /tmp/pip-modern-metadata-izmltgts/flashinfer_python.egg-info/top_level.txt
      writing manifest file '/tmp/pip-modern-metadata-izmltgts/flashinfer_python.egg-info/SOURCES.txt'
      error: package directory '3rdparty/spdlog' does not exist
      [end of output]
  
  note: This error originates from a subprocess, and is likely not a problem with pip.
error: metadata-generation-failed

× Encountered error while generating package metadata.
╰─> See above for output.

note: This is an issue with the package mentioned above, not pip.
hint: See above for details.

@yzh119