github flashinfer-ai/flashinfer v0.1.0

latest releases: nightly-v0.6.11-20260508, v0.6.11, v0.6.10.post1...
22 months ago

0.1.0 (2024-07-17)

Features

  • Add mask to merge_state_in_place (#372) (e14fa81)
  • expose pytorch api for block sparse attention (#375) (4bba6fa)
  • Fused GPU sampling kernel for joint top-k & top-p sampling (#374) (6e028eb)

Don't miss a new flashinfer release

NewReleases is sending notifications on new releases.