flashinfer-ai/flashinfer v0.1.3

on GitHub

0.1.3 (2024-07-31)

Bugfix

• bugfix: Fix cudagraph mode of BatchPrefillWithRaggedKVCacheWrapper (#412) (9907bc)
• fix cu118 cub usage for sampling kernels (#410) (58d359)

Misc

• enhance allocator error info and add shape check for prefill begin forward functions (#413) (5e36c5)