vllm.utils.b12x
¶
Accessors for the b12x package shipped with flashinfer-python.
Functions:
-
has_b12x–Return whether the b12x package is available.
-
reuse_packed_weight_storage–Reuse packed tensor addresses when a compatible weight is reloaded.
has_b12x()
¶
reuse_packed_weight_storage(current, replacement)
¶
Reuse packed tensor addresses when a compatible weight is reloaded.