Skip to content

vllm.models.mistral.mistral_large4.amd.specialized_decode.mono.common.device

Device-side mechanisms every mono kernel shares, one module each: ops (wave / math / packing primitives) and sync (the tagged mailbox).

Modules:

  • ops –

    Device-side primitives of the mono kernels: wave reductions and shuffles, the

  • sync –

    The tagged mailbox: hand-offs between the CTAs of one GPU (device scope) and