Skip to content

vllm.v1.worker.gpu.spec_decode.dspark.config

Functions:

dspark_draft_supports_eplb(draft_model_config)

Return whether a DSpark draft should register with EPLB here.

Source code in vllm/v1/worker/gpu/spec_decode/dspark/config.py
def dspark_draft_supports_eplb(draft_model_config: "ModelConfig") -> bool:
    """Return whether a DSpark draft should register with EPLB here."""
    if current_platform.is_rocm():
        return False
    return getattr(draft_model_config.hf_config, "model_type", None) in (
        "deepseek_v4",
        "deepseek_v41",
    )