Files

1.9 KiB

1time_stats.moe_gating_linear.mintime_stats.moe_gating_linear.maxtime_stats.moe_gating_linear.meantime_stats.moe_gating_linear.mediantime_stats.moe_gating_linear.stdtime_stats.moe_gating_routing_topk.mintime_stats.moe_gating_routing_topk.maxtime_stats.moe_gating_routing_topk.meantime_stats.moe_gating_routing_topk.mediantime_stats.moe_gating_routing_topk.stdtime_stats.moe_shuffling.mintime_stats.moe_shuffling.maxtime_stats.moe_shuffling.meantime_stats.moe_shuffling.mediantime_stats.moe_shuffling.stdtime_stats.moe_grouped_gemm.mintime_stats.moe_grouped_gemm.maxtime_stats.moe_grouped_gemm.meantime_stats.moe_grouped_gemm.mediantime_stats.moe_grouped_gemm.stdnum_tokensnum_expertsnum_experts_per_deviceexpert_parallel_sizerouting_runtime_pathrouting_assignment_policyrouting_weight_policyrouting_uses_router_logitsgating_runtime_contextgating_runtime_context_implrouter_topkhidden_dimexpert_hidden_dimuse_gatednum_tensor_parallel_workerstotal_routed_tokensmodel_expansion_ratiotokens_per_expert_avgtokens_to_experts_ratioexpert_utilizationmin_load_ratioload_imbalance_cvmax_load_ratioload_entropyload_gini_coefficientload_distributionseedmoe_grouped_gemm_backendmeasurement_typeprofiling_precisionmodel_archquant_signature
20.030975999310612680.0490560010075569150.034678399749100210.032544000074267390.0050935227062697370.051936000585556030.084192000329494480.060542400553822520.056416001170873640.0090514899110830330.0259199999272823330.040640000253915790.0305279997177422060.0306080002337694170.00402312662056056750.296032011508941650.34944000840187070.30750238895416260.301375985145568850.014090820215642452161281281standard_fused_topklogit_topksoftmax_renormTrueprefill_hotffn_like_prefix_20x840961536True41280.3751.01.00.6093750.01.02316909648405634.06.1226268575034890.5433349609375uniform0vllm_fusedCUDA_EVENTBF16genericmethod=fp8|act=dynamic|serialized=True|block=128x128