Alora, the research verification company
Menu

2404.00004

Competing lab announces cheaper decode for 70B

Northwind Labs reports a decode kernel that claims 18% cheaper tokens on 70B self-hosted serving versus vLLM baseline.

UNTESTED WEAK

Northwind Labs reports 18% cheaper decode tokens on 70B self-hosted serving versus a vLLM baseline.

structural read; full verdict pending

Holds when: 70B self-hosted

Evidence ledger