WizardLM-2 8x22B

WizardLM-2 8x22B

microsoft · Released Apr 16, 2024
32
Our Score

WizardLM-2 8x22B is Microsoft AI's most advanced Wizard model. It demonstrates highly competitive performance compared to leading proprietary models, and it consistently outperforms all existing state-of-the-art opensource models. It is an instruct finetune of Mixtral 8x22B. #moe

$0.62 / 1M Input Price
$0.62 / 1M Output Price
65,535 tokens Context Window
8,000 tokens Max Output
22B Parameters

Architecture

ModalityText → Text
TokenizerMistral
Instruct Typevicuna
Parameters22B

Model Information

OpenRouter ID microsoft/wizardlm-2-8x22b
Providermicrosoft
Release Date April 16, 2024
Context Length65,535 tokens
Max Completion8,000 tokens
Status Active

Pricing

Token Type Cost per 1M tokens Cost per 1K tokens
Input $0.62 $0.000620
Output $0.62 $0.000620

Live Performance

Live endpoint metrics — refreshed every 30 minutes.

100%
Avg Uptime
899ms
Best Latency (TTFT)
8 tok/s
Best Throughput
1/1
Active Endpoints
Available via: Novita