NeoSignal
← Back to models
C

Calmerys 78b Orpo V0.1

Models
84

Open-source 78B parameter model based on Qwen2 architecture

Ranked #3 on HuggingFace Open LLM Leaderboard

Metrics

providerdfurman
hf average44.1
parameters77.972
open source
architectureQwen2ForCausalLM
context window32,768

Score Breakdown

code70
math38
reasoning59
intelligence49
instruction following79

Compatibility

111111119511111111951111111190

Scoring Methodology

intelligence30% weight

Overall reasoning and task completion ability

Source: LMArena ELO, Artificial Analysis Intelligence Index, HuggingFace MMLU-PRO

math20% weight

Mathematical reasoning and problem solving

Source: MATH benchmark, GSM8K, HuggingFace MATH-Lvl5

code20% weight

Code generation, understanding, and debugging

Source: HumanEval, MBPP, SWE-bench

reasoning15% weight

Multi-step logical reasoning

Source: ARC-Challenge, BBH, MMLU-Pro, HuggingFace BBH

instruction_following15% weight

Ability to follow complex instructions accurately

Source: HuggingFace IFEval

Data Sources

huggingface.cohuggingface.co
Last updated: December 24, 2025