AI Frontier
← Browse this publisher

NVIDIA / Technical Report

Post-Training Language Models for Gold-Medal Performance in Coding Competitions

Nemotron Labs 3 Competitive Coding 550B-A55B · 2026-09-02

Source summary

Original wording · Original language

Abstract. · Page 1

Competitive programming has become a key test of large language model reasoning, with international competitions such as IOI and ICPC representing its most challenging settings. We present an end-to-end specialization pipeline combining large-scale problem curation, synthetic reasoning traces, supervised fine-tuning (SFT), and reinforcement learning (RL). Using 22,000 curated problems, we train Nemotron-3-Nano-CC (30B-A3B) with SFT and RL and Nemotron-3-Ultra-CC (550B-A55B) with SFT alone. We further introduce GenCorrect, a feedback-driven test-time compute strategy that iteratively generates, evaluates, and refines diverse solutions. On IOI 2025, Nano-CC improves from 130 points to 291 after post-training and to 468 with GenCorrect, exceeding the gold threshold of 438.3 while Ultra-CC reaches 502. Guided by these results, we develop a competition-specific Ultra-CC system and evaluate it prospectively during IOI 2026. Under the same time, internet-access, and submission constraints as human contestants, it scores 535.4 out of 600, exceeding both the gold threshold of 361.12 and the top human score of 498.27. To our knowledge, this is the first AI system to outscore the highest-scoring human contestant on an IOI problem set.

Core figures

Enlarge to explore. Download the original for full detail.

Figure 1 · ResultsPage 2
Figure 1 | Performance of our pipeline and models on IOI 2025 and IOI 2026.
Figure 2 · ArchitecturePage 3
Figure 2 | Our competitive-programming pipeline. Nemotron-3-Nano-CC undergoes supervised fine-tuning and reinforcement learning, while Nemotron-3-Ultra-CC uses supervised fine-tuning only. Both models use GenCorrect at inference time.

Click the image to zoom. Press Esc to close. Full-resolution files are available below each figure.