model · first seen 28 Oct 2026
GPT-2
Also: GPT-2-style transformer, Generative Pre-trained Transformer 2
A decoder-only transformer language model released by OpenAI in 2019 for autoregressive text generation.
GPT-2 is OpenAI's 2019 decoder-only transformer language model for autoregressive text generation. Nothing in the sources is new about the model itself; it shows up as a familiar baseline and teaching artifact. A Chinese tutorial repo rebuilds it from scratch in PyTorch, one developer reimplements GPT-2 small in hand-written AArch64 assembly, and a blog post implements it in CSS. On the research side, a Turkish GPT-2 is fine-tuned for turn-taking prediction, a model-collapse study self-trains GPT-2 across generations, and mathematicians train GPT-2-style transformers to generate 3-manifold triangulations.
GPT-2 remains a standard small, well-understood reference model for education, low-level reimplementation and controlled experiments. The handful of new mentions reflects that steady background use rather than a new trend.
Analyst note (established), 17 Nov 2026.
Mentions per week
PapersCodeDiscussion
Rank 21 on 14 Nov 2026 · 6 mentions in 28 days · 6 independent groups · code → papers → discussion · first seen 2 weeks ago · acceleration -0.59
Earliest sources
- aa1143/NamiGPTCode · 28 Oct 2026 · aa1143 · 243 stars
- TurnTurk-GPT: Text-Based Turn-Taking Prediction for TurkishPapers · 30 Oct 2026 · Ahmet Tuğrul Bayrak, Fatma Nur Korkmaz, Nur Yağmur Tuncer, Mustafa Sertaç T…
- Using Transformers to Generate 3-Manifold TriangulationsPapers · 5 Nov 2026 · Daniel Bruwel, Ashvni Narayanan, Jonathan Spreer
- Richness Is Not Evenness: Ordered Renyi Crossings under Self-TrainingPapers · 6 Nov 2026 · Pranjal Srivastava
- ArneshBanerjee/gpt2.sCode · 7 Nov 2026 · ArneshBanerjee · 103 stars
- Implementing GPT-2 in CSSDiscussion · 7 Nov 2026 · zapt02 · 22 points
Latest sources
- Implementing GPT-2 in CSSDiscussion · 7 Nov 2026 · zapt02 · 22 points
- ArneshBanerjee/gpt2.sCode · 7 Nov 2026 · ArneshBanerjee · 103 stars
- Richness Is Not Evenness: Ordered Renyi Crossings under Self-TrainingPapers · 6 Nov 2026 · Pranjal Srivastava
- Using Transformers to Generate 3-Manifold TriangulationsPapers · 5 Nov 2026 · Daniel Bruwel, Ashvni Narayanan, Jonathan Spreer
- TurnTurk-GPT: Text-Based Turn-Taking Prediction for TurkishPapers · 30 Oct 2026 · Ahmet Tuğrul Bayrak, Fatma Nur Korkmaz, Nur Yağmur Tuncer, Mustafa Sertaç T…
- aa1143/NamiGPTCode · 28 Oct 2026 · aa1143 · 243 stars