Jump to content

Template:Frontier gap: Difference between revisions

From Digital Millennium Wiki
Stub-style box: how far behind the frontier, with a progress bar
 
Document help parameter
 
(One intermediate revision by the same user not shown)
Line 31: Line 31:
| at_frontier  =      <!-- "yes" once you are considered a frontier lab -->
| at_frontier  =      <!-- "yes" once you are considered a frontier lab -->
| approx      =      <!-- "no" drops the word "about" -->
| approx      =      <!-- "no" drops the word "about" -->
| help        =      <!-- call to action under the box; OpenCerebral gets a compute ask by default; "no" hides it -->
| start        =      <!-- left end of the bar; default 2017-06-12 -->
| start        =      <!-- left end of the bar; default 2017-06-12 -->
| start_label  =      <!-- default "Transformer" -->
| start_label  =      <!-- default "Transformer" -->
Line 37: Line 38:
* The gap is written in years and months, months and days, or days, depending on its size.
* The gap is written in years and months, months and days, or days, depending on its size.
* If <code>matches_date</code> is on or after <code>released</code>, or <code>at_frontier = yes</code>, the box says '''at the frontier''' and the bar fills completely, as in the second example.
* If <code>matches_date</code> is on or after <code>released</code>, or <code>at_frontier = yes</code>, the box says '''at the frontier''' and the bar fills completely, as in the second example.
* For OpenCerebral the box ends with a compute ask (oc@kunix.org). Set <code>help</code> to change it, or <code>help = no</code> to hide it. It is hidden at the frontier.
* When a new model comes out, update <code>model</code>, <code>released</code>, <code>matches</code> and <code>matches_date</code>.
* When a new model comes out, update <code>model</code>, <code>released</code>, <code>matches</code> and <code>matches_date</code>.
* Dates take the same forms as [[Template:Infobox]]: <code>2019</code>, <code>February 2019</code>, <code>2019-02-14</code>.
* Dates take the same forms as [[Template:Infobox]]: <code>2019</code>, <code>February 2019</code>, <code>2019-02-14</code>.
</noinclude>
</noinclude>

Latest revision as of 04:04, 23 October 2026

OpenCerebral is about 7 years, 8 months behind the frontier.
▲ GPT-2 (1.5B) level, 14 February 2019
Transformer
12 June 2017
Frontier: Claude Opus 5.5, Claude Fable 5.1
21 October 2026
Newest model: Boris-2-Preview-2 (21 October 2026). It scores about the same as GPT-2 (1.5B), which reached that level in February 2019.
Compared on: zero-shot HellaSwag, ARC-Easy, ARC-Challenge and PIQA, against published GPT-2 (1.5B) results
Help close the gap: donate compute or credits to oc@kunix.org
Example Lab is at the frontier.
Transformer
12 June 2017
Frontier: Example-1
1 January 2027
Newest model: Example-1 (1 January 2027).

How far behind the frontier a lab's newest model is. The gap is the time between the frontier first reaching your model's level and your model's release. The bar runs from the Transformer paper (June 2017) to that release: the filled part is how far along the frontier's history your model has caught up, and the hatched part is the gap.

Usage

{{Frontier gap
| subject      =      <!-- defaults to OpenCerebral -->
| model        =      <!-- newest model, e.g. [[Boris-2-Preview-2]] -->
| released     =      <!-- its release date -->
| matches      =      <!-- the frontier model it roughly matches, e.g. GPT-2 (1.5B) -->
| matches_date =      <!-- when that model was announced -->
| frontier     =      <!-- today's frontier models, for the right end of the bar -->
| basis        =      <!-- what the comparison is based on -->
| at_frontier  =      <!-- "yes" once you are considered a frontier lab -->
| approx       =      <!-- "no" drops the word "about" -->
| help         =      <!-- call to action under the box; OpenCerebral gets a compute ask by default; "no" hides it -->
| start        =      <!-- left end of the bar; default 2017-06-12 -->
| start_label  =      <!-- default "Transformer" -->
}}
  • The gap is written in years and months, months and days, or days, depending on its size.
  • If matches_date is on or after released, or at_frontier = yes, the box says at the frontier and the bar fills completely, as in the second example.
  • For OpenCerebral the box ends with a compute ask (oc@kunix.org). Set help to change it, or help = no to hide it. It is hidden at the frontier.
  • When a new model comes out, update model, released, matches and matches_date.
  • Dates take the same forms as Template:Infobox: 2019, February 2019, 2019-02-14.