Template:Frontier gap: Difference between revisions
Appearance
Stub-style box: how far behind the frontier, with a progress bar |
Document help parameter |
||
| (One intermediate revision by the same user not shown) | |||
| Line 31: | Line 31: | ||
| at_frontier = <!-- "yes" once you are considered a frontier lab --> | | at_frontier = <!-- "yes" once you are considered a frontier lab --> | ||
| approx = <!-- "no" drops the word "about" --> | | approx = <!-- "no" drops the word "about" --> | ||
| help = <!-- call to action under the box; OpenCerebral gets a compute ask by default; "no" hides it --> | |||
| start = <!-- left end of the bar; default 2017-06-12 --> | | start = <!-- left end of the bar; default 2017-06-12 --> | ||
| start_label = <!-- default "Transformer" --> | | start_label = <!-- default "Transformer" --> | ||
| Line 37: | Line 38: | ||
* The gap is written in years and months, months and days, or days, depending on its size. | * The gap is written in years and months, months and days, or days, depending on its size. | ||
* If <code>matches_date</code> is on or after <code>released</code>, or <code>at_frontier = yes</code>, the box says '''at the frontier''' and the bar fills completely, as in the second example. | * If <code>matches_date</code> is on or after <code>released</code>, or <code>at_frontier = yes</code>, the box says '''at the frontier''' and the bar fills completely, as in the second example. | ||
* For OpenCerebral the box ends with a compute ask (oc@kunix.org). Set <code>help</code> to change it, or <code>help = no</code> to hide it. It is hidden at the frontier. | |||
* When a new model comes out, update <code>model</code>, <code>released</code>, <code>matches</code> and <code>matches_date</code>. | * When a new model comes out, update <code>model</code>, <code>released</code>, <code>matches</code> and <code>matches_date</code>. | ||
* Dates take the same forms as [[Template:Infobox]]: <code>2019</code>, <code>February 2019</code>, <code>2019-02-14</code>. | * Dates take the same forms as [[Template:Infobox]]: <code>2019</code>, <code>February 2019</code>, <code>2019-02-14</code>. | ||
</noinclude> | </noinclude> | ||
Latest revision as of 04:04, 23 October 2026
OpenCerebral is about 7 years, 8 months behind the frontier.
▲ GPT-2 (1.5B) level, 14 February 2019
Transformer
12 June 2017Frontier: Claude Opus 5.5, Claude Fable 5.1
21 October 2026
12 June 2017Frontier: Claude Opus 5.5, Claude Fable 5.1
21 October 2026
Newest model: Boris-2-Preview-2 (21 October 2026). It scores about the same as GPT-2 (1.5B), which reached that level in February 2019.
Compared on: zero-shot HellaSwag, ARC-Easy, ARC-Challenge and PIQA, against published GPT-2 (1.5B) results
Compared on: zero-shot HellaSwag, ARC-Easy, ARC-Challenge and PIQA, against published GPT-2 (1.5B) results
Help close the gap: donate compute or credits to oc@kunix.org
Example Lab is at the frontier.
Transformer
12 June 2017Frontier: Example-1
1 January 2027
12 June 2017Frontier: Example-1
1 January 2027
Newest model: Example-1 (1 January 2027).
How far behind the frontier a lab's newest model is. The gap is the time between the frontier first reaching your model's level and your model's release. The bar runs from the Transformer paper (June 2017) to that release: the filled part is how far along the frontier's history your model has caught up, and the hatched part is the gap.
Usage
{{Frontier gap
| subject = <!-- defaults to OpenCerebral -->
| model = <!-- newest model, e.g. [[Boris-2-Preview-2]] -->
| released = <!-- its release date -->
| matches = <!-- the frontier model it roughly matches, e.g. GPT-2 (1.5B) -->
| matches_date = <!-- when that model was announced -->
| frontier = <!-- today's frontier models, for the right end of the bar -->
| basis = <!-- what the comparison is based on -->
| at_frontier = <!-- "yes" once you are considered a frontier lab -->
| approx = <!-- "no" drops the word "about" -->
| help = <!-- call to action under the box; OpenCerebral gets a compute ask by default; "no" hides it -->
| start = <!-- left end of the bar; default 2017-06-12 -->
| start_label = <!-- default "Transformer" -->
}}
- The gap is written in years and months, months and days, or days, depending on its size.
- If
matches_dateis on or afterreleased, orat_frontier = yes, the box says at the frontier and the bar fills completely, as in the second example. - For OpenCerebral the box ends with a compute ask (oc@kunix.org). Set
helpto change it, orhelp = noto hide it. It is hidden at the frontier. - When a new model comes out, update
model,released,matchesandmatches_date. - Dates take the same forms as Template:Infobox:
2019,February 2019,2019-02-14.