<?xml version="1.0"?>
<feed xmlns="http://www.w3.org/2005/Atom" xml:lang="en">
	<id>https://wiki.kunix.org/index.php?action=history&amp;feed=atom&amp;title=Boris-125M</id>
	<title>Boris-125M - Revision history</title>
	<link rel="self" type="application/atom+xml" href="https://wiki.kunix.org/index.php?action=history&amp;feed=atom&amp;title=Boris-125M"/>
	<link rel="alternate" type="text/html" href="https://wiki.kunix.org/index.php?title=Boris-125M&amp;action=history"/>
	<updated>2026-11-22T13:53:23Z</updated>
	<subtitle>Revision history for this page on the wiki</subtitle>
	<generator>MediaWiki 1.43.9</generator>
	<entry>
		<id>https://wiki.kunix.org/index.php?title=Boris-125M&amp;diff=125&amp;oldid=prev</id>
		<title>Jdj: New article with Infobox model (data from the Hugging Face model card)</title>
		<link rel="alternate" type="text/html" href="https://wiki.kunix.org/index.php?title=Boris-125M&amp;diff=125&amp;oldid=prev"/>
		<updated>2026-11-16T00:43:48Z</updated>

		<summary type="html">&lt;p&gt;New article with Infobox model (data from the Hugging Face model card)&lt;/p&gt;
&lt;p&gt;&lt;b&gt;New page&lt;/b&gt;&lt;/p&gt;&lt;div&gt;{{Infobox model&lt;br /&gt;
| developer       = [[OpenCerebral]] (as New Millennium Artificial Intelligence)&lt;br /&gt;
| family          = Boris-1&lt;br /&gt;
| model_type      = Base (pretrained)&lt;br /&gt;
| license         = Apache 2.0&lt;br /&gt;
| status          = Released; superseded by [[Boris-1.3-125M]]&lt;br /&gt;
| architecture    = GPT-2 decoder (pre-LayerNorm, learned positions, tied embeddings), 12 heads, d&amp;lt;sub&amp;gt;model&amp;lt;/sub&amp;gt; 768&lt;br /&gt;
| parameters      = 124.5M&lt;br /&gt;
| layers          = 12&lt;br /&gt;
| context         = 1,024 tokens&lt;br /&gt;
| tokenizer       = GPT-NeoX-20B BPE, 50,304 (padded)&lt;br /&gt;
| training_tokens = 2.5B&lt;br /&gt;
| dataset         = FineWeb-Edu 60% / DCLM-Baseline 40%&lt;br /&gt;
| hardware        = 1 × RTX 3060 12GB&lt;br /&gt;
| training_time   = 33 h 39 m&lt;br /&gt;
| compute         = ≈ 1.9 × 10&amp;lt;sup&amp;gt;18&amp;lt;/sup&amp;gt; FLOPs (6ND estimate)&lt;br /&gt;
| precision       = bf16 autocast, fp32 master weights&lt;br /&gt;
| hellaswag       = 29.33&lt;br /&gt;
| piqa            = 59.74&lt;br /&gt;
| winogrande      = 49.72&lt;br /&gt;
| arc_easy        = 41.75&lt;br /&gt;
| arc_challenge   = 23.89&lt;br /&gt;
| lambada         = 22.86&lt;br /&gt;
| bench_note      = Zero-shot; acc_norm for HellaSwag, PIQA and ARC, acc for WinoGrande and LAMBADA&lt;br /&gt;
| bench_source    = [https://huggingface.co/opencerebral/Boris-1.3-125M Boris-1.3-125M model card]&lt;br /&gt;
| weights         = [https://huggingface.co/opencerebral/Boris-125M opencerebral/Boris-125M]&lt;br /&gt;
| formats         = safetensors (transformers GPT-2)&lt;br /&gt;
| website         = [https://oc.kunix.org oc.kunix.org]&lt;br /&gt;
| released        = 2026-07-15&lt;br /&gt;
| series          = Boris base models&lt;br /&gt;
| succeeded_by    = [[Boris-75M]]&lt;br /&gt;
}}&lt;br /&gt;
&amp;#039;&amp;#039;&amp;#039;Boris-125M&amp;#039;&amp;#039;&amp;#039; is a 124.5M-parameter base language model, the first model released by [[OpenCerebral]] (then New Millennium Artificial Intelligence). It was trained from scratch on a single RTX 3060.&lt;br /&gt;
&lt;br /&gt;
== External links ==&lt;br /&gt;
* [https://huggingface.co/opencerebral/Boris-125M Boris-125M on Hugging Face]&lt;br /&gt;
&lt;br /&gt;
{{Stub}}&lt;/div&gt;</summary>
		<author><name>Jdj</name></author>
	</entry>
</feed>