<?xml version="1.0"?>
<feed xmlns="http://www.w3.org/2005/Atom" xml:lang="en">
	<id>https://wiki.kunix.org/index.php?action=history&amp;feed=atom&amp;title=Boris-250M</id>
	<title>Boris-250M - Revision history</title>
	<link rel="self" type="application/atom+xml" href="https://wiki.kunix.org/index.php?action=history&amp;feed=atom&amp;title=Boris-250M"/>
	<link rel="alternate" type="text/html" href="https://wiki.kunix.org/index.php?title=Boris-250M&amp;action=history"/>
	<updated>2026-11-22T13:53:23Z</updated>
	<subtitle>Revision history for this page on the wiki</subtitle>
	<generator>MediaWiki 1.43.9</generator>
	<entry>
		<id>https://wiki.kunix.org/index.php?title=Boris-250M&amp;diff=130&amp;oldid=prev</id>
		<title>Jdj: New article with Infobox model (data from the Hugging Face model card)</title>
		<link rel="alternate" type="text/html" href="https://wiki.kunix.org/index.php?title=Boris-250M&amp;diff=130&amp;oldid=prev"/>
		<updated>2026-11-16T00:43:51Z</updated>

		<summary type="html">&lt;p&gt;New article with Infobox model (data from the Hugging Face model card)&lt;/p&gt;
&lt;p&gt;&lt;b&gt;New page&lt;/b&gt;&lt;/p&gt;&lt;div&gt;{{Infobox model&lt;br /&gt;
| developer       = [[OpenCerebral]] (as New Millennium Artificial Intelligence)&lt;br /&gt;
| family          = Boris-1&lt;br /&gt;
| model_type      = Base (pretrained)&lt;br /&gt;
| license         = Apache 2.0&lt;br /&gt;
| status          = Released&lt;br /&gt;
| architecture    = GPT-2 decoder (pre-LayerNorm, learned positions, tied embeddings), 18 heads, d&amp;lt;sub&amp;gt;model&amp;lt;/sub&amp;gt; 1,152&lt;br /&gt;
| parameters      = 250.4M&lt;br /&gt;
| layers          = 12&lt;br /&gt;
| context         = 1,024 tokens&lt;br /&gt;
| tokenizer       = GPT-NeoX-20B BPE, 50,304 (padded)&lt;br /&gt;
| training_tokens = 5.01B&lt;br /&gt;
| dataset         = FineWeb-Edu 60% / DCLM-Baseline 40%&lt;br /&gt;
| hardware        = 1 × RTX 3060 12GB&lt;br /&gt;
| training_time   = 105 h 56 m (about 4.4 days)&lt;br /&gt;
| compute         = ≈ 7.5 × 10&amp;lt;sup&amp;gt;18&amp;lt;/sup&amp;gt; FLOPs (6ND estimate)&lt;br /&gt;
| precision       = bf16 autocast, fp32 master weights&lt;br /&gt;
| hellaswag       = 33.7&lt;br /&gt;
| piqa            = 64.3&lt;br /&gt;
| winogrande      = 50.0&lt;br /&gt;
| arc_easy        = 47.7&lt;br /&gt;
| arc_challenge   = 26.1&lt;br /&gt;
| lambada         = 31.0&lt;br /&gt;
| bench_note      = Zero-shot; acc_norm for HellaSwag, PIQA and ARC, acc for WinoGrande and LAMBADA. Published to one decimal, in the card&amp;#039;s chart&lt;br /&gt;
| bench_source    = [https://huggingface.co/opencerebral/Boris-250M model card]&lt;br /&gt;
| weights         = [https://huggingface.co/opencerebral/Boris-250M opencerebral/Boris-250M]&lt;br /&gt;
| formats         = safetensors (transformers GPT-2)&lt;br /&gt;
| website         = [https://oc.kunix.org oc.kunix.org]&lt;br /&gt;
| released        = 2026-07-23&lt;br /&gt;
| series          = Boris base models&lt;br /&gt;
| preceded_by     = [[Boris-75M]]&lt;br /&gt;
| succeeded_by    = [[Boris-1.3-75M]]&lt;br /&gt;
}}&lt;br /&gt;
&amp;#039;&amp;#039;&amp;#039;Boris-250M&amp;#039;&amp;#039;&amp;#039; is a 250.4M-parameter base language model from [[OpenCerebral]] (then New Millennium Artificial Intelligence), the largest of the Boris-1 models, trained from scratch on a single RTX 3060 for a Chinchilla-optimal 5.01B tokens.&lt;br /&gt;
&lt;br /&gt;
== External links ==&lt;br /&gt;
* [https://huggingface.co/opencerebral/Boris-250M Boris-250M on Hugging Face]&lt;br /&gt;
&lt;br /&gt;
{{Stub}}&lt;/div&gt;</summary>
		<author><name>Jdj</name></author>
	</entry>
</feed>