<?xml version="1.0"?>
<feed xmlns="http://www.w3.org/2005/Atom" xml:lang="en">
	<id>https://wiki.kunix.org/index.php?action=history&amp;feed=atom&amp;title=Boris-2-Preview-1</id>
	<title>Boris-2-Preview-1 - Revision history</title>
	<link rel="self" type="application/atom+xml" href="https://wiki.kunix.org/index.php?action=history&amp;feed=atom&amp;title=Boris-2-Preview-1"/>
	<link rel="alternate" type="text/html" href="https://wiki.kunix.org/index.php?title=Boris-2-Preview-1&amp;action=history"/>
	<updated>2026-11-22T13:53:22Z</updated>
	<subtitle>Revision history for this page on the wiki</subtitle>
	<generator>MediaWiki 1.43.9</generator>
	<entry>
		<id>https://wiki.kunix.org/index.php?title=Boris-2-Preview-1&amp;diff=126&amp;oldid=prev</id>
		<title>Jdj: New article with Infobox model (data from the Hugging Face model card)</title>
		<link rel="alternate" type="text/html" href="https://wiki.kunix.org/index.php?title=Boris-2-Preview-1&amp;diff=126&amp;oldid=prev"/>
		<updated>2026-11-16T00:43:49Z</updated>

		<summary type="html">&lt;p&gt;New article with Infobox model (data from the Hugging Face model card)&lt;/p&gt;
&lt;p&gt;&lt;b&gt;New page&lt;/b&gt;&lt;/p&gt;&lt;div&gt;{{Infobox model&lt;br /&gt;
| developer       = [[OpenCerebral]]&lt;br /&gt;
| family          = Boris-2&lt;br /&gt;
| model_type      = Base (pretrained, preview)&lt;br /&gt;
| license         = Apache 2.0&lt;br /&gt;
| status          = Released; superseded by [[Boris-2-Preview-2]]&lt;br /&gt;
| architecture    = Decoder-only transformer: 8-head MHA, SwiGLU 1664, RoPE, Canon layers, 15M n-gram table&lt;br /&gt;
| parameters      = 143.7M&lt;br /&gt;
| layers          = 31 (d&amp;lt;sub&amp;gt;model&amp;lt;/sub&amp;gt; 512)&lt;br /&gt;
| context         = 2,048 tokens&lt;br /&gt;
| tokenizer       = Own byte-level BPE, 32,768&lt;br /&gt;
| training_tokens = 52.5B (50B stable + 2.5B decay)&lt;br /&gt;
| dataset         = Main: ClimbMix ~89%, FineMath ~11%. Decay: ClimbMix, Cosmopedia tutorials, OpenMathInstruct-2, FineMath, Cosmopedia math, DCLM&lt;br /&gt;
| hardware        = 1 × NVIDIA V100 32GB (~59,500 tok/s)&lt;br /&gt;
| compute         = ≈ 4.1 × 10&amp;lt;sup&amp;gt;19&amp;lt;/sup&amp;gt; FLOPs (6ND estimate), n-gram table excluded&lt;br /&gt;
| precision       = fp16 mixed, fp32 residual stream&lt;br /&gt;
| hellaswag       = 45.23&lt;br /&gt;
| arc_easy        = 58.38&lt;br /&gt;
| arc_challenge   = 29.95&lt;br /&gt;
| piqa            = 69.21&lt;br /&gt;
| bench1          = ArithMark-3&lt;br /&gt;
| bench1_score    = 37.60&lt;br /&gt;
| bench1_mean     = no&lt;br /&gt;
| bench2          = ArithMark-2&lt;br /&gt;
| bench2_score    = 37.68&lt;br /&gt;
| bench2_mean     = no&lt;br /&gt;
| bench_note      = Zero-shot, lm-evaluation-harness 0.4.12, acc_norm (ArithMark-2: acc). ArithMark is left out of the mean&lt;br /&gt;
| bench_source    = [https://huggingface.co/opencerebral/Boris-2-Preview-1 model card]&lt;br /&gt;
| weights         = [https://huggingface.co/opencerebral/Boris-2-Preview-1 opencerebral/Boris-2-Preview-1]&lt;br /&gt;
| formats         = safetensors (transformers, trust_remote_code)&lt;br /&gt;
| website         = [https://oc.kunix.org oc.kunix.org]&lt;br /&gt;
| released        = 2026-10-09&lt;br /&gt;
| series          = Boris base models&lt;br /&gt;
| preceded_by     = [[Boris-1.7-D60M-n30M]]&lt;br /&gt;
| succeeded_by    = [[Boris-2-Preview-2]]&lt;br /&gt;
}}&lt;br /&gt;
&amp;#039;&amp;#039;&amp;#039;Boris-2-Preview-1&amp;#039;&amp;#039;&amp;#039; is the first preview of [[Boris-2]]: the main run&amp;#039;s 50B-token checkpoint with a short 2.5B-token learning-rate decay, trained from scratch on a single NVIDIA V100.&lt;br /&gt;
&lt;br /&gt;
== External links ==&lt;br /&gt;
* [https://huggingface.co/opencerebral/Boris-2-Preview-1 Boris-2-Preview-1 on Hugging Face]&lt;br /&gt;
&lt;br /&gt;
{{Stub}}&lt;/div&gt;</summary>
		<author><name>Jdj</name></author>
	</entry>
</feed>