Jump to content

Boris-1.3-125M

From Digital Millennium Wiki

Boris-1.3-125M is Boris-125M with about 2.66B tokens of continued pretraining in seven passes, leading with FineWeb-Edu before DCLM to avoid the ARC regression seen in Boris-1.3-75M.

External links

Image by Jakub Steiner / Wikimedia Commons / Licensed under CC BY-SA 2.0
This page or section is a stub. You can help the wiki by accurately contributing to it.