N Neurarch Try it See it Changes Bot Pricing API Open app

Changes / Feeds / FacebookAI/roberta-base

FacebookAI/roberta-base

4 changes to a tracked key since 2019-08-05, newest first. Head as last read: e2da8e2f811d1448a5b465c236feacd80ffbac7b.

GPU memory to fine-tune it, card by card: roberta-base on /m/.

DateAdvisoryWhat changed, and what it does
2020-04-24x_NXMC-2020-0021 breakingEOS declared as 2 (was unset); generation that relied on the library default now stops on this token; BOS declared as 0 (was unset); model_type declared as "roberta" (was unset) (2020-04-24).
2ecd732fb792 -> 47a52b98637f
2020-01-31x_NXMC-2020-0020architectures declared as ["RobertaForMaskedLM"] (was unset) (2020-01-31).
e306078ce883 -> 2ecd732fb792
2019-09-26x_NXMC-2019-0002 breakingderived parameters 124.0M to 124.0M (+1.5K, +0.00 GB of bf16 weights); context window 512 to 514 tokens (2019-09-26).
bbbb96c1319c -> 3094fd15f106
2019-09-26x_NXMC-2019-0001 breakingderived parameters 124.0M to 124.0M (-1.5K, -0.00 GB of bf16 weights); context window 514 to 512 tokens (2019-09-26).
02c245a6111b -> bbbb96c1319c

Pin it, and let a bot move the pin

from_pretrained("FacebookAI/roberta-base", revision="e2da8e2f811d1448a5b465c236feacd80ffbac7b")

With the Renovate preset, a pull request moves this pin when the head moves, and links back here.

config changes badge

[![config changes](https://img.shields.io/endpoint?url=https%3A%2F%2Fwww.neurarch.com%2Fchanges-feeds%2Fbadge%2FFacebookAI%2Froberta-base.json)](https://www.neurarch.com/changes-feeds/models/FacebookAI/roberta-base.html)