Changes / Feeds / FacebookAI/roberta-large
FacebookAI/roberta-large
4 changes to a tracked key since 2019-08-05, newest first. Head as last read: 722cf37b1afa9454edce342e7895e588b6ff1d59.
GPU memory to fine-tune it, card by card: roberta-large on /m/.
| Date | Advisory | What changed, and what it does |
|---|---|---|
| 2020-04-24 | x_NXMC-2020-0027 breaking | EOS declared as 2 (was unset); generation that relied on the library default now stops on this token; BOS declared as 0 (was unset); model_type declared as "roberta" (was unset) (2020-04-24).66311c774099 -> 5674b5c411ca |
| 2020-01-31 | x_NXMC-2020-0026 | architectures declared as ["RobertaForMaskedLM"] (was unset) (2020-01-31).7cca3b740828 -> 66311c774099 |
| 2019-09-26 | x_NXMC-2019-0004 breaking | derived parameters 354.3M to 354.3M (+2.0K, +0.00 GB of bf16 weights); context window 512 to 514 tokens (2019-09-26).f0c702d5c384 -> 5cae4475acf9 |
| 2019-09-26 | x_NXMC-2019-0003 breaking | derived parameters 354.3M to 354.3M (-2.0K, -0.00 GB of bf16 weights); context window 514 to 512 tokens (2019-09-26).5d7774624540 -> f0c702d5c384 |
Pin it, and let a bot move the pin
from_pretrained("FacebookAI/roberta-large", revision="722cf37b1afa9454edce342e7895e588b6ff1d59")
With the Renovate preset, a pull request moves this pin when the head moves, and links back here.
[](https://www.neurarch.com/changes-feeds/models/FacebookAI/roberta-large.html)