N Neurarch Try it See it Changes Bot Pricing API Open app

Changes / Feeds / EleutherAI/pythia-160m

EleutherAI/pythia-160m

4 changes to a tracked key since 2023-03-22, newest first. Head as last read: 50f5173d932e8e61f858120bcb800b97af589f46.

GPU memory to fine-tune it, card by card: pythia-160m on /m/.

DateAdvisoryWhat changed, and what it does
2023-04-03x_NXMC-2023-0026 breakingEOS declared as "<|endoftext|>" (was unset); generation that relied on the library default now stops on this token; BOS declared as "<|endoftext|>" (was unset); tokenizer_class "PreTrainedTokenizerFast" to "GPTNeoXTokenizer" (2023-04-03).
610be53109eb -> 4560d92fe0f8
2023-03-22x_NXMC-2023-0025 breakingdeclared dtype "float32" to "float16" (2023-03-22).
cd86582a32fb -> 610be53109eb
2023-03-22x_NXMC-2023-0024 breakingdeclared dtype "float16" to "float32" (2023-03-22).
9cab9b464039 -> cd86582a32fb
2023-03-22x_NXMC-2023-0023 breakingEOS "<|endoftext|>" removed; generation falls back to whatever the library or another file declares; BOS "<|endoftext|>" removed; tokenizer_class "GPTNeoXTokenizer" to "PreTrainedTokenizerFast" (2023-03-22).
84b79d44e308 -> 9cab9b464039

Pin it, and let a bot move the pin

from_pretrained("EleutherAI/pythia-160m", revision="50f5173d932e8e61f858120bcb800b97af589f46")

With the Renovate preset, a pull request moves this pin when the head moves, and links back here.

config changes badge

[![config changes](https://img.shields.io/endpoint?url=https%3A%2F%2Fwww.neurarch.com%2Fchanges-feeds%2Fbadge%2FEleutherAI%2Fpythia-160m.json)](https://www.neurarch.com/changes-feeds/models/EleutherAI/pythia-160m.html)