Changes / Feeds / microsoft/phi-2
microsoft/phi-2
4 changes to a tracked key since 2023-12-13, newest first. Head as last read: 810d367871c1d460086d9f82db8696f2e0a0fcd0.
GPU memory to fine-tune it, card by card: phi-2 on /m/.
| Date | Advisory | What changed, and what it does |
|---|---|---|
| 2024-01-27 | x_NXMC-2024-0060 breaking | EOS declared as 50256 (was unset); generation that relied on the library default now stops on this token; BOS declared as 50256 (was unset) (2024-01-27).313453cae697 -> 3f879ff35d20 |
| 2024-01-27 | x_NXMC-2024-0059 breaking | EOS declared as 50256 (was unset); generation that relied on the library default now stops on this token; BOS declared as 50256 (was unset) (2024-01-27).f05bc51ad3b1 -> 313453cae697 |
| 2024-01-11 | x_NXMC-2024-0058 breaking | MLP width unset to 10240, KV heads unset to 32; derived parameters 1.61B to 2.78B (+1.17B, +2.34 GB of bf16 weights); rope_theta unset to 10000; every position embedding changes (2024-01-11).d3186761bf5c -> cb2f4533604d |
| 2023-12-13 | x_NXMC-2023-0022 breaking | model_type "phi" to "phi-msft"; a different class is instantiated from the same id (2023-12-13).96f15add7380 -> 40b720df64dc |
Pin it, and let a bot move the pin
from_pretrained("microsoft/phi-2", revision="810d367871c1d460086d9f82db8696f2e0a0fcd0")With the Renovate preset, a pull request moves this pin when the head moves, and links back here.
[](https://www.neurarch.com/changes-feeds/models/microsoft/phi-2.html)