|
|
|
|
|
|
by MacsHeadroom
745 days ago
|
|
|
ChatGPT memory is just a database with everything you told it to remember. Low Rank Adaptors (LoRA) are a way of changing the function of a model by only having to load a delta for a tiny percentage of the weights rather than all the weights for an entirely new model. No fine-tuning is going to happen on Apple computers or phones at any point. They are just swapping out Apple's pre-made LoRAs so that they can store one LLM and dozens of LoRAs in a fraction of the space it would take to store dozens of LLMs. |
|
|