|
|
|
|
|
|
by jarrell_mark
1192 days ago
|
|
|
It should work with about 12gb GPU RAM. I got it to load on a GTX 1070 with 8GB GPU RAM, but then it crashed before it could generate a response. It needs less RAM than regular GPT-J because the weights are converted to 8-bit |
|
|