|
|
|
|
|
|
by lakshith-403
736 days ago
|
|
|
Interesting. I think OpenAI here uses sparse autoencoders to map out sparse activation patterns in networks. Comparing them to how a real person reasons about a situations. Inspectus, on the other hand is a general tool to visualize how transformer models pay attention to different parts of the data they process. |
|
|