Curious how it handles foreign key traversal at inference time, in my experience that's where tabular models tend to fall apart when the join graph isn't seen during pre training.
The whole graph is walked at inference time to create the context. There is an attention feature, called 'neighbor attention', that propagate signals along primary-foreign key relationships. The task table includes the foreign keys themselves.