Abstract: We introduce a new attention mechanism, dubbed structural self-attention (StructSA), that leverages rich correlation patterns naturally emerging in key-query interactions of attention.

Accurately capturing the spatial correlations of traffic network significantly benefits short-term traffic forecasting. Some existing works represent spatial correlations in a simple one-dimensional ...