Clustering in Pure-attention Hardmax Transformers and Its Role in Sentiment Analysis

Event: CIN-PDE 2024

Albert Alcalde, FAU DCN-AvH. Friedrich-Alexander-Universität Erlangen–Nürnberg
Giovanni Fantuzzi, FAU DCN-AvH. Friedrich-Alexander-Universität Erlangen–Nürnberg
Enrique Zuazua, FAU DCN-AvH/FAU MoD. Friedrich-Alexander-Universität Erlangen–Nürnberg

Clustering in Pure-attention Hardmax Transformers and Its Role in Sentiment Analysis
View this poster