Fairseq

Making Sentence Embeddings Robust to User-Generated Content
✔️ Accepted at LREC-COLING 2024 ✔️
Lydia Nishimwe, Benoît Sagot, Rachel Bawden
Making Sentence Embeddings Robust to User-Generated Content
Your Fairseq-trained model might have more embedding parameters than it should.
How a bug in reading SentencePiece vocabulary files can cause Fairseq-trained models to have up to 3k extra parameters in the embedding layer.
Lydia Nishimwe
Last updated on Mar 26, 2024
Your Fairseq-trained model might have more embedding parameters than it should.