Researcher profile
Fredrik Carlsson
2 papers in the PaperMetrix corpus
Publications
Papers by this author
-
Semantic Re-tuning with Contrastive Tension
2021 · KTH Publication Database DiVA (KTH Royal Institute of Technology)
Extracting semantically useful natural language sentence representations frompre-trained deep neural networks such as Transformers remains a challenge. Wefirst demonstrate that pre-training objectives impose a significant task bias ontothe final layers of models, with a layer-wise …
-
Should we Stop Training More Monolingual Models, and Simply Use Machine Translation Instead?
2021 · arXiv (Cornell University)
Most work in NLP makes the assumption that it is desirable to develop solutions in the native language in question. There is consequently a strong trend towards building native language models even for low-resource languages. …