Researcher profile

Fredrik Carlsson

2 papers in the PaperMetrix corpus

Publications

Papers by this author

  1. Semantic Re-tuning with Contrastive Tension

    2021 · KTH Publication Database DiVA (KTH Royal Institute of Technology)

    Extracting semantically useful natural language sentence representations frompre-trained deep neural networks such as Transformers remains a challenge. Wefirst demonstrate that pre-training objectives impose a significant task bias ontothe final layers of models, with a layer-wise …

  2. Should we Stop Training More Monolingual Models, and Simply Use Machine Translation Instead?

    2021 · arXiv (Cornell University)

    Most work in NLP makes the assumption that it is desirable to develop solutions in the native language in question. There is consequently a strong trend towards building native language models even for low-resource languages. …