Patrick Schramowski

BERT has a Moral Compass: Improvements of ethical and moral values of machines

2019 · arXiv (Cornell University)

Allowing machines to choose whether to kill humans would be devastating for world peace and security. But how do we equip machines with the ability to learn ethical or even moral choices? Jentzsch et al.(2019) …

Judging Quality Across Languages: A Multilingual Approach to Pretraining Data Filtering with Language Models

2025 · arXiv (Cornell University)

High-quality multilingual training data is essential for effectively pretraining large language models (LLMs). Yet, the availability of suitable open-source multilingual datasets remains limited. Existing state-of-the-art datasets mostly rely on heuristic filtering methods, restricting both their …

LAION-5B: An open large-scale dataset for training next generation image-text models

2022 · arXiv (Cornell University)

Groundbreaking language-vision architectures like CLIP and DALL-E proved the utility of training on large amounts of noisy image-text data, without relying on expensive accurate labels used in standard vision unimodal supervised learning. The resulting models …