Tommi Jaakkola · PaperMetrix

Approximate Inference in Additive Factorial HMMs with Application to Energy Disaggregation

2018 · DSpace@MIT (Massachusetts Institute of Technology)

This paper considers additive factorial hidden Markov models, an extension to HMMs where the state factors into multiple independent chains, and the output is an additive function of all the hidden states. Although such models …

Style Transfer from Non-Parallel Text by Cross-Alignment

2017 · arXiv (Cornell University)

This paper focuses on style transfer on the basis of non-parallel text. This is an instance of a broad family of problems including machine translation, decipherment, and sentiment modification. The key challenge is to separate …

A Game Theoretic Approach to Class-wise Selective Rationalization.

2019 · DSpace@MIT (Massachusetts Institute of Technology)

Selection of input features such as relevant pieces of text has become a common technique of highlighting how complex neural predictors operate. The selection can be optimized post-hoc for trained models or incorporated directly into …

Consistent Accelerated Inference via Confident Adaptive Transformers

2021 · arXiv (Cornell University)

We develop a novel approach for confidently accelerating inference in the large and expensive multilayer Transformers that are now ubiquitous in natural language processing (NLP). Amortized or approximate computational methods increase efficiency, but can come …

Dirichlet Flow Matching with Applications to DNA Sequence Design

2024 · PubMed

Discrete diffusion or flow models could enable faster and more controllable sequence generation than autoregressive models. We show that na\"ive linear flow matching on the simplex is insufficient toward this goal since it suffers from …

Rethinking Cooperative Rationalization: Introspective Extraction and Complement Control

2019