User-centered & Robust NLP OSS: Lessons Learned from Developing & Maintaining RSMTool

For the last 5 years, we have developed and maintained RSMTool -an open-source tool for evaluating NLP systems that automatically score written and spoken responses.