State of What Art? A Call for Multi-Prompt LLM Evaluation
Published in TACL, 2024
Publications
DMLR: Data-centric Machine Learning Research – Past, Present and Future
Published in Submitted to The DMLR Journal, 2023
140 Characters of Justice? The Promise and Perils of Using Social Media to Reveal Lay Punishment Perspectives
Published in University of Illinois Law Review (1473), 2023
The Eval4NLP 2023 Shared Task on Prompting Large Language Models as Explainable Metrics
Published in Arxiv, 2023
Human-in-the-Loop Schema Induction
Published in ACL 2023 demo track, 2023
Zero-Shot On-the-Fly Event Schema Induction
Published in The 17th Conference of the European Chapter of the Association for Computational Linguistics (EACL), 2023
On the Limitations of Reference-Free Evaluations of Generated Text
Published in Empirical Methods in Natural Language Processing (EMNLP), 2022
Re-Examining System-Level Correlations of Automatic Summarization Evaluation Metrics
Published in The North Americal Chapter of the Association for Computational Linguistics (NAACL), 2022
RESIN-11: Schema-guided Event Prediction for 11 Newsworthy Scenarios
Published in The North American Chapter of the Association for Computational Linguistics 2022 in the Demonstration Track, 2022
A Statistical Analysis of Summarization Evaluation Metrics using Resampling Methods
Published in Transactions of the Association for Computational Linguistics (TACL), 2021
Statistical Significance Testing for Natural Language Processing
Published in Morgan&Claypool Publishers, 2020
Appendix - Recommended Statistical Significance Tests for NLP Tasks
Published in arxiv, 2018
The Structured Weighted Violations MIRA
Published in Arxiv, 2020
Deep Dominance - How to Properly Compare Deep Neural Models
Published in Association for Computational Linguistics (ACL), 2019
The Hitchhikers Guide to Testing Statistical Significance in Natural Language Processing
Published in Association for Computational Linguistics (ACL 2018), 2018
Replicability Analysis for Natural Language Processing: Testing Significance with Multiple Datasets
Published in Transactions of the Association for Computational Linguistics (TACL), 2017
Set-SMAA for Finding Preferable Multi-Objective Solutions
Published in GECCO 2017 (This is not an NLP paper), 2017
The Structured Weighted Violations Perceptron Algorithm
Published in Empirical Methods in Natural Language Processing (EMNLP), 2016