MTRAG: A Multi-Turn Conversational Benchmark for Evaluating Retrieval-Augmented Generation Systems
- 2025
- ACL 2025
Vraj Shah
Title
Staff Research Scientist
Bio
Vraj Shah is a Staff Research Scientist at IBM Almaden Research Center, where his work is focused on developing novel AI models and human-in-the-loop tools for natural language processing tasks, while reducing the barrier of entry for domain experts in adopting AI.
Publications
How do Categorical Duplicates Affect ML? A New Benchmark and Empirical Analyses
- Vraj Shah
- Thomas Parashos
- et al.
- 2024
- VLDB 2024
Top collaborators
KF
Kshitij Fadnis
Research Staff Engineer
CG
Chulaka Gunasekara
Research Staff Member
SR
Sara Rosenthal
Staff Research Scientist
LP
Lucian Popa
Principal Research Scientist