LLMs as Meta-Reviewers' Assistants: A Case Study

May 1, 2025·
Eftekhar Hossain
,
Sanjeev Kumar Sinha
,
Naman Bansal
,
R. Alexander Knipper
,
Souvika Sarkar
,
John Salvador
Yash Mahajan
Yash Mahajan
,
Sri Ram Pavan Kumar Guttikonda
,
Mousumi Akter
,
Md. Mahadi Hassan
,
Matthew Freestone
,
Matthew C. Williams Jr.
,
Dongji Feng
,
Santu Karmaker
· 0 min read
Type
Publication
Proceedings of the 2025 Conference of the Nations of the Americas Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers), 7763–7803
Status
Peer-reviewed
publications
Yash Mahajan
Authors
Postdoctoral Researcher, BridgeAI Lab
I’m a postdoctoral researcher in the BridgeAI Lab at the University of Central Florida, where I study how language models and AI systems should be evaluated, selected, and deployed when aggregate benchmark scores do not capture semantic behavior, user requirements, or deployment constraints. I completed my Ph.D. in Computer Science and Software Engineering at Auburn University in 2025, advised by Dr. Sathyanarayanan N. Aakur and co-advised by Dr. Shubhra Kanti (Santu) Karmaker, with a dissertation on evaluating semantic and contextual alignment in language models. My current work combines model evaluation, resource-aware model selection, and scalable inference into reproducible methods for matching AI models to real-world tasks.