KJ

Projects

arXiv

The Doctor Will (Still) See You Now: On the Structural Limits of Agentic AI in Healthcare

A qualitative study based on interviews with 20 stakeholders examining how agentic AI is defined, evaluated, and constrained in healthcare, identifying three mutually reinforcing tensions: conceptual fragmentation, an autonomy contradiction, and an evaluation blind spot.

Agentic AIHealthcare AIResponsible AI
arXiv

Expert Evaluation and the Limits of Human Feedback in Mental Health AI Safety Testing

A mixed-methods study examining inter-rater reliability among three psychiatrists evaluating 360 LLM-generated mental health responses, revealing systematic expert disagreement driven by incompatible clinical frameworks rather than measurement error.

AI SafetyRLHFMental Health AI
FAccT

Responsible AI in the Global Context

A global survey-based study exploring responsible AI practices across 1000 organizations in 20 industries and 19 regions, defining a conceptual RAI maturity model.

Responsible AIAI Governance
arXiv

The Measurement Imbalance in Agentic AI Evaluation Undermines Industry Productivity Claims

A systematic review of 84 papers (2023–2025) exposing an evaluation imbalance in agentic AI, where technical metrics dominate (83%) while human-centered, safety, and economic dimensions remain peripheral, with a proposed four-axis evaluation framework.

Agentic AIAI EvaluationBenchmarking
IUI

More than Marketing? On the Information Value of AI Benchmarks for Practitioners

A qualitative interview study with 19 practitioners in academia, product, and policy examining how AI benchmarks are used to inform decision-making, finding that benchmarks serve as relative performance indicators but often lack the real-world relevance needed for substantive deployment decisions.

AI BenchmarksModel Evaluation
ECAI

LeRAAT: LLM-Enabled Real-Time Aviation Advisory Tool

A real-time advisory system leveraging large language models to assist aviation professionals with decision-making during complex operational scenarios.

LLMAviationNLPReal-Time Systems