Empirical Inference Conference Paper 2025

Why AI Is WEIRD and Should Not Be This Way: Towards AI For Everyone, With Everyone, By Everyone

arXiv
Thumb ticker sm 1
Empirical Inference
  • Postdoctoral Researcher

This paper presents a vision for creating AI systems that are inclusive at every stage of development, from data collection to model design and evaluation. We address key limitations in the current AI pipeline and its WEIRD* representation, such as lack of data diversity, biases in model performance, and narrow evaluation metrics. We also focus on the need for diverse representation among the developers of these systems, as well as incentives that are not skewed toward certain groups. We highlight opportunities to develop AI systems that are for everyone (with diverse stakeholders in mind), with everyone (inclusive of diverse data and annotators), and by everyone (designed and developed by a globally diverse workforce). *WEIRD = an acronym coined by Joseph Henrich to highlight the coverage limitations of many psychological studies, referring to populations that are Western, Educated, Industrialized, Rich, and Democratic; while we do not fully adopt this term for AI, as its current scope does not perfectly align with the WEIRD dimensions, we believe that today’s AI has a similarly "weird" coverage, particularly in terms of who is involved in its development and who benefits from it.

Author(s): Mihalcea*, R. and Ignat*, O. and Bai, L. and Borah, A. and Chiruzzo, L. and Jin, Z. and Kwizera, C. and Nwatu, J. and Poria, S. and Solorio, T.
Links:
Book Title: The Thirty-Nineth AAAI Conference on Artificial Intelligence, AAAI 2025 (Senior Member Presentation Track)
Number (issue): 27
Pages: 28657-28670
Year: 2025
Month: April
Editors: Toby Walsh, Julie Shah, Zico Kolter
Publisher: AAAI Press
Bibtex Type: Conference Paper (conference)
DOI: 10.1609/aaai.v39i27.35092
Event Place: Philadelphia, Pennsylvania, USA
State: Published
URL: https://doi.org/10.48550/arXiv.2410.16315
Note: *equal contribution

BibTex

@conference{Mihalceaetal25,
  title = {Why {AI} Is {WEIRD} and Should Not Be This Way: Towards {AI} For Everyone, With Everyone, By Everyone},
  booktitle = {The Thirty-Nineth {AAAI} Conference on Artificial Intelligence, {AAAI} 2025 (Senior Member Presentation Track)},
  abstract = {This paper presents a vision for creating AI systems that are inclusive at every stage of development, from data collection to model design and evaluation. We address key limitations in the current AI pipeline and its WEIRD* representation, such as lack of data diversity, biases in model performance, and narrow evaluation metrics. We also focus on the need for diverse representation among the developers of these systems, as well as incentives that are not skewed toward certain groups. We highlight opportunities to develop AI systems that are for everyone (with diverse stakeholders in mind), with everyone (inclusive of diverse data and annotators), and by everyone (designed and developed by a globally diverse workforce). *WEIRD = an acronym coined by Joseph Henrich to highlight the coverage limitations of many psychological studies, referring to populations that are Western, Educated, Industrialized, Rich, and Democratic; while we do not fully adopt this term for AI, as its current scope does not perfectly align with the WEIRD dimensions, we believe that today’s AI has a similarly "weird" coverage, particularly in terms of who is involved in its development and who benefits from it.},
  number = {27},
  pages = {28657-28670},
  editors = {Toby Walsh, Julie Shah, Zico Kolter },
  publisher = {AAAI Press},
  month = apr,
  year = {2025},
  note = {*equal contribution},
  slug = {mihalceaetal25},
  author = {Mihalcea*, R. and Ignat*, O. and Bai, L. and Borah, A. and Chiruzzo, L. and Jin, Z. and Kwizera, C. and Nwatu, J. and Poria, S. and Solorio, T.},
  url = {https://doi.org/10.48550/arXiv.2410.16315},
  month_numeric = {4}
}