Artificial Intelligence Ethics Test for University Students: Design Principles, Content Validation, and Pilot Testing

Abstract

The accelerated evolution of artificial intelligence (AI) has led to its impact extending to all aspects of society, including education. However, university students are increasingly facing ethical challenges in their use of AI technologies. This growing concern highlights the need for robust assessment tools that can accurately measure students’ understanding of AI ethics. Although several studies have examined assessment instruments for AI literacy among university students, few have focused on the development of rigorously validated cognitive tests specifically targeting AI ethics. To address this gap, we developed the AI Ethics Test (AIEt). This study presents test design, content validation procedures, and pilot testing. The test was developed using the Evidence-Centered Design (ECD) framework, and 7 constructs were covered. A rigorous validation process was conducted, including expert reviews and cognitive interviews with students, to ensure content validity. Then, pilot testing was implemented at a public university in southwest China, involving 96 first- and second-year students. Item analysis was carried out, and informed revisions were made to enhance the test validity. AIEt provides an effective and reliable tool for assessing AI ethics, laying the groundwork for future research and practices in AI education at the higher education level.

Ähnliche Arbeiten