携手并进：学校对人工智能的拥抱与学生面临的风险增加相关

Schools’ Embrace of AIConnected to Increased Risksto Students TheCenter for Democracy & Technology (CDT)is the leading nonpartisan,nonprofit organization fighting to advance civil rights and civil liberties in thedigital age. We shape technology policy, governance, and design with a focuson equity and democratic values. Established in 1994, CDT has been a trustedadvocate for digital rights since the earliest days of the internet. The organization isheadquartered in Washington, D.C. and has a Europe Office in Brussels, Belgium. As governments expand their use of technology and data, it is critical that theydo so in ways that affirm individual privacy, respect civil rights, foster inclusiveparticipatory systems, promote transparent and accountable oversight, andadvance just social structures within the broader community. CDT’s Equity in Civic Technology Projectfurthers these goals by providingbalanced advocacy that promotes the responsible use of data and technology whileprotecting the privacy and civil rights of individuals. We engage with these issuesfrom both technical and policyminded perspectives, creating solutions-orientedpolicy resources and actionable technical guidance. This report is licensed under aCreative Commons Attribution 4.0 International License. Hand in Hand Schools’ Embrace of AI Connected toIncreased Risks to Students Elizabeth Laird, Maddy Dwyer, andHannah Quay-de la Vallee Cover Illustration: Gabriel Hongsdusit Graphic Design: Tangible Designs/Next Chapter Communications Contents Introduction: Current Status of AI Use in Schoolsand Emerging Risks5 AI in the Classroom: Uses Expand Alongside QuestionsAbout What Constitutes Quality Teaching and Learning15 Chatbots and Students: Interactions with AI AffectReal-Life Relationships24 AI and IEPs: Use by Teachers Grows AmidstIncreased Concerns Among Students with Disabilities30 AI Literacy: Training and Guidance Perceived as HelpfulBut Have Not Kept Pace with AI Adoption or Known Risks 34 Deepfakes and NCII: Technology ExpandsPre-Existing Sexual Harassment and Bullying Threats39 Student Activity Monitoring: Technology RemainsUbiquitous and Harms to Students Persist 45 Student Privacy: AI Use Related to ExistingConcerns and Threats50 Gender Expansive Students and Privacy:Schools Vary in Policies and Protections 56 Immigrant Students: Privacy and Safety At Risk59 Additional Resources63 Methodology63 Endnotes64 Introduction:Current Status of AIUse in Schools andEmerging Risks 01 Artificial intelligence (AI) has continued to alter the educationalexperiences of teachers, students, and parents during the 2024-25 schoolyear. The frequency and variety of AI uses continues to grow; at the sametime, the increased use of AI in educational settings is correlated withheightened risks to students. The following section details thecurrentstatusof AI use in schools along withfour emerging risksassociatedwith this technology, all of which increase the more that a school uses AI: •Data breaches or ransomware attacks;•Tech-enabled sexual harassment and bullying;•AI systems that do not work as intended; and•Troubling interactions between students and technology. Identifying the concrete risks that accompany the use of AI in schoolsenables educators, school administrators, policymakers, and communitiesto mount prevention and response efforts such that the positive uses of AIdo not inadvertently harm students. Current Status of AI Use in Schools The vast majority of teachers, students, and parents report that they have usedAI, with personal uses more common than work or school uses. Parents with higher incomes or who live in urban and suburban areas reporthigher rates of AI use for themselves and their children, which could beindicative of an AI divide. Understanding How AI is Used in Schools Although a majority of teachers and students report having used AI themselves,they vary greatly in the number of ways in which they report AI is used inschool.ii The frequency with which parents use AI is directly related to whether their childuses AI, whether their child’s school has provided guidance on AI, and whethertheir child’s school has asked for input on using AI. Lower levels of AI use by teachers and parents correspond with higher levels ofconcern toward this technology. However, students who report that their school uses AI for many reasons reporthigher levels of concern about this technology. Emerging Risks Teachers and students who reportmany school-related usesare also more likely to reportexposure to risks like: •Data breaches or ransomware attacks;•Tech-enabled sexual harassment and bullying;•AI systems that do not work as intended; and•Troubling interactions between students and technology. Teachers who use AI for many reasons are more likely to report that their schoolhas experienced a large-scale data breach. The more that teachers and students report that their school uses AI, themore likely they are to report ha