Updated
12:50 p.m. ET
On a recent morning, Cheryl Drakeford, a third-grade teacher at First Avenue Elementary School in Newark, projected a challenging math question on her classrooms whiteboard: What fraction of the letters in the word MATHEMATICIAN are consonants?
Ms. Drakeford knew that consonant might be an unfamiliar word to some students. So she suggested they ask Khanmigo, a new tutoring bot that uses artificial intelligence, for help.
She paused for a minute while about 15 schoolchildren dutifully typed the same question What are consonants? into their math software. Then she asked the third-graders to share the tutoring bots answer.
Consonants are the letters in the alphabet that are not vowels, one student read aloud. The vowels are A, E, I, O and U. Consonants are all the other letters.
Tech industry hype and doomsday prophesies around A.I.-enhanced chatbots like ChatGPT sent many schools scrambling this year to block or limit the use of the tools in classrooms. Newark Public Schools is taking a different approach. It is one of the first school systems in the United States to pilot test Khanmigo, an automated teaching aid developed by Khan Academy, an education nonprofit whose online lessons are used by hundreds of districts.
Newark has essentially volunteered to be a guinea pig for public schools across the country that are trying to distinguish the practical use of new A.I.-assisted tutoring bots from their marketing promises.
Proponents contend that classroom chatbots could democratize the idea of tutoring by automatically customizing responses to students, allowing them to work on lessons at their own pace. Critics warn that the bots, which are trained on vast databases of texts, can fabricate plausible-sounding misinformation making them a risky bet for schools.
Officials in Newark, the largest district in New Jersey, said they were cautiously testing the tutoring bot in three schools. Their findings could influence districts across the United States that are vetting A.I. tools this summer for the upcoming school year.
Its important to introduce our students to it, because its not going away, Timothy Nellegar, the director of educational technology at Newark Public Schools, said of A.I.-assisted technology. But we need to figure out how it works, the risks, the good and the bad.
Image
In Tito Rodriguezs math class, sixth-graders used the tutoring bot to learn about designing surveys.
Credit…
Gabriela Bhaskar for The New York Times
Khan Academy is among a handful of online learning companies that have created new tutoring bots based on language models developed by OpenAI, the research lab behind ChatGPT. Khan Academy, whose high-level tech donors include Google, the Bill and Melinda Gates Foundation and the Elon Musk Foundation, received access to the A.I. models last year.
Designed specifically for schools, the tutoring bot often takes students through the sequential steps needed to solve a problem.
When Khan Academy began looking for districts to pilot test its experimental tutorbot this spring, Newark volunteered. A number of local elementary schools were already using the education organizations online math lessons as a way to track students mastery of concepts like grouping numbers. And the A.I. tool would be free for those schools during the initial pilot-testing phase.
District officials said they wanted to see if Khanmigo could enhance student engagement and math learning. Schools like First Avenue, attended by many children from lower-income families, were also eager to give their students an early opportunity to try a new A.I.-assisted teaching aid.
Districts like Newark that use Khan Academys online lessons, analytics and other school services which do not include Khanmigo pay an annual fee of $10 per student. Participating districts that want to pilot test Khanmigo for the upcoming school year will pay an additional fee of $60 per student, the nonprofit said, noting that computing costs for the A.I. models were significant.
Newark students began using Khans automated teaching aid in May. The reviews have so far been mixed.
Image
Mr. Rodriguez suggested sixth-graders ask Khanmigo two questions: What is a survey? What makes a question statistical?
Credit…
Gabriela Bhaskar for The New York Times
Newark officials said they wanted to see if Khanmigo could enhance math learning. The results so far have been mixed.
Credit…
Gabriela Bhaskar for The New York Times
Image
Mr. Rodriguez said the tutoring bot had allowed him to spend more time with students who needed guidance while allowing other students to plow ahead.
Credit…
Gabriela Bhaskar for The New York Times
One recent morning, sixth graders at First Avenue Elementary were working on a statistics assignment that involved developing their own consumer surveys. Their teacher, Tito Rodriguez, suggested the students start by asking Khanmigo two background questions: What is a survey? What makes a question statistical?
Mr. Rodriguez described the bot as a useful co-teacher that allowed him to devote extra time to children who needed guidance while enabling more self-driven students to plow ahead.
Now they dont have to wait for Mr. Rodriguez, he said. They can ask Khanmigo.
Down the hall in Ms. Drakefords math class, the bots responses to students sometimes seemed less like suggestions and more like direct answers.
When students asked Khanmigo the fraction question posted on the classrooms white board, the bot answered that the word mathematician contained 13 letters and that seven of those letters were consonants. That meant the fraction of consonants was seven out of 13, the bot wrote, or 7/13.
Image
During Ms. Drakefords lesson on fractions, Khanmigos responses sometimes seemed less like suggestions and more like direct answers.
Credit…
Gabriela Bhaskar for The New York Times
Thats our biggest concern, that too much of the thinking work is going through Khanmigo, said Alan Usherenko, the districts special assistant for schools, including First Avenue, in Newarks North Ward. The district did not want the bot to lead students through a problem step by step, he said, adding, We want them to know how to tackle the problem themselves, to use their critical thinking skills.
In an email, Khan Academy said students often needed initial support getting through problem-solving steps, and practicing could help them learn to automatically go through the steps, without assistance.
The group added that the tutoring bot was designed to help students solve problems, not give them the answers. But in the case of the fraction problem in Newark, the organization said, Khanmigo helped too much, too fast.
Our engineering team corrected the A.I. a few weeks ago, Khan Academy said in an email on Tuesday, so that it no longer gives the answer to this question.
On Wednesday, a reporter asked Khanmigo the same fraction question. In student mode, the tutoring bot explained the steps and then directly