Andrew Ho
@andrewdeanho.bsky.social
Charles William Elliot Professor of Education, Harvard
Testing, Measurement, Psychometrics, Statistics
Testing, Measurement, Psychometrics, Statistics
Applying to a PhD in measurement? Remember to look beyond "the usual suspects" to great programs in N. America and beyond, including these from @ncme38.bsky.social: ncme.org/students/gra...
ICYMI, here is my advice for @harvardeducation.bsky.social: andrewho.scholars.harvard.edu/sites/g/file...
ICYMI, here is my advice for @harvardeducation.bsky.social: andrewho.scholars.harvard.edu/sites/g/file...
November 20, 2025 at 3:42 PM
Applying to a PhD in measurement? Remember to look beyond "the usual suspects" to great programs in N. America and beyond, including these from @ncme38.bsky.social: ncme.org/students/gra...
ICYMI, here is my advice for @harvardeducation.bsky.social: andrewho.scholars.harvard.edu/sites/g/file...
ICYMI, here is my advice for @harvardeducation.bsky.social: andrewho.scholars.harvard.edu/sites/g/file...
In my Week 1 assignment, I ask students to critique AI/GPT's answer to, "What is 'validity' in the context of educational measurement?"
Now that Harvard has updated its sandbox from GPT4.1 to GPT5.1, its answer is mostly right instead of mostly wrong.
Still, a good task! @ncme38.bsky.social
Now that Harvard has updated its sandbox from GPT4.1 to GPT5.1, its answer is mostly right instead of mostly wrong.
Still, a good task! @ncme38.bsky.social
November 18, 2025 at 4:54 PM
In my Week 1 assignment, I ask students to critique AI/GPT's answer to, "What is 'validity' in the context of educational measurement?"
Now that Harvard has updated its sandbox from GPT4.1 to GPT5.1, its answer is mostly right instead of mostly wrong.
Still, a good task! @ncme38.bsky.social
Now that Harvard has updated its sandbox from GPT4.1 to GPT5.1, its answer is mostly right instead of mostly wrong.
Still, a good task! @ncme38.bsky.social
We are looking for great folks to lead @ncme38.bsky.social through an important era for measurement science and practice. Nominations are due on Friday. Questions? See below or send me a DM!
Nominations: form.jotform.com/252314794748...
Info: higherlogicdownload.s3.amazonaws.com/NCME/4b7590f...
Nominations: form.jotform.com/252314794748...
Info: higherlogicdownload.s3.amazonaws.com/NCME/4b7590f...
November 11, 2025 at 4:55 PM
We are looking for great folks to lead @ncme38.bsky.social through an important era for measurement science and practice. Nominations are due on Friday. Questions? See below or send me a DM!
Nominations: form.jotform.com/252314794748...
Info: higherlogicdownload.s3.amazonaws.com/NCME/4b7590f...
Nominations: form.jotform.com/252314794748...
Info: higherlogicdownload.s3.amazonaws.com/NCME/4b7590f...
On Friday, I moderated a National Academy of Education panel on the state and future of education research, with Peggy Carr, @agamoran.bsky.social, Pam Grossman. Many calls for resilience, creativity, advocacy, engagement, and alliances for funding, data, freedom. Photo credit: @aadukia.bsky.social
November 10, 2025 at 4:50 PM
On Friday, I moderated a National Academy of Education panel on the state and future of education research, with Peggy Carr, @agamoran.bsky.social, Pam Grossman. Many calls for resilience, creativity, advocacy, engagement, and alliances for funding, data, freedom. Photo credit: @aadukia.bsky.social
Heading to DC realizing that I've been discussing "The Future of NAEP" for 15 years.
2012: nces.ed.gov/nationsrepor...
2022: nap.nationalacademies.org/resource/264...
NAEP is overdue for improvement. AI can help. But, say it with me: Protect Trend. andrewho.scholars.harvard.edu/sites/g/file...
2012: nces.ed.gov/nationsrepor...
2022: nap.nationalacademies.org/resource/264...
NAEP is overdue for improvement. AI can help. But, say it with me: Protect Trend. andrewho.scholars.harvard.edu/sites/g/file...
November 4, 2025 at 6:43 PM
Heading to DC realizing that I've been discussing "The Future of NAEP" for 15 years.
2012: nces.ed.gov/nationsrepor...
2022: nap.nationalacademies.org/resource/264...
NAEP is overdue for improvement. AI can help. But, say it with me: Protect Trend. andrewho.scholars.harvard.edu/sites/g/file...
2012: nces.ed.gov/nationsrepor...
2022: nap.nationalacademies.org/resource/264...
NAEP is overdue for improvement. AI can help. But, say it with me: Protect Trend. andrewho.scholars.harvard.edu/sites/g/file...
Well, he didn't use that word. You did. But I was happy to respond. Here's the court decision (see p9, etc.): law.justia.com/cases/texas/...
It's fair to ask whether TAC appointments and renewals truly protect TAC members from "influence," of course. But I never feel led about, let alone muzzled.
It's fair to ask whether TAC appointments and renewals truly protect TAC members from "influence," of course. But I never feel led about, let alone muzzled.
October 30, 2025 at 8:44 PM
Well, he didn't use that word. You did. But I was happy to respond. Here's the court decision (see p9, etc.): law.justia.com/cases/texas/...
It's fair to ask whether TAC appointments and renewals truly protect TAC members from "influence," of course. But I never feel led about, let alone muzzled.
It's fair to ask whether TAC appointments and renewals truly protect TAC members from "influence," of course. But I never feel led about, let alone muzzled.
When districts sued Texas for AI scoring, how did independent measurement experts help inform the case? At 1:45, I'm talking about the important, often unseen role of Technical Advisory Committees in evaluating testing (and AI) evidence. @ncme38.bsky.social #AIMECon www.xcdsystem.com/ncme/program...
October 29, 2025 at 4:12 PM
When districts sued Texas for AI scoring, how did independent measurement experts help inform the case? At 1:45, I'm talking about the important, often unseen role of Technical Advisory Committees in evaluating testing (and AI) evidence. @ncme38.bsky.social #AIMECon www.xcdsystem.com/ncme/program...
Liberty Munson's great keynote to open @ncme38.bsky.social's AIME-Con. I asked for examples of GenAI tests where we have evidence they're more 1) engaging, 2) precise, 3) predictive, and 4) impactful than traditional alternatives. She cited early evidence by Khan and Duolingo. With more at AIME-Con!
October 28, 2025 at 1:55 PM
Liberty Munson's great keynote to open @ncme38.bsky.social's AIME-Con. I asked for examples of GenAI tests where we have evidence they're more 1) engaging, 2) precise, 3) predictive, and 4) impactful than traditional alternatives. She cited early evidence by Khan and Duolingo. With more at AIME-Con!
Heading to @ncme38.bsky.social's sold-out AIME-Con in Pittsburgh. Kudos to Pres. Amy Hendrickson for growing this from a notion to a key signal of our field's advancement of new tech. www.ncme-aime.org/meetings/AIM...
And thanks to Chairs Joshua Wilson, Christopher Ormerod, & Maggie Beiting-Parrish!
And thanks to Chairs Joshua Wilson, Christopher Ormerod, & Maggie Beiting-Parrish!
October 27, 2025 at 7:38 PM
Heading to @ncme38.bsky.social's sold-out AIME-Con in Pittsburgh. Kudos to Pres. Amy Hendrickson for growing this from a notion to a key signal of our field's advancement of new tech. www.ncme-aime.org/meetings/AIM...
And thanks to Chairs Joshua Wilson, Christopher Ormerod, & Maggie Beiting-Parrish!
And thanks to Chairs Joshua Wilson, Christopher Ormerod, & Maggie Beiting-Parrish!
What's a TAC? Our new NCME initiative honors the service of 150+ experts who advise state testing programs. Together, they advance validity, precision, and fairness.
www.ncme.org/community/co...
We hope this list increases awareness of the role, the community, and the pipeline. @ncme38.bsky.social
www.ncme.org/community/co...
We hope this list increases awareness of the role, the community, and the pipeline. @ncme38.bsky.social
October 23, 2025 at 6:51 PM
What's a TAC? Our new NCME initiative honors the service of 150+ experts who advise state testing programs. Together, they advance validity, precision, and fairness.
www.ncme.org/community/co...
We hope this list increases awareness of the role, the community, and the pipeline. @ncme38.bsky.social
www.ncme.org/community/co...
We hope this list increases awareness of the role, the community, and the pipeline. @ncme38.bsky.social
I finally did it. Here is my TAC Bingo Card: bit.ly/tacbingo
I hope it will help folks anticipate and understand my most common requests and recommendations. It will also encourage me to learn new things and avoid becoming predictable.
I predict a round of drinks will be on me. @ncme38.bsky.social
I hope it will help folks anticipate and understand my most common requests and recommendations. It will also encourage me to learn new things and avoid becoming predictable.
I predict a round of drinks will be on me. @ncme38.bsky.social
October 22, 2025 at 8:44 PM
I finally did it. Here is my TAC Bingo Card: bit.ly/tacbingo
I hope it will help folks anticipate and understand my most common requests and recommendations. It will also encourage me to learn new things and avoid becoming predictable.
I predict a round of drinks will be on me. @ncme38.bsky.social
I hope it will help folks anticipate and understand my most common requests and recommendations. It will also encourage me to learn new things and avoid becoming predictable.
I predict a round of drinks will be on me. @ncme38.bsky.social
What's behind this map of measurement programs? Hundreds of faculty and students, all part of a networked community that @ncme38.bsky.social is proud to support.
www.ncme.org/students/con...
Thanks to our Educators of Measurement SIG and Graduate Student Issues Committee for supporting this effort!
www.ncme.org/students/con...
Thanks to our Educators of Measurement SIG and Graduate Student Issues Committee for supporting this effort!
October 21, 2025 at 2:59 PM
What's behind this map of measurement programs? Hundreds of faculty and students, all part of a networked community that @ncme38.bsky.social is proud to support.
www.ncme.org/students/con...
Thanks to our Educators of Measurement SIG and Graduate Student Issues Committee for supporting this effort!
www.ncme.org/students/con...
Thanks to our Educators of Measurement SIG and Graduate Student Issues Committee for supporting this effort!
Interested in measurement? NCME has expanded its list of PhD programs in North America (82 and counting). Our community is strong.
Landing page: www.ncme.org/students/con...
List: bit.ly/ncmephdprograms
Map: bit.ly/ncmephdmap
@ncme38.bsky.social
Landing page: www.ncme.org/students/con...
List: bit.ly/ncmephdprograms
Map: bit.ly/ncmephdmap
@ncme38.bsky.social
October 16, 2025 at 6:17 PM
Interested in measurement? NCME has expanded its list of PhD programs in North America (82 and counting). Our community is strong.
Landing page: www.ncme.org/students/con...
List: bit.ly/ncmephdprograms
Map: bit.ly/ncmephdmap
@ncme38.bsky.social
Landing page: www.ncme.org/students/con...
List: bit.ly/ncmephdprograms
Map: bit.ly/ncmephdmap
@ncme38.bsky.social
NCME keeps upping its swag game, now with AIME-Con-specific swag! (And plushies of course.) bit.ly/ncmeswag
(AIME-Con is our AI in measurement conference, at capacity with nearly 500 attendees!): www.xcdsystem.com/ncme/program... @ncme38.bsky.social
(AIME-Con is our AI in measurement conference, at capacity with nearly 500 attendees!): www.xcdsystem.com/ncme/program... @ncme38.bsky.social
October 15, 2025 at 6:26 PM
NCME keeps upping its swag game, now with AIME-Con-specific swag! (And plushies of course.) bit.ly/ncmeswag
(AIME-Con is our AI in measurement conference, at capacity with nearly 500 attendees!): www.xcdsystem.com/ncme/program... @ncme38.bsky.social
(AIME-Con is our AI in measurement conference, at capacity with nearly 500 attendees!): www.xcdsystem.com/ncme/program... @ncme38.bsky.social
EOP is hosting a (small) conference for quantitative research on educational opportunity at Stanford, February 5 & 6, 2026! We hope you'll submit your work and join us. Proposals are due 11/7. #SEDA forms.gle/jYfz9CasQ5c1...
October 14, 2025 at 4:10 PM
EOP is hosting a (small) conference for quantitative research on educational opportunity at Stanford, February 5 & 6, 2026! We hope you'll submit your work and join us. Proposals are due 11/7. #SEDA forms.gle/jYfz9CasQ5c1...
NCME responds to the IES RFI. We ask IES to invest in professional standards, NAEP, high-quality research, training grants, a robust infrastructure for high-quality measurement in education, and more. @ncme38.bsky.social
higherlogicdownload.s3.amazonaws.com/NCME/4b7590f...
higherlogicdownload.s3.amazonaws.com/NCME/4b7590f...
October 10, 2025 at 3:59 PM
NCME responds to the IES RFI. We ask IES to invest in professional standards, NAEP, high-quality research, training grants, a robust infrastructure for high-quality measurement in education, and more. @ncme38.bsky.social
higherlogicdownload.s3.amazonaws.com/NCME/4b7590f...
higherlogicdownload.s3.amazonaws.com/NCME/4b7590f...
I finally wrote up my advice to PhD applicants in FAQ format. It's only my unofficial, personal perspective for folks interested in working with me at Harvard @harvardeducation.bsky.social. I also plug other measurement programs at @ncme38.bsky.social! andrewho.scholars.harvard.edu/sites/g/file...
October 7, 2025 at 3:12 PM
I finally wrote up my advice to PhD applicants in FAQ format. It's only my unofficial, personal perspective for folks interested in working with me at Harvard @harvardeducation.bsky.social. I also plug other measurement programs at @ncme38.bsky.social! andrewho.scholars.harvard.edu/sites/g/file...
Should @harvard.edu shift norms on screen management and active learning in its large classrooms? Two interesting policy ideas emerged from a standing-room-only HILT plenary panel at @harvardeducation.bsky.social on Friday with Jal Mehta, Todd Rogers, Dave Deming, and Karen Thornber...
October 6, 2025 at 1:28 PM
Should @harvard.edu shift norms on screen management and active learning in its large classrooms? Two interesting policy ideas emerged from a standing-room-only HILT plenary panel at @harvardeducation.bsky.social on Friday with Jal Mehta, Todd Rogers, Dave Deming, and Karen Thornber...
Mid-COVID, I wrote my "Three Metrics" memo, encouraging states to use better metrics lest they mislead the public and themselves about educational progress. It's now published in TCR with a bit of "I told you so" context.
Let's keep improving aggregate reporting.
journals.sagepub.com/doi/10.1177/...
Let's keep improving aggregate reporting.
journals.sagepub.com/doi/10.1177/...
September 22, 2025 at 3:36 PM
Mid-COVID, I wrote my "Three Metrics" memo, encouraging states to use better metrics lest they mislead the public and themselves about educational progress. It's now published in TCR with a bit of "I told you so" context.
Let's keep improving aggregate reporting.
journals.sagepub.com/doi/10.1177/...
Let's keep improving aggregate reporting.
journals.sagepub.com/doi/10.1177/...
Glad to see Senate discussing K-12 education live on the hill. My colleague Marty West is testifying. www.help.senate.gov/hearings/the... @harvardeducation.bsky.social
September 18, 2025 at 2:25 PM
Glad to see Senate discussing K-12 education live on the hill. My colleague Marty West is testifying. www.help.senate.gov/hearings/the... @harvardeducation.bsky.social
It's great to see NAEP & NCES staffing up. Measurement requires rare expertise. I hope my qualified colleagues consider these important positions and the commitment to public service that they represent.
Note: Some applications are due today.
www.usajobs.gov/Search/Resul...
@ncme38.bsky.social
Note: Some applications are due today.
www.usajobs.gov/Search/Resul...
@ncme38.bsky.social
September 15, 2025 at 3:28 PM
It's great to see NAEP & NCES staffing up. Measurement requires rare expertise. I hope my qualified colleagues consider these important positions and the commitment to public service that they represent.
Note: Some applications are due today.
www.usajobs.gov/Search/Resul...
@ncme38.bsky.social
Note: Some applications are due today.
www.usajobs.gov/Search/Resul...
@ncme38.bsky.social
NCME submissions are due today for our annual meeting in LA, 4/8-11. The flurry of emails I've fielded (and sent) over the past few weeks has me very excited for the scholarship and symposia to come!
Now, I bravely enter the submission portal... @ncme38.bsky.social
Now, I bravely enter the submission portal... @ncme38.bsky.social
September 12, 2025 at 3:18 PM
NCME submissions are due today for our annual meeting in LA, 4/8-11. The flurry of emails I've fielded (and sent) over the past few weeks has me very excited for the scholarship and symposia to come!
Now, I bravely enter the submission portal... @ncme38.bsky.social
Now, I bravely enter the submission portal... @ncme38.bsky.social
The 8-12-80 Rule, an essay I share with my students this time of year: Only 8% of their learning happens in class, with me. 12% comes from their TAs. 80% comes from their time outside of class, with each other.
If we believe this, how should change how we teach and learn? medium.com/@harvardeduc...
If we believe this, how should change how we teach and learn? medium.com/@harvardeduc...
September 8, 2025 at 3:27 PM
The 8-12-80 Rule, an essay I share with my students this time of year: Only 8% of their learning happens in class, with me. 12% comes from their TAs. 80% comes from their time outside of class, with each other.
If we believe this, how should change how we teach and learn? medium.com/@harvardeduc...
If we believe this, how should change how we teach and learn? medium.com/@harvardeduc...
These short courses in AI and Educational Measurement look fantastic. I need to update my syllabus. #LifelongLearning
Upcoming at NCME's AIME-Con in Pittsburgh, 10/27-29, program here: www.xcdsystem.com/ncme/program...
Registration: ncme.site-ym.com/events/Event...
@ncme38.bsky.social
Upcoming at NCME's AIME-Con in Pittsburgh, 10/27-29, program here: www.xcdsystem.com/ncme/program...
Registration: ncme.site-ym.com/events/Event...
@ncme38.bsky.social
September 5, 2025 at 3:33 PM
These short courses in AI and Educational Measurement look fantastic. I need to update my syllabus. #LifelongLearning
Upcoming at NCME's AIME-Con in Pittsburgh, 10/27-29, program here: www.xcdsystem.com/ncme/program...
Registration: ncme.site-ym.com/events/Event...
@ncme38.bsky.social
Upcoming at NCME's AIME-Con in Pittsburgh, 10/27-29, program here: www.xcdsystem.com/ncme/program...
Registration: ncme.site-ym.com/events/Event...
@ncme38.bsky.social
As the school year begins with AI looming, here again are my notes encouraging us to administer oral exams: bit.ly/andrewhoccl
Oral exams were great even before AI. Now, I think they're essential. Here's where I talk about this in my @ncme38.bsky.social address: www.youtube.com/watch?v=QDQx...
Oral exams were great even before AI. Now, I think they're essential. Here's where I talk about this in my @ncme38.bsky.social address: www.youtube.com/watch?v=QDQx...
September 2, 2025 at 2:30 PM
As the school year begins with AI looming, here again are my notes encouraging us to administer oral exams: bit.ly/andrewhoccl
Oral exams were great even before AI. Now, I think they're essential. Here's where I talk about this in my @ncme38.bsky.social address: www.youtube.com/watch?v=QDQx...
Oral exams were great even before AI. Now, I think they're essential. Here's where I talk about this in my @ncme38.bsky.social address: www.youtube.com/watch?v=QDQx...