Discussion about this post

User's avatar
Marla Simpson's avatar

I very much appreciate the work you do. It's extremely informative and helps represent important concerns. I agree with you most of the time, but I don't share your negative view of GPTZero. It is designed to err on the side of false negatives instead of false positives, which does mean that it often misses AI work and categorizes it as human. On the other hand, I appreciate the level of caution from GPTZero because I am more concerned about false positives than false negatives in practice. I can't speak to the specific instance cited in the Inside Higher Ed article, but I can say that I ran 100 old 2019-2019 (human) papers through GPTZero and the highest AI score I got was very low (well under 20%). My colleague ran 600 old papers through it and still hasn't gotten one score over 10% AI likelihood. What this means is that if I use a high threshold for detector results on a decent-sized student writing sample, I can be very confident that if a score is high, there is certainly some legitimate reason to assume that the student didn't do the work themselves. This gives me something objective as a starting point for holding students accountable. That said, I am completely open to learning more about the pros and cons of different detectors and tips on using them effectively. This is a topic that really hasn't received enough attention. I didn't know that GPTZero had introduced a "humanize" function. That's awful.

The other point where I maybe differ from your perspective is that I really view students as pawns in a big game of financial speculation. I think we agree that companies like Chegg and Big Tech companies pushing AI on students are exploiting natural human tendencies (like the predictable tendency for students to procrastinate, then feel desperate) to fuel investment and try to gain market share.

As I wrote in a recent comment on another blog, "From a business point of view, what we have are AI companies building user numbers by tempting students away from the work of studying for grades, then using these growth statistics to convince businesses that they need to keep up with the users of the future (students), then trying to convince our institutions that we need to make our students AI-ready for future jobs."

I hope that the lawsuit against Chegg is successful because it will help set a legal precedent.

Expand full comment
Joseph Brown's avatar

Hey Derek, did you see that OpenAI is making ChatGPT Plus free for students through May? I mean, that timeline is going to wreak havoc on colleges and universities as this semester concludes.

Expand full comment
1 more comment...

No posts