[recursivedoubts]

In the AI era, tests are going to have to be in person and hand written.

I have written an article on how I have adjusted my classes to the situation:

https://htmx.org/essays/universities-and-ai/

Ironically, I think the AI era may make university degrees a better signal of the intellectual abilities of students due to the presence of pre-computer infrastructure like large lecture halls, industrial-scale copiers, etc.

[bArray]

Even then, AI smart glasses are now making an appearance in classrooms [1]. The situation is getting really quite ridiculous.

[1] https://www.evenrealities.com/en-GB/blogs/buyers-guide/ai-mo...

[redwall_hp]

It's news to me that they weren't already. My exams were all in person and on paper in the early 2020s, and even my physics homework was a "do it on engineering paper and drop it in a mail slot" affair. The professors would forbid computers and phones during lectures and would stop to shame anyone who thought they were being sneaky.

Computer Science classes were all on paper for exams, and low level ones did the old "here's a Javadoc, write some code with a pencil."

The only online exams I had were for 100 level electives.

[Aurornis]

> It's news to me that they weren't already.

It’s an old (and outdated IMO) tradition at some Ivy Leagues, as the article notes.

It may have worked in the era when students had a little more fear of repercussions and a little more sense that cheating on a test would only cause them problems when courses got harder later.

Now it seems there is little interest in dealing with cheating, as evidenced by how hard it was for this professor to even get attention to the matter within his department. Students also don’t believe cheating will cause them future harm because they assume they can cheat everything up through graduation the same way.

When the rug gets pulled and they have to demonstrate their knowledge in person without ChatGPT, the cheaters collapse. I fear that we’re delaying this reckoning so deep into academic careers now that by the time these students encounter the point where they can’t cheat their way to completion of a course they’re in for a world of hurt, if they continue at all. We really should be coming down hard on cheating earlier and more often.

[s0rce]

Mine were like this is 2005. The math classes also didn't allow calculators, engineering classes did, but not graphing ones that could store information.

[markus_zhang]

IMO many CS classes should be lab based already, except the theory heavy ones. I still wonder why MIT needs to test students of OS courses on paper when the labs cover a lot of the ground. If I can do well in the labs I wouldn’t bother to memorize stuffs for the exams.

[fn-mote]

You have to test to make sure the student who you are giving the grade to is the student who did the work.

Without certifying someone’s abilities, the degree doesn’t mean much.

[bee_rider]

I think “take home open book exam, good luck,” followed by evil laughter, is mostly a math department thing.

[atty]

And physics

[BinRoo]

> In the AI era...

Back in my day, you could also just Google the problems and find the solutions. What mitigated cheating at UVA was the honor code and each professor's faith and trust in our integrity. That culture was enough to not cheat.

Imo, the fix should be to work on culture. Cheating should always be a tempting choice, so that the student may challenge their integrity, which is a muscle that can atrophy.

[Aurornis]

> What mitigated cheating at UVA was the honor code and each professor's faith and trust in our integrity. That culture was enough to not cheat.

The decline of actual consequences for cheating has played a big role.

When I was in college, people who got caught cheating found themselves in a world of trouble. Repeat offenders faced severe consequences like failing courses, which could delay their graduation date if it was a critical-path course. This has a real dollar amount attached to it because you start working later.

Now it seems universities avoid addressing cheating problems at all costs. The professor in this article complains about how hard it was to draw attention to the cheating problem, with no response within his own department.

Students know this. As cheating gains critical mass and you see that nothing bad is happening to the cheaters, you start feeling like you're at risk of falling behind if you aren't cheating. The cheaters are getting higher grades (100% for many in this case) and they get to go out partying while you're still working through the material. You're really screwed if grades are distributed on a curve.

So temptation spreads. Anecdotally, I've seen a few young people lie to themselves and think that they're just going to use ChatGPT to check their answers and learn from it, but they don't realize how superficial it is to have ChatGPT fix your problem and then skim the correct answer. They put less effort into checking their work because they know they have a button to push to check it for them. When they get put into a situation where they can't rely on that button, it all falls apart

[bradleyjg]

> Imo, the fix should be to work on culture.

We can’t even agree on what’s wrong with it. We aren’t going to be able to fix it.

[willis936]

Back in your day education was not sold as a financial transaction to a prosperous life. The honor system is idyllic and requires idyllic circumstances: people who pursue education for no reason other than curiosity or self improvement. If you want the honor system back then you need to offer more stable safety nets. It's not "kids these days", it's the natural result of the systems adults have made.

[nerdsniper]

> Back in your day education was not sold as a financial transaction to a prosperous life.

Yes it was. This was the pitch for as long as Google has existed. The only relevant change from the early days of Google is that now you also need to go to a T20 school and GPA inflation has gone completely insane.

[nekusar]

Exactly.

College is a pure financial transaction, and a quite bad one especially if you fail.

As for me, I use a HDMI redirect to another computer that runs a local LLM. Screen scrapes and puts the answer on the screen as an overlay.

And you can run it in proxmox. I sell services to set this up. Can't be detected, and user controls an error rate calc.

BTW, I have no degree myself. And I have no greater ioy than devaluing everyone's degrees. Its always been a fucking rick kids game. Time to take em down a notch .

[npstr]

Seems easy to counter all of this. I study at a German remote university, and they require, next to the front camera, a second camera to record the screen + hands and arms of the student while taking exams, and before the exam starts a complete video of the room, below desk areas, ears, etc. I don't see an angle how to reliably cheat in such conditions, and have seen nothing mentioned by any other student. So I would say it's up to the university if they want to allow fraud like that...they could easily stop it.

[Gigachad]

The world is getting more competitive. Integrity goes out the window when cheating in a test can mean meaningful better life outcomes and when you believe everyone else will be too.

[odyssey7]

The thing about the community of trust—of which all stewards—is that camaraderie, respect, identifying with the community, and integrity will keep the majority of students from cheating. And if that isn’t enough, the “single sanction” was historically a sufficient danger to raise the stakes immensely.

However, some students will cheat, and for that reason, I am very much against curves. If you learn the material and demonstrate that you have, you should get the A. But it’s more work for professors to calibrate their curriculums, and there seems to be no real accountability for the inverse of learning objectives—teaching objectives—so curves are likely here to stay.

[Escapado]

I agree that that is probably the lowest stake solution. Alternatively there are solutions like the safe exam browser which locks down the device quite well during the exam session.

—- Disclosure: I run a small start up which offers teachers a platform to create and conduct digital exams and interfaces with the safe exam browser precisely because cheating is the number one complaint teachers I have spoken to have when it comes to digital exams.

[Atotalnoob]

Sure, and those require kernel level access, strip privacy, and don’t run on all OS

[walrus01]

> In the AI era, tests are going to have to be in person and hand written.

Forcing hand written should really not be necessary. It would be very cheap in terms of old computing hardware to set up a test room with old desktop PCs that have wired only NICs (with a network connection that goes to a switch in the same room with no uplink, connected to a decent size laser printer only), running something like lubuntu and libreoffice writer as a basic word processor.

Let people at least type their essay with the standard features of a word processor as usable as MS Word 2000 or better.

[QuadmasterXLII]

I’m 30 and “we can’t do tests in paper” seems _insane_. Just how metastatic has ed tech been in what, 9 years since my undergrad?

[walrus01]

I'm quite a bit older than you, old enough that I remember learning to touch type in elementary school on Apple IIe and IIgs desktop computers. It's not reasonable these days to expect people to hand write a 4, 6, 8 page length essay on paper and pen with a finite time limit in a classroom. Being able to edit and revise things in a word processor type interface is an essential part of writing an academic paper.

Additionally expecting whoever is reading the paper to comprehend everyone's (likely very sloppy, in this era) handwriting is an exercise in frustration for the person who would be evaluating the papers.

Not that tests/exams can't be given on paper, ever (multiple choice still works), but for something where people are expected to provide multiple pages of coherently written essay output, I would struggle to do it by hand. And I'm old enough that we did do a lot purely on paper when I was in school.

[__d]

My child's high school is doing the same thing: all exams are now handwritten on paper in a supervised room. Phones and smartwatches are always banned during the school day, but laptops are banned during exams. This is standard at state-funded high schools in Australia.

There will likely be a period where those who went through high school with computers struggle with hand writing stuff, but the next generation will have done it all their lives.

[rtpg]

I had to do "write code on paper" stuff as part of french engineering school entrance exams.

It's fine (tho annoying when you lose points to "typos"), but it limits what kinds of problems you can reasonably put on the exam. You'll definitely lean a bit more into theoretical stuff than practicals. Which is fine for some courses, I think a bit less interesting in other courses.

Remember, the hand written code is also harder for reviewers to grade! You have to manually run the code in your head, for example

Having said all that... "we've booked the computer room, you don't have internet, go type up all your stuff in this VM we have set up" feels fine if you don't like this constraint IMO

[ant6n]

I’m 40 and forcing students to do handwritten essays during tests has always been stupid. Typing is much faster, why bottleneck ideas by forcing handwriting?

[ThrowawayR2]

A lecture hall full of click-click-click isn't going to be conducive to concentrating on a test.

[rsanek]

If you can't concentrate while people are working on computers near you, I don't think you'll do well in any workplace that is based around knowledge work.

[kalium-xyz]

I had tons of exams like that. Its not an issue as the computers simply do not have loud mechanical keyboards connected

[yulker]

because writing speed isn't the bottleneck for what is being tested

[dzink]

Fill the room with typewriters.

[walrus01]

Typewriters are an expensive and niche item these days, due to no longer being manufactured, and the good ones being collected by weird nerds. Sort of like buying a 40-year-old vinyl turntable that is in good and usable condition.

[dzink]

If I build you a custom device that receives questions from a central computer and lets the user plug in whatever keyboard they want via bluetooth or usb to only type and answer the questions (ability to edit the text and submit when ready). The central computer can receive all the questions submitted to any of these devices connected to it via wifi or cloud. How much would pay per device? Would you pay for a subscription?

[kalium-xyz]

You cant type fast on them either

[forgetfreeman]

I'm 50. Optimizing testing for speed is goofy. The point of the exercise is to demonstrate the student's understanding of the material, not their WPM.

[tengwar2]

I'm 60+. I'd be more concerned about the student's physical ability to write for several hours continuously. Writer's cramp used to be a problem, and that was when we were used to hand-writing everything. Legibility is also a consideration: I have to hand-write a lot(keyboards would not be socially acceptable for some of my work), and even with decades of practice and a hand that I designed for legibility, sometimes I have difficulty reading my own writing.

[dminik]

You should definitely take speed into consideration. If your're writing an essay, being able to type it out and still have both the opportunity and time to edit it is great. If you're writing it on paper, you likely have neither. What comes to you first is what's submitted.

[doodlesdev]

And that's exactly the point! By making sure the student can't edit the entire text once its written, you force him to think about the essay's structure and force him to plan much more before writing :)

[imron]

If you’re suggesting that the test favors those capable of arranging their thoughts and words before putting pen to paper then.... I’m not sure there’s a problem

[forgetfreeman]

And yet strangely this hasn't proved a major impediment to the species at any point in the last ~5000 years...

[xp84]

Sure but given any length of time, which does tend to be finitely allocated for a test (if for no other reason than the prof or proctor does have other places to be eventually), having to hand write is slower and harder to revise, which means it's harder to get that full, understanding-demonstrating essay, done and polished.

[dwattttt]

If your test is bottlenecked on the speed it takes to write it, you're testing writing skills.

I also challenge that "hand writing is harder to revise"; again, why is the speed it takes to write it at all relevant?

[customguy]

> Forcing hand written should really not be necessary.

I do think it's necessary. And I felt unsure at first of how extremely strong I feel about this -- I think everybody should be able to write cursive, and even doctors should be able to write legibly, which ALL of them could learn in one single day, an afternoon, if they had to -- but then I did a simple search for "the benefits of writing by hand studies" and now I'm even more radical.

It's like PE or brushing your teeth. Nobody initially wants it, so we, knowing better, force them.

[vector_spaces]

I appreciate the sentiment, as someone who vastly prefers handwriting, but the downfall of this might be the situation we have historically had in the US with math, where the experience of being clumsily force fed this additional material can be so painful that it induces PTSD-like symptoms and a lifelong aversion to the material. A similar phenomenon even occurs with cursive and PE class.

That obviously isn't to say that I don't think people should learn these subjects, nor that we should avoid presenting them at all to young minds. It's just that, as someone who failed math all through grade school and now does pure math research as an adult, I don't think "forcing them" in the sense of introducing yet another high stakes and high pressure set of evaluations to all the others is really the enlightened path here

[WalterBright]

How can you tell if they learned anything if you don't test them?

[zdragnar]

I'm neither fully left handed or fully right handed. I mostly write with my left hand, but it has never been clean, despite doing all of my school work for 18 years with either pencil or pen and paper.

I wish I could have a just spent "an afternoon" to magically make either my printing or cursive better, but it basically stalled out early on and never improved despite years of practice.

[subygan]

i don't at all think it's that obvious / easy.

i was taught cursive in 2nd grade. and my handwriting is gobsmackingly horrible. coming back to stuff I've written after I've forgotten the context, makes it impossible for me to understand what I've written.

and it's not for lack of trying. I spent almost every summer till 10th grade, practicing writing 30 pages a day. and still it gets reset to my horrible hand writing in weeks after school start. at this point, i just consider myself hand writing challenged.

i cannot tell you how much happy i am that, computers have made handwritten exams obsolete.

[techjamie]

I was in the same boat as a kid. My handwriting is so bad, for the essay portion of the state test we had to take one year, they got an exemption and let me use Notepad to type mine out because they didn't want to risk my grade if the person couldn't read my writing. This was in the mid-2000s.

These days I just disclaim to people when I hand them anything handwritten that I'm very aware my writing is terrible, and I will not be offended at all if they have to ask what it says.

[encomiast]

> I think everybody should be able to write cursive

As someone who has hated both reading and writing cursive since middle school, I'm curious what is significant about cursive specifically?

[WalterBright]

Doing work with handwriting helps in learning the material. I don't know why that works, but my experience (and others') clearly shows it does.

[remashedspood]

And I strongly disagree.

The moment I have to write stuff down my focus is gone and I might as well be taking a nap.

And having to read my own handwriting assures I’ll never look at that page, again.

Different strokes

[DangitBobby]

Having to write stuff down made it impossible for me to pay attention to the lecture. But I was definitely more likely to remember what I did write down. Bit of a catch 22

[Larrikin]

Do you acknowledge you're a minority?

I detest writing and have terrible handwriting but have seen first hand that typing or just listening is not as effective. In grad school I sucked it up and just typed up my handwritten notes so they were searchable when I actually needed them to be.

But writing by hand and just reading them over was usually enough.

[encomiast]

That's been my experience as well. I'm just curious about cursive writing specifically.

[WalterBright]

point taken. I learned to take notes by printing by hand, as my cursive was illegible.

[shagie]

It helps with fine motor skills at a time that people are capable of learning them.

... And there are jobs that use those skills.

Correlation between handwriting, drawing skills and dental skills of junior dental students - https://pubmed.ncbi.nlm.nih.gov/22269191/

My dentist, while teaching dentistry commented that if the student did not learn cursive in school, it takes them another 3-4 months of practice in order to acquire the fine motor control for holding dental instruments.

[encomiast]

If anyone is interested, here is a link where you can download the study: https://www.researchgate.net/publication/221770027_Correlati...

I few interesting bits — it does involve cursive, but it's Arabic and it's graded on a rubric that includes things like "Presenting the beauty aspects of Arabic writing'. Also, given a sample of 71 students and a p<0.001 means the correlation coefficient only needs to be around 0.40 which means handwriting and drawing may only explain about 16% of the variance of these dental skills. That's not nothing, but given the subjective nature of the test and the confounders (does this handwriting sample really measure motor skills or maybe it measures care and attention to detail, or conscientiousness), I'd be a little wary of using this to argue for education policy.

Still, glad you posted it and glad I read it. It interesting.

[robcohen]

So the logical entailment here is what? That everyone should have the dexterity of a dental surgeon so we can save the 7000 dental surgeons 3 months of training? Am I missing something?

[metalcrow]

What's the benefit of cursive over standard writing?

[cataphract]

What is "standard writing"? Isn't cursive the standard you're taught and then everyone writes however they want?

[Larrikin]

In 2nd grade I was assured by my teachers that all adults wrote cursive and you had to relearn the alphabet again. Then in 3rd grade the teachers all said they couldn't read anyone's handwriting and to print everything.

In high school the most difficult part of the SAT was the honor pledge that you didn't cheat that you had to write in cursive. Nobody writes cursive.

[Arainach]

No. Most people handwrite most things in print lettering, not cursive. I'm nearly 40 and no one in my life writes anything other than their name (signature) in cursive ever.

[encomiast]

When I was in school we started with "manuscript" writing, which is detached letters similar to a typical sans-serif typeface without the two-story `a` and other fanciness. We then progressed to cursive.

[wombatpm]

Physics 107 at U of I in the 80’s had all quizzes on the PLATO system. Please for the love of mercy do not not go back to inflexible systems for exams and quizzes.

[freehorse]

Talking about programming-related courses, I can see the point of testing on a computer where one can run and debug actual code (that's how I had my programming courses) but I am not sure I get the advantage or writing code or pseudocode on a "basic word processor".

Moreover, for math or math-heavy courses (assuming most people with degrees here have STEM degrees, and many with at least some math) I cannot imagine how to comfortably write math in a word processor. Or use latex and not spend half the time troubleshooting latex, esp without internet access. So for some kind of courses at least, imo pen and paper for a timed in-person exam is the only way.

Otherwise def doable, but knowing how some universities function, I think the main problem would be getting the agreement and initiative to set such a computer room up. Getting some kind of consensus between professors that this is how (some) exams should be held and including it in the Holy Curriculum. Getting bureaucrats understand what it is about eg why you need these wired connections when the uni has a campus-wide wifi. Getting IT security agree with using old computers with lubuntu instead of their bloated enterprise windows "secure" OS. And if they are not connected to the internet how will they get security updates? How do we conform to whatever IT security rules are in place?

Writing on paper is much simpler, everybody can understand it and has been standard for decades at least. It can start tomorrow and be used in the interim while waiting approval for such a computer setup.

[fn-mote]

Writing on paper requires higher level planning skills.

A word processor allows you to edit, which is a major part of the writing process.

Forcing learners to plan everything “perfectly” before they write is a big ask. And you’re probably not teaching that skill.

I remember how much my technical writing skills improved once I started writing in a computer and editing. It was a huge difference.

[recursivedoubts]

More expensive than you'd think, but I am pushing for something like that.

[tialaramex]

It would also be a huge discrimination problem.

I (as part of a small team) run the IT side of exams for a UK University and as well as the many exams intended to be taken entirely with computers, we also deliberately have an exam that's always marked as "Available to take" regardless of where on campus you are and what machine you're using, that exam just launches a stripped down Microsoft Word, with no way to start other software or access your own data.

So instead of reading the instruction book and writing either in the book or on separate provided paper, you read the book and type your answers in Word, when you're done either your work is printed or these days often it's automatically sent to the markers electronically.

There's a spectrum of people using this, going from the profoundly blind who couldn't have attempted an actual hand written exam through to people who have dyslexia or similar problems and would be able to write but it might be very difficult to mark. It also becomes a "last ditch fallback" for a number of scenarios where plans went wrong or something was forgotten and so that's why it's always available - we do run exams specifically planned to be in Word, but those have distinct IDs so that you know you're taking the exam "HIST1234/C4 History of Clowns and Clowning. Essay on prepared topic" or whatever, as well as "Multiple choice" style exams, and a large number of exams which involve using computer tooling, e.g. R, Stats packages, programming.

[Bawoosette]

When I started university, it did indeed have a dedicated building that was essentially a computer lab specifically for testing. In theory, cheating was prevented by having people walk around the lab watching the students. Toward the end, I did have a couple exams that needed the absolutely batshit insane malware installed on a personal device, but I think if I were to do it again today, I could still demand to use the testing center instead. It still exists.

[tiahura]

What's wrong with https://www.scantron.com/?

[Arainach]

For nearly any subject of learning at a level above high school, multiple choice is a terrible way to assess knowledge.

Multiple choice can only tell if you reached a final answer (or guessed it). It cannot tell anything about how you reached that conclusion.

[userbinator]

However, it is a fast and simple method of assessment.

[dekdrop]

how do you make sure they are not using their mobile phone with llms while the exam? I have seen that happening.

[walrus01]

The same method that any test given in the last 150 years has done to prevent people from using cheat sheets or similar, by having roaming proctors in the room? Or policies like certain models of HP or TI graphing calculator only allowed on the table, for the sort of test that requires one...

[WalterBright]

Somehow I got through high school and 4 years of every class being a math class in college without a graphing calculator.

[pianopatrick]

If people wanted to get really serious you could use a cell phone jammer and have students pass through a mini EMP at the door.

[jasondigitized]

Seems like a problem an entrepreneur / technologist can easily solve.

[wnevets]

Can you fit a decent LLM on a thumbdrive?

[walrus01]

Lots of ways to disable USB ports in bios and at the operating system level, additionally have a proctor watching to be sure everyone is in a word processor. Heck, ewaste grade computers can run a basic word processor, fill all USB ports except the mouse and keyboard with epoxy. Mount the computer in such a way the rear ports are inaccessible without it being very obvious what someone is doing and fill just the front ports (if they exist) with epoxy. Lots of ways to go about it.

[bryanlarsen]

A proctored exam doesn't need to have perfect lock-down. The proctor should notice the thumb-drive. They might miss it, but the risk will deter most.

[bagels]

It can fit on augmented reality glasses, eventually.

[walrus01]

Pretty sure that augmented reality glasses, and things in the category of the meta glasses with built-in camera are already banned in most academic test environments, by a blanket policy prohibiting the use of any camera in the room.

[bagels]

Right, they're easy to detect today, that's not going to last long. The whole point is to prevent cheating, well, cheats aren't going to follow the rules. Written tests/in person tests aren't a complete answer to this.

[sarchertech]

If augmented reality glasses advance to the point where you can’t easily tell from a distance, then make the students hand them over for a close inspection.

If we get to the point where even that doesn’t work then we’ll be at the point where a camera in the room with an AI analyzing eye movements should be able to detect it. And no matter how advanced they get they’ll still need to radiate heat, so a thermal camera should work. If that fails, industrial CT scanners are getting cheaper and cheaper.

Heck if it gets too bad there’s always mm wave body scanners and a set of cheap glasses kept at school.

[Avicebron]

Probably safer to use typewriters.

[paul7986]

There should be no computer at all just give students a typewriter. It could prompt a resurgence of the typewriter :)

[loloquwowndueo]

These days pretty sure computers are cheaper than typewriters.

[shagie]

You can get a manual typewriter (hammer rather than ball) on Amazon for about $200. Brand name ones run in the $300 - $400 range.

A college instructor turns to typewriters to curb AI-written work and teach life lessons - https://apnews.com/article/typewriter-ai-cheating-chatgpt-co...

[walrus01]

Computers good enough to run libreoffice writer or the equivalent and print to a networked laser are thrown in the ewaste trash all the time, the cost really would be in the labor and somewhat custom software setup. Could also reuse old flat panel displays that have been decommissioned from office use.

[loloquwowndueo]

Lubing typewriters and ensuring they have a fresh ribbon also sounds pretty labor intensive.

(Where do you even get ribbons these days)

[BaculumMeumEst]

Nobody is going to do that.

[walrus01]

Why not?

[sokoloff]

Do you let students bring their own keyboards? If not, does that disadvantage a Dvorak user? Or a Kinesis user? Or a non-US layout? Or a Mac user?

If you do let them bring their own keyboards, how sure are you that those are just dumb keyboards?

[walrus01]

I would bet good money, statistically, that forcing hand written tests with pen and paper is much more likely to disadvantage students with a medically documented physical disability than you are to encounter someone who can't type at all on a standard 101 key qwerty layout keyboard.

[vcf]

At my university, students with verified disabilities are allowed to use a university-provided laptop (properly locked-down, with allowed tools such as screen readers). But these are special cases. Computers for everyone would be costly and impractical given exams are punctual but all roughly over the same week or so.

[gchallen]

There are limits to what you can assess on timed assessments, and there are students whose performance on such assessments is not a good signal of their intellectual ability.

In addition, at many institutions such tests are given infrequently and can be worth a significant component of a student's overall grade, increasing both student stress levels and the tendency for such assessments to measure short term knowledge students have obtained by cramming, not more meaningful longer-term knowledge gains.

I see you're giving quizzes every three weeks, which is better than twice a semester, but still not what I would consider an ideal cadence. In my course weekly computer-based quizzes comprise 70% of a student's grade, but that's supported by a significant institutional investment in high-frequency computer-based testing: https://cbtf.illinois.edu/.

[rfergie]

> there are students whose performance on such assessments is not a good signal of their intellectual ability

Is there a form of assessment that is a good signal of the intellectual ability of all students?

[warumdarum]

Fruit of labor? Good students of science produce novel science..as in testable ideas without precedent.. a thing llms struggle with, as they at best can interpolate and mash up previous ideas

[recursivedoubts]

I agree and would like to move towards a customized computer setup like you mention. A friend at Berkeley manages a similar setup. Unfortunately Montana State is too small to have set one up yet.

[sourcecodeplz]

so let say you give the students a pop-quiz. is that not acceptable anymore because some students don't do well when surprised?

[mlloyd]

Acceptable is different from being an accurate assessment of knowledge. The question is what is the teacher attempting to measure?

[softwaredoug]

I think most teachers have adapted pretty well. I'm really surprised to find teachers that haven't reckoned with possibility of AI cheating in 2026.

In person writing, etc. But also for anything take home students have to verbally discuss their work in some fashion. Seems to mostly work. Students still us ChatGPT as a search engine, which seems fine.

(Source: married to a professor. And my son is in high school)

[Lerc]

Why hand written?

Wouldn't a one-on-one interview be a better way to establish a broad evaluation of competency.

[JoshTriplett]

> Wouldn't a one-on-one interview be a better way to establish a broad evaluation of competency.

1) Possibly, depending on the material, but most classes aren't looking for a "broad evaluation of competency", they're looking for the specific material taught. It'd make more sense as a graduation requirement: the equivalent of a dissertation but for undergraduate work.

2) Even in small classes (e.g. 20-30 students) that wouldn't scale, let alone the massive courses earlier in a curriculum or that are shared by many degrees (e.g. hundreds of students).

[userbinator]

I think suspected cheaters should be subjected to an interview.

[panicinducer]

Maybe not everything needs to "scale"? You're asking each student to spend well over 100 hours in lectures and study for each class. Surely you can find 20 or 30 minutes per student for evaluation.

[JoshTriplett]

Please by all means direct more funding at universities, hire several times as many professors, and have them each teach half as many classes with a fraction of the students. The result would absolutely be an improvement.

(That said, any kind of subjective assessment has its own pile of hazards compared to objective assessments.)

[Yossarrian22]

I recommend reading this article, there is a very good reason that's not an option for this professor.

[Waterluvian]

Being hand written would be silly theatre that excludes perfectly capable people (like me) who cannot sustain writing more than a few minutes.

Edit: I think we’re actually all agreeing. That a typed exam as an option is perfectly cromulent. I’m just saying the idea that it must be written is silly.

[glimshe]

I don't want to dismiss your limitation, but it's better to create an acommodation for your particular case than to prevent the system from being implemented for everybody else.

[Waterluvian]

Yeah, that’s the way it worked in undergrad for me. People would have hand written exams and the ones that had essay portions I’d do under more careful scrutiny in a different location using their hardware.

[shermantanktop]

Writing by hand for extended periods is a capability.

It was mandatory in an earlier age. Now it has become optional, but it could become mandatory again.

Presumably someone who is unable would get an accommodation of some kind.

[notreallyauser]

Gen Xer here: we coped with hand written exams just fine. Accommodations (extra time and/or a scribe) were available for those who needed them.

[recursivedoubts]

We have a testing center set up for people who require accommodations, another piece of legacy functionality I never expected to use back when I gave my tests online.

[woodruffw]

I don't think it's theatre, in the sense that it is effective for the advertised purpose (preempting AI-based cheating). But it seems to me like there are also plenty of ways to make reasonable accommodations for people who can't do a pen-and-paper exam, such as an offline computer.

[SecretDreams]

All my stem exams were hand written, it's how it should be. The best part is coming out with everyone else already disheveled and then grabbing a drink (or many) after the last one is over. That's some solidarity drinking right there.