Sterile_Technique@lemmy.worldtoTechTakes@awful.systems•Remember how ChatGPT totally aced the bar exam? Wow! yeah, turns out that was just a lieEnglish
64·
7 months agoIt’s more like taking a digital copy into the test room with you and Ctrl+F’ing every question/answer.
I mean you still gotta understand some shit for Ctrl+F to be helpful. If you’ve ever taken an open book quiz without prior study you’ll learn pretty quick that open book does NOT = easy A (depending on the class / prof I guess, but you get the gist).
So, open book Ctrl-F’able bar exam, I could probably get an okay score just on key word matching, not knowing jack shit about law; but it’d be far from a perfect score. Current state of machine learning appears to be in a comparable boat.