Jaden Norman@lemmy.world to Technology@lemmy.worldEnglish · 5 months agoAI agents wrong ~70% of time: Carnegie Mellon studywww.theregister.comexternal-linkmessage-square109fedilinkarrow-up135arrow-down11
arrow-up134arrow-down1external-linkAI agents wrong ~70% of time: Carnegie Mellon studywww.theregister.comJaden Norman@lemmy.world to Technology@lemmy.worldEnglish · 5 months agomessage-square109fedilink
minus-squareKnock_Knock_Lemmy_In@lemmy.worldlinkfedilinkEnglisharrow-up0·5 months agoThat looks better. Even with a fair coin, 10 heads in a row is almost impossible. And if you are feeding the output back into a new instance of a model then the quality is highly likely to degrade.
minus-squareLog in | Sign up@lemmy.worldlinkfedilinkEnglisharrow-up0·5 months agoWhereas if you ask a human to do the same thing ten times, the probability that they get all ten right is astronomically higher than 0.0000059049.
minus-squareKnock_Knock_Lemmy_In@lemmy.worldlinkfedilinkEnglisharrow-up1·5 months agoDunno. Asking 10 humans at random to do a task and probably one will do it better than AI. Just not as fast.
That looks better. Even with a fair coin, 10 heads in a row is almost impossible.
And if you are feeding the output back into a new instance of a model then the quality is highly likely to degrade.
Whereas if you ask a human to do the same thing ten times, the probability that they get all ten right is astronomically higher than 0.0000059049.
Dunno. Asking 10 humans at random to do a task and probably one will do it better than AI. Just not as fast.