Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

There was a test and a very useful golang error that literally explain what was wrong. The model tried implementing a solution, failed and when I pointed out the error most of them just rolled back the "solution"


What exact models were you using? And with what settings? 4.6 / 5.3 codex both with thinking / high modes?


minimax 2.5, kimi k2.5, codex 5.2, gemini 3 flash and pro, glm 4.7, devstral2 123b, etc.


Ok, thanks for the info




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: