Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Part of the concern might be that visual reasoning problems are overrepresented in ARC in the space of all abstract reasoning problems.

It’s similar to how chess problems are technically reasoning problems but they are not representative of general reasoning.



ARC is meant to test fundamental algorithms. It's entirely ok to train a model specifically for this task. Part of the beauty of ARC is that it's resistant to memorization.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: