Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

I found this to be inaccurate, I can run OSS GPT 120B (4 bit quant) on my 5090 and 64 ram system with around 40 t/s. Yet here the site claims it won't work
 help



Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: