Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

tbh the summarized thinking with encrypted raw thinking is there for many purposes; it is there to:

1. make distillation much harder

2. safety: prevent modifications to the thinking leading to injection attacks.

3. also honestly sometimes the model raw thoughts can be deranged and is not a good user experience (consider the varied audience in the market, etc.)

also often the mass underestimate/the model makers over-estimate how people love distilling models



The reasoning blocks are only temporarily part of the context. They aren't part of the context in the next turn anymore so (2) wouldn't really be an issue.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: