Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

In practice you have to scale data to [-1,1] or [0,1] for a neural net anyway, right? (Depending on the kernel function.)


Another common method is to scale to mean 0, variance 1. In my opinion this makes more sense since it handles outliers a bit better-e.g., consider a case where most of your values for a feature are scaled from 1 to 10 but there's one point with value 1,000,000.


I agree that you SHOULD normalize/scale data before running neural networks and autoencoders.... and this resolves the units issue in most cases (unless measurements in some units are non-linear functions of measurements in others).

But this scaling also resolves the issue for PCA. So, I don't see much difference between autoencoders and PCA with regards to original post's "dimensional invalidity" concern.

If anything, the scaling options you mention suggest "dimensional invalidity" isn't a big deal in practice for either method.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: