Most of the important stuff is in busybox and gcc (maybe Python.) Cache those and their dependancies and you have most of what you want.