Also Bostonian here. I think the other problem with Brutalism in urban contexts is that is very non-contextual and very imposing structurally. It really announces itself much to the detriment of everything around it.

On the other hand I find Brutalism architecture that sits in contrast to wide open fields or a hillside to work very well.