It depends, of course, if you're talking as a botanist or as a cook. It's one of those words with multiple levels of truth.

Same with tomato - it's a fruit botanically, but in culinary terms it's a vegetable and definitely not a fruit. As long as you get your context right, you won't have problems communicating :)