He can say what he wants, is the thing. When you reply to a "why didn't you take the job with us?" feedback request, you can be as succinct/diplomatic as you think is appropriate. The OP did the same.