I think "the thing you are building is too trivial", as a criticism, implicitly expands to "you should be building something more important than the thing you're building". And it's correct to be skeptical of any "you should x" claim from someone who is not xing.