What do people mean by "It's not that deep"?

When I ask, the best answer I can get is "it's not that annoying" but I would like to instead know the full phrase's meaning.