What makes some psychedelics more psychedelic than others?

So say you have 2 of the most popular psychedelics, lsd and shrooms. They just seem to have different effects on the brain. It just makes me wonder what is it in those drugs that makes them act the way they do. It's obviously all related to serotonin and dopamine but there's more to it than that right? Any thoughts