How did the brief flash of political unity following the September 11th attacks not lead to better things?

It was the first time in my memory that the left and right were capable of coming together for a unified cause, with people on both sides condemning the attacks. There was widespread international support as well. I'm not saying the US shouldn't be faulted for how it responded, but I'm surprised that the attacks didn't lead to greater political cooperation.