Native English speakers are PISSED at me when they learn I don't speak English.

I've been in Canada for over a year and I still don't speak English. I've done everything I could but I could still only know basic things. I can't understand anything from audiobooks, television, radio and etc. I get extremely anxious whenever people talk to me in English. I still prefer Chinese to English. I'm so ashamed to be honest.#####Edit: I'm Chinese