Why is it difficult for me to understand english, i spent 4 years trying to understand it didnt work why ?

i have trouble to get used to the street english, when people are talking i don't get it at least it's hard to keep track of everything. but i do understand everything my english teacher tell me. are there two kind of english ? i am living in ottawa i really need some help