I suppose when you say English as spoken in England, you are referring to Queen's English or BBC English. I have heard some people from England speaking English which is very hard to understand, both in accent and words. And, yes, while it's true that we cannot just say one accent is the right one and the rest are wrong, we still have to maintain some kind of standard to go by. Just as an example, the people in Singapore speaks a dialect of English called Singlish. Although that's the way they speak English in their country, I don't think it's desirable to teach that to the students, especially those who are learning it as a second language.