外人は日本語を話すできない?

I've been finding an interesting gai-jin (foreigner) effect today. It seems that Japanese people automatically assume that foreigners don't speak much Japanese. At restaurants or stores, when I start to speak in Japanese, they seem to have a lot of trouble understanding me, even though I am quite sure that I'm pronoucing things correctly. It seems that they are expecting me speak English or something.