There should be a universal word which politely means "Sorry, I don't speak your language".

And by saying the word followed by a smile and a nod, both parties agree to avoid an awkward exchange.