Does visual world paradigm work?

Visual world paradigm is used to test the way we comprehend language, and is done by tracking the eye movement of a person. I believe that this method does not work, simply because what we think is influenced greatly by a society, and not so much by language alone.

For example, if we say "the man bit the..." naturally we would think of food. If the phrase "hot dog" was added after that, if we use proper english hot would refer to the dog, and the man would be biting a dog that is hot. However, society influences us and we know that a hot dog is in fact a kind of food. As such, we cannot use visual world paradigms to test the way we comprehend language, as there are other factors affecting it.