Ears held flat can signal fear or anxiety, especially when a cat is crouched, stiff, or trying to hide. Ears that briefly swivel toward a sound are a different movement. When the ears stay flat and the body tenses, stop handling the cat and leave it a clear way to move off.