It's fascinating. You really just didn't want to catch his eye in any way. Eventually, he would find (or make up a reason) to get rid of you.