It appears THIS problem is not entirely under your direct control but there are certainly things you can do to make it more likely he'll give up on the staring and start a conversation with you.
3 Reasons Why Men Are Attracted to a Woman’s Breasts
Not knowing what to say, how to say, how to act, or basically how to approach a woman we're attracted to which causes us to overthink, become nervous, and freeze up internally.