Sometimes, when you think he has crossed the line, stand up to him and put a stop to his aggressiveness. Be brave and show him that no one can mess with you.
This will either scare him because he is a coward, in which case you don’t need him, or it will make him realize that you know how to stand up for yourself, which will make him respect you even more and hopelessly fall in love with you.