You don’t need to be aggressive, just don’t be a pushover. Aggressiveness is generally unnecessary unless you’re dealing with a grade A asshole, which in that case by all means, be aggressive. At the end of the day having self-respect and confidence will take you further than aggression fueled by your hatred for your stutter.