So I was listening to a podcast called The Deployment Zone and they talked about this very issue. The Deployment Zone » Episode 13: The Ultimate Showdown
One of the hosts said the fuzz is caused by the paint particles partially drying before they hit the model. Essentially I was spraying too far away from my model. I was spraying from about 12 in away. The can gave no directions about distance.
The hosts on the show rattled off the following spray distances by primer brand.
Armory - approx 8in away
Army Painter - approx 8in away
Citadel - approx 12in away
Krylon - approx 15-16in away
Rustoleum - approx 15-16in away
They also mentioned that the propellent in some spray cans will etch the plastic if sprayed too close to a model. I'm gonna test the theory this weekend.
Thanks for the advice!