At least half of the close calls I've had were by men. Some were illegal immigrants, some were on a cell phone, and some were trying to shave/read the sports section while driving.
Now that I commute on the train everyday, it's hardly a factor for me anymore.