Most native and fluent Japanese speakers use informal gender-specific forms in daily speech.
Foreigners who are learning Japanese as a 2nd language tend to speak in more gender-neutral, polite forms... even in situations that wouldn't require a high level of polite speech. That's because, for the sake of simplicity, most textbooks teach a standardized form of moderately polite, gender-neutral Japanese. Since women use more polite forms, even in informal speech, this can make some men sound femenine when speaking Japanese.
"watashi", however, is not necesarily a feminine term. It's merely a polite one.
The reality of the situation is that foreigners overuse certain forms of speech anyway (including the personal pronoun). In most informal conversations, it's perfectly fine not to use a personal pronoun at all, as long as it's obvious that the subject on which you're speaking is yourself.