Getting rid of gender flag [fixed]

I am trying to get rid of the gender flag female for a hair so it is male only. But it won't let me. I can uncheck it, click apply all swatches and then save. But when I reopen again it is still for both genders.

Already fixed. Found out I had to delete the first swatch.