I'm a little bit freckled aswell and I'm no ginger (non of my known ancestors is), so these two things aren't exclusevly related though the often are. What makes you think Neanderthals are involved?

I read that Neanderthals were red-haired but brown-skinned. They had mixed with the modern man.