Brush away! Bit of dry skin can be gently brushed away by using a clean toothbrush- just don't be too vigorous!
It's also important to moisturise your lips regularly, expecially in winter, so get the lip balm out ladies! You don't have to break the bank, brands like Vaseline and Carmex are ideal and are very effective.
For a more intense moisture-hit, layer your lips in vaseline before bed then hit the hay. You'll wake up with wonderfully soft lips!