Using lotion can help prevent ingrown hairs. Right after finishing your shave, apply a shaving lotion. Dry skin is another common cause of ingrown hairs. Doing so will extract current ingrown hairs, and prevent future occurrences.