Of course, there are a few instances where you'll want to avoid using castor oil altogether, like if your skin is inherently sensitive or you are prone to developing styes in your eyes.