Teething happens when the baby's teeth are starting to grow out of the gums. Your baby can be irritable due to the soreness from it. Using a clean moist washcloth or gauze to wipe your baby's gums clean once a day can help alleviate some of the soreness that occurs from the teething. This method is recommended for daily oral hygiene of infants as well. Teething is not known to cause fever.