A kidney infection can bring on fever, chills, upset stomach and vomiting. It also can lead to pain in the back, side, groin or belly. Peeing may cause a burning feeling or pain. A person may need to pee often, and the urge to urinate may feel strong and long-lasting. The urine may contain pus or blood, and it might smell bad or look cloudy.