Jana Kramer Visited Hospital for Bacterial Infection in Kidneys During Her 'Babymoon'

Jana Kramer is sharing details of a hospital visit she had to make during a trip to Florida.

The country singer and actress, 39, — who in June confirmed to PEOPLE that she is expecting a baby with fiancé Allan Russell — shared an in-depth message on Instagram Sunday, where she revealed that she discovered she'd been dealing with a bacterial infection in her kidneys while she and Russell were on their "Babymoon."

Alongside photos of herself and her fiancé in hospital rooms during their Florida getaway, Kramer wrote that while their baby is "good," the celebratory trip came with "some lessons learned."

"Part one….Well. Our babymoon didn’t go as planned but there were some lessons learned. First off and most important, baby is good♥️," she began the post's caption, before telling her followers they could hear his "sweet heartbeat" within her carousel post.

She then continued, "The back pain I’ve been dealing with for weeks wasn’t just back pain. Lesson number one…don’t just brush off pain, because it can be more serious than u think. So many times (moms especially) just brush off pain because we are the last ones to take care of ourselves."

"When I posted about my back hurting a week ago I just had chalked it up to pregnancy and didn’t tell the doctors because back pain is 'normal' so 'don’t be a wimp' is what I thought," Kramer added.

"Then someone very sweet in my dms sent me a message that it could possibly be my kidney. (I’ve since thanked her for her dm💜)."

Kramer then shared that she still boarded a plane to Florida as to not "ruin" their trip, but when they landed, she went to the hospital as she "couldn’t handle the pain anymore."

"Long story short it was a bad bacterial infection that got into the kidneys. This resulted in a 2 day stay in hospital and antibiotics because I let it get passed where I should have," she wrote. "So. Lesson. Listen to ur body. Ur not a baby or inconveniencing people. If u hurt, talk to ur doctor."

The musician then shared some words of advice for her followers: "Leaving things for too long or not taking care of yourself when ur not feeling good can become very serious," she wrote.

"Also shout out to this amazing man who I begged to go sleep at the beautiful hotel he got for us but instead slept on a pull out chair," Kramer added of Russell.

"*Tip... Find u a man who doesn’t make u feel bad or leave ur side when ur not feeling good. Shout out to the nurses at Good Samaritan hospital in West Palm. Y’all were the sweetest. Xx"

Alongside her message, Kramer shared several photos of her in the hospital, including one shot where she cradled her bare baby bump. Also featured in the carousel was a video that showed the musician lying on a hospital bed as she recorded the sound of her baby's heartbeat, as well as photos of Russell both standing close by her and wrapped in a blanket on a chair next to her hospital bed.

Kramer later uploaded another Instagram post which featured images of her on the beach in Florida, drinking out of a coconut and kissing Russell in front of the water.

"Part 2: Upside of not feeling good in Florida…this view," she wrote in the post's caption, adding, "Though it was only one day to enjoy it we soaked up every minute. I love you @superiorstriker."

Kramer — who shares daughter Jolie Rae and son Jace Joseph with ex-husband Mike Caussin —opened up to PEOPLE last month about her third pregnancy, as she revealed at the iHeartRadio Music Festival in Las Vegas that while her latest pregnancy had been "harder," she was still finding it "great."

“Obviously it's been a little bit harder. I’m just a little older and this is my third kid,” Kramer said. “Things are a little different now, but it's great. I'm just so blessed. I didn't think this would be possible, so it's a beautiful, beautiful thing.”

Never miss a story — sign up for PEOPLE's free daily newsletter to stay up-to-date on the best of what PEOPLE has to offer, from celebrity news to compelling human interest stories.

The musician and Russell got engaged in May after nearly seven months of dating, and announced their baby news exclusively with PEOPLE the following month. Her former soccer player fiancé is also father to a 16-year-old son.

“I'm giving people hope that you can have a happy ending,” Kramer told PEOPLE at the time. “I remember being in my bed two years ago being like, ‘I'm never going to be loved again, it's over for me. Who will ever want me?' "

"Now I'm the happiest and I have so much love in my life, and it's not just because of my fiancé and my kids, but it's because I finally started to love myself and have that journey," she added.