Hailey Bieber Bares Her Baby Bump in Never-Before-Seen Photo from 'When Jack Was in My Belly'

A few weeks after welcoming her baby boy, Hailey Bieber is looking back to when she was pregnant.

On Friday, Sept. 20, the Rhode founder, 27, shared a black-and-white photo to her Instagram Stories of herself leaning against a wooden fence in the middle of the field. Wearing a white cropped long-sleeve shirt and a pair of underwear, Bieber bared her bump and stared off into the distance.

"When Jack was in my belly 🥺😭," Bieber wrote across the never-before-seen snap.

Hailey welcomed her first baby, son Jack Blues, with husband Justin Bieber, 30, in August.

Never miss a story — sign up for PEOPLE's free daily newsletter to stay up-to-date on the best of what PEOPLE has to offer​​, from celebrity news to compelling human interest stories.

"WELCOME HOME JACK BLUES BIEBER 🐻," Justin wrote in an Instagram post on Aug. 23 that showed his wife holding their baby boy’s tiny foot. Hailey also posted the same photo on her Instagram Stories with the child's name and a teddy bear and blue heart emoji.

At the time, a source close to Justin exclusively told PEOPLE that the couple was “overjoyed” by their new arrival. 

“The baby is such a miracle. He's adorable and doing well," the source said. "Hailey's doing well, too."

The source added that the musician is “already a great dad” and becoming parents is something the pair “very much wished and prayed for.” 

"The day they found out that Hailey was pregnant was the best ever for Justin,” the source continued. “He was over the moon with excitement. It was a big celebration for them."

In early September, Justin shared his first Instagram post since welcoming his son, highlighting his new dad-themed mug.

In one photo from the carousel, the musician showed off his coffee mug featuring a cute cartoon bear wearing a bowtie and holding up a heart. "Papa Bear," the mug read, with bear paw prints on either side of the new dad nickname.