Hailey Bieber Celebrates 6th Wedding Anniversary with Husband Justin Bieber: 'Love You'

Hailey Bieber is toasting another year of marriage with her husband, Justin!

On Friday, Sept. 13, the Rhode founder and new mom, 27, shared several posts on her Instagram Stories as she celebrated the 6th anniversary of the pair's initial September 2018 New York City courthouse wedding.

Hailey commemorated their latest relationship milestone with three behind-the-scenes glimpses of their anniversary celebration — which apparently included sweet balloons, candles and an adorable instant camera picture.

The first image shared by Hailey featured three gold, heart-shaped balloons, which were decorated with red hearts and featured the phrase "Love you" printed across the front.

She then posted a short video of what appeared to be the couple's set-up for the night, including several pink candles surrounded by flowers.

Finally, Hailey took a photo of her hand holding up a heartwarming polaroid snapshot that showed herself and Justin, 30, sharing a kiss. The two proud parents could be seen close-up as they locked lips, while the candles from her previous clip appeared in the background.

"6 years🤍💍," Hailey wrote over the image, adding below, "Love you baby."

While Sept. 13 marked the sixth anniversary of the day the model and Grammy winner first tied the knot months after getting engaged in 2018, it's still only been five years since their larger ceremony in Bluffton, South Carolina in 2019 — where they were surrounded by 154 guests, PEOPLE noted at the time.

Last year, in celebration of the anniversary of their first, official wedding, Justin shared a touching post on Instagram, in which he called Hailey "the most precious, my beloved."

"You have captivated my heart. I know from the depths of my soul down to my bones that this journey with you will only exceed our wildest expectations," he wrote at the time. “So let’s keep dreaming big baby. Cheers to forever and ever. I love you with every fiber of my being.”

Never miss a story — sign up for PEOPLE's free daily newsletter to stay up-to-date on the best of what PEOPLE has to offer​​, from celebrity news to compelling human interest stories. 

As the couple now celebrate six years since their wedding, it isn't the only milestone they've been celebrating in recent weeks.

Justin and Hailey announced the arrival of their first son Jack Blues last month on Aug. 23, continuing something of a family tradition by naming their son with the initials ‘JB’ (like Justin, some of his siblings and his father Jeremy Bieber).

The pair have given some insight into their life now as parents on Instagram, where Justin recently shared a snap of a cute "papa bear" coffee mug on Sept. 3, and where Hailey flashed her new "mom" ring the same day.

Meanwhile, their family has continued to rave about baby Jack publicly.

On Friday, Sept. 13, at the People + Chain 50th anniversary party in Los Angeles, Hailey's dad Stephen Baldwin dished about his "cute" new grandson.

After explaining that he was in town “hanging out with my four year old granddaughter Iris," Baldwin shared some info on baby Jack. “And of course, here comes Jack Blues Bieber. And yeah, he's just… I don't want to say too much. He's unbelievably cute,” the actor said, adding that “the world will see him soon.”

Justin's mom Pattie Mallette also posted about the couple's first baby on her Instagram Stories shortly after the Aug. 23 announcement, calling the arrival of the newborn a "miracle."

Just days after the announcement of baby Jack's arrival, a source told PEOPLE that Justin is "already a great dad."

"The pregnancy was something that they very much wished and prayed for. The day they found out that Hailey was pregnant, was the best ever for Justin," the source said. 

"He was over the moon with excitement. It was a big celebration for them," they continued, adding that Hailey and Justin are "both overjoyed" about the arrival of their baby.