New Mom Hailey Bieber Supports Husband Justin as He Appears Onstage During Don Toliver Concert in L.A.

Hailey Bieber stepped out to support her husband Justin Bieber!

On Saturday, Oct. 19, the new mom, 27, was seen having fun at Don Toliver’s Los Angeles concert —which saw Justin make a surprise appearance on stage — with her friend Lori Harvey. 

During the show, which was held at the Crypto Arena, the rapper was joined onstage by surprise guest Justin, 30, for a live rendition of their song "Private Landing" from his 2023 studio album Love Sick. The hit track also features Future.

Justin appeared on the stage in a white beanie, black hoodie and black glasses, as seen in a clip shared by Harvey, 27, on her Instagram Stories on Oct. 19. The "Love Yourself" singer stood on the opposite side of Toliver onstage as he danced to the song while holding his microphone in the air.

"Make some noise for f------ Justin B," Toliver was heard saying.

Toliver, 30, is currently on his Hardstone Psycho tour that continues with stops in San Diego; Austin, Texas; and Atlanta. Performing alongside the headliner are artists Ski Mask the Slump God, Molly Santana and Monaleo.

Harvey also shared another clip featuring Hailey and another friend dancing during Toliver's show on her Instagram Stories. In the video, Hailey wore an oversized leather jacket, black glasses and her hair pulled back into a messy bun with face-framing pieces falling on either side.

The Rhode founder danced along to the musical performance with both hands held up to her chest as she swayed to the beat. 

Hailey and Justin's night out comes almost two months after they announced the arrival of their first child, son Jack Blues Bieber, on August 23. Justin shared the news in sweet post on Instagram that featured an image of the newborn's foot.

"WELCOME HOME JACK BLUES BIEBER," he wrote in the caption. 

In September, a source exclusively told PEOPLE that the couple are "more in love" following the birth of their son and after celebrating the sixth anniversary of their September 2018 New York City courthouse wedding.

"They seem even more in love since the baby arrived," the source said.

The insider added that the Rhode founder is "feeling great" and that her husband is "encouraging her to catch up with friends." 

Hailey has "been out a few times without the baby," the source said. 

Meanwhile, the insider noted that Justin has "been in a happy bubble since baby Jack was born” and said that the Grammy winner "wants to focus on being a great dad and husband."

Never miss a story — sign up for PEOPLE's free daily newsletter to stay up-to-date on the best of what PEOPLE has to offer​​, from celebrity news to compelling human interest stories.

On Oct. 1, Hailey shared a pic on Instagram of a piece of jewelry she has that is dedicated to her firstborn child. The snap showed her wearing a gold chain with "JBB" arranged in bubbly letter pendants encrusted with gemstones as a nod to her son’s initials.

The baby's name continues a family tradition for the Biebers, as he shares his initials with his dad, his grandfather, Jeremy Bieber, and a few of Justin's siblings.