Todd Chrisley No Longer Working at Prison Chapel, His Attorney Says

Todd Chrisley, who is currently incarcerated after he and his wife Julie Chrisley were indicted on 12 counts of tax evasion, fraud, and conspiracy, no longer has a job in prison.

The reality star, 55, is currently serving time at Federal Prison Camp Pensacola, where PEOPLE can confirm that he was removed from his job as an Assistant to the Chaplain.

His attorney, Jay Surgent, tells PEOPLE that he was removed from his position due to "associating with inmates" who are part of the prison's Residential Drug Abuse Program.

Surgent says that Todd also lost access to a small office in the chapel where he did his volunteer work and is "very disappointed and upset that he can no longer participate in the administration of the set-up for religious services at Pensacola, which includes Christian, Jewish, and Muslim services."

He tells PEOPLE that Todd feels he was removed from his duties "without cause," but it "has not affected his firm belief that in the end, God will work things out for him, Julie, and his family."

"For privacy reasons, we do not comment on the conditions of confinement for any incarcerated individual, including their work detail assignments," a representative for the Federal Bureau of Prisons told TMZ, which first reported the news.

While the couple was cleared of their state tax evasion charge in Georgia in October 2019, they were sentenced to a combined 19 years behind bars in November 2022. Despite having appealed their case, they reported to prison in January 2023.

After both their sentences were reduced in September 2023, Todd's release date was pushed to June 26, 2032, per the Federal Bureau of Prisons' online inmate search system.

While Julie’s seven-year prison sentence was vacated in June after federal judges ruled that her case had insufficient evidence, her original sentencing was upheld last month after a judge ruled that her original punishment was sufficient. According to inmate records, her release date is now set for April 22, 2028.

Before Julie's sentencing was upheld in September, their daughter Savannah Chrisley spoke about how she expects "the worst" amid her parents' legal battles.

"That's the only dreams that I've had recently. It's just her coming home and her being at home to the point that, like, I wake up and I'm kind of, like, disoriented," she said on the Aug. 13 episode of her Unlocked podcast.

Never miss a story — sign up for PEOPLE's free daily newsletter to stay up-to-date on the best of what PEOPLE has to offer​​, from celebrity news to compelling human interest stories.

"I'm like, ‘Wait. What is happening?’ Because it feels so real," she said. "And I'm trying not to get my hopes up because, let's face it, a lot of things within this legal battle have not gone our way. So I expect the worst, and anything else that is better than that is a win."