Tom Sandoval is facing a new reality in the aftermath of his affair with Rachel “Raquel” Leviss being exposed and his friends taking sides in his breakup with ex Ariana Madix.

On Tuesday’s episode of Vanderpump Rules, Lisa Vanderpump expressed concerns about the Schwartz & Sandy’s co-owner’s mental health after he confided in her about having suicidal thoughts at the height of Scandoval.

The SUR owner told Scheana Shay and Lala Kent that Sandoval, 41, is in “a very dark place” amid the public outcry over his affair. But, the ladies stopped short of giving him their sympathy when Scheana said her former friend was “diving into this villain energy.” 

“My conversation with Sandoval last night could not have been more frustrating,” she said of the conversation during which she called him a narcissist, which Sandoval denied. “He’s taking no accountability for anything that he’s done, so Lisa saying he’s depressed [when] I haven’t seen that. I’ve just seen him project.”

However, Lisa, 63, insisted that Sandoval is “a shadow of his former self” as he attempts to move forward with his life following the scandal.

“I don’t ever want to see anyone go down the path of that kind of depression when you feel the whole world’s against you… There’s only so much one person can take before they break,” she shared. “I don’t want to be in a position where we have regret.” 

The issue hit close to home for Lisa as her own brother Mark died by suicide in April 2018.

“I never thought suicide would touch my life,” she shared of her brother’s death. “When I look back at my brother saying he was depressed, it’s a real trigger for me because he was depressed and where is he now? Tom Sandoval is not the kind of person that says he’s had suicidal thoughts unless he means it. ”

Scheana, 38, and Lala, 33, found themselves at crossroads as Lisa encouraged them to forgive Sandoval but they worried it would come at the cost of “losing Ariana.”

“Ariana made it very clear,” Scheana said in a confessional. “Anyone who chooses to remain friends with Tom Sandoval is basically dead to her, but at the same time, if someone is really struggling at this level, how do I keep coming for him?”

Meanwhile, Sandoval told his friend Billie Lee that the scandal has caused him to be “really stressed out, depressed, [and] overwhelmed.” He added he now feels like an “outsider” with his group of friends, adding, “I feel like Andy Dufresne when he first gets to Shawshank.”

“I wish I could get back some part that resembles my old life. It’s always the people that are closest to you that seem to hurt you the most,” he shared.

Later in their conversation, Sandoval admitted he “got close a couple of times” to ending his life. He added, “When you get in that frame of mind. I had to really snap myself out of it. There was all kinds of feelings in my head — pain, anger, sadness, depression, [and] bleakness. I lost all of my friends and I felt like maybe the best way to show that I’m sorry and kind of what everybody wants is for me to go away.”

“I just want to be happy again. I don’t feel like I’m allowed to get there,” he added as Billie told him he would get there with time.

At James Kennedy’s pool party, Ariana was quick to shut down Scheana’s concerns about her ex’s mental well-being, saying, “I can understand that maybe he has had some thoughts and feelings, but like those thoughts and those feelings are based on the situation that he created, in which he didn’t give a f— about anybody else’s mental health. I know I’m a bitch saying this, but like, it just feels a little bit annoying.”  

She added Sandoval is a “scary f—ing person that I don’t trust any word that comes out of his mouth because it’s constantly changing and it all, to me, feels like manipulation.”

However, Tom Schwartz was still hopeful that Sandoval could make amends with the group. Schwartz encouraged Sandoval to “leave your ego” behind before their trip to Lake Tahoe, where Lisa was opening her new restaurant Wolf by Vanderpump. But, Sandoval was still pointing the finger at Scheana and Lala for using the affair to their benefit, including podcast content and merchandise.

“Lala and Scheana showed the entire nation how to treat us,” he claimed. “People followed their lead.” 

“This energy is not going to serve you well,” Schwartz countered. “You got to put down the guard a little bit. I’m not saying you have to let people walk all over you and abuse you.” 

“His tone of ‘they don’t know what they’ve done to me,’ it worries me,” he added. “I don’t want to undermine his feelings, but I don’t think it’s going to be productive.”

Despite the conversation, Schwartz maintained a positive outlook about their upcoming trip, saying in a confessional, “I’m optimistic about this trip to Tahoe but do I expect it to miraculously cleanse everyone’s memory? No, of course, not. But, I’m hoping it opens up the door a little bit.”

He then tried to reassure Sandoval, telling him, “I think people are in place where they’re ready to talk without necessarily coming after you.”

Never miss a story — sign up for PEOPLE’s free daily newsletter to stay up-to-date on the best of what PEOPLE has to offer, from celebrity news to compelling human interest stories.

Vanderpump Rules airs Tuesday at 8 p.m. ET/PT on Bravo.

If you or someone you know is considering suicide, please contact the 988 Suicide and Crisis Lifeline by dialing 988, text “STRENGTH” to the Crisis Text Line at 741741 or go to 988lifeline.org.