Ryan Lochte has survived elimination in Week 2 of Dancing with the Stars.Facebook/Dancing with the Stars

Things might be looking up for Ryan Lochte on Dancing with the Stars, as he has avoided elimination and is one more step closer to winning the Mirrorball Trophy. But last week's incident -- where protesters stormed the Dancing with the Stars set -- affected the Olympic swimmer so much that he thought of quitting the show.

"You know, right after the show I wanted to quit because it hurt so bad," Lochte told CNN on Monday night. His mother was present on the set to watch the show and watching her go through the ordeal was what prompted the desire to quit, he said. Lochte also seemed apologetic for bringing in negativity to the show, saying he cried after two people stormed the stage protesting against Lochte's inclusion in Season 23 of Dancing with the Stars.

"I got teary eyed because ... this show is so classy and so fun and everyone comes together like a family. It's such a good show that I didn't want that negativity," Lochte told CNN.

According to a Radar Online source, several other people associated with the show also wanted Lochte to quit after the incident. "At this point, members of the cast and a lot of people working on the show just want Ryan out," a production insider told Radar Online, adding that they believe Lochte wasn't on the show for the right reasons.

Lochte gained a lot of haters after lying about behind held at gunpoint in Rio and taking part in the dancing reality show was seen as a move to improve his brand, which took a beating after the incident. "Not only that, but he is also one of the most entitled human beings on the planet," said the source. "He has been complaining non-stop since he started, and a lot of people are just over him already."

Dancing with the Stars airs on Mondays and Tuesdays on ABC.