Josh and Anna Duggar from the former TLC reality show "19 Kids and Counting" are doing their best to rebuild their marriage, but the road to recovery is one filled with challenges.

A new report has surfaced saying that Anna is having a tough time trusting her husband, so she has prohibited him from using any kind of smartphone.

"He isn't allowed to have one of those," a source close to the Duggars shared with InTouch Weekly. "He has a little phone with a tiny screen and he can't send or receive picture messages on it."

Even though Anna's parents have encouraged her not to divorce Josh, it seems like her brothers and sisters do not feel the same way. When Josh recently tried talking to Anna's sister, she gave him the cold shoulder.

"He tried to talk to Anna's sister Susanna, saying he was sorry he hadn't talked to her since everything happened, and it got really awkward," the source explained. "She stopped him and said, 'You don't have to apologise to me. If you'd had an affair on me, we wouldn't be married anymore.'"

Anna's brother Daniel Keller is even harsher on Josh. He earlier called Josh "that pig [Anna] calls her husband" after it was learned that Josh was leading a double life and constantly cheated on his wife using the Ashley Madison website.

Daniel is so disgusted with Josh that he could not even stand being close to him. "Josh tried to sit next to Daniel at a restaurant," said the source, "and Daniel got up and moved to another table."

Josh and Anna's marriage might be in a difficult spot right now, but they are determined not to let it stay that way for long.

"Since the residential treatment program ended, we have been working with a professional marriage and family counselor to take important steps toward healing," they recently wrote on their blog. "It isn't easy and some days are very difficult. It is a long road to rebuild trust and a truly healthy relationship. We are very thankful for God's forgiveness, grace and help, as it is our strength and guide to rebuilding our lives."