Once upon a time, Caitlyn Jenner took on the role of stepfather to the Kardashian brood when she married the widowed Kris Jenner.

Back then she was still Bruce, and she had seemed to have an amicable relationship with her step children long before the entire clan became stars of their own reality series.

But like almost everyone else who has had gotten into a romantic relationship with members of television’s self proclaimed “first family” of reality shows, things seem to be going south.

A source has told US Weekly that Caitlyn’s relationship with Khloe, Kim, and Kourtney Kardashian is “strained… all three sisters feel there should have been an ‘I’m sorry’ moment from Caitlyn,” the insider says, referring to the aftermath of the 2015 Vanity Fair cover story, wherein the Kardashians felt that Caitlyn had been duly unfair in her statements towards their mother Kris.

Of course most children would speak out in defense of their mother. In a Howard Stern interview this January, Khloe had said that Caitlyn may have not been honest with Kris when it came to her transition. Speaking out may have added to the cracks in their relationship with Jenner.

“Khloé is scorned and they never had a real resolution after their initial fight after the Vanity Fair article, nor after the fight resulting from the Howard Stern interview,” the insider pointed out.

Kim who was supportive of Caitlyn during her transition is also no longer on speaking terms with her former step-dad. “Kim is not as close to Caitlyn anymore; she was after she first transitioned but as things came out and Caitlyn stayed unapologetic, the relationship got more and more strained,” the insider said. “Because of how things played out with Bruce and with Caitlyn, she is reluctant to have a serious relationship with Caitlyn.”

As for Kourtney, the Insider explains that she wasn’t really close with Caitlyn to begin with and thus “doesn’t really get involved.”

This hasn’t negatively impacted Caitlyn’s relationship with her two daughters with Kris though. This father’s day, Kendall and Kylie Jenner both shared messages about their father on social media.