Advice – How can we address couple’s privilege in a quad?

My nesting partner and I are dating a couple together. Recently, I realized that all of our scheduling revolves around the other couple. There are kids and jobs and logistics to consider. How can I address my hurt in a non-confrontational way?