Pet question

Is there a specific point of diminishing returns where it’s no longer worth upgrading pets past a certain level to gain a boost in power from their passive boost or is it more of a focus on your main pets but always upgrade the other pets as you go along and as you gain resources ?