Without spoilers, how much should I prioritize the main quest?

I accidentally joined a faction and I hate it when the characters are in a hurry for me to complete their quest and I'm doing other things.

The main quest doesn't seem as urgent as this faction, is what im trying to say. (I don't wanna name it just in case)

But then I also heard that once you finish the main quest something happens so idk!