Should I only shoutout swap with authors in a similar genre or should I swap with everyone to max out my reach?

Is it better to stick to my own genre of authors?