NOOOOO
Most swingers are working class people in their 40's who are already grandparents. They are stuck in the boring and sparkless marriages they got into, for "the kids" and now they are absolutely bored out of their wit. Their jobs are traps and they are still too young to retire, but lack the intellectual curiosity to actually return to school, or learn new skills or make new friends.
Sorry to burst your bubble.
Doctors, lawyers, business people, ... those folks just cheat if they are going to cheat. High end people might even have a house on the side that their wives may or may not know about. But they aren't wife-swapping and that kind of foul stuff.

