You can see who you attract!
Or you can cherry pick your clients and filter who you want to work with.
Many doctors do that automatically by the price they charge for private clients. Others do it by means of filtering out those who fit their speciality. You can do it consciously in many ways. As soon as you do you are in charge who you work with.
It may sound arrogant but when you look at this filtering process closely you will see it's not. it's rather practical and enables you to be around the people you want to be. In my personal career I have found this one of the most rewarding pieces of the puzzle and enjoy now 100% more the people I work with.