If only there were dedicated cycle lanes for them to cycle in so you wouldn't have to "pull out or swerve around them".......
But those dedicated cycle lanes come at the expense of roads lanes or already hard to find car parks! If someone could magically take cyclists off the roads WITHOUT doing anything to further reduce the space available for cars, I'd happily support it. Unfortunately that's not the reality, it comes to "room for cars" or "room for cyclists" and I'm going to pick cars every day of the week.
Those road lanes and car parks come at the expense of dedicated cycle lanes! I want to be able to cycle to a house/shop but instead of cycle lanes, there are precious parks where single occupant vehicles can sit for hours at a time, serving a small number of drivers vs dozens/hundreds of cyclists.
See how your argument isn't what you thought it was?