Work's just trading in some of your lifetime for money. On one hand might as well trade it doing something you enjoy, but on the other hand if you are paid more then you can trade less of it for the same money.
Switching to another career and not making much money doesn't seem sensible. You could stop 5 years earlier and have the same money, but much more lifetime left.
Also watch that when you chase something you enjoy as a job, it can stop being fun quickly.