Yes. I would. It may ruin some of the enjoyment, sure. But at least I’d have a job that I hold a passion for. So even if that passion diminishes, I’ll likely be good at the job and enjoy aspects of it. Better than needing to work a job with no passion from the start, because any job will grow boring or tedious, given enough time.
However, this is contingent on pay. I’d need to at least get as much comp or better comp than I do in my current career, or else I’m not taking that risk. If you offer me insanely good money? Hell yeah I’ll hop into my hobby.