im gonna play devils advocate on this one....Just because I went through this myself.  
From the time I got my first recording software, and a cheap ass computer mic, I was hooked.  I loved the whole process of recording, and "making something from nothing" so to speak.  I would sit at that computer for hours at a time, recording lil bits of nonsense just because it was fun, and I loved learning new things.  So after a while, I knew (or so I thought) that audio was the only career for me.
Until later on when I started recording some other "acts" other than myself.  This was definitely NOT fun anymore.  I didnt feel the same passion as I did when recording myself.  To put it bluntly, their music just flat out sucked-- and I hated listening to it, let alone dealing with it for hours.  It made me not even want to get creative with it, or have the "perfectionist" attitude, like I do with my own stuff.....
...And I thought... "If I'm gonna do this for a living, I'm going to HAVE this problem a LOT." 
...Which you will.  You're not really gonna have the option to "pick" who you record... It wont be a financially wise decision to turn down EVERY single act that doesnt fit your "criteria"... And if you do, you'll go broke...  AND if you're not having fun, and you dread the thought of going into work everyday, then what's the point?
But there is somewhat of a "solution" to this.. (at least in my case)
Think of something ELSE that you have an interest in, and pursue that.  Something that you will love to go into every morning without being miserable the whole time.... And then Just keep on recording yourself, or other acts at home.  Hell, its what you love doing anyway, so what does it matter if you have a "job" as an engineer, or if you only get to do it at home -- either way, its STILL what you love, right?? AND now you have a job with steady income, so you can be as picky as you want with the acts!!  
 
So I'd give it a lot of thought.  I'm not saying that this case scenario will apply to you, or even anyone else for that matter -- that's not really what I'm trying to get at here.  I'm just saying that this is a career decision we're talking about, not some piddly little "what do I wanna do today?" decision. You have to do lots of research, and KNOW for a FACT that this is what you want.
And if you truely KNOW that this is the only career for you, then by all means, go for it!  Don't let anything get in your way of acheiving what you want. 
 
OK, OK, I'm done now. 
 
Peace