If you listen to WAY-OLD blues "singer/ guitar" recordings, you will find them changing meter too...sometimes it was a 12-bar blues, sometimes, 11 and 1/2. lol. Usually when this happened it was by "feel" but didn't sound good sometimes as the "other" players were guessing when they were supposed to start the new form. But, that was a different time, and a different market.
I find that I use odd meters in order to frame melodies. Sometimes odd meters can be used really well. "All you need is love" has an odd-meter verse. 7/4 or 4/4 + 3/4, and it really facilitates the melody.
I worked with a few artists who had seemingly odd meters. One was because they wrote leadsheets incorrectly and didn't know that "pauses" or holds, or fermatas could be written without takiing up beats on the leadsheet. So their melody was well written on verse 1 , but, following a pause, every melody note was offset by a beat in verse 2 (yikes).
Sometimes melodies just click better in odd-meters, sometimes they sound too deliberate. Certainly, a band can't play to an eratic "feel" of a certain person and remain tight (in a pop realm). I would try tearing apart the form as much as possible and writing out a "real" form" so at least everyone knows when to play. Don't let the "hey man, its feel" keep you from being tight.