I'm only 19 so I feel like my real world experience is lacking compared to others, but my goal in life is just to be happy. If what you are doing now doesn't make you happy, then don't stay. Plus, a change of scenery is always nice. Oh, and I've been to Charlotte a few times for ACC Championship games and I love it up there. It's nice.
But all in all, I don't think you should keep going with something if you think you can be happier elsewhere.