A lot of us have similar issues. Depending on where you live, and the appropriate ordinances, there ARE rules regarding decibel level of outside noise. It is obviously higher during the day, but in if you live in a strictly residential neighborhood, there typically are time limits.
For example, I live under county ordinances, as I live in an unincorporated area outside of city limits. When I first moved in (we are one of two centered houses on a cul-de-sac), things were fine for a while. No real noise problems except for barking dogs. I looked up the appropriate statutes, spoke to the owner, understood their issue, but pointed out the dog was by my bedroom window (less than 10 feet away, even with a fence it doesn't matter). They moved the dog to the other side of the house, and set up a fenced in runner so the dog could be over there. That worked out better.
But over the years, the house sold, and the dude who bought it gutted the entire place before actually moving in. He decided, in his stupidity, that it was OK to use power tools and make a ton of noise in this house and outside on the patio in his back yard after he got off of work at 730, and work until midnight, 1 a.m. After saying something a couple of times, I looked up county ordinances, and it says very clearly, no power tools, no noise over XX decibels past 7:30 p.m. (Note: I did understand his issue -- he works, trying to get house done, I get it -- but at the time, I had an infant whose bedroom was right next to where he was working). I went outside one night at 11:30, confronted him (back yard, he was on the patio using a power saw). He told me to go fuck off. So I printed out the code ordinances. Duct taped them (highlighted) to his door, along with a note that the cops had been called, and went home. The noise stopped.
The next day was Friday. That night, I got home, and I walked over there, where his wife was. He came out, sheepishly with her, and said they don't want any issues, we're neighbors, and they were sorry. but they do need to work on the house. So I told him I get it, but if you are going to run power tools, you either have to do it inside so it doesn't wake us up, or do it during the daytime. He didn't like it, took him longer to get his house done, but he complied.
Now, six years later, we're on good terms. He still is a moron (cuts his lawn in the dark -- idiot), but he means well. He's just not the sharpest tool in the shed. But he tries hard to be a good neighbor, and I reciprocate.
Moral of this long ass story is -- sometimes you gotta call people out on the carpet and stay on em until they realize they aren't going to "win." If this dude has a drum set, and plays it in the daytime, that's his business unless the decibel level is higher than what's permitted where you live. If it is, look up those code sections, print them out, highlight them, and hammer on him. If he refused to comply, continually call the cops (they make a record each time you call). Ultimately, you'll win if you stay on it. It sucks, but that is what this world is nowadays -- people are assholes who think they can do whatever they want whenever they want it. And that simply isn't true.
Sorry you have to deal with it man. But you're not alone. You just gotta step up your game to get it to stop.