I agree, no filler in GoT. I keep comparing to Walking Dead because it's the only other current show I watch and because they're both based on books, which would normally provide the amazing advantage of knowing where the plot is going a long time in advance instead of the rest of dumpster shows on TV where writers just make shit up as they go from season to season. Unfortunately I think Walking Dead still fell into the hands of dumb ass writers that usually have no idea what's gonna happen the following year and it shows.
Another thing I like about GoT is that the writers/creator don't use tool characters, tool is just what I call one dimensional character written and forced in the show to serve a sole purpose before dying or leaving, like the woman Tyrese fell in love with for an episode then got killed to turn Tyrese from a peaceful dumbfuck to a raging dumbfuck, there are usually at least one tool per Walking Dead season. Although a case can be made that Robb Stark's wife was a tool to facilitate the breaking of his oath to Walder Frey and all the consequences of that.
A thought on the subject of the show's pace going faster than the books: if HBO was to respect the epic that it introduced to us and how worthy the wait shall be; they wouldn't rush Martin to finish the books cause that will undoubtedly reflect on the quality of the writing so I think the best case scenario is for GoT to go on a year hiatus or even two if it needs to, to allow Martin to finish the books comfortably, I know some fans will be pissed off but I think waiting is better than any compromise on this epic, people wait on movie sequels just the same and I would appreciate and respect that action.
I do trust and like the two show running guys but I can't tell if they could really go into "make stuff up on our own" mode, even if Martin gave them guidelines on where the overall plot is going.