Books are just books. When you elevate them beyond "book" status you're practicing idolatry. Besides, as a friend once told me, "you're never somebody until you have enemies."
What bothers me is that IMO Tolkien picked up baggage from Dungeons & Dragons, from his fantasy tropes put into the grinder, and from the general stigma around roleplaying games. (Oddly, Gary Gygax consistently played down the influence of Tolkien upon D&D.) As a result, I think a lot of modern consideration of Tolkien's work is marred by after-the-fact events. I grew up playing tabletop RPGs with a very smart group of socially-able people. We didn't fit the stereotype, and yet, it was nearly a dark secret that many of us felt we had to keep. I have the impression that many that consider themselves literati are reticent to embrace or even seriously engage Tolkien's work, either because they were picked on for playing D&D, saw other kids picked on for playing D&D, or they wanted to play, but were too afraid to do it. I know that's a bold and unfounded statement to make. However, in most of what I read, there's usually some off-hand remark about orcs, dwarves, or elves that makes it clear that the author knows that these are not adult things. Oddly, hobbits aren't picked on so much, -probably because their literary function is more easily explained. So, in effect, I'm not defending Tolkien as much as my opinion that RPGs are potentially valuable and legitimate pastimes, and that the stigma around them and Tolkien is unfortunate. exhibit a?: All it takes is to overhear someone saying "They left out the tale of Tom Bombadil!" for me to be delighted I didn't read LOTR. ;)