I believe I’m aphantasic and I still enjoy books. I think about the things described. To go the other way, I read recently that the author of the Witcher books doesn’t “see” the things he’s writing, it’s pure text description for him but his books are still great.