The fact that this album is so complex and has so many layers adds to the appeal IMO.
Some music you can listen to and immediately understand the concepts and ideas. Not to say that's bad. Some of my favorite songs are like that.
But, with jigsaw puzzle raps like this, it requires you to think. At first it may sound like just a bunch of words that rhyme well together, but then when you listen again, you catch something new and it's like
Then you go online and read the theories and breakdowns and it's like
Then you give the album another listen and it starts to come together
I can see why someone who just gives this a superficial listen might find it unappealing, but for me, it gets better each time I listen again and find something new to appreciate