Yea, I looked at it a bit more and it's a bit of a mess...
Gnome-icon-theme in turn requires other stuff, unless going for an earlier version, and poppler needs to be upgraded as well.
And that might be only the beginning, if one wants to have all the functionality (because it supports other types of documents through other libs).
I'll call it quits for now.
I'm sure it will be much easier with VL 6.0, with the newer libs in place.
One promising pdf viewer was epdfview, which does not require gnome libs.
But development on that seems to have halted, and last time I tried it, it was way to slow for long documents.