You may consider dropping the GUI login manager altogether and going straight to terminal login with an automatically started x session if you wish. Not sure that's going to make a huge difference, although if you find that works, should be able to remove any login manager packages present on the system too. You may use this guide to set that up https://wiki.archlinux.org/index.php/Start_X_at_Boot
It's for arch linux, but the instructions should work on VL too, just make sure you reference the correct paths.
I use this setup personally
~/.bash_profileif [[ -z $DISPLAY ]] && [[ $(tty) = /dev/tty1 ]]; then
# Could use xinit instead of startx
#exec xinit -- /usr/bin/X -nolisten tcp vt7
That will boot you to the normal text login, you enter your name and password, and if you are working on the default terminal, it will fire up your x session. If you need to work on text mode only, you can press CTRL+ALT+F2 to get to tty2 and you will remain in text mode.
Your ~/.xinitrc may need a little tweaking to get your current window manager setup, but it should just be a matter of finding the line that starts the default desktop and replacing it with "exec ck-launch-session dbus-session icewm-session"