@millihertz There was an X server that could use generic framebuffer devices, maybe you should try that.
Here: https://xfree86.org/current/Xfbdev.1.html
With Xorg they've made it all modular, so I'm not sure how to do that anymore, maybe you should make a xorg.conf and set the driver to be used to framebuffer driver explicitly in it 🤷
@m0xee unfortunately i need Xorg for its direct rendering support... also i'm not sure Xfbdev is maintained (although i did make a bootdisk with it on at one point)
no matter, though, it's (somehow) working now...