Sweet setup
You need DRM-compatible drivers for the GPU to work with DisplayLink. (so, proprietary drivers are unlikely to work fine - but maybe someone will give you some workarounds that would work).
Also, the kernel module is not signed, so you will need to disable secure boot or sign the module yourself.
Cheers,
Michal