So, this solved it:
https://support.displaylink.com/know...plication-only
I had tried it before, but it was hanging Ubuntu from starting - something to do with Nvidia Persistence that would hang the boot screen. But anyway, adding EVDI module to boot doesn't hang Nvidia anymore, and I have no idea why.