It's strange, because I'm currently using the 5.4 driver in Kubuntu 20.04 with kernel 5.4.0-80 successfully.
Perhaps a failed dkms installation?
You may try to boot with the 5.4.0-80 kernel, then run: sudo dkms autoinstall
to see whether it fixes the problem...
|