This happens to me on 580 too, not the prompt, just a black screen.
I need to stay on the 550 drivers because of that issue, but the Ubuntu Nvidia repo is transitioning away from 550 and redirecting to 580 when you try to apt install version 550.
You could try the older version of the 550 drivers, which are still available through apt, and see how they work for you.