Can you follow these steps:
Open Software & Updates
Move to the "Other Software" tab. Scroll down to the Microsoft Edge Repository and click on it to select it. Then click the "Remove" button.
Close Software & Updates.
It will ask to refresh - it is fine to refresh the cache.
If you have replaced Edge Browser and no longer use it, you can remove Edge Browser and are done.
If you still use and prefer Microsoft Edge Browser, proceed below:
Open terminal and run this to get the Signed Key you need
curl https://packages.microsoft.com/keys/microsoft.asc | gpg --dearmor > microsoft.gpg
sudo install -o root -g root -m 644 microsoft.gpg /usr/share/keyrings/
sudo sh -c 'echo "deb [arch=amd64 signed-by=/usr/share/keyrings/microsoft.gpg] https://packages.microsoft.com/repos/edge stable main" > /etc/apt/sources.list.d/microsoft-edge-beta.list'
Remove the file you no longer need
sudo rm microsoft.gpg
Install the Edge browser.
sudo apt update && sudo apt install microsoft-edge-beta