That is an entry in the Bootloader and you can remove that. Removing it may just maybe cause the grub menu to not appear as such, though it can and will if you tap esc or tab - which as mentioned above, is essential.
If Windows is Not Installed, you can remove the bootloader entry with:
efibootmgr
You should see an entry for Windows like
Boot0000* Windows Boot Manager
Note the four digit number. You need only the last digit of that four digit number.
Replace 0 in the following example with that last digit:
efibootmgr -b 0 -B
Let's say you see Boot0001* Windows Boot Manager, then you would use efibootmgr -b 1 -B OR if you see Boot0003* Windows Boot Manager, then you would use efibootmgr -b 3 -B