The dialog box for servers polls your desktop workspace (desktop5.dsk or desktop6.ndk) for any and all references to servers. Any server found, dead or alive, makes it onto the list. So, the only way to remove old server entries is to remove old server icons from the workspace. A chore and a pain for all those involved.
This was first published in August 2004