I have solved this now.
On Windows 10, you must go to your "Control Panel", then select "Programs". From there, you can uninstall Neo4j Desktop. After doing this, the Neo4j Desktop installer did not say "there is already a per-user installation" and...
I am having the same issue here. I have deleted everything related to Neo4j and deleted everything that has been recommended in this thread. Every time I try to reinstall, the installation gets aborted. Please help