Create a batch file with the following contents, or just run one line at a time on your command prompt. Remember to start your cmd with Admin privileges by right clicking on it.
reg delete HKLM\Software\Microsoft\Silverlight /f reg delete HKEY_CLASSES_ROOT\Installer\Products\D7314F9862C648A4DB8BE2A5B47BE100 /f reg delete HKEY_LOCAL_MACHINE\SOFTWARE\Classes\Installer\Products\D7314F9862C648A4DB8BE2A5B47BE100 /f reg delete HKEY_CLASSES_ROOT\TypeLib\{283C8576-0726-4DBC-9609-3F855162009A} /f reg delete HKEY_LOCAL_MACHINE\SOFTWARE\Microsoft\Windows\CurrentVersion\App Paths\install.exe /f reg delete HKEY_CLASSES_ROOT\AgControl.AgControl /f reg delete HKEY_CLASSES_ROOT\AgControl.AgControl.5.1 /f reg delete HKEY_LOCAL_MACHINE\SOFTWARE\Microsoft\Windows\CurrentVersion\Uninstall\{89F4137D-6C26-4A84-BDB8-2E5A4BB71E00} /f rmdir /s /q "%ProgramFiles%\Microsoft Silverlight" rmdir /s /q "%ProgramFiles(x86)%\Microsoft Silverlight"
You will get some errors depending what version of Windows you got (x86 or x64).
After this I re-installed the latest version of Silverlight and all was done.