"As it turns out, if I also uncheck the option ""Allow Winamp to report anonymous usage statistics"", the preferences are saved correctly.
Alternatively, you can disable the internet connection entirely - choose ""Not connected to the internet"" under ""Select you internet connection"". (From here).
Lastly, you can manually edit the preferences file by running