Nobody seems to be able to answer this, there's some questions about the license of the samples and there doesn't seem to be any clarity about this issue.
Problem seemed to be related to an incorrect identification of my motherboard's sound device. When I disconnected some USB speakers from the computer and reinstalled the latest version of LMMS it worked. Where previously LMMS wouldn't even save its settings on exit, once I disconnected my USB speake...
Windows XP, Version 0.4.12, popping sounds when first installed (Or when LMMS windows user folder config folder is deleted) and then resorts to the Dummy Audio Plugin afterwards. Trying to compile from source but can't overcome the weird libsndfile problem