Isn't possible to hide the affinity section altogether, you can only decide to select the "I prefer not to tell" option.
A video was posted on youtube where it says you can do this by changing the privacy settings but neither on IMVU Next (the web version), nor even from the Android app is there an option to hide the affinity section from the profile via the privacy settings.
Unless it's a new experimental feature (not yet available to everyone), I think the only way to not show the affinity panel informations remains to select the "I prefer not to tell" option