Description of the need
I suspect that most people who enable the core Contact form do so in order to allow visitors to contact them, without needing to provide their email address publicly. As such, I also believe that most emails recieved through the contact form have nothing to do with feedback about the website itself (that seems like a very specific use-case).
Proposed solution
I therefore propose renaming the default Contact form category from "Website feedback" to something like "Website enquiry", or just "Enquiry". To me this seems more generic and a better default option.
Alternatives that have been considered
Users can always just edit the default category themselves (I personally have to do that all the time).
Additional information

Recent comments
The setting on admin/structure/file-types/settings is only for files uploaded via Content > Manage files. Not for files uploaded via a file field. File fields have their own setting for...
Files uploaded using add file
ADMIN EDIT: Image below is link to YouTube video
Portfolio — A Free Portfolio Theme for Backdrop CMS
through Content > Manage files, if you click on addfile link. Even though the Default file directory under Structure > File types > file settings is "files/uploaded" or anything...
Files uploaded using add file