Description of the need
I suspect that most people who enable the core Contact form do so in order to allow visitors to contact them, without needing to provide their email address publicly. As such, I also believe that most emails recieved through the contact form have nothing to do with feedback about the website itself (that seems like a very specific use-case).
Proposed solution
I therefore propose renaming the default Contact form category from "Website feedback" to something like "Website enquiry", or just "Enquiry". To me this seems more generic and a better default option.
Alternatives that have been considered
Users can always just edit the default category themselves (I personally have to do that all the time).
Additional information

Recent comments
Thanks!! Easiest for me to just give permission for anon users to see the admin theme. That worked. It's just for this one page.
Link field in a Content Type is malformed for annonymous user- Permission issue?
It looks like the screenshot of what you show it should look like is the admin theme whereas what they see is the front end theme. By default, such users won't have permissions to see the...
Link field in a Content Type is malformed for annonymous user- Permission issue?
I've added a new recipe. The recipe has no PHP code. It has two module dependencies (one of those depends on another contrib module and both depend on core modules that are normally enabled)...
The Future of Configuration Recipes for Backdrop CMS