Sending messages in Cyrillic and PHP 8

Thanks for the reply, but I have to apologize, I don't know what dblog means.

There are no error descriptions in Recent log messages.

I can access the server through cPanel and FTP as well as phpMyAdmin but I don't know exactly where to check if these are the required tools.

I am not usung modules: SMTP? Mime Mail? Mail System? Only core message system.

Oh, I understand

admin/reports/dblog

No there are no error messages

Типmail

Date Неделя, Ноември 19, 2023 - 5:03pm

User Anonymous (not verified)

Location https://domain.bg/contact

Referrer https://domain.bg/contact

СъобщениеТест Test (abc@email.com) sent an email regarding Контакти.

Severitynotice

Hostname xxx.xxx.xxx.xxx

Operations

Thank you!

Perhaps the reason this hasn't been noticed is that there aren't many users of Backdrop CMS who need Cyrillic.

As far as I am informed, I am the only user of the system in Bulgaria. However, I am responsible for the maintenance and development of more than 65 sites, and now all of them are with Backdrop CMS :) (except for one with Drupal 6)

The issues described in this topic were posted as an issue on Github at:

https://github.com/backdrop/backdrop-issues/issues/6305

The issue was investigated by various experts of the Backdrop community and they concluded that the Cyrillic issues when migrating from PHP 7 to PHP 8 are not rooted in Backdrop CMS, but are likely due to issues in the PHP 8 web server configuration or the specific email client K9 Mail.

Now I want to lay out some few additional facts that became known to me subsequently, as well as the solution to the problem that I was able to find, which may be useful for other users facing a similar problem - and it can be related not only with the Cyrillic alphabet, but also with other languages and alphabets containing symbols other than those in the standard Latin alphabet.

1. The problems with Cyrillic (when PHP 8 is used on web server side) with  the K9 Mail client for Android seem to be of no small importance to Backdrop users with Baxkdrop CMS contact forms given the news that Mozilla has acquired control of the K9 Mail app and is currently rebranding it as Thunderbird for Android - which is likely to significantly increase the number to users who rely on it for their e-mail on smartphones:

https://github.com/thunderbird/thunderbird-android/releases

2. Cyrillic messaging tests conducted by my hosting provider via a simple static PHP contact form (without any CMS) installed on the same web server did not detect web server configuration issues with Cyrillic when moving from PHP 7 to PHP 8. I was told that similar messaging issues containing Cyrillic and non-standard Latin letters (e.g. german umlauts) for some email clients are reported for Drupal 7, for example there:

https://www.drupal.org/project/contact_emails/issues/3077899

3. I was surprised to find that exactly the same problem exists with a brand new installation of Drupal 7 and moving the web server from PHP 7 to PHP 8. To save space I'm not describing them again, the problems are the same as described at the beginning of this theme in the forum.

This seems to confirm the conclusion that the cause of the problem is not in Backdrop CMS by itself since the identical problem is also observed in Drupal 7.

In the additional tests, I found something else that I hadn't noticed in the previous tests - when moving from PHP 7 to PHP 8 there is another strange problem. When the server works with PHP 7 and the received message is answered with Reply, the answer is sent to the email address filled in the contact form. After switching to PHP 8, the response is sent to the address from which the message was sent via the contact form - this address, which is entered in admin/config/system/site-information as the site's email address.

Unfortunately, my limited knowledge does not allow a deeper understanding of the real reasons for this phenomenon.

4. Finally, I want to share that all these problems are solved by installing the SMTP Authentication Support module

https://backdropcms.org/project/smtp

In my case, I used an smtp server, which is a standard part of the shared hosting service and is available through the settings for each email account created through cPanel.

Only difficulty was getting the correct settings for my server configuration as they are not described in the module documentation and I found them by searching the Internet.

For me, smtp access via an encrypted connection was via TLS and port 587.

After installing and properly configuring the SMTP Authentication Support module, all Cyrillic problems were removed and Cyrillic messages are received correctly both through the Contact Form, Webform and Rules.

When using this module, the problem with the electronic address for replying to a message with Reply was also solved - the reply is sent to the address filled in the contact form.

Finally, consulting this decision with my hosting provider, the experts there advised me to stick with this configuration because using an smtp server reduces the likelihood that various email service providers will rate messages sent through the contact form as spam.