Mail subject Turkish Character Problem

Use this forum if you have installed hMailServer and want to ask a question related to a production release of hMailServer. Before posting, please read the troubleshooting guide. A large part of all reported issues are already described in detail here.
Post Reply
trapper892
New user
New user
Posts: 9
Joined: 2008-10-21 10:01

Mail subject Turkish Character Problem

Post by trapper892 » 2009-05-15 11:14

Hello;

Hmailserver perfect program. Thanks for this.

I write in Turkey. If mail subject include Turkish special character (ş,ğ,ı,ü,ç,ö) than mail subject divided or missing sent or incoming mails . We use hmailserver 5.1 , before used to hmailserver 4.4.4 and it has same problem.
What can I do ?, please help me.

Best Regards

User avatar
katip
Senior user
Senior user
Posts: 746
Joined: 2006-12-22 07:58
Location: Istanbul

Re: Mail subject Turkish Character Problem

Post by katip » 2009-05-15 15:26

Strange :?:
What kind of email client do you use?
Katip
--
HMS 5.7.0 x64, MariaDB 10.4.10 x64, SA 3.4.2, ClamAV 0.101.2 + SaneS

User avatar
martin
Developer
Developer
Posts: 6834
Joined: 2003-11-21 01:09
Location: Sweden
Contact:

Re: Mail subject Turkish Character Problem

Post by martin » 2009-05-15 17:58

hMailServer doesn't modify the message contents unless you have rules or scripts set up which modifies message content. Have you?

trapper892
New user
New user
Posts: 9
Joined: 2008-10-21 10:01

Re: Mail subject Turkish Character Problem

Post by trapper892 » 2009-05-15 21:14

Message context there is no problem, but message subject if contains turkish special character (ş,ı,ğ,ö,ü), message subject is divided, where turkish character start in message subject.

We use spamasasin eventhandler script. if score between 3.5 - 7 mark subject [SPAM], if score grater than 7 message delete.

May be this Eventhandler reason of problem. "oMessage.Save" function use .

User avatar
martin
Developer
Developer
Posts: 6834
Joined: 2003-11-21 01:09
Location: Sweden
Contact:

Re: Mail subject Turkish Character Problem

Post by martin » 2009-05-16 13:42

What do you mean by "message subject is divided"?

mafr1
Normal user
Normal user
Posts: 66
Joined: 2009-04-01 18:39
Location: NL

Re: Mail subject Turkish Character Problem

Post by mafr1 » 2009-05-16 13:47

martin wrote:What do you mean by "message subject is divided"?
I think what trapper means is that the subject is cut off at these special characters. En remaining part of the subject is being shown at the beginning of the body.
Marco
hMailServer 5.3.1-B1748

trapper892
New user
New user
Posts: 9
Joined: 2008-10-21 10:01

Re: Mail subject Turkish Character Problem

Post by trapper892 » 2009-05-17 12:29

For example message subject = " Merhaba Bırak Bu İşleri"

Message subject = "Merhaba B" after sent mail. Because "ı" is special character in turkish char set.

On Monday deactive spamasassin, I think spamasassin EventHandler make this. "oMessage.Save" function
Last edited by trapper892 on 2009-05-17 12:32, edited 1 time in total.

User avatar
martin
Developer
Developer
Posts: 6834
Joined: 2003-11-21 01:09
Location: Sweden
Contact:

Re: Mail subject Turkish Character Problem

Post by martin » 2009-05-17 12:32

Is it possible for you in some way to retrieve the entire Subject header of the message (and not just the content)?

trapper892
New user
New user
Posts: 9
Joined: 2008-10-21 10:01

Re: Mail subject Turkish Character Problem

Post by trapper892 » 2009-05-17 20:07

Deactive Vb Script, but there is no chage.
Message subject is cutting where start turkish character in message subject. hmailserver 5.1 has this problem.
And than hmailserver 4.4 message subject not cutting, but if message subject is long 40 character and, it include turkish special character (ğ,ı,ş,ü,ö,ç). double \t\n add end of sublect row.

For example. mail format (.eml) edit with notepad, below subject, you can see Subject row end of double "\t\n". For this reason, email not show correct, "outlook or outlook express", if email edit email notepad and delete enter ("\t\n") , email show corect.

To find the cause of this error I tried for 2 weeks, 4 month ago.

----------------------------Double add \t\n
From: <admin@betaarastirma.com>
To: =?iso-8859-9?Q?Burak_Akku=FE?= <burak892@gmail.com>
Subject: =?iso-8859-9?B?YWRwZ2FzamRnIPD+5/b+IGFzcGRnc2FkZ3AgYXNkZyBhc2Rn/GFzZGZn?=

=?iso-8859-9?B?biDw/uf2/g==?=
Date: Fri, 15 May 2009 12:27:37 +0300
MIME-Version: 1.0
Content-Type: multipart/alternative;


---------------------------- \t\n was deleted, edit with noted and save message
From: <admin@betaarastirma.com>
To: =?iso-8859-9?Q?Burak_Akku=FE?= <burak892@gmail.com>
Subject: =?iso-8859-9?B?YWRwZ2FzamRnIPD+5/b+IGFzcGRnc2FkZ3AgYXNkZyBhc2Rn/GFzZGZn?=
=?iso-8859-9?B?biDw/uf2/g==?=
Date: Fri, 15 May 2009 12:27:37 +0300
MIME-Version: 1.0
Content-Type: multipart/alternative;

User avatar
katip
Senior user
Senior user
Posts: 746
Joined: 2006-12-22 07:58
Location: Istanbul

Re: Mail subject Turkish Character Problem

Post by katip » 2009-05-18 05:37

Subject looks strange in your example. Where does blank line come from?
Your edited version shouldn't help much too as it must contain at least one empty space at the beginning of 2nd line.
I may be wrong though...
Katip
--
HMS 5.7.0 x64, MariaDB 10.4.10 x64, SA 3.4.2, ClamAV 0.101.2 + SaneS

trapper892
New user
New user
Posts: 9
Joined: 2008-10-21 10:01

Re: Mail subject Turkish Character Problem

Post by trapper892 » 2009-05-19 10:49

Subject: =?iso-8859-9?B?YWRwZ2FzamRnIPD+5/b+IGFzcGRnc2FkZ3AgYXNkZyBhc2Rn/GFzZGZn?=
>>>>>>>>>>>>>>>>>>>Hear there is a blank row and than mail not swow correct format >>>>>>>>>>>>>>
=?iso-8859-9?B?biDw/uf2/g==?=

User avatar
katip
Senior user
Senior user
Posts: 746
Joined: 2006-12-22 07:58
Location: Istanbul

Re: Mail subject Turkish Character Problem

Post by katip » 2009-05-20 04:46

trapper892 wrote: >>>>>>>>>>>>>>>>>>>Hear there is a blank row and than mail not swow correct format >>>>>>>>>>>>>>
Yes we see this.
This is illegal. I was asking what may cause this?
Katip
--
HMS 5.7.0 x64, MariaDB 10.4.10 x64, SA 3.4.2, ClamAV 0.101.2 + SaneS

trapper892
New user
New user
Posts: 9
Joined: 2008-10-21 10:01

Re: Mail subject Turkish Character Problem

Post by trapper892 » 2009-05-20 21:42

Sorry Katip, The first asks not understand.

this is hmailserver bug. Because I wirite vbScript , delete whole "tab" and "enter" characters in message subject, but no change some mail, if subject include turkish character, and subject length long, This situation has occurred.

I use hmailserver two company,
a company use hmailserver 4.4.4, this version, if message subject longer, the extra add a tab and enter character, message format is corrupted.

The other company use hmailserver 5.1, this version, if the message header/subject contains the Turkish characters, they are cut and missing is sending, where start the Turkish characters
Last edited by trapper892 on 2009-05-20 21:45, edited 1 time in total.

^DooM^
Site Admin
Posts: 13861
Joined: 2005-07-29 16:18
Location: UK

Re: Mail subject Turkish Character Problem

Post by ^DooM^ » 2009-05-20 21:44

martin wrote:Is it possible for you in some way to retrieve the entire Subject header of the message (and not just the content)?
I suggest you attach a zipped up .eml file here that is broken.
If at first you don't succeed, bomb disposal probably isn't for you! ヅ

trapper892
New user
New user
Posts: 9
Joined: 2008-10-21 10:01

Re: Mail subject Turkish Character Problem

Post by trapper892 » 2009-05-21 11:40

Hello;

Attach two broken mail. if delete empty row in subject, mail show correct.

best regards
Attachments
mail.rar
(5.31 KiB) Downloaded 203 times

User avatar
martin
Developer
Developer
Posts: 6834
Joined: 2003-11-21 01:09
Location: Sweden
Contact:

Re: Mail subject Turkish Character Problem

Post by martin » 2009-05-21 13:48

Can you disable anti spam and scripts at the same time and see if the problem goes away?
Can you reproduce this problem simply by sending a message with the subject ABC ğ ABC or something similar?

trapper892
New user
New user
Posts: 9
Joined: 2008-10-21 10:01

Re: Mail subject Turkish Character Problem

Post by trapper892 » 2009-05-22 10:56

Anti spam and script was canceled, but the error is similar mail.

If you forward the attached e-mail . May be, You'll see that e-mail format is corrupted.

Same problem occurred again today in attached e-mail.

if email subject : "Fw: Limak projesi panoları lokasyon isimleri ve 1 adet 3 konumlu mandal buton durumu" problem occured. delete "ı" character in "panoları" word no problem and than end of the char delete "u" delete character in "durumu" word, or any at least one character delete, no problem occured, I try many times. It is very mix problem.

In birief, Message Subjet;

"Fw: Limak projesi panoları lokasyon isimleri ve 1 adet 3 konumlu mandal buton durumu" ==> problem occured
"Fw: Limak projesi panolar lokasyon isimleri ve 1 adet 3 konumlu mandal buton durumu" ==> no problem, deleted "ı" character
"Fw: Limak projesi panoları lokasyon isimleri ve 1 adet 3 konumlu mandal buton durum" ==> no problem, detede "u" character end ot the subject.
Attachments
mail.rar
(1.25 KiB) Downloaded 185 times

User avatar
katip
Senior user
Senior user
Posts: 746
Joined: 2006-12-22 07:58
Location: Istanbul

Re: Mail subject Turkish Character Problem

Post by katip » 2009-05-22 14:59

This can be an OE related issue.

I have sent this subject to myself two times, once with TB by myself, another time with Outlook, asked a friend outside who uses HMS as well to do so, I don't use O/OE. Both show subject correct as desired and written in RFC conform format. Here the headers:

Outlook:

Subject: =?iso-8859-9?Q?Fw:_Limak_projesi_panolar=FD_lokasyon_isimleri_ve_1_adet_3?=
=?iso-8859-9?Q?_konumlu_mandal_buton_durumu?=
MIME-Version: 1.0
X-Mailer: Microsoft Office Outlook 12.0

---------------------------

TB:

User-Agent: Thunderbird 2.0.0.21 (Windows/20090302)
MIME-Version: 1.0
Subject: Fw: Limak projesi =?ISO-8859-9?Q?panolar=FD_lokasyon_isimler?=
=?ISO-8859-9?Q?i_ve_1_adet_3_konumlu_mandal_buton_durumu?=

--------------------------

(Forum software obviously trims leading spaces at the beginning of new lines, actually there are spaces leading the 2nd subject line which has to be so)

As told before, you better try to find out where this blank line in the subject comes from.
Katip
--
HMS 5.7.0 x64, MariaDB 10.4.10 x64, SA 3.4.2, ClamAV 0.101.2 + SaneS

^DooM^
Site Admin
Posts: 13861
Joined: 2005-07-29 16:18
Location: UK

Re: Mail subject Turkish Character Problem

Post by ^DooM^ » 2009-05-22 15:03

Are you marking subject as [SPAM] ?
If at first you don't succeed, bomb disposal probably isn't for you! ヅ

trapper892
New user
New user
Posts: 9
Joined: 2008-10-21 10:01

Re: Mail subject Turkish Character Problem

Post by trapper892 » 2009-05-23 10:12

No , message is not flagged as spam. I deactivated, spamassasin script and, hmailserver spam filter.

Hello Katip;

I already the message format, the message header has been corrupted because I took 2 weeks to understand. And Than,

Try a lot way, solve this problem. write vbscript. Delete whole tab (\t) and new line (\n) character, nothing change. Turkish character of this problem has been found in the message header. When writing a thought one way, I'll write a script and delete Turkish characters in the message subject.

thanks for all.

best regards

Crypty
New user
New user
Posts: 4
Joined: 2010-07-09 14:18

Re: Mail subject Turkish Character Problem

Post by Crypty » 2010-12-02 11:46

Sayfanın en başına

Response.Charset = "ISO-8859-9"
Response.Codepage = 1252

kodlarını ekleyin.

Eğer EventHandlers.vbs sayfasında işlem yapıyorsanız, "response" yazmadan ekleyin.

Charset = "ISO-8859-9"
Codepage = 1252

-----

The top of the page

Response.Charset = "ISO-8859-9"
Response.Codepage = 1252

Add codes.

If you are EventHandlers.vbs on the transaction, "response" to add writing.

Charset = "ISO-8859-9"
Codepage = 1252

jun
Normal user
Normal user
Posts: 43
Joined: 2009-09-29 05:14

Re: Mail subject Turkish Character Problem

Post by jun » 2010-12-03 08:49

Hi All,

I think we have the same problem with the special characters but mine is a japan characters and using his mobile phone to send emails. But the problem is when I receive the email "from" is missing. I'm using hmail server 5.3.3 and my database is Mysql. Here is the logs that I got from hmail server.

"SMTPD" 2352 11929 "2010-12-02 12:07:48.875" "59.135.39.205" "SENT: 220 crewmailonline.com ESMTP"
"SMTPD" 2352 11929 "2010-12-02 12:07:48.953" "59.135.39.205" "RECEIVED: EHLO ezweb.ne.jp"
"SMTPD" 2352 11929 "2010-12-02 12:07:48.953" "59.135.39.205" "SENT: 250-crewmailonline.com[nl]250-SIZE[nl]250 AUTH LOGIN"
"SMTPD" 2352 11929 "2010-12-02 12:07:49.031" "59.135.39.205" "RECEIVED: MAIL FROM:<yoshi.yoshi.taro-1023tbt@ezweb.ne.jp> SIZE=666"
"DEBUG" 2352 "2010-12-02 12:07:49.031" "Total spam score: 0"
"SMTPD" 2352 11929 "2010-12-02 12:07:49.031" "59.135.39.205" "SENT: 250 OK"
"SMTPD" 2352 11929 "2010-12-02 12:07:49.093" "59.135.39.205" "RECEIVED: RCPT TO:<000088@crewmailonline.com>"
"SMTPD" 2352 11929 "2010-12-02 12:07:49.109" "59.135.39.205" "SENT: 250 OK"
"SMTPD" 2352 11929 "2010-12-02 12:07:49.171" "59.135.39.205" "RECEIVED: DATA"
"SMTPD" 2352 11929 "2010-12-02 12:07:49.187" "59.135.39.205" "SENT: 354 OK, send."
"DEBUG" 2384 "2010-12-02 12:07:49.359" "Delivering message..."
"APPLICATION" 2384 "2010-12-02 12:07:49.359" "SMTPDeliverer - Message 187: Delivering message from yoshi.yoshi.taro-1023tbt@ezweb.ne.jp to master@crewmailonline.com. File: C:\CSERVER\hMailServer\Data\{DAC7D924-A60A-421B-8569-DDAF356C3A0E}.eml"
"DEBUG" 2384 "2010-12-02 12:07:49.359" "ScriptServer:FireEvent"
"DEBUG" 2384 "2010-12-02 12:07:49.375" "ScriptServer:~FireEvent"
"DEBUG" 2384 "2010-12-02 12:07:49.375" "Applying rules"
"DEBUG" 2384 "2010-12-02 12:07:49.375" "Applying rule"
"DEBUG" 2384 "2010-12-02 12:07:49.375" "ScriptServer:FireEvent"
"DEBUG" 2384 "2010-12-02 12:07:49.390" "ScriptServer:~FireEvent"
"DEBUG" 2384 "2010-12-02 12:07:49.390" "Performing local delivery"
"DEBUG" 2384 "2010-12-02 12:07:49.390" "Applying rules"
"DEBUG" 2384 "2010-12-02 12:07:49.390" "Saving message: C:\CSERVER\hMailServer\Data\crewmailonline.com\master\DA\{DAC7D924-A60A-421B-8569-DDAF356C3A0E}.eml"

========= end of logs ============

Please see attached file for the raw eml file
{DAC7D924-A60A-421B-8569-DDAF356C3A0E}.zip
(698 Bytes) Downloaded 143 times
Could someone help me regarding this issue. Many thanx in advance


Regards,

JUN

Post Reply