Hmailserver crash with mailinglist 10000 subscribers

Use this forum if you have installed hMailServer and want to ask a question related to a production release of hMailServer. Before posting, please read the troubleshooting guide. A large part of all reported issues are already described in detail here.
Post Reply
Thomas Parvais
Normal user
Normal user
Posts: 111
Joined: 2004-12-17 12:21
Contact:

Hmailserver crash with mailinglist 10000 subscribers

Post by Thomas Parvais » 2008-11-13 13:27

Hello Martin

HMS 4.4.b270 crashes when I launch mail to my distribution list (10000 subs).
Here is some dump info:
Server=watson.microsoft.com
UI LCID=1033
Flags=1672018
Brand=WINDOWS
TitleName=hMailServer
DigPidRegPath=HKLM\Software\Microsoft\Windows NT\CurrentVersion\DigitalProductId
ErrorText=This error occurred on 4/11/2008 at 15:53:06.
HeaderText=hMailServer encountered a problem and needed to close.
Stage1URL=/StageOne/hMailServer_exe/1_0_0_1/ntdll_dll/5_2_3790_3959/0002caa2.htm
Stage2URL=/dw/stagetwo.asp?szAppName=hMailServer.exe&szAppVer=1.0.0.1&szModName=ntdll.dll&szModVer=5.2.3790.3959&offset=0002caa2
DataFiles=C:\DOCUME~1\ADMINI~1\LOCALS~1\Temp\1\WER7526.dir00\hMailServer.exe.mdmp|C:\DOCUME~1\ADMINI~1\LOCALS~1\Temp\1\WER7526.dir00\appcompat.txt
Heap=C:\DOCUME~1\ADMINI~1\LOCALS~1\Temp\1\WER7526.dir00\hMailServer.exe.hdmp
ErrorSubPath=hMailServer.exe\1.0.0.1\ntdll.dll\5.2.3790.3959\0002caa2
DirectoryDelete=C:\DOCUME~1\ADMINI~1\LOCALS~1\Temp\1\WER7526.dir00
I have also others debug files: hMailServer.exe.hdmp et hMailServer.exe.mdmp available for you if needed

I don't know what's happen. Do you need more info ?

Thomas
Interrested by Law & new technologies ?
Intéressé par le droit de l'internet et des nouvelles technologies ?
Visit/Visitez http://www.droit-technologie.org

^DooM^
Site Admin
Posts: 13861
Joined: 2005-07-29 16:18
Location: UK

Re: Hmailserver crash with mailinglist 10000 subscribers

Post by ^DooM^ » 2008-11-13 13:29

any errors reported in hMails own error log?
If at first you don't succeed, bomb disposal probably isn't for you! ヅ

Thomas Parvais
Normal user
Normal user
Posts: 111
Joined: 2004-12-17 12:21
Contact:

Re: Hmailserver crash with mailinglist 10000 subscribers

Post by Thomas Parvais » 2008-11-13 13:54

^DooM^ wrote:any errors reported in hMails own error log?
nothing :-(
Interrested by Law & new technologies ?
Intéressé par le droit de l'internet et des nouvelles technologies ?
Visit/Visitez http://www.droit-technologie.org

User avatar
martin
Developer
Developer
Posts: 6834
Joined: 2003-11-21 01:09
Location: Sweden
Contact:

Re: Hmailserver crash with mailinglist 10000 subscribers

Post by martin » 2008-11-13 14:03

Can you reproduce the problem?
Is it a distribution list or are you sending the messages using some other software?
When does it crash? When you deliver the message or while hMailServer is processing it?
Can you enable all logging in hMailServer, reproduce the problem, zip the log and send it to me at martin@hmailserver.com so that I can take a look at it?

Thomas Parvais
Normal user
Normal user
Posts: 111
Joined: 2004-12-17 12:21
Contact:

Re: Hmailserver crash with mailinglist 10000 subscribers

Post by Thomas Parvais » 2008-11-13 14:16

martin wrote:Can you reproduce the problem?
Is it a distribution list or are you sending the messages using some other software?
When does it crash? When you deliver the message or while hMailServer is processing it?
Can you enable all logging in hMailServer, reproduce the problem, zip the log and send it to me at martin@hmailserver.com so that I can take a look at it?
ok, for next Newsletter release, I'll log everything (beg. of DEcember).

Yes, it was during Hmailserver processing. This is not the first time it happens.

No script, no other software. Just a mail sent to a distribution list, populated directly with your API to add / delete new members.
Interrested by Law & new technologies ?
Intéressé par le droit de l'internet et des nouvelles technologies ?
Visit/Visitez http://www.droit-technologie.org

User avatar
martin
Developer
Developer
Posts: 6834
Joined: 2003-11-21 01:09
Location: Sweden
Contact:

Re: Hmailserver crash with mailinglist 10000 subscribers

Post by martin » 2008-11-13 14:22

So when you started hMailServer again, it continued to process the messages, or?

Thomas Parvais
Normal user
Normal user
Posts: 111
Joined: 2004-12-17 12:21
Contact:

Re: Hmailserver crash with mailinglist 10000 subscribers

Post by Thomas Parvais » 2008-11-14 11:43

martin wrote:So when you started hMailServer again, it continued to process the messages, or?
apparently yes
Interrested by Law & new technologies ?
Intéressé par le droit de l'internet et des nouvelles technologies ?
Visit/Visitez http://www.droit-technologie.org

User avatar
martin
Developer
Developer
Posts: 6834
Joined: 2003-11-21 01:09
Location: Sweden
Contact:

Re: Hmailserver crash with mailinglist 10000 subscribers

Post by martin » 2008-11-15 23:50

I did try to send a message to a distribution list with 15 000 subscribers but didn't get this problem. I tested it in the same build as you are using. I recommend that you upgrade to the latest version before the next sendout, and then enable all logging in case it happens again.

Thomas Parvais
Normal user
Normal user
Posts: 111
Joined: 2004-12-17 12:21
Contact:

Re: Hmailserver crash with mailinglist 10000 subscribers

Post by Thomas Parvais » 2008-12-02 23:37

Hello

Yesterday we tried to send Newsletter again.

Previously, I also upgraded to last stable release available.

I activate logging (SMTP/Application & Debug).

Same issue occurs: only internal members have received the newsletter (I mean email also declared on Hmailserver).

Here is the log from the reception of the newsletter by HMS and the phase after where normally the email must be replicated.... (there is nothing relevant in others error log files):

send_newsletter@droit-technologie.org is the source origin of the newsletter (ASP Page) and newsletter address is newsletter@droit-technologie.org

Code: Select all

"SMTPD"	3944	3982	"2008-12-01 18:39:11.442"	"217.112.181.130"	"SENT: 220 serveur.maxetzoe.com"
"SMTPD"	3944	3982	"2008-12-01 18:39:11.442"	"217.112.181.130"	"RECEIVED: EHLO serveur.maxetzoe.com"
"SMTPD"	3944	3982	"2008-12-01 18:39:11.442"	"217.112.181.130"	"SENT: 250-hmailserver[nl]250-SIZE[nl]250 AUTH LOGIN"
"SMTPD"	3944	3982	"2008-12-01 18:39:11.442"	"217.112.181.130"	"RECEIVED: MAIL FROM:<send_newsletter@droit-technologie.org>"
"DEBUG"	3944	"2008-12-01 18:39:11.442"	"BLCheck::ClientExistsInDNSBL()"
"DEBUG"	3944	"2008-12-01 18:39:11.442"	"BLCheck::_GetRevertedIP"
"DEBUG"	3944	"2008-12-01 18:39:11.442"	"BLCheck::~_GetRevertedIP"
"DEBUG"	3944	"2008-12-01 18:39:11.504"	"BLCheck::~ClientExistsInDNSBL()"
"DEBUG"	3944	"2008-12-01 18:39:11.504"	"BLCheck::ClientExistsInDNSBL()"
"DEBUG"	3944	"2008-12-01 18:39:11.504"	"BLCheck::_GetRevertedIP"
"DEBUG"	3944	"2008-12-01 18:39:11.504"	"BLCheck::~_GetRevertedIP"
"DEBUG"	3944	"2008-12-01 18:39:11.520"	"BLCheck::~ClientExistsInDNSBL()"
"SMTPD"	3944	3982	"2008-12-01 18:39:11.520"	"217.112.181.130"	"SENT: 250 OK"
"SMTPD"	3944	3982	"2008-12-01 18:39:11.520"	"217.112.181.130"	"RECEIVED: RCPT TO:<newsletter@droit-technologie.org>"
"SMTPD"	3944	3982	"2008-12-01 18:39:50.833"	"217.112.181.130"	"SENT: 250 OK"
"SMTPD"	3944	3982	"2008-12-01 18:39:50.833"	"217.112.181.130"	"RECEIVED: DATA"
"DEBUG"	3944	"2008-12-01 18:39:50.833"	"TransparentTransmissionBuffer::Initialize()"
"SMTPD"	3944	3982	"2008-12-01 18:39:50.833"	"217.112.181.130"	"SENT: 354 OK, send."
"DEBUG"	3928	"2008-12-01 18:39:50.848"	"PMADO:SaveObject()"
"DEBUG"	3928	"2008-12-01 18:39:50.848"	"Adding message to database. File: C:\Program Files\hMailServer\Data\{CA690862-47B8-480D-9666-690F86889D16}.eml"
"APPLICATION"	3928	"2008-12-01 18:40:12.395"	"Source: PersistentMessage::_SaveParsedRecipientsInDB, Code: HM4224, Description: Tried to save recipient without an address."
"DEBUG"	3928	"2008-12-01 18:40:12.489"	"PMADO:~SaveObject()"
"DEBUG"	3928	"2008-12-01 18:40:12.504"	"Message added. File: C:\Program Files\hMailServer\Data\{CA690862-47B8-480D-9666-690F86889D16}.eml"
"DEBUG"	3928	"2008-12-01 18:40:12.504"	"Application::SubmitPendingEmail()"
"DEBUG"	3928	"2008-12-01 18:40:12.504"	"Application::~SubmitPendingEmail()"
"SMTPD"	3928	3982	"2008-12-01 18:40:12.504"	"217.112.181.130"	"SENT: 250 Queued (0.015 seconds)"
"SMTPD"	3928	3982	"2008-12-01 18:40:12.504"	"217.112.181.130"	"RECEIVED: QUIT"
"SMTPD"	3928	3982	"2008-12-01 18:40:12.504"	"217.112.181.130"	"SENT: 221 goodbye"
"DEBUG"	3928	"2008-12-01 18:40:12.504"	"Socket::~Socket(ID:3982, Addr=61233504)"
"DEBUG"	3860	"2008-12-01 18:40:12.504"	"SD::DeliverMessage"
"APPLICATION"	3860	"2008-12-01 18:40:12.520"	"SMTPDeliverer - Message 868141: Delivering message from send_newsletter@droit-technologie.org to [b][i]***LONG LIST OF EMAIL MEMBERS***[/i][/b] . File: C:\Program Files\hMailServer\Data\{CA690862-47B8-480D-9666-690F86889D16}.eml"
"DEBUG"	3860	"2008-12-01 18:40:12.567"	"ClamWinVirusScanner::Scan()"
"DEBUG"	3860	"2008-12-01 18:40:12.567"	"SURBL::Run"
"DEBUG"	3860	"2008-12-01 18:40:12.567"	"SURBL::~Run"
"DEBUG"	3860	"2008-12-01 18:40:12.567"	"RuleApplier::ApplyRules"
"DEBUG"	3860	"2008-12-01 18:40:12.567"	"RuleApplier::_ApplyRule"
"DEBUG"	3860	"2008-12-01 18:40:12.567"	"RuleApplier::~_ApplyRule"
"DEBUG"	3860	"2008-12-01 18:40:12.567"	"RuleApplier::_ApplyRule"
"DEBUG"	3860	"2008-12-01 18:40:12.567"	"RuleApplier::~_ApplyRule"
"DEBUG"	3860	"2008-12-01 18:40:12.567"	"RuleApplier::_ApplyRule"
"DEBUG"	3860	"2008-12-01 18:40:12.567"	"RuleApplier::~_ApplyRule"
"DEBUG"	3860	"2008-12-01 18:40:12.567"	"RuleApplier::~ApplyRules"
"DEBUG"	3860	"2008-12-01 18:40:12.567"	"SD::_DeliverToLocalAccounts"
"DEBUG"	3860	"2008-12-01 18:40:12.567"	"RuleApplier::ApplyRules"
"DEBUG"	3860	"2008-12-01 18:40:12.567"	"RuleApplier::~ApplyRules"
"DEBUG"	3860	"2008-12-01 18:40:12.567"	"PMADO:CopyMailContentsFrom()"
"DEBUG"	3860	"2008-12-01 18:40:12.895"	"PMADO:~CopyMailContentsFrom()"
"DEBUG"	3860	"2008-12-01 18:40:13.114"	"Adding message to database. File: C:\Program Files\hMailServer\Data\parvais.com\thomas\A8\{A8A07C30-6E40-41FC-AEBF-A94797A1D344}.eml"
"DEBUG"	3860	"2008-12-01 18:40:13.145"	"AWStats::LogDeliverySuccess"
"DEBUG"	3860	"2008-12-01 18:40:13.176"	"RuleApplier::ApplyRules"
"DEBUG"	3860	"2008-12-01 18:40:13.176"	"RuleApplier::~ApplyRules"
"DEBUG"	3860	"2008-12-01 18:40:13.176"	"PMADO:CopyMailContentsFrom()"
"DEBUG"	3860	"2008-12-01 18:40:13.208"	"PMADO:~CopyMailContentsFrom()"
"DEBUG"	3860	"2008-12-01 18:40:13.254"	"Adding message to database. File: C:\Program Files\hMailServer\Data\droit-technologie.org\info\C8\{C82F99CA-2BDF-43CE-9D10-3E79F2D90EA2}.eml"
"DEBUG"	3860	"2008-12-01 18:40:13.286"	"AWStats::LogDeliverySuccess"
"DEBUG"	3860	"2008-12-01 18:40:13.317"	"SD::~_DeliverToLocalAccounts"
"DEBUG"	3860	"2008-12-01 18:40:13.379"	"SD::_DeliverToExternalAccounts"
"APPLICATION"	3860	"2008-12-01 18:40:13.379"	"Source: SMTPDeliverer::_DeliverToExternalAccounts, Code: HM4226, Description: Could not deliver message; Recipient address missing."
What is very strange is that I didn't find any recipient in the log for the newsletter distribution. I suppose HMS should open a SMTP connection to each of the recipient ?

There is no special traffic reported in Awstat neither. Nothing special in message waiting list window (3 mails waiting to be sent among 2 for newsletter)

I really don't see what is happening here ?

If I try to stop Hmailserver via its mgnt interface , it took some while (30-40s) then restart the process. And now, mails seem to be generated to the distribution list:

in error log I have the following:

Code: Select all

"DEBUG"	3912	"2008-12-02 22:20:24.723"	"Socket::~Socket(ID:5803, Addr=61480632)"
"DEBUG"	3944	"2008-12-02 22:21:04.676"	"Socket::Socket(ID:5804, Addr=169192696)"
"DEBUG"	3944	"2008-12-02 22:21:04.692"	"Socket::Socket(ID:5805, Addr=60273144)"
"DEBUG"	3944	"2008-12-02 22:21:04.817"	"Socket::Socket(ID:5806, Addr=68636248)"
"DEBUG"	3944	"2008-12-02 22:21:05.036"	"Socket::Socket(ID:5807, Addr=571941656)"
"DEBUG"	3912	"2008-12-02 22:21:05.989"	"PersistentMessage::ReadObject()"
"DEBUG"	3912	"2008-12-02 22:21:05.989"	"PersistentMessage::~ReadObject()"
"DEBUG"	3912	"2008-12-02 22:21:05.989"	"PersistentMessage::ReadObject()"
"DEBUG"	3912	"2008-12-0.....

Then +/- 9000 similar lines (that corresponds to #of subscribers maybe)

later:

"APPLICATION"	4580	"2008-12-02 22:22:01.551"	"SMTPDeliverer - Message 849450: Delivering message from send_newsletter@droit-technologie.org to [b]***list of all email recipients***[/b]  File: C:\Program Files\hMailServer\Data\{11B27B85-098B-4A8D-8298-39EF2BB7A65A}.eml"
"DEBUG"	1736	"2008-12-02 22:22:01.645"	"PersistentMessage::~ReadObject()"
"DEBUG"	4580	"2008-12-02 22:22:01.645"	"ClamWinVirusScanner::Scan()"
"DEBUG"	4580	"2008-12-02 22:22:01.645"	"SURBL::Run"
"DEBUG"	4580	"2008-12-02 22:22:01.645"	"SURBL::~Run"
"DEBUG"	4580	"2008-12-02 22:22:01.645"	"RuleApplier::ApplyRules"
"DEBUG"	4580	"2008-12-02 22:22:01.645"	"RuleApplier::_ApplyRule"
"DEBUG"	4580	"2008-12-02 22:22:01.645"	"RuleApplier::~_ApplyRule"
"DEBUG"	4580	"2008-12-02 22:22:01.645"	"RuleApplier::_ApplyRule"
"DEBUG"	4580	"2008-12-02 22:22:01.645"	"RuleApplier::~_ApplyRule"
"DEBUG"	4580	"2008-12-02 22:22:01.645"	"RuleApplier::_ApplyRule"
"DEBUG"	4580	"2008-12-02 22:22:01.645"	"RuleApplier::~_ApplyRule"
"DEBUG"	4580	"2008-12-02 22:22:01.645"	"RuleApplier::~ApplyRules"
"DEBUG"	4580	"2008-12-02 22:22:01.645"	"SD::_DeliverToLocalAccounts"
"DEBUG"	4580	"2008-12-02 22:22:01.645"	"SD::~_DeliverToLocalAccounts"
"DEBUG"	4580	"2008-12-02 22:22:01.676"	"SD::_DeliverToExternalAccounts"
"DEBUG"	5344	"2008-12-02 22:22:01.676"	"SD::DeliverMessage"
"APPLICATION"	5344	"2008-12-02 22:22:01.692"	"SMTPDeliverer - Message 868141: Delivering message from send_newsletter@droit-technologie.org to [b]***list of all email recipients***[/b] 
and then successful SMTP transaction with subscribers....
I really don't know why "internal users" receive the mail directly, but the external subscribers start to receive the newsletter after a restart of the hmailserver service.

Martin, I hope this will help you....to help me. I keep all log files at your disposal if you want

Kind regards,
Interrested by Law & new technologies ?
Intéressé par le droit de l'internet et des nouvelles technologies ?
Visit/Visitez http://www.droit-technologie.org

User avatar
martin
Developer
Developer
Posts: 6834
Joined: 2003-11-21 01:09
Location: Sweden
Contact:

Re: Hmailserver crash with mailinglist 10000 subscribers

Post by martin » 2008-12-03 10:19

Please send me the log at martin@hmailserver.com...

Thomas Parvais
Normal user
Normal user
Posts: 111
Joined: 2004-12-17 12:21
Contact:

Re: Hmailserver crash with mailinglist 10000 subscribers

Post by Thomas Parvais » 2008-12-03 22:51

martin wrote:Please send me the log at martin@hmailserver.com...
Was done 10 minutes ago Martin. Thanks !

Just simple question: have you changed/improved the queuing/throttling on distribution list on Release 5 ? something like http://www.hmailserver.com/forum/viewto ... =2&t=10629 ?

Thank you

Thomas
Interrested by Law & new technologies ?
Intéressé par le droit de l'internet et des nouvelles technologies ?
Visit/Visitez http://www.droit-technologie.org

User avatar
martin
Developer
Developer
Posts: 6834
Joined: 2003-11-21 01:09
Location: Sweden
Contact:

Re: Hmailserver crash with mailinglist 10000 subscribers

Post by martin » 2008-12-04 00:31

Have replied to your email. No significant changes have been made in this area in v5.

User avatar
martin
Developer
Developer
Posts: 6834
Joined: 2003-11-21 01:09
Location: Sweden
Contact:

Re: Hmailserver crash with mailinglist 10000 subscribers

Post by martin » 2008-12-04 11:44

I'm a bit confused. Your original post was that hMailServer crashed. Now you're saying it reports an error message in the log and but continues running with no crash?

The error is caused because your distribution list contains an empty email address. If you open the list in hMailServer Administrator, you should see it there. Removing the empty address should fix the error.

Thomas Parvais
Normal user
Normal user
Posts: 111
Joined: 2004-12-17 12:21
Contact:

Re: Hmailserver crash with mailinglist 10000 subscribers

Post by Thomas Parvais » 2008-12-04 14:10

martin wrote:I'm a bit confused. Your original post was that hMailServer crashed. Now you're saying it reports an error message in the log and but continues running with no crash?

The error is caused because your distribution list contains an empty email address. If you open the list in hMailServer Administrator, you should see it there. Removing the empty address should fix the error.
not crash, sending of message stops. Btw, you have the issue=> 1 email was empty ! I remove it we will try next newsletter !!

Thank you !

Thomas
Interrested by Law & new technologies ?
Intéressé par le droit de l'internet et des nouvelles technologies ?
Visit/Visitez http://www.droit-technologie.org

Post Reply