hMail hangs with "HM4208, Source: IOCPQueueWorkerTask..."

Use this forum if you have installed hMailServer and want to ask a question related to a production release of hMailServer. Before posting, please read the troubleshooting guide. A large part of all reported issues are already described in detail here.
Post Reply
jr3151006
Normal user
Normal user
Posts: 31
Joined: 2011-02-03 14:57

hMail hangs with "HM4208, Source: IOCPQueueWorkerTask..."

Post by jr3151006 » 2011-02-28 15:38

hi,

we are using a VMware server (2GB RAM - Dual Core Xeon E5345 2.33Ghz) for a custommer with only 1 domain wich has 3 domain alias and 110 mailboxes; sometimes h-mail (v5.3.3b-1879) hangs for users using IMAP and for pop3 users.


Looking the Hmail error log files we can see:

"ERROR" 764 "2011-02-28 10:03:40.967" "Severity: 2 (High), Code: HM4208, Source: IOCPQueueWorkerTask::DoWork, Description: An unknown error occured while handling asynchronous requests."


I was reading the topi http://www.hmailserver.com/forum/viewto ... =6&t=17808 and found that our server already has 'Index' disabled at 'Performance tab'; I multiplied by 3 the values on 'Tread' tab and force the application priority to 'above normal' since that server is only for email purposes.

There is anything else to consider?

* our db is MySQL Windows.

User avatar
daz69
Normal user
Normal user
Posts: 128
Joined: 2010-07-20 15:22
Location: Cornwall

Re: hMail hangs with "HM4208, Source: IOCPQueueWorkerTask...

Post by daz69 » 2011-02-28 16:03

Sounds like an upgrade may be the best way to go.

http://www.hmailserver.com/forum/viewto ... 08#p121683

cerri
Normal user
Normal user
Posts: 90
Joined: 2008-05-12 17:06

Re: hMail hangs with "HM4208, Source: IOCPQueueWorkerTask...

Post by cerri » 2011-02-28 16:50

I've just encountered the same error:

"ERROR" 5492 "2011-02-28 15:44:46.328" "Severity: 3 (Medium), Code: HM5141, Source: TCPConnection::HandleRead, Description: An error occurred while handling read operation. Remote IP: 2.158.254.25"
"ERROR" 5492 "2011-02-28 15:44:46.328" "Severity: 3 (Medium), Code: HM4371, Source: IMAPConnection::~IMAPConnection(), Description: An error occurred while clearing command handlers."
"ERROR" 5492 "2011-02-28 15:44:46.328" "Severity: 3 (Medium), Code: HM4308, Source: MailboxChangeNotifier::Unsubscribe, Description: An unknown error has occurred."
"ERROR" 5492 "2011-02-28 15:44:46.328" "Severity: 2 (High), Code: HM4208, Source: IOCPQueueWorkerTask::DoWork, Description: An unknown error occured while handling asynchronous requests."
"ERROR" 5600 "2011-02-28 15:44:46.344" "Severity: 3 (Medium), Code: HM5141, Source: TCPConnection::HandleRead, Description: An error occurred while handling read operation. Remote IP: 2.158.254.25"
"ERROR" 5600 "2011-02-28 15:44:46.344" "Severity: 3 (Medium), Code: HM4371, Source: IMAPConnection::~IMAPConnection(), Description: An error occurred while clearing command handlers."
"ERROR" 5600 "2011-02-28 15:44:46.344" "Severity: 3 (Medium), Code: HM4308, Source: MailboxChangeNotifier::Unsubscribe, Description: An unknown error has occurred."
"ERROR" 5600 "2011-02-28 15:44:46.359" "Severity: 2 (High), Code: HM4208, Source: IOCPQueueWorkerTask::DoWork, Description: An unknown error occured while handling asynchronous requests."
"ERROR" 5416 "2011-02-28 15:44:46.578" "Severity: 2 (High), Code: HM4208, Source: Thread::ThreadFunc, Description: An unknown error occurred while running thread. Returning thread to pool."

I had to kill the process and to start it again, to solve the problem.
My configuration:

hMailServer 5.3.3 - Build 1879
Windows 2003 Enterprise SP2
4GB Ram - MySQL DB

jr3151006
Normal user
Normal user
Posts: 31
Joined: 2011-02-03 14:57

Re: hMail hangs with "HM4208, Source: IOCPQueueWorkerTask...

Post by jr3151006 » 2011-03-02 20:25

As Cerri posted in other link (http://www.hmailserver.com/forum/viewto ... 08#p121683), I will prefer wait for a new stable version instead move to a beta who maybe fix that problem and create anothers!

* I would like to hear hMail team!

tks,

Renato Pereira

Bill48105
Developer
Developer
Posts: 6192
Joined: 2010-04-24 23:16
Location: Michigan, USA

Re: hMail hangs with "HM4208, Source: IOCPQueueWorkerTask...

Post by Bill48105 » 2011-03-02 22:46

Based on testing & reports it appears these issues are resolved or significantly reduced in latest 5.4 & possibly in 5.3.4 although I've not tried that one myself.

So people running 5.3.3 or earlier who are having the IOCP errors need to make the decision if they want to try & adjust hmailserver settings to try & reduce the frequency of the errors or take chance of upgrading to 5.3.4 beta or 5.4 alpha to see if the upgrade solves the problem. We have been in a chicken & egg situation where some are having the problem looking for solutions but unwilling/reluctant to try the updates but without people testing the updates we have no way to know if the updates fix the problems, have new bugs, etc. That being said, I doubt any of us are going to ask people to upgrade to beta/alpha builds on production machines so it is wait & see as been the case for the past few months. Eventually a build will have the name changed & maybe people won't be so scared of a label. ;)

For anyone reluctant to upgrade to 5.3.4 beta or 5.4 alpha, you might consider running a test server to see how it works. Or one might consider making backups & upgrading during an off peak time so that restoring is not as big of a deal. If you are considering upgrading to new server hardware, you might consider migrating to the new server then upgrading the new one so you can fall back on your old one of needed. So a few semi-safe options to consider, especially for those having the IOCP errors.
Bill
hMailServer build LIVE on my servers: 5.4-B2014050402
#hmailserver on FreeNode IRC https://webchat.freenode.net/?channels=#hmailserver
*** ABSENT FROM hMail! Those in IRC know how to find me if urgent. ***

cerri
Normal user
Normal user
Posts: 90
Joined: 2008-05-12 17:06

Re: hMail hangs with "HM4208, Source: IOCPQueueWorkerTask...

Post by cerri » 2011-03-02 22:50

Hi Bill48105,

you say "adjust hmailserver settings": what do you mean? What can be set on hmailserver to reduce this error?
About the IOCP error, is it a bug or is it, ie, an overload of the hmailserver?

Thanks

Bill48105
Developer
Developer
Posts: 6192
Joined: 2010-04-24 23:16
Location: Michigan, USA

Re: hMail hangs with "HM4208, Source: IOCPQueueWorkerTask...

Post by Bill48105 » 2011-03-02 23:15

cerri,
I've posted up possible settings numerous times & really really hate to go over them again & again.. Especially since they rarely seem to help & sometimes make the errors happen more often. Adjusting the settings was really just an attempt for work-arounds until real fixes could be in place.

As noted numerous times the IOCP errors appear to be caused by many factors. It/they are not 1 bug but instead an issue that manifests under certain conditions. Because of that it was almost impossible to reproduce to try & track it down. (From what I can tell the same or very similar issue can be reproduced back MANY versions of hmailserver - possibly back to 4.4 - but the combination of conditions were just so unlikely no one ran into it or happened so infrequently no one complained about it. For some reason there was an 'outbreak' with 5.3.3 or possibly 5.3.x where suddenly conditions were right for it to happen more all of a sudden. It was not a new issue, just newly a problem.) Once we were able to reproduce it, changes in the code often made the problem 'stop' when in fact it just manifested to occur under other conditions. After weeks & weeks of tedious testing we believed we narrowed it down to certain areas & martin re-wrote a bunch of related code for 5.3.4 & the newer 5.4 versions which appear to have solved the problem but until more testing is done we don't know if the problem has really gone or if it simply moved to happen under different conditions. People having the IOCP errors to an extent that their server is not reliable anyway are likely good candidates but as noted it should all be done with care, backups & common sense.
Bill
hMailServer build LIVE on my servers: 5.4-B2014050402
#hmailserver on FreeNode IRC https://webchat.freenode.net/?channels=#hmailserver
*** ABSENT FROM hMail! Those in IRC know how to find me if urgent. ***

cerri
Normal user
Normal user
Posts: 90
Joined: 2008-05-12 17:06

Re: hMail hangs with "HM4208, Source: IOCPQueueWorkerTask...

Post by cerri » 2011-03-03 09:53

Hi Bill48105,

sorry for the question, I didn't find the posts you refer searching the forum before, now I found the settings.
Again, sorry about that.

But I found a cool answer: you (and Martin) were able to reproduce the problem and you've tried to solve in the 5.3.4 beta release (if I read right), and that was what I was searching about.

I mean, if you were able to reproduce the error, you were able even to try to solve it. :-)
So, I'll try to update my installation with the new beta this weekend (or as soon as possible).

Thanks againg.

jr3151006
Normal user
Normal user
Posts: 31
Joined: 2011-02-03 14:57

Re: hMail hangs with "HM4208, Source: IOCPQueueWorkerTask...

Post by jr3151006 » 2011-03-03 10:23

Hey guys,

the handling error on the app CODE is too 'generic'? I dont think so...
In that way the hMail team are able to trace the possibilities in the code wich generated that error, showed in the log!!

>>> My thoughs...

Bill48105
Developer
Developer
Posts: 6192
Joined: 2010-04-24 23:16
Location: Michigan, USA

Re: hMail hangs with "HM4208, Source: IOCPQueueWorkerTask...

Post by Bill48105 » 2011-03-04 07:18

cerri: It is believed 5.3.4 beta & newer 5.4 alpha's fix or greatly reduce risk of the problem based on testing & reports from a few people who have tried it. The only way we'll know for sure is when enough people try the updated versions.

jr3151006: Not sure what you are saying exactly but I will say this.. Martin & I spent more hours than I can count tracking down the cause(s) of the problem but a HUGE hindrance was fact that making changes to the code to try & debug/trace it or even minor changes in the system such as a different program running caused the problem to stop or move to different set of conditions. Once we narrowed it down martin pretty much tore out the area & started over rather than spend more time chasing it. The work was not for nothing as it confirmed there was a problem and narrowed it down to specific areas but it sure would have been great to be a 'oh there it is' and simple fix but thankfully martin took the time to work on it. Now we just need people to test the updated versions so we know if this problem is fixed or if new bugs were introduced.

Anyway, we await feedback on how 5.3.4 beta & 5.4 alpha are working for people, even if just on test servers.
Thx
Bill
hMailServer build LIVE on my servers: 5.4-B2014050402
#hmailserver on FreeNode IRC https://webchat.freenode.net/?channels=#hmailserver
*** ABSENT FROM hMail! Those in IRC know how to find me if urgent. ***

cerri
Normal user
Normal user
Posts: 90
Joined: 2008-05-12 17:06

Re: hMail hangs with "HM4208, Source: IOCPQueueWorkerTask...

Post by cerri » 2011-03-09 09:25

I've updated my customer installation to hMailServer 5.3.4 - 1913, and until now all is running fine.

I've update this post if there will be any news.

Thanks to all

jr3151006
Normal user
Normal user
Posts: 31
Joined: 2011-02-03 14:57

Re: hMail hangs with "HM4208, Source: IOCPQueueWorkerTask...

Post by jr3151006 » 2011-03-09 15:22

Cerri,

can you guide/explain me about the 'migration'? There is some considerations/procedures?

tks,

Renato P

cerri
Normal user
Normal user
Posts: 90
Joined: 2008-05-12 17:06

Re: hMail hangs with "HM4208, Source: IOCPQueueWorkerTask...

Post by cerri » 2011-03-09 15:30

Nothing. I update from a 5.3.3, so just run the installer.

Ofcourse, it's a good thing to have a DB backup before update. Just in case ;-)

adipose
New user
New user
Posts: 24
Joined: 2004-05-28 23:55

Re: hMail hangs with "HM4208, Source: IOCPQueueWorkerTask...

Post by adipose » 2011-08-12 16:25

My server started getting these errors again today:

Severity: 2 (High), Code: HM4208, Source: IOCPQueueWorkerTask::DoWork, Description: An unknown error occured while handling asynchronous requests.

I had a few 4GB logs before I noticed.

I have been running 4.3.4 for quite some time without issue. Should I be using the alpha (!) vs. the latest beta or stable?

^DooM^
Site Admin
Posts: 13861
Joined: 2005-07-29 16:18
Location: UK

Re: hMail hangs with "HM4208, Source: IOCPQueueWorkerTask...

Post by ^DooM^ » 2011-08-12 16:36

Update to latest stable first to see if that fixes your issue
If at first you don't succeed, bomb disposal probably isn't for you! ヅ

adipose
New user
New user
Posts: 24
Joined: 2004-05-28 23:55

Re: hMail hangs with "HM4208, Source: IOCPQueueWorkerTask...

Post by adipose » 2011-08-12 22:35

^DooM^ wrote:Update to latest stable first to see if that fixes your issue
Sorry for the typo. I am using 5.3.4 1913 (not 4.3.4).

^DooM^
Site Admin
Posts: 13861
Joined: 2005-07-29 16:18
Location: UK

Re: hMail hangs with "HM4208, Source: IOCPQueueWorkerTask...

Post by ^DooM^ » 2011-08-13 02:12

That is still not the latest stable.
If at first you don't succeed, bomb disposal probably isn't for you! ヅ

Bill48105
Developer
Developer
Posts: 6192
Joined: 2010-04-24 23:16
Location: Michigan, USA

Re: hMail hangs with "HM4208, Source: IOCPQueueWorkerTask...

Post by Bill48105 » 2011-08-13 16:55

adipose wrote:My server started getting these errors again today:

Severity: 2 (High), Code: HM4208, Source: IOCPQueueWorkerTask::DoWork, Description: An unknown error occured while handling asynchronous requests.

I had a few 4GB logs before I noticed.

I have been running 4.3.4 for quite some time without issue. Should I be using the alpha (!) vs. the latest beta or stable?
Based on what others are telling us 5.3.4 beta has the same IOCP issue as earlier versions under certain conditions & seems upgrading to 5.4 alpha fixes it or possibly just shifts when it happens which we won't know until enough people try 5.4 but this poll should give you an idea of how 5.4 is working out for people so far: http://www.hmailserver.com/forum/viewto ... 10&t=20581
Bill
hMailServer build LIVE on my servers: 5.4-B2014050402
#hmailserver on FreeNode IRC https://webchat.freenode.net/?channels=#hmailserver
*** ABSENT FROM hMail! Those in IRC know how to find me if urgent. ***

adipose
New user
New user
Posts: 24
Joined: 2004-05-28 23:55

Re: hMail hangs with "HM4208, Source: IOCPQueueWorkerTask...

Post by adipose » 2011-08-15 19:28

^DooM^ wrote:That is still not the latest stable.
I don't know what you mean by the "latest stable."

I am using 5.3.4 build 1913, which is the "latest" build available on:

http://www.hmailserver.com/index.php?page=download

The latest "stable," as I would call it, is 5.3.3 build 1879, since that is the latest "production version."

I am actually using the most recent beta, because build 5.3.3/1879 has had this issue for some time. The beta appeared to be working fine until the error cropped up again a few days ago.

Now, there is an alpha build out there, 5.4. My original question was whether I should upgrade to the alpha, since even the latest beta does not appear to have solved the issue.

You respond by saying, "try the latest stable." But I don't know what "stable" means in the hmail context. Is it alpha? Is it beta? Is it production?

^DooM^
Site Admin
Posts: 13861
Joined: 2005-07-29 16:18
Location: UK

Re: hMail hangs with "HM4208, Source: IOCPQueueWorkerTask...

Post by ^DooM^ » 2011-08-16 00:36

My bad, i'm so used to calling 5.4 stable I forget it's still only classified on the site as alpha. I'm running 5.4 in production, I recommend that version
If at first you don't succeed, bomb disposal probably isn't for you! ヅ

Bill48105
Developer
Developer
Posts: 6192
Joined: 2010-04-24 23:16
Location: Michigan, USA

Re: hMail hangs with "HM4208, Source: IOCPQueueWorkerTask...

Post by Bill48105 » 2011-08-16 15:56

So many of us have been running 5.4 alpha without issue for so long (almost 1 year for me) while there are known problems with 5.3.3 & 5.3.4 that we consider 5.4 to be the most stable & it is the newest so latest stable. :) Just waiting on martin to make it official. ;)
Bill
hMailServer build LIVE on my servers: 5.4-B2014050402
#hmailserver on FreeNode IRC https://webchat.freenode.net/?channels=#hmailserver
*** ABSENT FROM hMail! Those in IRC know how to find me if urgent. ***

adipose
New user
New user
Posts: 24
Joined: 2004-05-28 23:55

Re: hMail hangs with "HM4208, Source: IOCPQueueWorkerTask...

Post by adipose » 2011-08-20 07:51

Heh, ok. Thanks, guys. I will upgrade to alpha, then.

Post Reply