IMAP Bug?

Use this forum if you have installed hMailServer and want to ask a question related to a production release of hMailServer. Before posting, please read the troubleshooting guide. A large part of all reported issues are already described in detail here.
Post Reply
User avatar
sheffters
Senior user
Senior user
Posts: 453
Joined: 2009-07-01 20:46
Contact:

IMAP Bug?

Post by sheffters » 2009-09-15 13:35

Hi,

I've got IMAP setup and two people accessed the same mail box at the same time (I thought this was ok?).

The second one got a load of error messages about uid's (see screenshots).

It doesn't seem to be very easy to replicate (so don't know what caused it) ... but it's a bit worrying ... something up with the server / database???

Any ideas? (even if its just - you're not supposed to do that with IMAP!). Been running with IMAP for a while and it's been ok until two different machines connected at the same time to the same mailbox (never had a problem when webmail does this though).

hMail = 5.1.2-B346
Client = Outlook 2007

Thanks!

S.
Untitled4.jpg
Untitled3.jpg

^DooM^
Site Admin
Posts: 13861
Joined: 2005-07-29 16:18
Location: UK

Re: IMAP Bug?

Post by ^DooM^ » 2009-09-15 14:56

Did you have any logging enabled?
If at first you don't succeed, bomb disposal probably isn't for you! ヅ

User avatar
sheffters
Senior user
Senior user
Posts: 453
Joined: 2009-07-01 20:46
Contact:

Re: IMAP Bug?

Post by sheffters » 2009-09-15 15:28

no :(

it all seems happy at the moment ... cant get it to do it again .. just a bit twitched about what happened behind the scenes / if its anything to worry about or one of those things that you just sorta shrug at ...

S.

^DooM^
Site Admin
Posts: 13861
Joined: 2005-07-29 16:18
Location: UK

Re: IMAP Bug?

Post by ^DooM^ » 2009-09-15 15:35

Well me I'd shrug at it, lifes to short to lose any sleep over it ;) Just keep logging enabled for a while and post back if it happens again. We would just be guessing without logs.
If at first you don't succeed, bomb disposal probably isn't for you! ヅ

User avatar
sheffters
Senior user
Senior user
Posts: 453
Joined: 2009-07-01 20:46
Contact:

Re: IMAP Bug?

Post by sheffters » 2009-09-15 16:24

We would just be guessing without logs.
yeah I know ... (wish I had a quid for everytime that was said on here! ... lol) ... was just a bit weird. Best I could do was the outlook codes :(

all seems well anyway ...

'zzzzzzzzzzzzz' .. sleep catchup :)

Cheers

S.

User avatar
dzekas
Senior user
Senior user
Posts: 2486
Joined: 2005-10-13 21:28
Location: Lithuania

Re: IMAP Bug?

Post by dzekas » 2009-09-15 21:06

sheffters wrote:Hi,

I've got IMAP setup and two people accessed the same mail box at the same time (I thought this was ok?).

The second one got a load of error messages about uid's (see screenshots).

It doesn't seem to be very easy to replicate (so don't know what caused it) ... but it's a bit worrying ... something up with the server / database???

Any ideas? (even if its just - you're not supposed to do that with IMAP!). Been running with IMAP for a while and it's been ok until two different machines connected at the same time to the same mailbox (never had a problem when webmail does this though).
Outlook keeps persistent connection to your IMAP service and might have UID issues on hMailServer when same account is accessed by two or more clients. Webmail does not have such issues, because webmail connections are not persistent.

looks like microsoft interpretation of IMAP RFC differs from hmailserver interpretation of same docs.

User avatar
sheffters
Senior user
Senior user
Posts: 453
Joined: 2009-07-01 20:46
Contact:

Re: IMAP Bug?

Post by sheffters » 2009-09-15 21:16

ah .. thanks :)

User avatar
dzekas
Senior user
Senior user
Posts: 2486
Joined: 2005-10-13 21:28
Location: Lithuania

Re: IMAP Bug?

Post by dzekas » 2009-09-15 21:25

sheffters wrote:ah .. thanks :)
It might be hMailServer or Outlook bug. We'll never know, if we can't reproduce it and microsoft does not explain which error triggers this message. hMailServer might be handing unique ids incorrectly between two concurrent sessions or microsoft might be ignoring some parts of rfc and then complaining when others use those rfc features.

User avatar
sheffters
Senior user
Senior user
Posts: 453
Joined: 2009-07-01 20:46
Contact:

Re: IMAP Bug?

Post by sheffters » 2009-09-15 21:29

It keeps doing it every now and again ... will put some logging on tomorrow and see.

S.

User avatar
sheffters
Senior user
Senior user
Posts: 453
Joined: 2009-07-01 20:46
Contact:

Re: IMAP Bug?

Post by sheffters » 2009-09-16 12:59

the IMAP onversation log when this happens ...

"IMAPD" 2344 4018 "2009-09-16 11:54:07.437" "94.171.161.187" "SENT: * 168 EXISTS"
"IMAPD" 2344 4018 "2009-09-16 11:54:07.437" "94.171.161.187" "SENT: * 1 RECENT"
"IMAPD" 2344 4075 "2009-09-16 11:54:07.437" "94.171.161.187" "SENT: * 168 EXISTS"
"IMAPD" 2344 4075 "2009-09-16 11:54:07.437" "94.171.161.187" "SENT: * 1 RECENT"
"IMAPD" 2420 4075 "2009-09-16 11:54:07.453" "94.171.161.187" "RECEIVED: DONE"
"IMAPD" 2420 4075 "2009-09-16 11:54:07.453" "94.171.161.187" "SENT: e7r8 OK IDLE terminated"
"IMAPD" 2420 4075 "2009-09-16 11:54:07.687" "94.171.161.187" "RECEIVED: 6px8 FETCH 168 (UID)"
"IMAPD" 2420 4075 "2009-09-16 11:54:07.687" "94.171.161.187" "SENT: * 168 FETCH (UID 59711)"
"IMAPD" 2420 4075 "2009-09-16 11:54:07.687" "94.171.161.187" "SENT: 6px8 OK FETCH completed"
"IMAPD" 2420 4075 "2009-09-16 11:54:07.921" "94.171.161.187" "RECEIVED: 9fgf UID FETCH 59698:59711 (UID FLAGS RFC822.SIZE BODY.PEEK[HEADER] INTERNALDATE)"
"IMAPD" 2420 4075 "2009-09-16 11:54:07.921" "94.171.161.187" "SENT: * 168 FETCH (UID 59711 RFC822.SIZE 1189 FLAGS () INTERNALDATE "16-Sep-2009 11:54:05 +0100" BODY[HEADER] {718}"
"IMAPD" 2420 4075 "2009-09-16 11:54:07.921" "94.171.161.187" "SENT: )"
"IMAPD" 2420 4075 "2009-09-16 11:54:07.921" "94.171.161.187" "SENT: 9fgf OK UID completed"
"IMAPD" 2420 4075 "2009-09-16 11:54:08.156" "94.171.161.187" "RECEIVED: hv6a IDLE"
"IMAPD" 2420 4075 "2009-09-16 11:54:08.156" "94.171.161.187" "SENT: + idling"
"IMAPD" 2420 4075 "2009-09-16 11:54:11.703" "94.171.161.187" "RECEIVED: DONE"
"IMAPD" 2420 4075 "2009-09-16 11:54:11.703" "94.171.161.187" "SENT: hv6a OK IDLE terminated"
"IMAPD" 2420 4075 "2009-09-16 11:54:11.718" "94.171.161.187" "RECEIVED: 7d7o UID FETCH 59711 (UID FLAGS BODY.PEEK[])"
"IMAPD" 2420 4075 "2009-09-16 11:54:11.718" "94.171.161.187" "SENT: * 168 FETCH (UID 59711 FLAGS () BODY[] {1223}"
"IMAPD" 2420 4075 "2009-09-16 11:54:11.718" "94.171.161.187" "SENT: )"
"IMAPD" 2420 4075 "2009-09-16 11:54:11.718" "94.171.161.187" "SENT: 7d7o OK UID completed"
"IMAPD" 2420 4075 "2009-09-16 11:54:11.953" "94.171.161.187" "RECEIVED: 8q3k IDLE"
"IMAPD" 2420 4075 "2009-09-16 11:54:11.953" "94.171.161.187" "SENT: + idling"
"IMAPD" 2420 4075 "2009-09-16 11:54:15.234" "94.171.161.187" "RECEIVED: DONE"
"IMAPD" 2420 4075 "2009-09-16 11:54:15.234" "94.171.161.187" "SENT: 8q3k OK IDLE terminated"
"IMAPD" 2420 4075 "2009-09-16 11:54:15.250" "94.171.161.187" "RECEIVED: zaiw UID STORE 59711 +FLAGS (\Seen)"
"IMAPD" 2420 4075 "2009-09-16 11:54:15.281" "94.171.161.187" "SENT: * 168 FETCH (FLAGS (\Seen) UID 59711)"
"IMAPD" 2420 4018 "2009-09-16 11:54:15.281" "94.171.161.187" "SENT: * 168 FETCH (FLAGS (\Seen) UID 59711)"
"IMAPD" 2420 4075 "2009-09-16 11:54:15.281" "94.171.161.187" "SENT: zaiw OK UID completed"
"IMAPD" 2420 4075 "2009-09-16 11:54:15.515" "94.171.161.187" "RECEIVED: wjo6 IDLE"
"IMAPD" 2420 4075 "2009-09-16 11:54:15.515" "94.171.161.187" "SENT: + idling"
"IMAPD" 2380 4103 "2009-09-16 11:54:33.406" "94.171.161.187" "RECEIVED: DONE"
"IMAPD" 2380 4103 "2009-09-16 11:54:33.406" "94.171.161.187" "SENT: h6u0 OK IDLE terminated"
"IMAPD" 2400 4101 "2009-09-16 11:54:33.421" "94.171.161.187" "RECEIVED: DONE"
"IMAPD" 2380 4103 "2009-09-16 11:54:33.421" "94.171.161.187" "RECEIVED: 9cx4 LOGOUT"
"IMAPD" 2400 4101 "2009-09-16 11:54:33.421" "94.171.161.187" "SENT: mxak OK IDLE terminated"
"IMAPD" 2380 4103 "2009-09-16 11:54:33.421" "94.171.161.187" "SENT: * BYE Have a nice day[nl]9cx4 OK Logout completed"
"IMAPD" 2380 4102 "2009-09-16 11:54:33.437" "94.171.161.187" "RECEIVED: DONE"
"IMAPD" 2400 4101 "2009-09-16 11:54:33.437" "94.171.161.187" "RECEIVED: q761 LOGOUT"
"IMAPD" 2380 4102 "2009-09-16 11:54:33.437" "94.171.161.187" "SENT: yxjg OK IDLE terminated"
"IMAPD" 2400 4101 "2009-09-16 11:54:33.437" "94.171.161.187" "SENT: * BYE Have a nice day[nl]q761 OK Logout completed"
"IMAPD" 2380 4100 "2009-09-16 11:54:33.453" "94.171.161.187" "RECEIVED: DONE"
"IMAPD" 2380 4100 "2009-09-16 11:54:33.453" "94.171.161.187" "SENT: msgb OK IDLE terminated"
"IMAPD" 2380 4102 "2009-09-16 11:54:33.453" "94.171.161.187" "RECEIVED: t4fv LOGOUT"
"IMAPD" 2380 4102 "2009-09-16 11:54:33.453" "94.171.161.187" "SENT: * BYE Have a nice day[nl]t4fv OK Logout completed"
"IMAPD" 2380 4100 "2009-09-16 11:54:33.468" "94.171.161.187" "RECEIVED: 8uxw LOGOUT"
"IMAPD" 2380 4100 "2009-09-16 11:54:33.468" "94.171.161.187" "SENT: * BYE Have a nice day[nl]8uxw OK Logout completed"

I've attached all mornings convo from 10ish if its any use ...

S.
Attachments
imap-16_09_2009.zip
(92.1 KiB) Downloaded 156 times

User avatar
martin
Developer
Developer
Posts: 6837
Joined: 2003-11-21 01:09
Location: Sweden
Contact:

Re: IMAP Bug?

Post by martin » 2009-09-16 17:58

> It keeps doing it every now and again

Which message did the problem occur with when you got it during that log session? Was it 59246 or 59236?

I would need to take that ID and check whenever hMailServer sends it to Outlook and see if I can figure out what's confusing Outlook.

The error message claims that hMailServer reported an UID which didn't comply with the RFC's. The UID shown in the error message does comply with the RFC's (numerical integer) so I assume the problem is that Outlook thinks that something hMailServer does related to UID's aren't done properly.

User avatar
sheffters
Senior user
Senior user
Posts: 453
Joined: 2009-07-01 20:46
Contact:

Re: IMAP Bug?

Post by sheffters » 2009-09-16 18:06

I didnt grab the UID (forgot) ... I'll leave the logging on and repost with screenshots next time it happens.

Cheers

S.

User avatar
sheffters
Senior user
Senior user
Posts: 453
Joined: 2009-07-01 20:46
Contact:

Re: IMAP Bug?

Post by sheffters » 2009-09-16 18:17

done it again ... so here we are! (didnt get the imap complaince error this time, just a uid error one)
uid error.jpg
logs have ... attached file is last hours worth of convos ...

error was ~1710 server time.

Thanks

S.
Attachments
im-hour-log.zip
(67.27 KiB) Downloaded 173 times

User avatar
sheffters
Senior user
Senior user
Posts: 453
Joined: 2009-07-01 20:46
Contact:

Re: IMAP Bug?

Post by sheffters » 2009-10-20 14:56

elo,

sorry to be a pain ... but this is still happpening ... any idea how to fix etc?

thanks

S.

DeanoX
Senior user
Senior user
Posts: 480
Joined: 2005-11-05 00:07
Location: Michigan

Re: IMAP Bug?

Post by DeanoX » 2009-10-20 16:40

Try an upgrade to the latest stable release of hmailserver 5.3-B1617, and see if the problem persists.
http://download.hmailserver.com/hMailSe ... -B1617.exe

User avatar
sheffters
Senior user
Senior user
Posts: 453
Joined: 2009-07-01 20:46
Contact:

Re: IMAP Bug?

Post by sheffters » 2009-10-20 16:44

Hi,

I'm on that for the last few days ... same prob :( ... was hoping it might have fixed it too.

Cheers

S.

roi
Normal user
Normal user
Posts: 153
Joined: 2009-09-20 12:56
Location: Chiba, Japan

Re: IMAP Bug?

Post by roi » 2009-10-21 11:20

sheffters -- I don't use Outlook but I find your problem distressing so I tried to google on the issue. It seems you are not alone with this problem and that it is not a server issue but an add-in issue. Below is a link that might be a good start for you. Good Luck...

http://www.microsoft.com/communities/ne ... &sloc=&p=1
hMS: 5.2.1-B361 | DB: Internal MySQL from hMS 4.4 | OS: W2K3 1Gb VM

User avatar
sheffters
Senior user
Senior user
Posts: 453
Joined: 2009-07-01 20:46
Contact:

Re: IMAP Bug?

Post by sheffters » 2009-10-21 15:04

Hi,

Thanks for that link.

*bases head against wall for not googlin properly myself*

I use Norton ... will disable it and see how it goes!

Thanks a lot

S.

^DooM^
Site Admin
Posts: 13861
Joined: 2005-07-29 16:18
Location: UK

Re: IMAP Bug?

Post by ^DooM^ » 2009-10-21 15:22

sheffters wrote:I use Norton
:roll:
If at first you don't succeed, bomb disposal probably isn't for you! ヅ

User avatar
sheffters
Senior user
Senior user
Posts: 453
Joined: 2009-07-01 20:46
Contact:

Re: IMAP Bug?

Post by sheffters » 2009-10-21 15:30

I know ... epic fail ... latest one is much better than the original 360's though ... apart from IMAP obviously.

Tried Comodo for a bit till there update thing got jammed on all my pcs and set CPU to 100% ... known bug with there update process ... but less than helpful having to uninstall, reinstall and then hope it gets a different update.

Used a few others too ... with variable results.

Ended up back on Norton ... now hunting for something else to use!

Problem is there isn't really one without a problem of some sort or other.

S.

^DooM^
Site Admin
Posts: 13861
Joined: 2005-07-29 16:18
Location: UK

Re: IMAP Bug?

Post by ^DooM^ » 2009-10-21 15:41

I'm using http://www.tallemu.com/ For the free Firewall and http://www.cloudantivirus.com/ for AV

I got fed up of these all in one jobbies breaking. I had the same issue with Comodo and AVG is just useless at the moment.
If at first you don't succeed, bomb disposal probably isn't for you! ヅ

User avatar
sheffters
Senior user
Senior user
Posts: 453
Joined: 2009-07-01 20:46
Contact:

Re: IMAP Bug?

Post by sheffters » 2009-10-21 16:23

ooh thanks ... will give em a go.

Had never heard of the http://www.tallemu.com/ one.

Cheers

S.

Frog
Normal user
Normal user
Posts: 55
Joined: 2005-07-28 10:46
Location: Sydney, Australia
Contact:

Re: IMAP Bug?

Post by Frog » 2009-10-23 07:26

We get this all the time (and always have done with Outlook) even on a vanilla install. It appears that deleting a message can cause the UIDs of other messages to change?

User avatar
sheffters
Senior user
Senior user
Posts: 453
Joined: 2009-07-01 20:46
Contact:

Re: IMAP Bug?

Post by sheffters » 2009-10-23 13:10

I think it happens when theres 2 machines in the same mail box and one of them deletes a message ... sometimes the UID changes sometimes it doesn't.

Don't know why the UID would change though ... presumably thats dealt with on the server???

Cheers

S.

^DooM^
Site Admin
Posts: 13861
Joined: 2005-07-29 16:18
Location: UK

Re: IMAP Bug?

Post by ^DooM^ » 2009-10-23 13:12

Wasn't it because hMail creates a new copy of the email when it moves it around?
If at first you don't succeed, bomb disposal probably isn't for you! ヅ

User avatar
dzekas
Senior user
Senior user
Posts: 2486
Joined: 2005-10-13 21:28
Location: Lithuania

Re: IMAP Bug?

Post by dzekas » 2009-10-23 13:25

sheffters wrote:I think it happens when theres 2 machines in the same mail box and one of them deletes a message ... sometimes the UID changes sometimes it doesn't.

Don't know why the UID would change though ... presumably thats dealt with on the server???
Server informs client about changed UIDs. They only have to check UIDVALIDATY.

Could you try turning off IMAP IDLE support?

User avatar
sheffters
Senior user
Senior user
Posts: 453
Joined: 2009-07-01 20:46
Contact:

Re: IMAP Bug?

Post by sheffters » 2009-10-23 14:23

^DooM^ wrote:Wasn't it because hMail creates a new copy of the email when it moves it around?
It's deleted though not moved ... at least thats when I've noticed it recently.
Could you try turning off IMAP IDLE support?
I'll give it a go and let you know.

Thanks!

S.

^DooM^
Site Admin
Posts: 13861
Joined: 2005-07-29 16:18
Location: UK

Re: IMAP Bug?

Post by ^DooM^ » 2009-10-23 15:07

You mean it's moved to the deleted folder before the expunge command is used.
If at first you don't succeed, bomb disposal probably isn't for you! ヅ

User avatar
sheffters
Senior user
Senior user
Posts: 453
Joined: 2009-07-01 20:46
Contact:

Re: IMAP Bug?

Post by sheffters » 2009-10-23 17:06

@ doom ... ah :)

@ dzekas ... still does it with IDLE disabled.

Will try using thunderbird or summat and see if it still happens.

S.

westdam
Senior user
Senior user
Posts: 728
Joined: 2006-08-01 21:24
Location: Padova, Italy
Contact:

Re: IMAP Bug?

Post by westdam » 2009-11-03 15:36

any news?
i'm using tbird since long time.. so cant help with oe..

User avatar
sheffters
Senior user
Senior user
Posts: 453
Joined: 2009-07-01 20:46
Contact:

Re: IMAP Bug?

Post by sheffters » 2009-11-03 17:47

elo,

Sorry ... forgot about this one!

Its an outlook problem ... works fine with norton + thunderbird ... but as soon as outlook connects at the same time it goes mental ... even if the other client is thunderbird (i.e. outlook + thunderbird connected at the same time) ...
went crazy, but don't now if thats because thunderbird did a full sync or not.

Basically, it comes down to Outlook being shite at IMAP no matter what else is running / connected, it cant handle more than 1 connection at once ... which kinda defeats the point of imap (or at least what im using it for!).

Cheers

S.

Post Reply