Page 1 of 1

Problem with hmail installation freeze imap folders

Posted: 2019-02-14 01:44
by marceloleaes
Hello

I have a hmail running on a windows server 2012
with MySQL database 5.7.19, hmail version: 5.6.7-B2425

it has been crashing a few times during the course of the day, I realize that other users complain that their imap boxes stop updating the most recent emails. after restarting the service back to normal, the logs realized that most of the errors are related to a specific user's box, but also the same log entries with other boxes but at a much lower frequency.

attached logs and dumps collections, thank the help of colleagues in this case :)

Re: Problem with hmail installation freeze imap folders

Posted: 2019-02-14 05:01
by Dravion
hMailServer cannot access various Messagefiles

"ERROR" 8880 "2019-02-13 18:40:52.539" "Severity: 3 (Medium), Code: HM4403, Source: Message::GetHeader, Description: Could not read the message header, since the file was not available. File: C:\MAILSERVER\hMailServer\Data\ffreis.com.br\fabio\4A\{4A61F9E8-576A-4E77-90A9-523CB217DEA7}.eml"
"ERROR" 8880 "2019-02-13 18:40:52.539" "Severity: 3 (Medium), Code: HM4403, Source: Message::GetHeader, Description: Could not read the message header, since the file was not available. File: C:\MAILSERVER\hMailServer\Data\ffreis.com.br\fabio\B3\{B36F1AD4-1C67-4169-B6A9-23E9AE80E5FE}.eml"
"ERROR" 8880 "2019-02-13 18:40:52.539" "Severity: 3 (Medium), Code: HM4403, Source: Message::GetHeader, Description: Could not read the message header, since the file was not available. File: C:\MAILSERVER\hMailServer\Data\ffreis.com.br\fabio\5B\{5B5850C5-FE22-4FF9-998B-5531063D4896}.eml"
"ERROR" 8880 "2019-02-13 18:40:52.539" "Severity: 3 (Medium), Code: HM4403, Source: Message::GetHeader, Description: Could not read the message header, since the file was not available. File: C:\MAILSERVER\hMailServer\Data\ffreis.com.br\fabio\E4\{E4D2DF4D-6867-4213-8386-DFB9296B1F94}.eml"
"ERROR" 8880 "2019-02-13 18:40:52.555" "Severity: 3 (Medium), Code: HM4403, Source: Message::GetHeader, Description: Could not read the message header, since the file was not available. File: C:\MAILSERVER\hMailServer\Data\ffreis.com.br\fabio\8D\{8D44A4F5-3DCB-4072-8472-B8BD3C8BFC68}.eml"

Check your Antivirus Software and or other blocking Processes.

Re: Problem with hmail installation freeze imap folders

Posted: 2019-02-14 15:02
by marceloleaes
Hi Dravion

On the server has Sophos Endpoint Protection and I have already made the release rule for the entire Hmail and IIS directory, I can discard the antivirus in this case. The part of the log that you have placed is just the user facing the problem. The stations are using Outlook 2016. Is there any known problem with this version of Outlook that can generate this behavior in Hmail?

Re: Problem with hmail installation freeze imap folders

Posted: 2019-02-14 15:13
by jimimaseye
What about av on the client machine? Or protocol traffic inspection on smtp or imap? Have you excluded that too?

Re: Problem with hmail installation freeze imap folders

Posted: 2019-02-14 15:55
by marceloleaes
On machines it's the same antivirus
It does not have an email plugin like avg, avast or similar.
imap and smtp connection has no intervention from him.

Re: Problem with hmail installation freeze imap folders

Posted: 2019-02-15 14:41
by mattg
This is nearly always that the data directory has no been excluded from Antivurus scanning

Check again please

Re: Problem with hmail installation freeze imap folders

Posted: 2019-02-16 04:13
by marceloleaes
Hi mattg

Absolutely sure that the directories I've added are not being scanned either in real time or on demand.
I just ran a test with eicar in the directories and in no directory or sub directory the antivirus was triggered.

Code: Select all

C: \ MAILSERVER \
C: \ inetpub \ wwwroot \
C: \ Program Files \ MySQL \ MySQL Server 5.7 \
C: \ ProgramData \ MySQL \ MySQL Server 5.7 \
It was detected only when moving to the desktop.
Sophos.JPG
In excluded directories:
Sophos2.JPG

Re: Problem with hmail installation freeze imap folders

Posted: 2019-02-16 15:35
by jimimaseye
Send eicar in via email and attempt to view it by email client.

What happens?

[Entered by mobile. Excuse my spelling.]

Re: Problem with hmail installation freeze imap folders

Posted: 2019-02-20 03:46
by marceloleaes
As attachment in email nothing happens.

Only when the attachment is saved on the machine does the antivirus announce the threat.

I noticed that the emails duplicate in some boxes, mainly in the box of sent items soon after sending, after a time when it synchronizes again they add the repeated emails.

Anything else or any specific performance settings to mitigate or solve this problem?

Re: Problem with hmail installation freeze imap folders

Posted: 2019-02-20 04:28
by mattg
Which mail client is being used?

Are single accounts accessed by multiple mail clients simultaneously?

Re: Problem with hmail installation freeze imap folders

Posted: 2019-02-20 09:58
by jimimaseye
marceloleaes wrote:
2019-02-20 03:46
As attachment in email nothing happens.

Only when the attachment is saved on the machine does the antivirus announce the threat.

I noticed that the emails duplicate in some boxes, mainly in the box of sent items soon after sending, after a time when it synchronizes again they add the repeated emails.

Anything else or any specific performance settings to mitigate or solve this problem?
Run this and post the results: viewtopic.php?f=20&t=30914

Re: Problem with hmail installation freeze imap folders

Posted: 2019-03-06 21:47
by marceloleaes
Follow-up result

Code: Select all

[code]2019-03-06   Hmailserver: 5.6.7-B2425

DOMAINS

   "Domain1.com" - abxxxxxx.com.br                Enabled: True

SIGNATURE         LIMITS                       DKIM               ADVANCED
  Enabled: False   Max size:                0   Enabled: False   
                   Max message size:        0                      Plus addressing: False
                   Max size of accounts:    0                    
                                                                   Greylisting:     False

   "Domain2.com" - acxxx.com                      Enabled: True

SIGNATURE         LIMITS                       DKIM               ADVANCED
  Enabled: False   Max size:                0   Enabled: False   
                   Max message size:        0                      Plus addressing: False
                   Max size of accounts:    0                    
                                                                   Greylisting:     False

   "Domain3.com" - alxxxxxxxx.com                 Enabled: True

SIGNATURE         LIMITS                       DKIM               ADVANCED
  Enabled: False   Max size:                0   Enabled: False   
                   Max message size:        0                      Plus addressing: False
                   Max size of accounts:    0                    
                                                                   Greylisting:     False

   "Domain4.com" - caxxxxxx.com.br                Enabled: True

SIGNATURE         LIMITS                       DKIM               ADVANCED
  Enabled: False   Max size:                0   Enabled: False   
                   Max message size:        0                      Plus addressing: False
                   Max size of accounts:    0                    
                                                                   Greylisting:     False

   "Domain5.com" - loxxxxxxxxxxx.com              Enabled: True

SIGNATURE         LIMITS                       DKIM               ADVANCED
  Enabled: False   Max size:                0   Enabled: False   
                   Max message size:        0                      Plus addressing: False
                   Max size of accounts:    0                    
                                                                   Greylisting:     False

   "Domain6.com" - loxxxxxxxxxxx.com.br           Enabled: True

SIGNATURE         LIMITS                       DKIM               ADVANCED
  Enabled: False   Max size:                0   Enabled: False   
                   Max message size:        0                      Plus addressing: False
                   Max size of accounts:    0                    
                                                                   Greylisting:     False

   "Domain7.com" - mbxxxxxxx.com                  Enabled: True

SIGNATURE         LIMITS                       DKIM               ADVANCED
  Enabled: False   Max size:                0   Enabled: False   
                   Max message size:        0                      Plus addressing: False
                   Max size of accounts:    0                    
                                                                   Greylisting:     False

   "Domain8.com" - paxxxxxxxxx.com                Enabled: True

SIGNATURE         LIMITS                       DKIM               ADVANCED
  Enabled: False   Max size:                0   Enabled: False   
                   Max message size:        0                      Plus addressing: False
                   Max size of accounts:    0                    
                                                                   Greylisting:     False

   "Domain9.com" - paxxxxxxxxx.com                Enabled: True

SIGNATURE         LIMITS                       DKIM               ADVANCED
  Enabled: False   Max size:                0   Enabled: False   
                   Max message size:        0                      Plus addressing: False
                   Max size of accounts:    0                    
                                                                   Greylisting:     False

   "Domain10.com" - paxxxxxxxx.com                Enabled: True

SIGNATURE         LIMITS                       DKIM               ADVANCED
  Enabled: False   Max size:                0   Enabled: False   
                   Max message size:        0                      Plus addressing: False
                   Max size of accounts:    0                    
                                                                   Greylisting:     False

   "Domain11.com" - paxxxxxxxx.com.br             Enabled: True

SIGNATURE         LIMITS                       DKIM               ADVANCED
  Enabled: False   Max size:                0   Enabled: False   
                   Max message size:        0                      Plus addressing: False
                   Max size of accounts:    0                    
                                                                   Greylisting:     False

   "Domain12.com" - paxxxxxxxxx.com               Enabled: True

SIGNATURE         LIMITS                       DKIM               ADVANCED
  Enabled: False   Max size:                0   Enabled: False   
                   Max message size:        0                      Plus addressing: False
                   Max size of accounts:    0                    
                                                                   Greylisting: !! ENABLED BUT NOT ACTIVATED!! 

   "Domain13.com" - paxxxxxxxx.com.br             Enabled: True

SIGNATURE         LIMITS                       DKIM               ADVANCED
  Enabled: False   Max size:                0   Enabled: False   
                   Max message size:        0                      Plus addressing: False
                   Max size of accounts:    0                    
                                                                   Greylisting:     False

   "Domain14.com" - paxxxxxxxxx.com               Enabled: True

SIGNATURE         LIMITS                       DKIM               ADVANCED
  Enabled: False   Max size:                0   Enabled: False   
                   Max message size:        0                      Plus addressing: False
                   Max size of accounts:    0                    
                                                                   Greylisting:     False

   "Domain15.com" - paxxxxxxxxx.com.br            Enabled: True

SIGNATURE         LIMITS                       DKIM               ADVANCED
  Enabled: False   Max size:                0   Enabled: False   
                   Max message size:        0                      Plus addressing: False
                   Max size of accounts:    0                    
                                                                   Greylisting:     False

   "Domain16.com" - paxxxxxxx.com                 Enabled: True

SIGNATURE         LIMITS                       DKIM               ADVANCED
  Enabled: False   Max size:                0   Enabled: False   
                   Max message size:        0                      Plus addressing: False
                   Max size of accounts:    0                    
                                                                   Greylisting:     False

   "Domain17.com" - paxxxxxxx.com.br              Enabled: True

SIGNATURE         LIMITS                       DKIM               ADVANCED
  Enabled: False   Max size:                0   Enabled: False   
                   Max message size:        0                      Plus addressing: False
                   Max size of accounts:    0                    
                                                                   Greylisting:     False

   "Domain18.com" - paxxxxxxxxxxxxxx.com          Enabled: True

SIGNATURE         LIMITS                       DKIM               ADVANCED
  Enabled: False   Max size:                0   Enabled: False   
                   Max message size:        0                      Plus addressing: False
                   Max size of accounts:    0                    
                                                                   Greylisting:     False

   "Domain19.com" - paxxxxxxxxxxxxxx.com.br       Enabled: True

SIGNATURE         LIMITS                       DKIM               ADVANCED
  Enabled: False   Max size:                0   Enabled: False   
                   Max message size:        0                      Plus addressing: False
                   Max size of accounts:    0                    
                                                                   Greylisting:     False

   "Domain20.com" - vexxxxxx.com                  Enabled: True

SIGNATURE         LIMITS                       DKIM               ADVANCED
  Enabled: False   Max size:                0   Enabled: False   
                   Max message size:        0                      Plus addressing: False
                   Max size of accounts:    0                    
                                                                   Greylisting:     False
-----------------------------------------------------------------------------------------------

IP RANGES

IP: 127.0.0.1 - 127.0.0.1     Priority: 15     Name: PAMPA LOCAL

  Allow connections                         Other
     SMTP:   True                              Antispam :   True !! 'Spam tests' not enabled !!
     POP3:   True !! Protocol DISABLED !!      Antivirus:   True !! ANTIVIRUS NOT CONFIGURED !!
     IMAP:   True                              SSL/TLS:    False

  Allow Deliveries from                     Require Authentication from
     Local To Local       -  True              Local To Local       - False
     Local To External    -  True              Local To External    - False
     External To Local    -  True              External To Local    - False
     External To External -  True              External To External -  True


IP: 0.0.0.0 - 255.255.255.255     Priority: 10     Name: RELAY DATACENTER

  Allow connections                         Other
     SMTP:   True                              Antispam :   True !! 'Spam tests' not enabled !!
     POP3:   True !! Protocol DISABLED !!      Antivirus:   True !! ANTIVIRUS NOT CONFIGURED !!
     IMAP:   True                              SSL/TLS:    False

  Allow Deliveries from                     Require Authentication from
     Local To Local       -  True              Local To Local       -  True
     Local To External    -  True              Local To External    -  True
     External To Local    -  True              External To Local    - False
     External To External -  True              External To External -  True


------------------------------------------------------
AUTOBANNED Local Addresses:
    No entries

-----------------------------------------------------------------------------------------------

AUTOBAN
  Autoban Enabled: False

No problems were found in the IP range configuration.
-----------------------------------------------------------------------------------------------

INCOMING RELAYS
   No entries
-----------------------------------------------------------------------------------------------

MIRRORING         Disabled
-----------------------------------------------------------------------------------------------

PROTOCOLS

SMTP
GENERAL             DELIVERY                  RFC COMPLIANCE            ADVANCED
No. Connections:  0  No Retries:  5 Mins: 25   Plain Text:        False  Bind: 
                     Host: EXTERNAL.TLD        Empty sender:       True  Batch recipients:   100
Max Msg Size: 90480  Relay:-                   Incorrect endings:  True  Use STARTTLS:      True
                      EXTERNAL.TLD  (ok)       Disc. on invalid:   True  Delivered-To hdr: False
                     Port: 587                 Max number commands: 100  Loop limit:           5
                     Req Auth: False                                     Recipient hosts:     15
                     Con. Sec.: None
  Routes:
     No routes defined.

POP3
 !! Service Not Enabled !!

IMAP
 GENERAL                   PUBLIC FOLDERS                    ADVANCED
  No. Connections:   0      Public folder name: #Public       IMAP sort:  True
                                                              IMAP Quota: True
                                                              IMAP Idle:  True
                                                              IMAP ACL:   True
                                                              Delim: "."
-----------------------------------------------------------------------------------------------

ANTISPAM

GENERAL                              SPAM TESTS              Score   SPAMASSASSIN
  Spam Mark:                  5       Use SPF:           False        Use Spamassassin:   False
  Add X-HmailServer-Spam:     True    Check HELO host:   False    
  Add X-HmailServer-Reason:   True    Check MX records:  False    
  Add X-HmailServer-Subject: False    Verify DKIM:       False    

  Spam delete threshold: 20         Maximum message size: 1024

DNSBL ENTRIES:
   No 'enabled' entries

SURBL ENTRIES:
   No 'enabled' entries

GREYLISTING:
  Greylisting:  False

WHITELISTING
   No entries
-----------------------------------------------------------------------------------------------

ANTIVIRUS:  No application configured.

  Block Attachments: False
-----------------------------------------------------------------------------------------------

SSL CERTIFICATES
   No entries
-----------------------------------------------------------------------------------------------

SSL/TLS
             SSL 3.0 :  False
             TLS 1.0 :   True
             TLS 1.1 :   True
             TLS 1.2 :   True                Verify Remote SSL/TLS Certs:   True
SslCipherList  :

ECDHE-RSA-AES128-GCM-SHA256     - ECDHE-ECDSA-AES128-GCM-SHA256   - ECDHE-RSA-AES256-GCM-SHA384     
ECDHE-ECDSA-AES256-GCM-SHA384   - DHE-RSA-AES128-GCM-SHA256       - DHE-DSS-AES128-GCM-SHA256       
kEDH+AESGCM                     - ECDHE-RSA-AES128-SHA256         - ECDHE-ECDSA-AES128-SHA256       
ECDHE-RSA-AES128-SHA            - ECDHE-ECDSA-AES128-SHA          - ECDHE-RSA-AES256-SHA384         
ECDHE-ECDSA-AES256-SHA384       - ECDHE-RSA-AES256-SHA            - ECDHE-ECDSA-AES256-SHA          
DHE-RSA-AES128-SHA256           - DHE-RSA-AES128-SHA              - DHE-DSS-AES128-SHA256           
DHE-RSA-AES256-SHA256           - DHE-DSS-AES256-SHA              - DHE-RSA-AES256-SHA              
AES128-GCM-SHA256               - AES256-GCM-SHA384               - ECDHE-RSA-RC4-SHA               
ECDHE-ECDSA-RC4-SHA             - AES128                          - AES256                          
RC4-SHA                         - HIGH                            - !aNULL                          
!eNULL                          - !EXPORT                         - !DES                            
!3DES                           - !MD5                            - !PSK;                           
-----------------------------------------------------------------------------------------------

TCPIP PORTS                                         Connection Sec
               0.0.0.0         / 25    / SMTP   -   None                
               0.0.0.0         / 110   / POP3   -   None                
               0.0.0.0         / 143   / IMAP   -   None                
               0.0.0.0         / 465   / SMTP   -   None                
               0.0.0.0         / 587   / SMTP   -   None                
-----------------------------------------------------------------------------------------------

LOGGING      Logging Enabled: True

  Paths:-
    Current:  C:\MAILSERVER\Logs\hmailserver_2019-03-06.log
    Error:    C:\MAILSERVER\Logs\ERROR_hmailserver_2019-03-06.log - !! ERRORS PRESENT !!
    Event:    C:\MAILSERVER\Logs\hmailserver_events.log - Not present
    Awstats:  C:\MAILSERVER\Logs\hmailserver_awstats.log
                        APPLICATION -      .
                        SMTP        -    True
                        POP3        -      .
                        IMAP        -      .
                        TCPIP       -      .
                        DEBUG       -      .
                        AWSTATS     -      .
-----------------------------------------------------------------------------------------------

SYSTEM TESTS

Database type: MySQL

IPv6 support is available in operating system.

Backup directory C:\MAILSERVER\BackupConf is writable.

Relative message paths are stored in the database for all messages.

-----------------------------------------------------------------------------------------------

HMAILSERVER.INI

[Directories]
Program folder:  C:\MAILSERVER\
Database folder: 
Data folder:     C:\MAILSERVER\Data
Log folder:      C:\MAILSERVER\Logs
Temp folder:     C:\MAILSERVER\Temp
Event folder:    C:\MAILSERVER\Events

[Database]
Type=              MYSQL
Username=          root
PasswordEncryption=1
Port=              3306
Server=            localhost
Internal=          0
-----------------------------------------------------------------------------------------------

Generated by HMSSettingsDiagnostics v1.95, Hmailserver Forum.
[/code]

Re: Problem with hmail installation freeze imap folders

Posted: 2019-03-06 21:49
by marceloleaes
mattg wrote:
2019-02-20 04:28
Which mail client is being used?

Are single accounts accessed by multiple mail clients simultaneously?
Outlook 2013 and 2016
No simultaneous access in any box

Re: Problem with hmail installation freeze imap folders

Posted: 2019-03-07 00:57
by mattg
What does the error log say
C:\MAILSERVER\Logs\ERROR_hmailserver_2019-03-06.log - !! ERRORS PRESENT !!


ALSO what are the hardware specs of this machine?
How many IMAP users?

Re: Problem with hmail installation freeze imap folders

Posted: 2019-03-07 03:47
by marceloleaes
Virtual machine running on XEN Server
Windows 2012 R2 - 4 Vcpu's - 8GB ram - 1TB VHD on Raid5 with PERC730P+
50 ~ 65 users, Outlook 2013, 2016

Vm turns up satisfactory
High disk reading and writing, raid controller has cache
I discard any problem related to hardware in this case

Re: Problem with hmail installation freeze imap folders

Posted: 2019-03-07 04:14
by mattg
mattg wrote:
2019-03-07 00:57
What does the error log say
C:\MAILSERVER\Logs\ERROR_hmailserver_2019-03-06.log - !! ERRORS PRESENT !!

Re: Problem with hmail installation freeze imap folders

Posted: 2019-03-08 01:44
by marceloleaes
logs and dumps collected today
at 5:55 pm my server stopped responding completely, did not even respond to the ping request

situation has reached the limit, thank you for any indication that you can effectively solve the problem.
the users are forced to close the outlook and open again because they realize that there are long periods without receiving emails

Re: Problem with hmail installation freeze imap folders

Posted: 2019-03-08 02:04
by mattg
marceloleaes wrote:
2019-03-07 03:47
I discard any problem related to hardware in this case
I don't

Check your hard drives
all of those issues are related to not being able to open a file or losing connection to the MySQL database

Re: Problem with hmail installation freeze imap folders

Posted: 2019-03-08 02:33
by marceloleaes
This behavior occurs on two different hosts.

My disks are flawless, so much so that there are other virtual machines and services running on the same disks.

Re: Problem with hmail installation freeze imap folders

Posted: 2019-03-08 02:42
by marceloleaes
No erros on Physical or Raid

Re: Problem with hmail installation freeze imap folders

Posted: 2019-03-08 02:46
by marceloleaes
Is there no relationship to using Outlook 2016?
The last build of Hmail is 2017, much has changed in Office in the latest updates. Using POP does not generate any errors, but in accounts that use IMAP, this is always ...

Re: Problem with hmail installation freeze imap folders

Posted: 2019-03-08 04:41
by marceloleaes
Analyzing the logs of the report viewer I found some errors like the one quoted in print
Capturar.JPG