Slowly working hmail server

Use this forum if you have installed hMailServer and want to ask a question related to a production release of hMailServer. Before posting, please read the troubleshooting guide. A large part of all reported issues are already described in detail here.
^DooM^
Site Admin
Posts: 13861
Joined: 2005-07-29 16:18
Location: UK

Re: Slowly working hmail server

Post by ^DooM^ » 2016-08-18 23:35

What is in these logs?

Code: Select all

"ERROR"   4852   "2016-08-15 01:03:15.751"   "Severity: 1 (Critical), Code: HM5519, Source: StackLogger::Log, Description: An error has been detected. A mini dump has been written to D:\Mail\hMailServer\Logs\minidump_2016-08-15 010314_{B0248273-E66A-4037-B167-30F267B46233}.dmp"
"ERROR"   7108   "2016-08-15 01:03:15.880"   "Severity: 1 (Critical), Code: HM5519, Source: StackLogger::Log, Description: An error has been detected. A mini dump has been written to D:\Mail\hMailServer\Logs\minidump_2016-08-15 010315_{900AB0DE-67EE-4622-BE13-64EE949F5CC7}.dmp"
"ERROR"   8204   "2016-08-15 01:03:16.003"   "Severity: 1 (Critical), Code: HM5519, Source: StackLogger::Log, Description: An error has been detected. A mini dump has been written to D:\Mail\hMailServer\Logs\minidump_2016-08-15 010315_{D1D800DC-40FD-4869-836C-E2C2F694353F}.dmp"
If at first you don't succeed, bomb disposal probably isn't for you! ヅ

User avatar
mattg
Moderator
Moderator
Posts: 20108
Joined: 2007-06-14 05:12
Location: 'The Outback' Australia

Re: Slowly working hmail server

Post by mattg » 2016-08-19 00:45

assorti wrote:Number of asynchronous streams do not change?
No, that is connections to Spamassassin
That doesn't need to change
Just 'cause I link to a page and say little else doesn't mean I am not being nice.
https://www.hmailserver.com/documentation

assorti
Normal user
Normal user
Posts: 74
Joined: 2016-08-05 15:41

Re: Slowly working hmail server

Post by assorti » 2016-08-19 08:36

^DooM^ wrote:What is in these logs?

Code: Select all

"ERROR"   4852   "2016-08-15 01:03:15.751"   "Severity: 1 (Critical), Code: HM5519, Source: StackLogger::Log, Description: An error has been detected. A mini dump has been written to D:\Mail\hMailServer\Logs\minidump_2016-08-15 010314_{B0248273-E66A-4037-B167-30F267B46233}.dmp"
"ERROR"   7108   "2016-08-15 01:03:15.880"   "Severity: 1 (Critical), Code: HM5519, Source: StackLogger::Log, Description: An error has been detected. A mini dump has been written to D:\Mail\hMailServer\Logs\minidump_2016-08-15 010315_{900AB0DE-67EE-4622-BE13-64EE949F5CC7}.dmp"
"ERROR"   8204   "2016-08-15 01:03:16.003"   "Severity: 1 (Critical), Code: HM5519, Source: StackLogger::Log, Description: An error has been detected. A mini dump has been written to D:\Mail\hMailServer\Logs\minidump_2016-08-15 010315_{D1D800DC-40FD-4869-836C-E2C2F694353F}.dmp"
which is a binary file ... I do not know what it is and what they are.

assorti
Normal user
Normal user
Posts: 74
Joined: 2016-08-05 15:41

Re: Slowly working hmail server

Post by assorti » 2016-08-19 08:38

mattg wrote:
assorti wrote:Number of asynchronous streams do not change?
No, that is connections to Spamassassin
That doesn't need to change
well, I will test the performance. I report the results.

assorti
Normal user
Normal user
Posts: 74
Joined: 2016-08-05 15:41

Re: Slowly working hmail server

Post by assorti » 2016-08-19 11:17

assorti wrote:
mattg wrote:
assorti wrote:Number of asynchronous streams do not change?
No, that is connections to Spamassassin
That doesn't need to change
well, I will test the performance. I report the results.
Unfortunately there is a slowdown of the server. The number of sessions reaches 400. It works slowly even at 380 sessions.
https://youtu.be/5uWYZQqrxGI

assorti
Normal user
Normal user
Posts: 74
Joined: 2016-08-05 15:41

Re: Slowly working hmail server

Post by assorti » 2016-08-19 11:24

at 260 session going slow work.
https://youtu.be/UY5HlFlBPEM

User avatar
mattg
Moderator
Moderator
Posts: 20108
Joined: 2007-06-14 05:12
Location: 'The Outback' Australia

Re: Slowly working hmail server

Post by mattg » 2016-08-20 01:04

Then try even higher numbers

This change has increased the slowness from 170 to 260 connections, keep going

These settings are very individual to each user of hMailserver, depending on what type of email, what type of email client, how many users, how much mail is processed, and hardware...
Just 'cause I link to a page and say little else doesn't mean I am not being nice.
https://www.hmailserver.com/documentation

assorti
Normal user
Normal user
Posts: 74
Joined: 2016-08-05 15:41

Re: Slowly working hmail server

Post by assorti » 2016-08-20 10:29

mattg wrote:Then try even higher numbers

This change has increased the slowness from 170 to 260 connections, keep going

These settings are very individual to each user of hMailserver, depending on what type of email, what type of email client, how many users, how much mail is processed, and hardware...
Good afternoon. Tell me why do not immediately put the 1000 connections in the settings of the performance?

User avatar
mattg
Moderator
Moderator
Posts: 20108
Joined: 2007-06-14 05:12
Location: 'The Outback' Australia

Re: Slowly working hmail server

Post by mattg » 2016-08-21 00:31

no reason

just try it
Just 'cause I link to a page and say little else doesn't mean I am not being nice.
https://www.hmailserver.com/documentation

tochi
Senior user
Senior user
Posts: 278
Joined: 2015-07-28 22:55

Re: Slowly working hmail server

Post by tochi » 2016-08-22 20:52

Your 'Max number of command threads' value is ridiculous high. With E5-2620 (6C12T), the value should be 12 or less.

User avatar
mattg
Moderator
Moderator
Posts: 20108
Joined: 2007-06-14 05:12
Location: 'The Outback' Australia

Re: Slowly working hmail server

Post by mattg » 2016-08-23 00:59

Well that seems to be the exact opposite of what I have been saying.

Is there a reason that you say this, especially since increasing the number has delayed the issue to more connections.
(I have my command threads set to 50)

I'm also not sure what the processor has to do with this. Command threads aren't the same as processor threads.
Processor threads are what can be done simultaneously. Command threads as per the help file...
Max number of command threads

When an SMTP, POP3 or IMAP client sends a command to hMailServer, this is handled by something called a command thread. The command threads typically handles simple commands, such as "log in", "retrieve message" and "add recipient to message". This number specifies how many simultanoeus commands can be run by clients. If you increase this value, more commands can run at the same time, but all of them will run slower. If you decrease this value, less commands can run at the same time, but they will be executed faster.


I'm not certain, but I think the default value is 15
Just 'cause I link to a page and say little else doesn't mean I am not being nice.
https://www.hmailserver.com/documentation

tochi
Senior user
Senior user
Posts: 278
Joined: 2015-07-28 22:55

Re: Slowly working hmail server

Post by tochi » 2016-08-23 02:08

https://www.hmailserver.com/documentati ... ndhandlers
'I/O Completion Ports' (IOCP) are used starting from ver 4.3. Any single thread here can process requests from multiple connections. According to Microsoft,
The best overall maximum value to pick for the concurrency value is the number of CPUs on the computer

User avatar
mattg
Moderator
Moderator
Posts: 20108
Joined: 2007-06-14 05:12
Location: 'The Outback' Australia

Re: Slowly working hmail server

Post by mattg » 2016-08-23 03:12

OK I'll pay that


@assorti try setting your command threads to 12 and see how that goes for you
Just 'cause I link to a page and say little else doesn't mean I am not being nice.
https://www.hmailserver.com/documentation

assorti
Normal user
Normal user
Posts: 74
Joined: 2016-08-05 15:41

Re: Slowly working hmail server

Post by assorti » 2016-08-23 09:54

mattg wrote:no reason

just try it
Put 1000. Still very slow at 300 sessions.

User avatar
mattg
Moderator
Moderator
Posts: 20108
Joined: 2007-06-14 05:12
Location: 'The Outback' Australia

Re: Slowly working hmail server

Post by mattg » 2016-08-23 11:00

mattg wrote:@assorti try setting your command threads to 12 and see how that goes for you
Just 'cause I link to a page and say little else doesn't mean I am not being nice.
https://www.hmailserver.com/documentation

assorti
Normal user
Normal user
Posts: 74
Joined: 2016-08-05 15:41

Re: Slowly working hmail server

Post by assorti » 2016-08-23 11:37

mattg wrote:
mattg wrote:@assorti try setting your command threads to 12 and see how that goes for you
Just do not quite understand what to install (this is probably the difficulty of translating) Reframe your offer or to attach a screenshot of the program with the parameters you want to change.

User avatar
mattg
Moderator
Moderator
Posts: 20108
Joined: 2007-06-14 05:12
Location: 'The Outback' Australia

Re: Slowly working hmail server

Post by mattg » 2016-08-23 12:02

Image
Just 'cause I link to a page and say little else doesn't mean I am not being nice.
https://www.hmailserver.com/documentation

assorti
Normal user
Normal user
Posts: 74
Joined: 2016-08-05 15:41

Re: Slowly working hmail server

Post by assorti » 2016-08-23 14:04

mattg wrote:Image
If I put 12 there, the client session will be very long obprabatyvatsya. You uvrenny exactly what you need it 12?

assorti
Normal user
Normal user
Posts: 74
Joined: 2016-08-05 15:41

Re: Slowly working hmail server

Post by assorti » 2016-08-23 14:21

mattg wrote:Image
The server slowly began to work even at 200 sessions. This is after I put the number 12.

tochi
Senior user
Senior user
Posts: 278
Joined: 2015-07-28 22:55

Re: Slowly working hmail server

Post by tochi » 2016-08-23 18:24

When you encounter slowness issue, enable SMTP log and send a test mail. Make that email unique with either unique sender or unique receiver so log entries for it can be easily found. Post log entries for sending it here. I want to see exact which command is delayed.

The POP3 session count is always high. It's not normal for a server with total 600 users. Can you temporarily disable POP3 and ask your users to use webmail and test the performance? Do this test after you collect logs above.

assorti
Normal user
Normal user
Posts: 74
Joined: 2016-08-05 15:41

Re: Slowly working hmail server

Post by assorti » 2016-08-25 08:23

tochi wrote:When you encounter slowness issue, enable SMTP log and send a test mail. Make that email unique with either unique sender or unique receiver so log entries for it can be easily found. Post log entries for sending it here. I want to see exact which command is delayed.

The POP3 session count is always high. It's not normal for a server with total 600 users. Can you temporarily disable POP3 and ask your users to use webmail and test the performance? Do this test after you collect logs above.
Good afternoon. Unfortunately pop3 can not turn off because if they stay only IMAP users the performance drop will not.

assorti
Normal user
Normal user
Posts: 74
Joined: 2016-08-05 15:41

Re: Slowly working hmail server

Post by assorti » 2016-08-25 10:29

tochi wrote:When you encounter slowness issue, enable SMTP log and send a test mail. Make that email unique with either unique sender or unique receiver so log entries for it can be easily found. Post log entries for sending it here. I want to see exact which command is delayed.

The POP3 session count is always high. It's not normal for a server with total 600 users. Can you temporarily disable POP3 and ask your users to use webmail and test the performance? Do this test after you collect logs above.
Here is an example of sending a letter at a time when the server is running slowly. Otpravlka prroiskhodit as slowly. Sending takes place in 21 seconds. (Number of sessions greater than about 280-300)
smtp.PNG
Last edited by assorti on 2016-08-25 10:59, edited 2 times in total.

assorti
Normal user
Normal user
Posts: 74
Joined: 2016-08-05 15:41

Re: Slowly working hmail server

Post by assorti » 2016-08-25 10:39

tochi wrote:When you encounter slowness issue, enable SMTP log and send a test mail. Make that email unique with either unique sender or unique receiver so log entries for it can be easily found. Post log entries for sending it here. I want to see exact which command is delayed.

The POP3 session count is always high. It's not normal for a server with total 600 users. Can you temporarily disable POP3 and ask your users to use webmail and test the performance? Do this test after you collect logs above.
But in this screenshot the log shipping in the case where the server is operating normally (the number of sessions about 200) to send a letter for 1 second.
smtp2.PNG
Last edited by assorti on 2016-08-25 10:58, edited 1 time in total.

assorti
Normal user
Normal user
Posts: 74
Joined: 2016-08-05 15:41

Re: Slowly working hmail server

Post by assorti » 2016-08-25 10:42

The same thing happens when users want to receive mail via POP3 or IMAP. The server starts slowly rabotatt with more than 300 sessions. This is seen in the video I published above is evident in the tests!
The server I can, RESOURCES enough and the processor is not loaded 100%
Because of this problem, users mail is very slow. Letters are sent slowly. I can not solve the problem for the third month. :(

User avatar
Dravion
Senior user
Senior user
Posts: 1433
Joined: 2015-09-26 11:50
Location: Germany
Contact:

Re: Slowly working hmail server

Post by Dravion » 2016-08-25 13:48

Maybe this is an problem on the Databaseserver side?

Which Datase Server do you use (MySQL, Microsoft SQL-Server or Postgres)?

MySQL has an option to monitor only slow queries this could help.Some indexes may needs to be rebuilt or some tweaking at the general config files of the Databaseserver can help (for example query cache, optimizer and executionplaner amout of buffer memory ect).

As far as i know SQL-Databaseservers dont like
specific Harddisk RAID-Configs and will perform badly on it. Recommended Raid for SQL DB Servers are RAID 0 and 5 i believe but i will check this later.

User avatar
mattg
Moderator
Moderator
Posts: 20108
Joined: 2007-06-14 05:12
Location: 'The Outback' Australia

Re: Slowly working hmail server

Post by mattg » 2016-08-25 15:33

What sort of tables ??
MyISAM or InnoDB

I recall that MyISAM may lock tables...
Just 'cause I link to a page and say little else doesn't mean I am not being nice.
https://www.hmailserver.com/documentation

assorti
Normal user
Normal user
Posts: 74
Joined: 2016-08-05 15:41

Re: Slowly working hmail server

Post by assorti » 2016-08-25 15:40

Dravion wrote:Maybe this is an problem on the Databaseserver side?

Which Datase Server do you use (MySQL, Microsoft SQL-Server or Postgres)?

MySQL has an option to monitor only slow queries this could help.Some indexes may needs to be rebuilt or some tweaking at the general config files of the Databaseserver can help (for example query cache, optimizer and executionplaner amout of buffer memory ect).

As far as i know SQL-Databaseservers dont like
specific Harddisk RAID-Configs and will perform badly on it. Recommended Raid for SQL DB Servers are RAID 0 and 5 i believe but i will check this later.
Do you think that you need to change the database from MySQL to MS SQL?

assorti
Normal user
Normal user
Posts: 74
Joined: 2016-08-05 15:41

Re: Slowly working hmail server

Post by assorti » 2016-08-25 15:42

mattg wrote:What sort of tables ??
MyISAM or InnoDB

I recall that MyISAM may lock tables...
InnoDB

User avatar
Dravion
Senior user
Senior user
Posts: 1433
Joined: 2015-09-26 11:50
Location: Germany
Contact:

Re: Slowly working hmail server

Post by Dravion » 2016-08-25 16:37

assorti wrote:
Dravion wrote: Do you think that you need to change the database from MySQL to MS SQL?
I think at this point you should give it a shot. You dont need to uninstall MySQL, just Install
Microsoft SQL-Server and compare the performance and stop the MySQL Service.

PS: DONT USE Microsoft SQL CE COMPACT, this is NOT an real SQL-Server at all, this will
make things only worse!

tochi
Senior user
Senior user
Posts: 278
Joined: 2015-07-28 22:55

Re: Slowly working hmail server

Post by tochi » 2016-08-25 19:23

assorti wrote:
tochi wrote:When you encounter slowness issue, enable SMTP log and send a test mail. Make that email unique with either unique sender or unique receiver so log entries for it can be easily found. Post log entries for sending it here. I want to see exact which command is delayed.

The POP3 session count is always high. It's not normal for a server with total 600 users. Can you temporarily disable POP3 and ask your users to use webmail and test the performance? Do this test after you collect logs above.
But in this screenshot the log shipping in the case where the server is operating normally (the number of sessions about 200) to send a letter for 1 second.
smtp2.PNG
Thank you for the logs in two posts. They are very helpful. After comparing the two, I saw that hmailserver acted quickly to incoming commands but receiving commands was delayed. The delay could be caused by several reasons. But database performance should not be an issue.
What are the Threading settings when you gathered the logs? What's your ISP connection speed (download/upload)?
Try the settings like the image and report results back
ScreenHunter_122 Aug. 25 10.21.jpg
ScreenHunter_122 Aug. 25 10.21.jpg (15.34 KiB) Viewed 14480 times

User avatar
Dravion
Senior user
Senior user
Posts: 1433
Joined: 2015-09-26 11:50
Location: Germany
Contact:

Re: Slowly working hmail server

Post by Dravion » 2016-08-25 19:28

@Tochi

All you asked was allready checked before. And its not an Problem to Internet connection speed
because the slowness occurs in its internal company network. Windows Client Computers accessing
this hMailServer on a 100 MBit's LAN logging in into the Server with Thunderbird, Webmail or
Outlook which is verry slow. Thats the Problem.

CPU usage is slow (14%) (XEON core i7) 16 GBybtes of RAM.
MySQL isnt undert heavy load, Virusscanners are off.
hMailServer allocating less then 100 MByte RAM on slowliness peaks
DISK IO Performance is upto 150 Mbyte's which is better then the normal
average.

tochi
Senior user
Senior user
Posts: 278
Joined: 2015-07-28 22:55

Re: Slowly working hmail server

Post by tochi » 2016-08-25 20:00

Dravion wrote:@Tochi

All you asked was allready checked before. And its not an Problem to Internet connection speed
because the slowness occurs in its internal company network. Windows Client Computers accessing
this hMailServer on a 100 MBit's LAN logging in into the Server with Thunderbird, Webmail or
Outlook which is verry slow. Thats the Problem.

CPU usage is slow (14%) (XEON core i7) 16 Mybtes RAM.
MySQL isnt undert heavy load, Virusscanners are off.
hMailServer allocating less then 100 MByte RAM on slowliness peaks
DISK IO Performance is upto 150 Mbyte's which is better then the normal
average.
I asked for connection speed because I want to give an adequate value in delivery thread. By reducing sending thread count, fewer emails can be delivered concurrently. It means more resources for POP3,IMAP,SMTP interactive clients. The overall sending and receiving emails speed may be reduced but the interactive response time should be faster.

I'm still curious why the POP3 session count is high though.

tochi
Senior user
Senior user
Posts: 278
Joined: 2015-07-28 22:55

Re: Slowly working hmail server

Post by tochi » 2016-08-25 20:19

assorti wrote:
tochi wrote:When you encounter slowness issue, enable SMTP log and send a test mail. Make that email unique with either unique sender or unique receiver so log entries for it can be easily found. Post log entries for sending it here. I want to see exact which command is delayed.

The POP3 session count is always high. It's not normal for a server with total 600 users. Can you temporarily disable POP3 and ask your users to use webmail and test the performance? Do this test after you collect logs above.
Good afternoon. Unfortunately pop3 can not turn off because if they stay only IMAP users the performance drop will not.
I don't understand here. Are you saying that there's no slowness issue if POP3 is disabled?
Can you show me how your typical POP3 client is configured?

assorti
Normal user
Normal user
Posts: 74
Joined: 2016-08-05 15:41

Re: Slowly working hmail server

Post by assorti » 2016-08-26 09:37

tochi wrote:
assorti wrote:
tochi wrote:When you encounter slowness issue, enable SMTP log and send a test mail. Make that email unique with either unique sender or unique receiver so log entries for it can be easily found. Post log entries for sending it here. I want to see exact which command is delayed.

The POP3 session count is always high. It's not normal for a server with total 600 users. Can you temporarily disable POP3 and ask your users to use webmail and test the performance? Do this test after you collect logs above.
Good afternoon. Unfortunately pop3 can not turn off because if they stay only IMAP users the performance drop will not.
I don't understand here. Are you saying that there's no slowness issue if POP3 is disabled?
Can you show me how your typical POP3 client is configured?
(Do not quite understand what you're writing about. Maybe it's the difficulties of translation.)
You want to see how my POP3 client is configured?
If I disable the POP3 performance drop will not be as the user sessions will be 100.
Slowing proiskhodt work when the server comes to 100 100 users POP3 IMAP users and occurs approximately 50 SMTP connections.
In the video, which is in my posts above - is an example of slow performance. Watch the video.

User avatar
Dravion
Senior user
Senior user
Posts: 1433
Joined: 2015-09-26 11:50
Location: Germany
Contact:

Re: Slowly working hmail server

Post by Dravion » 2016-08-26 12:07

@assorti

I believe tochi is asking you the followin question:

What is happening if you disable POP3 entirely on the hMAilServer?

Does this change the performace situation for Thunderbird and Webmail users or not?

This is a verry important.

And just for clarification:
Which hMailServer version do you use?
Which Thunderbird version do you use?
Do you have all Windows Server 2012 updates installed?
Did you check your Mainboard Manufacturers
Driver Support-Website regarding Mainboard Chipset and Networkcard Drivers update?

What is the exact Serial no of your Mainboard and its installed BIOS/Firmware?

What is the vendor name of your RAM Memory
and exact modell?

Did you change your BIOS settings and enabled some overclocking functions in the BIOS menue?

Is Powersaving in the Windows controlpanel enabled or is it set to maximum Performance?

It also would help if we have a Benchmark
Report of your System to find the bottleneck.

User avatar
Dravion
Senior user
Senior user
Posts: 1433
Joined: 2015-09-26 11:50
Location: Germany
Contact:

Re: Slowly working hmail server

Post by Dravion » 2016-08-26 12:54

Some tools which may help

Memory check, boots from ISO (warning, takes 4 or more hours)
http://www.memtest.org/download/5.01/me ... 01.iso.zip

DriverAgent 3 Day full access (scans for outdated drivers and let you download the newest)
http://driveragent.com/driverlicense?PH ... v77h95bp37

My HMSInfo utility (just take a screenshot or repot the log)
search.php?st=0&sk=t&sd=d&sr=posts&keyw ... INfo&ch=-1

Hwinfo64 Detailed Hardware Inforeport
https://www.fosshub.com/HWiNFO.html/hw64_534.exe

assorti
Normal user
Normal user
Posts: 74
Joined: 2016-08-05 15:41

Re: Slowly working hmail server

Post by assorti » 2016-08-26 13:28

Dravion wrote:@assorti

I believe tochi is asking you the followin question:

What is happening if you disable POP3 entirely on the hMAilServer?

Does this change the performace situation for Thunderbird and Webmail users or not?

This is a verry important.

And just for clarification:
Which hMailServer version do you use?
Which Thunderbird version do you use?
Do you have all Windows Server 2012 updates installed?
Did you check your Mainboard Manufacturers
Driver Support-Website regarding Mainboard Chipset and Networkcard Drivers update?

What is the exact Serial no of your Mainboard and its installed BIOS/Firmware?

What is the vendor name of your RAM Memory
and exact modell?

Did you change your BIOS settings and enabled some overclocking functions in the BIOS menue?

Is Powersaving in the Windows controlpanel enabled or is it set to maximum Performance?

It also would help if we have a Benchmark
Report of your System to find the bottleneck.

What is happening if you disable POP3 entirely on the hMAilServer?

If you disable the POP3 server is slow will not be as it will be about 100 IMAP connections.
Slowing down the server occurs when the total number of sessions exceeds 300. If I disable POP3 is slowing proizvaoditelnosti unnoticed.
Which hMailServer version do you use?
I'm using 5.6.4-B2283
Which Thunderbird version do you use?
45.2.0
Do you have all Windows Server 2012 updates installed?
Yes, I have it updated automatically
Driver Support-Website regarding Mainboard Chipset and Networkcard Drivers update?
Yes I installed all the drivers from the manufacturer's website. The latest driver version.
What is the exact Serial no of your Mainboard and its installed BIOS/Firmware?
Mainboard: Supermicro X9SRW-F
What is the vendor name of your RAM Memory
and exact modell?

hynix 4 GB * 4
hynix 16 GB * 1
IMG_2016-08-26_141852_HDR_995x746.jpg
Did you change your BIOS settings and enabled some overclocking functions in the BIOS menue?
I did not change the settings and did not increase productivity.
Is Powersaving in the Windows controlpanel enabled or is it set to maximum Performance?
I did not quite understand your question.

It also would help if we have a Benchmark
Report of your System to find the bottleneck.

Which performance test run?

assorti
Normal user
Normal user
Posts: 74
Joined: 2016-08-05 15:41

Re: Slowly working hmail server

Post by assorti » 2016-08-26 13:52

Dravion wrote:Some tools which may help

Memory check, boots from ISO (warning, takes 4 or more hours)
http://www.memtest.org/download/5.01/me ... 01.iso.zip

DriverAgent 3 Day full access (scans for outdated drivers and let you download the newest)
http://driveragent.com/driverlicense?PH ... v77h95bp37

My HMSInfo utility (just take a screenshot or repot the log)
search.php?st=0&sk=t&sd=d&sr=posts&keyw ... INfo&ch=-1

Hwinfo64 Detailed Hardware Inforeport
https://www.fosshub.com/HWiNFO.html/hw64_534.exe
Test memory I have spent.
HWinFO.PNG
HMS Info.PNG
HMS Info.PNG (11.14 KiB) Viewed 14445 times
HMSInfo
!!!!.zip
(39.24 KiB) Downloaded 98 times

assorti
Normal user
Normal user
Posts: 74
Joined: 2016-08-05 15:41

Re: Slowly working hmail server

Post by assorti » 2016-08-26 13:57

You saw logs sending messages? When the server is slow and regular?
100, and 300 sessions.
Here at the bottom of the logs. Sending takes place in a second. But when the number of POP3 and IMAP sessions exceeds 300 is experiencing significant delays. The screenshot below.
smtp2.PNG
smtp.PNG

User avatar
Dravion
Senior user
Senior user
Posts: 1433
Joined: 2015-09-26 11:50
Location: Germany
Contact:

Re: Slowly working hmail server

Post by Dravion » 2016-08-26 14:47

assorti wrote:You saw logs sending messages? When the server is slow and regular?
100, and 300 sessions.
Here at the bottom of the logs. Sending takes place in a second. But when the number of POP3 and IMAP sessions exceeds 300 is experiencing significant delays. The screenshot below.
smtp2.PNG

smtp.PNG

Sorry, you didnt understand it correctly:

I want you to disable POP3 and just run SMTP+IMAP and nothing else!
And then please report back. After you reported back, you can re-enable POP3.

This is verry important because POP3 has its processing structures and IMAP has some
diffrent processing structures. If it doesnt change anything, we have to look more deeper
into the fetch section behind POP3 and IMAP which is the Filesystem and the Database section.

User avatar
Dravion
Senior user
Senior user
Posts: 1433
Joined: 2015-09-26 11:50
Location: Germany
Contact:

Re: Slowly working hmail server

Post by Dravion » 2016-08-26 14:57

Ok, on your hMailServer Version 5.6.4-B2283 is outdated, please install the current stable version of hMailServer is 5.6.5 - Build 2367

Please download and upgrade your hMailServer version:
https://www.hmailserver.com/download_ge ... loadid=254

assorti
Normal user
Normal user
Posts: 74
Joined: 2016-08-05 15:41

Re: Slowly working hmail server

Post by assorti » 2016-08-26 15:08

Dravion wrote:
assorti wrote:You saw logs sending messages? When the server is slow and regular?
100, and 300 sessions.
Here at the bottom of the logs. Sending takes place in a second. But when the number of POP3 and IMAP sessions exceeds 300 is experiencing significant delays. The screenshot below.
smtp2.PNG

smtp.PNG

Sorry, you didnt understand it correctly:

I want you to disable POP3 and just run SMTP+IMAP and nothing else!
And then please report back. After you reported back, you can re-enable POP3.

This is verry important because POP3 has its processing structures and IMAP has some
diffrent processing structures. If it doesnt change anything, we have to look more deeper
into the fetch section behind POP3 and IMAP which is the Filesystem and the Database section.
How would you explain ....
See now I going slow down the mail server when the number of sessions, POP3, IMAP and SMTP is 300.
If I disable POP3 there will be 300 sessions and sootvetsvtenno will slow server performance. Do you understand what I mean?

assorti
Normal user
Normal user
Posts: 74
Joined: 2016-08-05 15:41

Re: Slowly working hmail server

Post by assorti » 2016-08-26 15:09

Dravion wrote:Ok, on your hMailServer Version 5.6.4-B2283 is outdated, please install the current stable version of hMailServer is 5.6.5 - Build 2367

Please download and upgrade your hMailServer version:
https://www.hmailserver.com/download_ge ... loadid=254
There are instructions for updating?

User avatar
Dravion
Senior user
Senior user
Posts: 1433
Joined: 2015-09-26 11:50
Location: Germany
Contact:

Re: Slowly working hmail server

Post by Dravion » 2016-08-26 15:10

assorti wrote:
Dravion wrote:Ok, on your hMailServer Version 5.6.4-B2283 is outdated, please install the current stable version of hMailServer is 5.6.5 - Build 2367

Please download and upgrade your hMailServer version:
https://www.hmailserver.com/download_ge ... loadid=254
There are instructions for updating?

No, just uninstall the old hMailServer and Install the new version and select existing database.

assorti
Normal user
Normal user
Posts: 74
Joined: 2016-08-05 15:41

Re: Slowly working hmail server

Post by assorti » 2016-08-26 15:35

Dravion wrote:
assorti wrote:
Dravion wrote:Ok, on your hMailServer Version 5.6.4-B2283 is outdated, please install the current stable version of hMailServer is 5.6.5 - Build 2367

Please download and upgrade your hMailServer version:
https://www.hmailserver.com/download_ge ... loadid=254
There are instructions for updating?

No, just uninstall the old hMailServer and Install the new version and select existing database.
What are my options? They are saved?
After removal of whether the settings are saved?

User avatar
Dravion
Senior user
Senior user
Posts: 1433
Joined: 2015-09-26 11:50
Location: Germany
Contact:

Re: Slowly working hmail server

Post by Dravion » 2016-08-26 16:12

The full procedures are described in details here:

https://www.hmailserver.com/documentati ... mendations

assorti
Normal user
Normal user
Posts: 74
Joined: 2016-08-05 15:41

Re: Slowly working hmail server

Post by assorti » 2016-08-26 16:27

Dravion wrote:The full procedures are described in details here:

https://www.hmailserver.com/documentati ... mendations
The instructions written that well, you need to remove and install the update on top.

User avatar
jimimaseye
Moderator
Moderator
Posts: 8118
Joined: 2011-09-08 17:48

Re: Slowly working hmail server

Post by jimimaseye » 2016-08-26 16:34

Simply download and run the install over the top of the current installation. No need to uninstall or stop services of existing install. It will take about 30 seconds.
HMS 5.6.6 B2383 on Win Server 2008 R2 Foundation, + 5.6.7-B2415 on test.
SpamassassinForWindows 3.4.0 spamd service
AV: Clamwin + Clamd service + sanesecurity defs : https://www.hmailserver.com/forum/viewtopic.php?f=21&t=26829

tochi
Senior user
Senior user
Posts: 278
Joined: 2015-07-28 22:55

Re: Slowly working hmail server

Post by tochi » 2016-08-26 23:59

Can you show me how your typical POP3 client is configured?

I still can't understand. If you disable POP3

A. there's no performance issue because total session count can't reach 300
B. when SMTP+IMAP session count is 300 (0 for POP3, disabled), all email operations are slowed down

The answer is A or B or something else?

User avatar
Dravion
Senior user
Senior user
Posts: 1433
Joined: 2015-09-26 11:50
Location: Germany
Contact:

Re: Slowly working hmail server

Post by Dravion » 2016-08-27 04:17

@assorti

Just for clarification:

How do you test the 300 connection slow down symptoms? Do you have a special kind of software which stresstest your hMailServer?

How can you distinct between the SMTP, POP3
or IMAP interferrence?

As far as i know your SMTP port 25 performance
is excellent but your IMAP performance is verry slow.

tochi
Senior user
Senior user
Posts: 278
Joined: 2015-07-28 22:55

Re: Slowly working hmail server

Post by tochi » 2016-08-27 21:51

Dravion wrote:@assorti

Just for clarification:

How do you test the 300 connection slow down symptoms? Do you have a special kind of software which stresstest your hMailServer?

How can you distinct between the SMTP, POP3
or IMAP interferrence?

As far as i know your SMTP port 25 performance
is excellent but your IMAP performance is verry slow.
Judging from videos and log pictures he posted, SMTP was also delayed. Specifically, the speed the server received commands was slow. While the responses to those commands were fast. It ruled out the database performance issue.
Either those commands were delayed during transmission, or the commands could not be picked by the server in time. The later is the more likely case. The fact that the slowness symptom was delayed when command thread value was increased in a supporting evidence. Though 12 should be sufficient normally. No idea why this would be the case. To be certain, packet trace log is required.

@assorti, do you know how to capture network traffic with WireShark?

User avatar
Dravion
Senior user
Senior user
Posts: 1433
Joined: 2015-09-26 11:50
Location: Germany
Contact:

Re: Slowly working hmail server

Post by Dravion » 2016-08-28 06:45

@tochi

Assorti provides me a username and password
to testwise connect to his hMailServer. I tested the performance with Thunderbird and i noticed SMTP and IMAP was delayed in Thunderbird both but as i telnetted his SMTP server on port 25 it accepted the Emails relay fast.

I noticed there was no STARTTLS and no encryption suppiort avaiable and Thunderbird only accepted plain text and no encryption for port 587 and Port 143.

But i had no way to see how many connections are allready open on hMailServer and if i allready hit the magical 300 concurrent slowlyness cap or not or if the transactionspeed was slow because his server is located somewhere in russia and longdistance network peering distance gave me some sort of latency response delay.

However, hMailServer port 25 gives you a processing time statistic response after the SMTP
DATA command is finished while telnetting the server and it says the SMTP receiving and enqueing process was finished in a few microseconds.

User avatar
Dravion
Senior user
Senior user
Posts: 1433
Joined: 2015-09-26 11:50
Location: Germany
Contact:

Re: Slowly working hmail server

Post by Dravion » 2016-08-28 09:59

I rechecked assortis hMailServer and i cannot see any delay right now:
assorti.png

assorti
Normal user
Normal user
Posts: 74
Joined: 2016-08-05 15:41

Re: Slowly working hmail server

Post by assorti » 2016-08-29 10:12

Dravion wrote:@assorti

Just for clarification:

How do you test the 300 connection slow down symptoms? Do you have a special kind of software which stresstest your hMailServer?

How can you distinct between the SMTP, POP3
or IMAP interferrence?

As far as i know your SMTP port 25 performance
is excellent but your IMAP performance is verry slow.
I do not have a special program for testing. I test in the real world with real connections.
I have about 450 sites that are connected by the protocol POP3 every 5 minutes. Under this condition, the load on the server virtually none.
At some point I send a file to one of the mailboxes and POP3 all of these 450 sites are beginning to answer me. At this point, and there is a large number of sessions since 450 units trying to send and read e-mail from the mailbox.

Have you tried through Mozilla Thunderbird to send a letter? Do you have a delay?

assorti
Normal user
Normal user
Posts: 74
Joined: 2016-08-05 15:41

Re: Slowly working hmail server

Post by assorti » 2016-08-29 10:14

tochi wrote:
Dravion wrote:@assorti

Just for clarification:

How do you test the 300 connection slow down symptoms? Do you have a special kind of software which stresstest your hMailServer?

How can you distinct between the SMTP, POP3
or IMAP interferrence?

As far as i know your SMTP port 25 performance
is excellent but your IMAP performance is verry slow.
Judging from videos and log pictures he posted, SMTP was also delayed. Specifically, the speed the server received commands was slow. While the responses to those commands were fast. It ruled out the database performance issue.
Either those commands were delayed during transmission, or the commands could not be picked by the server in time. The later is the more likely case. The fact that the slowness symptom was delayed when command thread value was increased in a supporting evidence. Though 12 should be sufficient normally. No idea why this would be the case. To be certain, packet trace log is required.

@assorti, do you know how to capture network traffic with WireShark?
Yes, I know what it is and why you need to capture the traffic?

assorti
Normal user
Normal user
Posts: 74
Joined: 2016-08-05 15:41

Re: Slowly working hmail server

Post by assorti » 2016-08-29 10:15

Dravion wrote:
assorti wrote:
Dravion wrote:Ok, on your hMailServer Version 5.6.4-B2283 is outdated, please install the current stable version of hMailServer is 5.6.5 - Build 2367

Please download and upgrade your hMailServer version:
https://www.hmailserver.com/download_ge ... loadid=254
There are instructions for updating?

No, just uninstall the old hMailServer and Install the new version and select existing database.
I updated hMailServer. Problems remain.

tochi
Senior user
Senior user
Posts: 278
Joined: 2015-07-28 22:55

Re: Slowly working hmail server

Post by tochi » 2016-08-29 18:10

assorti wrote:
tochi wrote:
Dravion wrote:@assorti

Just for clarification:

How do you test the 300 connection slow down symptoms? Do you have a special kind of software which stresstest your hMailServer?

How can you distinct between the SMTP, POP3
or IMAP interferrence?

As far as i know your SMTP port 25 performance
is excellent but your IMAP performance is verry slow.
Judging from videos and log pictures he posted, SMTP was also delayed. Specifically, the speed the server received commands was slow. While the responses to those commands were fast. It ruled out the database performance issue.
Either those commands were delayed during transmission, or the commands could not be picked by the server in time. The later is the more likely case. The fact that the slowness symptom was delayed when command thread value was increased in a supporting evidence. Though 12 should be sufficient normally. No idea why this would be the case. To be certain, packet trace log is required.

@assorti, do you know how to capture network traffic with WireShark?
Yes, I know what it is and why you need to capture the traffic?
By comparing hmailserver logs and network packet trace logs, we can be certain where the commands were delayed.

Please show me how your typical POP3 client is configured.

Also, please try to change worker thread priority to above normal and see what will happen. Just change priority and keep other values unchanged.
ScreenHunter_122 Aug. 29 09.07.jpg
ScreenHunter_122 Aug. 29 09.07.jpg (19.76 KiB) Viewed 14337 times
By the way, you don't enable Scripts, do you?
ScreenHunter_123 Aug. 29 09.27.jpg
ScreenHunter_123 Aug. 29 09.27.jpg (6.68 KiB) Viewed 14337 times

User avatar
Dravion
Senior user
Senior user
Posts: 1433
Joined: 2015-09-26 11:50
Location: Germany
Contact:

Re: Slowly working hmail server

Post by Dravion » 2016-08-29 19:47

assorti wrote: I do not have a special program for testing. I test in the real world with real connections.
Ok
assorti wrote: I have about 450 sites that are connected by the protocol POP3 every 5 minutes. Under this condition, the load on the server virtually none.
What?
You have 450 POP3-Clients connected and you server doesnt slow down at this point???
assorti wrote: At some point I send a file to one of the mailboxes and POP3 all of these 450 sites are beginning to answer me. At this point, and there is a large number of sessions since 450 units trying to send and read e-mail from the mailbox.
Just for clarification:
Your POP3-Clients trying to connect to ONE SPECIFIC MAILBOX at the same time and
Reading and Sending to this ONE SPECIFIC MAILBOX???

Questions:
*What file do you sending to this special mailbox (Large Binary data, pictures ect?)
*How big is the file you sending to your special mailbox?
*Do your 450 POP3-Clients only reading your special POP3-Mailbox or not?
*How do you get informed that any of the 450 POP3-Clients have received the mail?
assorti wrote: Have you tried through Mozilla Thunderbird to send a letter? Do you have a delay?
What do you mean with "Letter"? Do you mean a Thunderdbird serial letter or do you
mean a Newsletter sended via PHP-Script or something?

On another thing:
From outside your hMailServer isnt accessible directly (as allready mentioned a few
posts above)

C:\>dig mx assorti-express.ru +short
15 mx2.hosting.reg.ru.
10 mx1.hosting.reg.ru.

telnet mx2.hosting.reg.ru 25
220-relay7.hosting.reg.ru ESMTP Postfix

Shows from outside it points to mx2.hosting.reg.ru or mx1.hosting.reg.ru. In my Thunderbird server i use post.assorti-express.ru

Have all your 450 POP3-Clients post.assorti-express.ru (direct hMailServer) or your Linux Postfix
server configured under Thunderbird->Seversettings->Server name ?

User avatar
Dravion
Senior user
Senior user
Posts: 1433
Joined: 2015-09-26 11:50
Location: Germany
Contact:

Re: Slowly working hmail server

Post by Dravion » 2016-08-29 21:49

Bandwich on peaks

You say your LAN is connected with 100 MBit's to your hMailServer which is equally to 12,5 MBytes per second. I think this could also be an bottleneck if 450 POP3 Clients connecting simultanously and fetching
the same EMail+Attachements. Maybe you can change your 450 Thunderbird clients to diffrent timing
values each 4 Min, 5 Min, 6 Min 9 Min per each POP3 Client.

Also and upgrade to GBits Ethernet LAN is highly recommended (1000 MBits => 125 Megabytes per sec.)

assorti
Normal user
Normal user
Posts: 74
Joined: 2016-08-05 15:41

Re: Slowly working hmail server

Post by assorti » 2016-08-30 09:36

tochi wrote:
assorti wrote:
tochi wrote: Judging from videos and log pictures he posted, SMTP was also delayed. Specifically, the speed the server received commands was slow. While the responses to those commands were fast. It ruled out the database performance issue.
Either those commands were delayed during transmission, or the commands could not be picked by the server in time. The later is the more likely case. The fact that the slowness symptom was delayed when command thread value was increased in a supporting evidence. Though 12 should be sufficient normally. No idea why this would be the case. To be certain, packet trace log is required.

@assorti, do you know how to capture network traffic with WireShark?
Yes, I know what it is and why you need to capture the traffic?
By comparing hmailserver logs and network packet trace logs, we can be certain where the commands were delayed.

Please show me how your typical POP3 client is configured.

Also, please try to change worker thread priority to above normal and see what will happen. Just change priority and keep other values unchanged.
ScreenHunter_122 Aug. 29 09.07.jpg

By the way, you don't enable Scripts, do you?
ScreenHunter_123 Aug. 29 09.27.jpg
Here is a screenshot of the email client settings.
client.PNG
client.PNG (10.08 KiB) Viewed 7889 times
Performance settings changed.
Scripts are disabled.

Post Reply