Search found 150 matches

by rolaids0
2014-01-14 03:20
Forum: General discussions
Topic: OLE DB Provider for SQL Server Type name is invalid
Replies: 33
Views: 18655

Re: OLE DB Provider for SQL Server Type name is invalid

Could you export the schema (no data) and post to www.pastebin.com? Unless there is something total messed up with the server (other issues not related to hmail) there's nothing that alters the schema of the DB. The last schema change occurs with 5.3.0 to 5.3.1 to insert an index. This is, of course...
by rolaids0
2013-12-28 05:06
Forum: Feature requests
Topic: OnSMTPData
Replies: 4
Views: 6816

Re: OnSMTPData

I'm a huge fan of logging ScriptServer.cpp: void ScriptServer::FireEvent(Event e, const String &sEventCaller, shared_ptr<ScriptObjectContainer> pObjects) { if (!Configuration::Instance()->GetUseScriptServer()) return; // JDR: stores the name of the method that is fired in the script. http://www.hmai...
by rolaids0
2013-12-27 17:13
Forum: Archived feature requests
Topic: ssl/tls and starttls [50%]
Replies: 145
Views: 200465

Re: ssl/tls and starttls

I'll compile it up to run with STARTTLS on 25 to test. Off the cuff calculation of usage at the work front shows about 90% of the non-spam traffic is STARTTLS enabled. After reception is known to be working sending should be implemented. Of course, inclusion of settings in the GUI is something that ...
by rolaids0
2013-12-27 00:07
Forum: Archived feature requests
Topic: ssl/tls and starttls [50%]
Replies: 145
Views: 200465

Re: ssl/tls and starttls

Bill and I have been working on the code for the past week and we've made some progress. The main issue is that it is not trivial to change a normal connection into an SSL connection. The files to take a look at are TCPConnection, ProtocolParser, and SMTPConnection. Getting STARTTLS working for SMTP...
by rolaids0
2013-05-16 17:03
Forum: Development & alpha discussions
Topic: server hangs
Replies: 9
Views: 10152

Re: server hangs

Try attaching a process monitor to the service to see if it is hitting the maximum memory for a 32bit process. You can also see CPU, number of threads, etc.
by rolaids0
2012-10-29 17:34
Forum: General discussions
Topic: Endless loop between backup & primary server
Replies: 21
Views: 13120

Re: Endless loop between backup & primary server

katip,
Anyway you can post the headers of those two messages here?

Nime,
Is it a Turkish version of Windows? Also, what version of windows are you using? All updates with regards to languages applied?
by rolaids0
2012-10-29 17:12
Forum: General discussions
Topic: Endless loop between backup & primary server
Replies: 21
Views: 13120

Re: Endless loop between backup & primary server

The server is written in C++, so not all of the C# methods work. It does use string classes and the .ToLower function, however, the argument to that function would be locale("") which according to my research would be invariant (no culture.) In the 5.4 tree that I have this occurs in SMTPConnection....
by rolaids0
2012-07-03 04:03
Forum: General discussions
Topic: Not receiving emails from gmail, yahoo etc.
Replies: 34
Views: 22726

Re: Not receiving emails from gmail, yahoo etc.

"Is that fog?" "yes, and its quite dense"

Your ISP is blocking your port 25 for you. Additionally, you're on a dynamic IP.

See: http://www.hmailserver.com/documentatio ... oting_tips
and: http://www.hmailserver.com/documentatio ... dynamic_ip
by rolaids0
2012-05-31 20:03
Forum: General discussions
Topic: Crashing every 30 minutes
Replies: 23
Views: 13670

Re: Crashing every 30 minutes

Then preventive you know you have issues.

Provide logs so we can track it down. Have you installed on a fresh server and had the same problems? You've done ZERO debugging. You're on your own until you provide the necessary data.
by rolaids0
2012-05-31 18:55
Forum: General discussions
Topic: Crashing every 30 minutes
Replies: 23
Views: 13670

Re: Crashing every 30 minutes

The server is running windows 2003 R2 with 8 gigs memory. 4 gigs are free at all times. The system gets rebooted every 14 days. The only thing running on this box is hMailServer. If the server is only running hmailserver and 4GB is free, then you have major issues. I have it running here and TOTAL ...
by rolaids0
2012-05-30 21:57
Forum: Feature requests
Topic: "Sleep" function in COM API
Replies: 17
Views: 17627

Re: "Sleep" function in COM API

You can Google "hmailserver wscript.sleep" and will see (from the Dev: Martin) ain't gonna happen for far too many technical reasons. Your solution here is to: 1) Use my proposed solution (which you don't like.) 2) Download the hmailserver source, and add it in yourself (which you don't seem to want...
by rolaids0
2012-05-30 21:46
Forum: Feature requests
Topic: "Sleep" function in COM API
Replies: 17
Views: 17627

Re: "Sleep" function in COM API

The answer takes some creativity (Google shows that sleep will probably NEVER be included into hmail, Martin said as much (more words)) To sleep (which will break things, but you don't seem to care) create a vbs file with just: WScript.Sleep 1000 each "loop" call that using cscript (with wscript.she...
by rolaids0
2012-05-25 16:11
Forum: General discussions
Topic: I need some advice to improve my hMailServer performance
Replies: 57
Views: 46350

Re: I need some advice to improve my hMailServer performance

I apologize if I missed it, but where is the DB server for Hmail housed? How is dovecot configured? What file system is being used on Linux to store the mail files? I may have missed it in your video, but in my testing to get to the level of CPU usage you are seeing I had to check all options in the...
by rolaids0
2012-02-12 18:37
Forum: General discussions
Topic: Strange behavior with Windows Live Mail and hMS
Replies: 31
Views: 14079

Re: Strange behavior with Windows Live Mail and hMS

Go with this instead: http://oss.netfarm.it/clamav/

Forgot to mention: use ClamD not the regular command line scanner. ClamD has many more benefits over using the command line scanner.
by rolaids0
2012-02-05 15:40
Forum: Feature requests
Topic: Email and chat system
Replies: 6
Views: 7640

Re: Email and chat system

If you want to use the same usernames and passwords for both your mail server and chat server, you may want to use Active Directory. For a FOSS Jabber server that runs cross platform take a look at Openfire: http://www.igniterealtime.org/projects/openfire/ . hMail can authenticate against a windows ...
by rolaids0
2011-12-16 04:16
Forum: General discussions
Topic: Intermittent failure to send mail - any idea why?
Replies: 25
Views: 23278

Re: Intermittent failure to send mail - any idea why?

You have major issues if random files are changing. Anyone else have access to the server other than yourself? Another thing to check, if this crops up again, is the modified time of the INI verses the last restart of the machine/hmail service. You or someone else may have opened the file, hit a but...
by rolaids0
2011-12-16 04:11
Forum: General discussions
Topic: Moved folders are not created
Replies: 6
Views: 4622

Re: Moved folders are not created

Maybe I missed it, but I don't see where the failing client tells hMail to create the folder. If you manually create the folder in outlook (on the failing account) does it get created? If created, can you move one or two messages into it? Have you done a manual send & receive? Also as mattg pointed ...
by rolaids0
2011-12-16 04:02
Forum: General discussions
Topic: Upgrading to Latest Versions, Gotchas to look for?
Replies: 3
Views: 3763

Re: Upgrading to Latest Versions, Gotchas to look for?

IOCP issues in 5.3.3, best bet is to go 5.3.4 or the still developed 5.4 beta. There is also a thread for experimental builds that some of us are using (somethings fixed, some new items.)
by rolaids0
2011-12-12 01:56
Forum: General discussions
Topic: Intermittent failure to send mail - any idea why?
Replies: 25
Views: 23278

Re: Intermittent failure to send mail - any idea why?

Disable the backups and see if the problem goes away. Also, how are you backing up? Does this cause a table lock (which will block inserts/updates and cause a time out)?
by rolaids0
2011-12-11 17:13
Forum: General discussions
Topic: Intermittent failure to send mail - any idea why?
Replies: 25
Views: 23278

Re: Intermittent failure to send mail - any idea why?

What runs on the server that causes queries to take more than 30 seconds? Also, queries in management studio can tell you nothing, you'd need to test through the same methods hmail is using ("Microsoft OLE DB Provider for SQL Server") Something is not right with the SQL server... why are queries tak...
by rolaids0
2011-12-11 16:11
Forum: General discussions
Topic: Intermittent failure to send mail - any idea why?
Replies: 25
Views: 23278

Re: Intermittent failure to send mail - any idea why?

Just shows us that the DB server is really messed up. The default time out is 30 seconds for a query, now comes the hard part: why is the DB server taking more than 30 seconds to insert a record? There are a lot of possibilities, however, I would take a look at the DB server now and see if there are...
by rolaids0
2011-12-09 02:31
Forum: General discussions
Topic: Intermittent failure to send mail - any idea why?
Replies: 25
Views: 23278

Re: Intermittent failure to send mail - any idea why?

What's in the log before that error occurs?
by rolaids0
2011-12-06 06:59
Forum: General discussions
Topic: please explain pros and cons of "Delivered-To" header
Replies: 6
Views: 5627

Re: please explain pros and cons of "Delivered-To" header

One only needs to look at the email message to see why one would want delivered-to... In its regular state, there is no way to see the RCPT TO: portion. So if you had a user get a message that doesn't have the TO: set to them... how would you know? You would have to enable a lot of logging to see su...
by rolaids0
2011-12-04 00:34
Forum: General discussions
Topic: Bizzare SMTP Experience.
Replies: 5
Views: 4142

Re: Bizzare SMTP Experience.

See if the 5.3.4 beta fixes your issue:
http://www.hmailserver.com/index.php?page=download
by rolaids0
2011-12-04 00:18
Forum: Scripting
Topic: Using VB .NET to retrieve a message by ID
Replies: 1
Views: 4858

Re: Using VB .NET to retrieve a message by ID

You can't. Your best bet is to get the file name, domain name, and user account to access the file. Keep in mind if you delete/rename/move the file, the DB will be out of sync.

http://www.hmailserver.com/documentatio ... om_objects
by rolaids0
2011-12-01 15:22
Forum: Development & alpha discussions
Topic: Message Indexing query slow, can we optimize it?
Replies: 61
Views: 51966

Re: Message Indexing query slow, can we optimize it?

So I guess the MessageID column is an integer and that increments with every message. Then we need a new variable (let's call it LastMessageIDindexed) initialized as -1 when the server is started. Then, to the indexing function, just add a "Where MessageID > LastMessageIDindexed" to the query, and ...
by rolaids0
2011-11-30 01:04
Forum: Development & alpha discussions
Topic: Message Indexing query slow, can we optimize it?
Replies: 61
Views: 51966

Re: Message Indexing query slow, can we optimize it?

I just ran the new query (which would be generated by the API) on MSSQL Express: SELECT TOP 25000 hm_messages.messageid, hm_messages.messageaccountid, hm_messages.messagefolderid, hm_messages.messagefilename , hm_accounts.accountaddress FROM hm_messages LEFT JOIN hm_accounts ON hm_messages.messageac...
by rolaids0
2011-11-30 00:49
Forum: Development & alpha discussions
Topic: Message Indexing query slow, can we optimize it?
Replies: 61
Views: 51966

Re: Message Indexing query slow, can we optimize it?

Note that the query you're looking at is in the original source. The only thing modified was the addition of a second query. Here is what the API does: // JDR: are we doing a quick index? if (quickIndex == true) { // yes, only pick the last 1000 records... very quick compared to full statement.SetWh...
by rolaids0
2011-11-29 18:50
Forum: Development & alpha discussions
Topic: Message Indexing query slow, can we optimize it?
Replies: 61
Views: 51966

Re: Message Indexing query slow, can we optimize it?

There's really not "optimization" done to the query. What happens is a different query is run, which has a much smaller result set. This result set being smaller than the first allows the query to run much faster. We haven't tested with MSSQL as none of us have it installed. If you have it installed...
by rolaids0
2011-11-17 03:59
Forum: Development & alpha discussions
Topic: Message Indexing query slow, can we optimize it?
Replies: 61
Views: 51966

Re: Message Indexing query slow, can we optimize it?

When it says "Doing QUICK" vs "Doing FULL" that's an indication of the query that's being picked. When 0 results are returned then the "No messages to index." line is logged. One thing that comes to mind is there's not really much point in doing the query again under quick (which is what it is doing...
by rolaids0
2011-11-16 05:22
Forum: Development & alpha discussions
Topic: Message Indexing query slow, can we optimize it?
Replies: 61
Views: 51966

Re: Message Indexing query slow, can we optimize it?

Bill and myself have done some work today on the code, seems we have a workable solution. Currently it will run the Full every 720th run (roughly 12 hours). Before you download the code, read this thread first: http://www.hmailserver.com/forum/viewtopic.php?f=10&t=21420 This code is considered exper...
by rolaids0
2011-11-15 22:30
Forum: Development & alpha discussions
Topic: Message Indexing query slow, can we optimize it?
Replies: 61
Views: 51966

Re: Message Indexing query slow, can we optimize it?

Yeah, it fires until it finds none to index. We'll see if having staggered indexing ("quick" which picks the latest 1000 records, and "full" which is currently how it is) occur at 60 minute (roughly) intervals helps. If it does and works well maybe we'll scale it up and if bill is feeling really gen...
by rolaids0
2011-11-15 21:37
Forum: Development & alpha discussions
Topic: Message Indexing query slow, can we optimize it?
Replies: 61
Views: 51966

Re: Message Indexing query slow, can we optimize it?

Looking at the code, it appears that the item fires off once a minute (give or take execution time). If it does the 1000 records every minute, then every 60th, or 120th, or so slow one (the "full" with out the last 1000 message) then it would include those that were missed. I'm not sure there is any...
by rolaids0
2011-11-15 21:27
Forum: Development & alpha discussions
Topic: Message Indexing query slow, can we optimize it?
Replies: 61
Views: 51966

Re: Message Indexing query slow, can we optimize it?

Bill and myself (IRC) are thinking about adding the column isindexed or doing only a daily full scan (the slow one) and using the last 1000 record one as needed.... Avoiding NULLs would be the best route, however, using the isindexed would require schema changes and with the number of DBs supported,...
by rolaids0
2011-11-15 21:16
Forum: Development & alpha discussions
Topic: Message Indexing query slow, can we optimize it?
Replies: 61
Views: 51966

Re: Message Indexing query slow, can we optimize it?

Looking at the source, the same process and query that creates the initial index creates the running index (new messages).
by rolaids0
2011-11-15 20:55
Forum: Development & alpha discussions
Topic: Message Indexing query slow, can we optimize it?
Replies: 61
Views: 51966

Re: Message Indexing query slow, can we optimize it?

select max(hm_messages.messageid) - 1000 from hm_messages will only ever return the last 1000 values, even if they are already indexed. The LIMIT 25000 returns all values first, then includes the first 25000 values. The 1000 could be changed to 25000 but that means anyone with 50K of indexed messag...
by rolaids0
2011-11-15 20:42
Forum: Development & alpha discussions
Topic: Message Indexing query slow, can we optimize it?
Replies: 61
Views: 51966

Re: Message Indexing query slow, can we optimize it?

That would optimize. Since it is looking for NULL values (which aren't indexed) a large result set may go to disk. Since a table scan occurs it appears the optimizer first pulls all values that =2 (messagetype). As you saw, this is a huge result set. Then it has to scan for nulls. Picks those out, a...
by rolaids0
2011-11-15 20:21
Forum: Development & alpha discussions
Topic: Message Indexing query slow, can we optimize it?
Replies: 61
Views: 51966

Re: Message Indexing query slow, can we optimize it?

That would work well for a system that receives less than 1000 messages per run. If its a system that's been running for some time then it'd only do the last 1000.

It seems the IS NULL is the killer part, if I take it out it runs very quickly.
by rolaids0
2011-11-15 18:45
Forum: Development & alpha discussions
Topic: Message Indexing query slow, can we optimize it?
Replies: 61
Views: 51966

Re: Message Indexing query slow, can we optimize it?

May be better: SELECT hm_messages.messageid, hm_messages.messageaccountid, hm_messages.messagefolderid, hm_messages.messagefilename, hm_accounts.accountaddress FROM hm_messages LEFT JOIN hm_accounts ON hm_messages.messageaccountid = hm_accounts.accountid LEFT OUTER JOIN hm_message_metadata ON hm_mes...
by rolaids0
2011-10-27 01:00
Forum: General discussions
Topic: hMailServer Recalculating Account Size Constantly
Replies: 19
Views: 10485

Re: hMailServer Recalculating Account Size Constantly

I was able to replicate with 100's of millions of deleted/inserted items into the database. An optimize does solve the issue for me.

After you've run the optimize, run this:

Code: Select all

SELECT MAX(messageid) FROM hm_messages;
I have a feeling the message ID may have hit the 4Bil mark.
by rolaids0
2011-10-26 19:12
Forum: General discussions
Topic: hMailServer Recalculating Account Size Constantly
Replies: 19
Views: 10485

Re: hMailServer Recalculating Account Size Constantly

I'm trying to see if I can replicate and I'm not having much luck. I inserted 600K+ records and then ran the query (it ran in .0006 seconds). I'm now doing random deletes and inserts (unoptimized table) but I've only got the time up to .34 seconds. What hardware is the DB running on and is it heavil...
by rolaids0
2011-10-26 17:14
Forum: General discussions
Topic: hMailServer Recalculating Account Size Constantly
Replies: 19
Views: 10485

Re: hMailServer Recalculating Account Size Constantly

Also, when was the last time an optimize was run on that table?
by rolaids0
2011-10-26 17:07
Forum: General discussions
Topic: hMailServer Recalculating Account Size Constantly
Replies: 19
Views: 10485

Re: hMailServer Recalculating Account Size Constantly

That is for objects, message caching is under the same window but the message indexing tab. Sounds like you have a lot of message objects for that account. Any other slow issues with that account (such has viewing messages)?
by rolaids0
2011-10-26 16:41
Forum: General discussions
Topic: hMailServer Recalculating Account Size Constantly
Replies: 19
Views: 10485

Re: hMailServer Recalculating Account Size Constantly

There are several places index aren't created :-D can you do a

Code: Select all

 SELECT COUNT(*) AS itemcount, SUM(messagesize) as mailboxsize FROM hm_messages WHERE messageaccountid = 1;
and post the results?

Also, check to see if you have caching enabled.
by rolaids0
2011-10-26 14:44
Forum: General discussions
Topic: hMailServer Recalculating Account Size Constantly
Replies: 19
Views: 10485

Re: hMailServer Recalculating Account Size Constantly

if you do an explain on that statement you'd see that a table scan is used to get the result (no keys on messageaccountid). If there is a lot of mail in the table, the sum will also take a long time to complete. Index to try out: ALTER TABLE `hmailserver`.`hm_messages` ADD INDEX `idx_hm_messageaccou...
by rolaids0
2011-10-01 03:44
Forum: Scripting
Topic: Automatic receipt request
Replies: 1
Views: 2656

Re: Automatic receipt request

You have to add a header to each message: http://www.livinginternet.com/e/ea_receipt.htm
by rolaids0
2011-10-01 03:41
Forum: General discussions
Topic: Please help me on external tool
Replies: 9
Views: 8888

Re: Please help me on external tool

How do you back up the rest of the system? Likely, this is the method you want to use.
by rolaids0
2011-10-01 03:37
Forum: General discussions
Topic: v5.3-B167 - LOGs-Is there a documentation?
Replies: 9
Views: 8129

Re: v5.3-B167 - LOGs-Is there a documentation?

See the documentation about stats.
by rolaids0
2011-10-01 03:36
Forum: General discussions
Topic: Advice for implementing with Windows Server 2008
Replies: 52
Views: 33771

Re: Advice for implementing with Windows Server 2008

What's the cost difference between foundation and standard?

Seems feature for feature they are similar with standard supporting higher numbers.

https://www.microsoft.com/en-us/server- ... tions.aspx
by rolaids0
2011-10-01 03:27
Forum: General discussions
Topic: Missing email mystery
Replies: 2
Views: 2578

Re: Missing email mystery

What happens when you take ASSP out of the loop? Also, what version of hMailServer?
by rolaids0
2011-08-02 02:43
Forum: User contributed hMailServer 5 scripts
Topic: Locate missing messages (Backup Error)
Replies: 3
Views: 6354

Re: Locate missing messages (Backup Error)

If I knew it wouldn't have happened :wink:
by rolaids0
2011-08-02 00:29
Forum: General discussions
Topic: Message retrieval failed : file did not exist
Replies: 3
Views: 3117

Re: Message retrieval failed : file did not exist

What was going on before and after the error occurred? Was there multiple connections to the same mailbox?
by rolaids0
2011-08-02 00:28
Forum: General discussions
Topic: Forward from HmailServer to Exchange 2010 Server
Replies: 7
Views: 5872

Re: Forward from HmailServer to Exchange 2010 Server

4GB may still be pushing the limit as far as a functional Exchange 2010 server, depending on mailboxes, size of mailboxes, and mail flow.
by rolaids0
2011-08-02 00:09
Forum: User contributed hMailServer 5 scripts
Topic: Locate missing messages (Backup Error)
Replies: 3
Views: 6354

Locate missing messages (Backup Error)

When I ran the backup, I got the following error: BACKUP ERROR: All messages are not located in the data folder. I knew that running the Data Directory Synchronizer could fix the issue, however, I didn't want to risk removing emails or having clients re-download entire messages either. I whipped up ...
by rolaids0
2011-07-21 13:00
Forum: Archived feature requests
Topic: Has development of hMailServer stopped?
Replies: 53
Views: 67851

Re: Has development of hMailServer stopped?

It seems to compile fine on Visual Studio 2008.