ListMailPRO Email Marketing Software Forums

ListMailPRO Email Marketing Software Forums => Server Optimization, Tweaks => Topic started by: paul on June 14, 2004, 11:05:08 am

Title: My list is about 100,000, how can I speed it up.
Post by: paul on June 14, 2004, 11:05:08 am
I'm using Cpanel.  They just came out with a new version that slowed down the delivery rate, but it has a new security patch, so I have to keep it.  

I have a list of about 100,000 prior to the upgrade it would take 24 hours (4-5K delivered per hour) to send out to the list totally.  Now it takes about 4-5 days (1-2K delivered per hour).  Any idea how I can speed this up?  Please help?

I love listmailpro.  I've been using it for a two years and loving it!  

Thanks,

Paul
Title: My list is about 100,000, how can I speed it up.
Post by: DW on June 14, 2004, 09:26:14 pm
Paul,

100,000 in 24 hours is quite slow in itself.  Your now 4-5 day delivery time is simply unbearable.

CPanel in its default configuration (prior to upgrade?) should have accepted all of your emails in a reasonable amount of time.   Something like a maximum of 3 hours to send 100,000 messages to the server would be a generous estimate.  After that, it's up to the SMTP software (Exim, in CPanel's case) to deliver each message in queue.

It's possible that your host is running a very large number of users on the server who are also sending out email or making extensive use of MySQL.  This is the most common cause of delays.

Unfortunately, there is no way for me to know what the CPanel upgrade did - I will have to look into it.  I have a large number of clients on CPanel and have access to a dedicated server running the software, too, so I should be able to come up with a solution if the slowdown is indeed caused by the upgrade.

Another thing known to slowdown mailings to larger lists is lack of a Primary Key on the "id" field of the lm_sendq table.

With PhpMyAdmin, which is more than likely accessible from your control panel, open up the lm_sendq table and hit the button next to the "id" field that shows "Primary Key".

This change is usually only necessary on much larger lists but could help somewhat in your case.  It will be implemented automatically on all installations in the next update.

I will see what I can determine with the admin access I have to a CPanel dedicated server.  On second thought, though, we have applied a patch to Exim and prevented it from being updated during CPanel updates so it's hard to say if I will be able to reproduce these results.  :?
Title: phpmyadmin
Post by: paul on June 16, 2004, 02:42:19 am
I made the change, I hope it helps.  I'll let you know after I send next newsletter.

Thanks,

Paul
Title: My list is about 100,000, how can I speed it up.
Post by: DW on April 25, 2005, 10:11:21 pm
It's been a long time since this post has been visited but I was just browsing around and read it again.  I thought I'd reply to hear how you made out.

Did your mailing speed improve?

Regards
Title: Upgrade helped.
Post by: paul on April 26, 2005, 01:36:25 am
Upgrading to 1.8 helped. It cut the delivery time in about half.
Title: My list is about 100,000, how can I speed it up.
Post by: neil on April 26, 2005, 04:19:44 am
I am on a dedicated server with CPanel and currently there is no
one else on it.

Which works better for the configuration, PhpMyAdmin or MySQL?

I am getting ready to install 1.8 on my server, and from what I've read
so far it looks like PhpMyAdmin is the way to go.

I'll keep checking back until I am actually running the config to see if
there is a winner.

Thanks,

Neil
Title: My list is about 100,000, how can I speed it up.
Post by: DW on April 26, 2005, 02:08:35 pm
PhpMyAdmin is more reliable for transferring a v1.7 installation onto a new server with v1.8.  If already installed, you will want to remove your v1.8 tables before importing your v1.7 ones.  Once the old database is running on the new files, re-login to ListMail (and be patient) for database changes to take effect.

Regards
Title: My list is about 100,000, how can I speed it up.
Post by: idealizm on June 21, 2007, 02:35:50 pm
Did anyone else notice a major decline in delivery speed again with the latest Cpanel upgrade?  Just like the original post, I logged in and saw that my support team upgraded my dedicated box with a newer Cpanel upgrade, and, of course, things have slowed quite a bit.
Title: I can second that...
Post by: paul on June 21, 2007, 03:38:35 pm
With Cpanel 11, I have seen a 20% decline in speed of delivery.
Title: Sorry, Forgot to add.
Post by: paul on June 22, 2007, 07:26:42 pm
I didn't see this decline in performance when I switched to CPanel 11.  I saw it after I switched to maildir mail box format from the old mbox.  Sorry, I just remembered.
Title: My list is about 100,000, how can I speed it up.
Post by: DW on June 23, 2007, 06:37:59 pm
Things can slow down noticeably based on the size of the queue.  Hard drive access time with folders containing just a few thousand files is much, much slower. I think the mailbox format could have a lot to do with it.

If you notice things going more slowly I recommend checking the size of the mail queue.

http://bradthemad.org/tech/notes/exim_cheatsheet.php
Code: [Select]
exim -bpc
You might consider shortening the length of time messages are kept in queue.  Yahoo, for one, does rate-limiting that can cause severe bottlenecks.  If you notice this becoming a problem you might want to contact them.

http://listmailpro.com/forum/index.php?topic=1579.0

I also recommend these Exim configuration changes:

http://listmailpro.com/forum/index.php?topic=49.0

Regards
Title: Thanks Dean..
Post by: paul on June 24, 2007, 03:47:07 am
Great input.  I have those configs. in place and I do find that Yahoo has been my big problem for about 2 months now. I have contacted them to little avail.

That exim config, works like a charm.

I will try contacting Yahoo again though.

1000 Thanks.