home *** CD-ROM | disk | FTP | other *** search
- Path: sparky!uunet!olivea!decwrl!decwrl!infopiz!mccall!ipmdf-newsgate!list
- From: ned@innosoft.com (Ned Freed)
- Newsgroups: vmsnet.mail.pmdf
- Subject: RE: Mail lists and large queues
- Message-ID: <01GMVGM6497694DO6P@INNOSOFT.COM>
- Date: 27 Jul 92 20:54:03 GMT
- Organization: The Internet
- Lines: 37
- Return-Path: <epmdf@YMIR.CLAREMONT.EDU>
- Resent-Date: 27 Jul 1992 12:54:03 -0800 (PST)
- Resent-From: epmdf@YMIR.CLAREMONT.EDU
- Errors-To: epmdf@YMIR.CLAREMONT.EDU
- Resent-Message-ID: <01GMVHPX1F1U9GVS47@YMIR.CLAREMONT.EDU>
- X-Vms-To: IN%"TIHOR@ACFcluster.NYU.EDU"
- X-Vms-Cc: IPMDF
- Mime-Version: 1.0
- Content-Type: TEXT/PLAIN; CHARSET=US-ASCII
- Content-Transfer-Encoding: 7BIT
-
- One additional point. While it is true that list traffic can flood the
- queues in some cases, it is also true that in most cases regular mail
- will get jobs queued just to process it. As such, the list expansion already
- tends to happen in a somewhat independent fashion. For example, we expand
- several very large lists on ymir.claremont.edu, several of which see heavy
- traffic, and in most cases this has virtually no effect on the initial
- delivery attempt for regular mail.
-
- Immediate delivery jobs for messages only "see" messages that they were
- queued to process -- specifically, messages that appeared after some
- time. This means that if mail from a list is already expanding in the
- background the immediate job does not see it.
-
- There is only one limitation with this approach. If your queues are so
- narrow that there are always jobs pending you may not get additional
- immediate jobs queued in some cases. The simple solution in this case is
- to use a wider queue that supports more simultaneous delivery jobs at
- once. I recommend at least six and possibly even eight job slots if you're
- serious about expanding large lists to many channels. Note that
- prioritization helps but cannot solve this problem -- if you use up all
- your job slots on expansion of lists there is simply no place for
- immediate message operations to go. Once prioritization of list messages is
- available you can set things up so that these messages don't create
- immediate jobs, but that's about all you can do. A job, once created,
- is not the sort of thing that can change its mind about what it is
- doing. The VMS batch system is not flexible enough to suspend a running
- job to let a later job start running.
-
- The big problem comes with periodic delivery. Although periodic jobs try
- to process messages with the fewest number of delivery attempts first, it
- is far from certain that this simple criteria suffices to correctlyu
- prioritize list traffic. This is the place where handling of jobs in
- priority order is a real benefit. If a list expands but sees lots of
- temporary delivery failures it can really wedge up periodic delivery.
- This is the case that prioritization really fixes.
-
- Ned
-