Introduction

This is an analysis of spam received at a set of spam traps during the week of Monday May 3rd 2004 (ISO week number 19, from Monday May 3rd 2004 to Sunday May 9th 2004 inclusive). Most of the spam traps are expired or non-existent accounts, the remaining few have been unused for a long time with no legitimate email traffic. All the expired addresses have been bouncing mail for over a year, most for more then three. None of the spam traps have been actively seeded to receive spam. For the purpose of this report, spam is defined as any message delivered to these spam traps. All times and dates are relative to UTC.

While it is impossible to say with any level of certainty how representative these numbers are of spam in general, I believe they are close enough to provide useful information to anyone interested in spam or spam prevention.

Summary

A short summary of this weeks numbers.

Total number of messages:
2946
Unique message bodies:
2758
Unique sender IP addresses:
1952
Average message size:
6902

Client DNS

Reverse DNS

The client IP address is looked up in DNS at the time of delivery. The following shows the number of clients with and without published reverse DNS information, and the number of clients with matching forward and reverse DNS information.

Clients without reverse DNS:
645 (21.9%)
Clients with reverse DNS:
2301 (78.1%)
Clients with matching forward and reverse DNS:
2148 (72.9%)

Originating Domain

The 10 most frequent domains (reverse excluding the host name/left most label). Only clients with matching forward and reverse DNS information are considered. Count is the number of messages delivered from clients within the given domain. Percentage is relative to the number of messages delivered from clients with matching forward and reverse DNS information.

Domain Count Percentage
moosq.com 202 9.4%
client.comcast.net 116 5.4%
tekmailer.com 104 4.8%
dyn.optonline.net 46 2.1%
t3media.net 42 2%
bestthings247.com 41 1.9%
ss01.net 40 1.9%
ny325.east.verizon.net 27 1.3%
4epurchase.com 21 1%
realerdeals.com 21 1%

Client Countries

Client Country Distribution

Client country is determined using the WebHosting.Info ip-to-country data. Data is updated monthly if there are updates available. This shows the top 15 countries for delivering clients. Count is the number of messages delivered from clients in the given country. Percentage is relative to the total number of messages received in the reporting period.

oos-contry.png

Contry Count Percentage
United States 1506 51.1%
*unknown* 474 16.1%
Republic Of Korea 200 6.8%
China 139 4.7%
Brazil 102 3.5%
Canada 66 2.2%
Japan 58 2%
Hong Kong 56 1.9%
United Kingdom 36 1.2%
Netherlands 23 0.8%
Taiwan 21 0.7%
France 21 0.7%
Spain 19 0.6%
Mexico 19 0.6%
Sweden 15 0.5%

Senders

Claimed Sender Domains

Domain name claimed in envelope sender addresses. It is commonly accepted that a significant share of all spam is sent with a forged sender address, so the following list is useless for identifying message origin. It is included here to show spammers domain preference when forging sender addresses.

Domain Count Percentage
yahoo.com 168 5.7%
hotmail.com 110 3.7%
msn.com 105 3.6%
thehdhd.com 39 1.3%
bestthings247.com 33 1.1%
mail.com 28 1%
email.com 20 0.7%
stderr.crystalholdings.com 20 0.7%
168.com 19 0.6%
canada.com 19 0.6%

Clients

A port scan is performed on all clients delivering messages to spam traps. The scan is started as soon as possible after message delivery, usually within a few seconds.

Please note that in cases where the client is located behind a router or firewall doing NAT, the target of the scan may be the router/firewall not the sending client.

Services On Unfiltered Ports

Services are identified by nmaps version detection feature. The following lists the 15 most common services found on unfiltered ports. The count is the number of distinct IP addresses, the percentage is relative to the total number of distinct IP addresses seen within the reporting period.

Service Count Percentage
Microsoft Windows msrpc 759 38.9%
Microsoft Windows UPnP 544 27.9%
Apache httpd 244 12.5%
OpenSSH 196 10%
Microsoft Windows XP microsoft-ds 132 6.8%
Sendmail smtpd 130 6.7%
Microsoft Terminal Service 113 5.8%
Microsoft mstask 107 5.5%
Microsoft DNS 69 3.5%
Microsoft IIS webserver 68 3.5%
Microsoft Distributed Transaction Coordinator 62 3.2%
MySQL 42 2.2%
Microsoft ftpd 41 2.1%
Microsoft ESMTP 39 2%
qmail smtpd 31 1.6%

Client OS Vendor

Client operating systems are identified by nmaps TCP/IP fingerprinting feature. The following lists the 10 most common client operating system vendors. In cases where TCP/IP fingerprinting did not successfully identify the clients operating systems, it is listed as *unknown*.

oos-os-vendor.png

Vendor Count Percentage
Microsoft 1070 54.8%
*unknown* 495 25.4%
Linux 205 10.5%
FreeBSD 145 7.4%
Turtle 29 1.5%
Apple 24 1.2%
Sun 6 0.3%
Cisco 3 0.2%
IBM 3 0.2%
Tektronix 3 0.2%

Time Distribution

Day of Week

Distribution of messages over days of week. The count shows the number of messages received on each day, the percentage is relative to the total number of messages received within the reporting period.

oos-day-of-week.png

Day Count Percentage
Mon 444 15.1%
Tue 426 14.5%
Wed 416 14.1%
Thu 465 15.8%
Fri 436 14.8%
Sat 401 13.6%
Sun 358 12.2%

Time of Day

Distribution of messages over time of day. 00 describes the hour from 00:00 to 01:00. The count shows the number of messages received within each hour, the percentage is relative to the total number of messages received within the reporting period.

oos-time-of-day.png

Hour Count Percentage
00 123 4.2%
01 137 4.7%
02 145 4.9%
03 118 4%
04 133 4.5%
05 100 3.4%
06 120 4.1%
07 109 3.7%
08 109 3.7%
09 113 3.8%
10 87 3%
11 93 3.2%
Hour Count Percentage
12 112 3.8%
13 98 3.3%
14 117 4%
15 133 4.5%
16 143 4.9%
17 149 5.1%
18 117 4%
19 123 4.2%
20 135 4.6%
21 145 4.9%
22 149 5.1%
23 138 4.7%

Size Distribution

Message Size Distribution

Message size distribution over all messages. Count is the number of messages within the given size range. The percentage is relative to the total number of messages received within the reporting period.

oos-size.png

Size Count Percentage
1.5KiB > size >= 0.5KiB 987 33.5%
2.5KiB > size >= 1.5KiB 595 20.2%
3.5KiB > size >= 2.5KiB 400 13.6%
4.5KiB > size >= 3.5KiB 244 8.3%
5.5KiB > size >= 4.5KiB 147 5%
6.5KiB > size >= 5.5KiB 110 3.7%
0.5KiB > size >= 0 85 2.9%
7.5KiB > size >= 6.5KiB 76 2.6%
12.5KiB > size >= 11.5KiB 42 1.4%
8.5KiB > size >= 7.5KiB 34 1.2%

DNS Block Lists

These numbers shows the presence of the sending client in a DNS block list at the time of message delivery. The selection of DNS block lists may be updated on a monthly basis.

Senders In DNS Block Lists

Sending clients present in DNS block list at the time of delivery. The count is the total number of messages delivered from clients listed in the respective block list. The percentage is relative to the total number of messages received within the reporting period.

DNS block list Count Percentage
bl.spamcop.net 2210 75%
xbl.spamhaus.org 1215 41.2%
cbl.abuseat.org 1215 41.2%
dnsbl.ahbl.org 1150 39%
sbl.spamhaus.org 1106 37.5%
dul.dnsbl.sorbs.net 842 28.6%
spam.dnsbl.sorbs.net 490 16.6%
socks.dnsbl.sorbs.net 246 8.4%
http.dnsbl.sorbs.net 204 6.9%
relays.visi.com 97 3.3%
smtp.dnsbl.sorbs.net 25 0.8%
misc.dnsbl.sorbs.net 15 0.5%
relays.ordb.org 9 0.3%
zombie.dnsbl.sorbs.net 6 0.2%

DNS Block List Groups

To investigate overlap of the different DNS block lists and the effectiveness of combinations of block lists, the following shows the number of messages delivered from clients listed in at least one of the groups block lists. The set of groups may be updated on a monthly basis.

all:
2673 of 2946(90.7%)
bl.spamcop.net, cbl.abuseat.org and dul.dnsbl.sorbs.net:
2437 of 2946(82.7%)
bl.spamcop.net and dul.dnsbl.sorbs.net:
2369 of 2946(80.4%)
bl.spamcop.net and cbl.abuseat.org:
2301 of 2946(78.1%)
*.dnsbl.sorbs.net:
1492 of 2946(50.6%)

SpamAssassin

All messages are filtered through SpamAssassin and reports are generated on hit rates excluding Bayesian classification scores.

SpamAssassin Without Bayesian Classifier

SpamAssassin hits when disregarding the result of the Bayesian classifier. The count is the number of messages for the given score range. The percentage is relative to the total number of messages received within the reporting period.

oos-sa-only.png

Hits Count Percentage
0 > hits 1 0%
5 > hits >= 0 1876 63.7%
10 > hits >= 5 685 23.3%
15 > hits >= 10 280 9.5%
20 > hits >= 15 73 2.5%
hits >= 20 31 1.1%

Distributed Checksum Clearinghouse

DCC Matches

Number of matches for the three matching algorithms used by DCC. The DCC servers are queried at the time of delivery. The Body, Fuz1 and Fuz2 columns shows the number of messages matched in the count range for their respective algorithm. The Highest column shows the number of hits from the algorithm returning the highest match count. The percentage is relative to the total number of messages received within the reporting period.

oos-dcc.png

Range Body Fuz1 Fuz2 Highest
25 >= count 2814 (95.5%) 2162 (73.4%) 953 (32.3%) 896 (30.4%)
50 >= count > 25 4 (0.1%) 8 (0.3%) 36 (1.2%) 32 (1.1%)
75 >= count > 50 4 (0.1%) 36 (1.2%) 88 (3%) 82 (2.8%)
100 >= count > 75 2 (0.1%) 31 (1.1%) 63 (2.1%) 69 (2.3%)
count > 100 122 (4.1%) 709 (24.1%) 1806 (61.3%) 1867 (63.4%)

About

On the Origin Of Spam is published as weekly and monthly reports by B. Johannessen in the hope that it will be useful to the anti-spam community.