Introduction

This is an analysis of spam received at a set of spam traps during the week of Monday June 7th 2004 (ISO week number 24, from Monday June 7th 2004 to Sunday June 13th 2004 inclusive). Most of the spam traps are expired or non-existent accounts, the remaining few have been unused for a long time with no legitimate email traffic. All the expired addresses have been bouncing mail for over a year, most for more then three. None of the spam traps have been actively seeded to receive spam. For the purpose of this report, spam is defined as any message delivered to these spam traps. All times and dates are relative to UTC.

While it is impossible to say with any level of certainty how representative these numbers are of spam in general, I believe they are close enough to provide useful information to anyone interested in spam or spam prevention.

Summary

A short summary of this weeks numbers.

Total number of messages:
2874
Unique message bodies:
2646
Unique sender IP addresses:
2075
Average message size:
6947

Client DNS

Reverse DNS

The client IP address is looked up in DNS at the time of delivery. The following shows the number of clients with and without published reverse DNS information, and the number of clients with matching forward and reverse DNS information.

Clients without reverse DNS:
708 (24.6%)
Clients with reverse DNS:
2166 (75.4%)
Clients with matching forward and reverse DNS:
1958 (68.1%)

Originating Domain

The 10 most frequent domains (reverse excluding the host name/left most label). Only clients with matching forward and reverse DNS information are considered. Count is the number of messages delivered from clients within the given domain. Percentage is relative to the number of messages delivered from clients with matching forward and reverse DNS information.

Domain Count Percentage
client.comcast.net 99 5.1%
imgsvr.com 56 2.9%
t3media.net 40 2%
hkcable.com.hk 39 2%
ne.client2.attbi.com 37 1.9%
bestthings247.com 35 1.8%
dyn.optonline.net 32 1.6%
in-addr.btopenworld.com 30 1.5%
bbtec.net 29 1.5%
optssvr.net 28 1.4%

Client Countries

Client Country Distribution

Client country is determined using the WebHosting.Info ip-to-country data. Data is updated monthly if there are updates available. This shows the top 15 countries for delivering clients. Count is the number of messages delivered from clients in the given country. Percentage is relative to the total number of messages received in the reporting period.

oos-contry.png

Contry Count Percentage
United States 1342 46.7%
*unknown* 429 14.9%
Republic Of Korea 273 9.5%
China 145 5%
Brazil 88 3.1%
Canada 84 2.9%
Hong Kong 73 2.5%
Japan 71 2.5%
United Kingdom 54 1.9%
Spain 30 1%
France 29 1%
Mexico 27 0.9%
Germany 23 0.8%
Taiwan 19 0.7%
Argentina 18 0.6%

Senders

Claimed Sender Domains

Domain name claimed in envelope sender addresses. It is commonly accepted that a significant share of all spam is sent with a forged sender address, so the following list is useless for identifying message origin. It is included here to show spammers domain preference when forging sender addresses.

Domain Count Percentage
yahoo.com 165 5.7%
hotmail.com 93 3.2%
msn.com 81 2.8%
DiscountAlert.com 42 1.5%
drdsvr.com 42 1.5%
britmilla.com 40 1.4%
aaiworldmarket.com 35 1.2%
bestthings247.com 24 0.8%
aol.com 23 0.8%
fyi-consumer.com 21 0.7%

Clients

A port scan is performed on all clients delivering messages to spam traps. The scan is started as soon as possible after message delivery, usually within a few seconds.

Please note that in cases where the client is located behind a router or firewall doing NAT, the target of the scan may be the router/firewall not the sending client.

Services On Unfiltered Ports

Services are identified by nmaps version detection feature. The following lists the 15 most common services found on unfiltered ports. The count is the number of distinct IP addresses, the percentage is relative to the total number of distinct IP addresses seen within the reporting period.

Service Count Percentage
Microsoft Windows msrpc 792 38.2%
Microsoft Windows UPnP 611 29.4%
OpenSSH 269 13%
Microsoft Windows XP microsoft-ds 224 10.8%
Apache httpd 203 9.8%
Microsoft Terminal Service 85 4.1%
MySQL 85 4.1%
Microsoft mstask 84 4%
Microsoft IIS webserver 63 3%
Microsoft Distributed Transaction Coordinator 54 2.6%
Microsoft DNS 51 2.5%
Microsoft ESMTP 41 2%
ProFTPD 37 1.8%
Microsoft ftpd 35 1.7%
Sendmail smtpd 34 1.6%

Client OS Vendor

Client operating systems are identified by nmaps TCP/IP fingerprinting feature. The following lists the 10 most common client operating system vendors. In cases where TCP/IP fingerprinting did not successfully identify the clients operating systems, it is listed as *unknown*.

oos-os-vendor.png

Vendor Count Percentage
Microsoft 1132 54.6%
*unknown* 554 26.7%
Linux 283 13.6%
FreeBSD 60 2.9%
Turtle 32 1.5%
Sun 5 0.2%
D-Link 4 0.2%
Apple 3 0.1%
Cisco 3 0.1%
CacheFlow 2 0.1%

Time Distribution

Day of Week

Distribution of messages over days of week. The count shows the number of messages received on each day, the percentage is relative to the total number of messages received within the reporting period.

oos-day-of-week.png

Day Count Percentage
Mon 397 13.8%
Tue 448 15.6%
Wed 402 14%
Thu 440 15.3%
Fri 449 15.6%
Sat 357 12.4%
Sun 381 13.3%

Time of Day

Distribution of messages over time of day. 00 describes the hour from 00:00 to 01:00. The count shows the number of messages received within each hour, the percentage is relative to the total number of messages received within the reporting period.

oos-time-of-day.png

Hour Count Percentage
00 124 4.3%
01 125 4.3%
02 112 3.9%
03 116 4%
04 109 3.8%
05 121 4.2%
06 113 3.9%
07 129 4.5%
08 124 4.3%
09 107 3.7%
10 100 3.5%
11 122 4.2%
Hour Count Percentage
12 108 3.8%
13 99 3.4%
14 123 4.3%
15 112 3.9%
16 133 4.6%
17 134 4.7%
18 122 4.2%
19 124 4.3%
20 138 4.8%
21 115 4%
22 130 4.5%
23 134 4.7%

Size Distribution

Message Size Distribution

Message size distribution over all messages. Count is the number of messages within the given size range. The percentage is relative to the total number of messages received within the reporting period.

oos-size.png

Size Count Percentage
1.5KiB > size >= 0.5KiB 888 30.9%
2.5KiB > size >= 1.5KiB 541 18.8%
3.5KiB > size >= 2.5KiB 435 15.1%
4.5KiB > size >= 3.5KiB 281 9.8%
5.5KiB > size >= 4.5KiB 150 5.2%
0.5KiB > size >= 0 110 3.8%
6.5KiB > size >= 5.5KiB 97 3.4%
7.5KiB > size >= 6.5KiB 55 1.9%
8.5KiB > size >= 7.5KiB 44 1.5%
9.5KiB > size >= 8.5KiB 35 1.2%

DNS Block Lists

These numbers shows the presence of the sending client in a DNS block list at the time of message delivery. The selection of DNS block lists may be updated on a monthly basis.

Senders In DNS Block Lists

Sending clients present in DNS block list at the time of delivery. The count is the total number of messages delivered from clients listed in the respective block list. The percentage is relative to the total number of messages received within the reporting period.

DNS block list Count Percentage
bl.spamcop.net 1834 63.8%
xbl.spamhaus.org 1361 47.4%
cbl.abuseat.org 1360 47.3%
dul.dnsbl.sorbs.net 920 32%
sbl.spamhaus.org 893 31.1%
dnsbl.ahbl.org 893 31.1%
socks.dnsbl.sorbs.net 291 10.1%
spam.dnsbl.sorbs.net 263 9.2%
http.dnsbl.sorbs.net 230 8%
misc.dnsbl.sorbs.net 135 4.7%
relays.visi.com 72 2.5%
smtp.dnsbl.sorbs.net 23 0.8%
relays.ordb.org 9 0.3%
zombie.dnsbl.sorbs.net 6 0.2%

DNS Block List Groups

To investigate overlap of the different DNS block lists and the effectiveness of combinations of block lists, the following shows the number of messages delivered from clients listed in at least one of the groups block lists. The set of groups may be updated on a monthly basis.

all:
2587 of 2874(90%)
bl.spamcop.net, cbl.abuseat.org and dul.dnsbl.sorbs.net:
2268 of 2874(78.9%)
bl.spamcop.net and dul.dnsbl.sorbs.net:
2116 of 2874(73.6%)
bl.spamcop.net and cbl.abuseat.org:
2093 of 2874(72.8%)
*.dnsbl.sorbs.net:
1416 of 2874(49.3%)

SpamAssassin

All messages are filtered through SpamAssassin and reports are generated on hit rates excluding Bayesian classification scores.

SpamAssassin Without Bayesian Classifier

SpamAssassin hits when disregarding the result of the Bayesian classifier. The count is the number of messages for the given score range. The percentage is relative to the total number of messages received within the reporting period.

oos-sa-only.png

Hits Count Percentage
0 > hits 1 0%
5 > hits >= 0 1807 62.9%
10 > hits >= 5 701 24.4%
15 > hits >= 10 283 9.8%
20 > hits >= 15 52 1.8%
hits >= 20 30 1%

Distributed Checksum Clearinghouse

DCC Matches

Number of matches for the three matching algorithms used by DCC. The DCC servers are queried at the time of delivery. The Body, Fuz1 and Fuz2 columns shows the number of messages matched in the count range for their respective algorithm. The Highest column shows the number of hits from the algorithm returning the highest match count. The percentage is relative to the total number of messages received within the reporting period.

oos-dcc.png

Range Body Fuz1 Fuz2 Highest
25 >= count 2721 (94.7%) 2082 (72.4%) 1188 (41.3%) 1132 (39.4%)
50 >= count > 25 0 (0%) 8 (0.3%) 22 (0.8%) 23 (0.8%)
75 >= count > 50 4 (0.1%) 29 (1%) 131 (4.6%) 110 (3.8%)
100 >= count > 75 5 (0.2%) 32 (1.1%) 86 (3%) 81 (2.8%)
count > 100 144 (5%) 723 (25.2%) 1447 (50.3%) 1528 (53.2%)

About

On the Origin Of Spam is published as weekly and monthly reports by B. Johannessen in the hope that it will be useful to the anti-spam community.