Why are people still trying to use content filters and authentication to fight spam?

Open letter to e-mail vendors: Your spam fix doesn't work. Time for a complete redo? Berlind's Testbed | ZDNet.com

The makers of anti-spam solutions (be they stand-alone or ones that are built-in to existing e-mail solutions) would have you believe that their solutions are worthy of battling spam and merit your attention if ridding your inbox (or inboxes) of spam is important to you. They're full of it. The proof? We're worse off today than we were five years ago when they were selling us the same rotten bill of goods.

Six years ago I co-founded an anti-spam company that didn't use content filtering. It looked for "lies" in the headers. We grew it into a an end-user service called MessageFire, and we started on a corporate service ala Postini. Then we sold the company to an up-and-coming email-compliance vendor called MessageGate. I stayed there for almost two years before the commute between Boston and Seattle, among other things, just got to be too much. Sadly, although they still are around, their attempt to start selling to the Fortune 100 and work their way down, just didn't work. And MessageFire's technology, a small part of their system, has languished.

How do I know that MessageFire's technology would still work? After all, I left the company several years ago, and the characteristics of spam have changed quite a bit since then. Very simple. The software is still filtering my personal email. And as the owner of somewhere.com, I get a lot of spam. Here are the stats on the accounts I am currently filtering.

Messages processed for Kee Hinckley in the past week.

Account Mail Junk Misfiled
xxx     93 (23.2%)    307 (76.8%) 0/ 0 (0.0%)
xxx     69 (21.0%)    259 (79.0%) 0/ 0 (0.0%)
xxx     52 (32.3%)    109 (67.7%) 0/ 0 (0.0%)
xxx    482 (6.6%)   6,774 (93.4%) 0/ 0 (0.0%)
Total    696 (8.5%)   7,449 (91.5%) 0/ 0 (0.0%)
System Total  31,882 (20.3%) 125,484 (79.7%) 134/ 28 (0.1%)

So in the past week, my personal mail accounts got 696 legitimate messages and 7,449 pieces of spam. Overall (in the same week) the system received 31,882 valid messages and 125,484 pieces of spam. The recorded error rate was 0.1%. (The yearly system totals are 1.6m legit messages and 6.2m pieces of spam.)

So that's not bad. But here's what's really impressive.

Your typical anti-spam system, as run by Google, Postini, MessageLabs or others, has a room full of people, working 24/7, identifying new pieces of spam and adding them to the filters.

The MessageFire anti-spam system is still running the same software, with the same rules, that it was running over two years ago when I left. In those two years spammers have vastly increased their use of dark IP addresses, pwnd machines, new image and PDF attachments, and other techniques. Every content-filter vendor out there has had to scramble to deal with the problem. But the MessageFire system is still running old, un-updated code. Not because it couldn't be improved (it definitely could be), but because it's sitting on MessageGate's shelf waiting for someone to come along and buy it. Yet it works as well, if not better, than any of those systems.

It's frustrating to write software that never gets used, even in the best of circumstances. To see MessageFire's technology sitting there filtering less than a hundred accounts, is enough to drive me to drink.

Technorati Tags: , , , ,

Categories:

Leave a comment

(not displayed)

TrackBack URL for this entry: http://www.marrowbones.com/cgi-bin/mt4/mt-tb.cgi/35

0 TrackBacks

Listed below are links to blogs that reference this entry: Why are people still trying to use content filters and authentication to fight spam?.

About this Entry

This page contains a single entry by Kee Hinckley published on September 17, 2007 8:41 PM.

Microsoft Office Advertisement -- Designed to Scare People Away? was the previous entry in this blog.

U.S. judge knocks down part of Patriot Act is the next entry in this blog.

Find recent content on the main index or look in the archives to find all content.

Subscribe via Reader

Subscribe via Email

Enter your email address:

Delivered by FeedBurner

About Me

I'm the CEO/CTO of Somewhere, Inc., a company building a unified social networking layer that gives people the means to track their friends across multiple social networks.
Creative Commons License
This weblog is licensed under a Creative Commons License.