Holey Dribble

For about a year I've been working on a computer program the mines the internet for data. I wrote it quickly about a year ago and it sucked! It was full of bugs, it was slow, and it was very hard for me to fix everything. So I rewrote it. I made it super-organized and did a huge amount of work to make it as fast as possible. The my computer hard drive died and I lost most of the code. So about a month ago I started writing version 3.0. I finished it on Sunday and I'm happy to report that I have it purposely running very slowly as I get the bugs out and it is processing 10,000 pages a day. I think it can do about 1 million pages a day at full tilt on the slow machine. I have another box that is much more powerful. I'm not sure what it can do there yet.