Ugh, crawlers...
Yep. Ugh. Crawlers...
Apparently, beemp3.com managed to find a folder I'd hidden away on my site for personal MP3 uploads, ignore my robots.txt rules, and put up links to all the music I have uploaded all across Rivenwolf.net. Can you say "UNHAPPY?" I sure can. How it found the folder in question, I'll never know. Maybe it just guessed... It seems shady enough to do something like that. Shame on my for having the folder indexed for easy access, because that allowed it to link to all the files I had uploaded. Bah!
So, in response to that, I'm not even going to bother flagging them all. What I did, though, was change all my links (so at least beemp3 is linking to dead things now), remove all my indexes (a major inconvenience, but I can't afford to leave them), and rewrite my hotlink prevention rules. Because of that, there may be some nasty side-effects with RSS feeds when I post links to stuff I have hosted. I provided a rule for Google Reader, since it seems to break things by being a referrer. I think most readers, though, treat things as a direct connection (at least the offline readers do), so there shouldn't be too much of a problem.
If there is, though, let me know?