| Author | Comment |
TI Freak
Probe
Posted: 4 May 2005
15:46 GMT
Total Posts:
Edit | Anyone know how to block bot crawlers??? I have a very annoying one that is downloading 4 of my files, and now just between the 4 files is up over 710 downloads. This normally wouldn't be a problem, though this throws the true count off, because a machine is downloading the programs, not people. Any advice would be appreciated. |
Andy
Administrator
Posted: 4 May 2005
15:49 GMT
Total Posts: 939 | Put a robots.txt in your /... Example: ticalc.org's Tutorial |
TI Freak
Probe
Posted: 4 May 2005
15:53 GMT
Total Posts:
Edit | So I just need to do what they did, and it can not get to my files? hmm...
Does the star mean any and all bots?? Or do I have to specify the name??
[Edited by TI Freak on 05-May-05 00:54] |
Andy
Administrator
Posted: 4 May 2005
17:27 GMT
Total Posts: 939 | Standard wildcard rules apply. (* matching any number of any character (including no characters), ? matching exactly one any character (well, I don't think you'd use that for bots)) |
