TIP: Click on subject to list as thread! ANSI
echo: filegate
to: Janis Kracht
from: mark lewis
date: 2010-09-29 20:02:40
subject: Last couple of days with my binkp mailer..

JK> Wow Baidubot is surely hitting on BBBS' webserver over here :(  Oh
 JK> well.. off to inet.bbb to get rid of them haha  

 ml> you could just deny them access to those links in BBBS that lead to
 ml> places like the messages, files and games... they are robots.txt
 ml> friendly... 

just to follow up and clarify this... an example is my gallery site... i
may not want the spiders trapsing thru the exhibits and looking at the
actual photos available... only the microthumbs and thumbs, sure so i just
set up a disallow for the exhibits area and let them wander over the
others... then, if i see them in the exhibits areas, then i know that
they're not following robots.txt and i can then contact their admins with
my complaint or just block them at the perimeter and deny them access to
everything... depending on my mood, of course ;)

)\/(ark

* Origin: (1:3634/12)
SEEN-BY: 3/0 633/267 640/954 712/0 313 550 620 848
@PATH: 3634/12 123/500 261/38 712/848 633/267

SOURCE: echomail via fidonet.ozzmosis.com

Email questions or comments to sysop@ipingthereforeiam.com
All parts of this website painstakingly hand-crafted in the U.S.A.!
IPTIA BBS/MUD/Terminal/Game Server List, © 2025 IPTIA Consulting™.