TIP: Click on subject to list as thread! ANSI
echo: osdebate
to: Richard B.
from: Chris
date: 2005-05-06 07:07:42
subject: Re: Protect webpage from bots

From: Chris 

There is a standard out there for a file called ROBOTS.TXT (not case
sensitive).  The basic premise is to tell the bots where they can and
cannot search your site.  See the links below.

/Chris (TGIF)

http://www.searchengineworld.com/robots/robots_tutorial.htm
Robots.txt File Tutorial

http://www.robotstxt.org/wc/robots.html
The Web Robots Pages

http://www.webtoolcentral.com/webmaster/tools/robots_txt_file_generator/
Web Tool Central - Webmaster / Promotion / Scripting resources

http://www.whitehouse.gov/robots.txt
Whitehouse.gov's robots.txt file

http://rootprompt.org/article.php3?article=8550
Using PHP instead of robots.txt


Richard B. wrote:
> Is there a way to prevent email harvesting from webpages?  I'm amazed
> at the quantity of spam is generated even if it is stopped by the
> various filters.
>
> - Richard

--- BBBS/NT v4.01 Flag-5
* Origin: Barktopia BBS Site http://HarborWebs.com:8081 (1:379/45)
SEEN-BY: 633/267 270
@PATH: 379/45 1 106/2000 633/267

SOURCE: echomail via fidonet.ozzmosis.com

Email questions or comments to sysop@ipingthereforeiam.com
All parts of this website painstakingly hand-crafted in the U.S.A.!
IPTIA BBS/MUD/Terminal/Game Server List, © 2025 IPTIA Consulting™.