HTML - Help: Robot.txt - Can I Exclude A Name From The Spiders?
Hey guys,
I have a question regarding robot.txt I am wondering if it is possible to exclude just a line of code or preferably any instance of a name from an entire site from all search engines? The site is built in pixel post (http://www.pixelpost.org/) so not sure if that will make it difficult to exclude. Any help would be great. Kind Regards, Nick. Similar TutorialsI'm hoping that there is a way to hide ads from spiders using HTML. Seeing as how my current host doesn't allow me to use Javascript. For an example, in http://www.eldon.com See the black border around the page? I would like to disable it or set a the table border property @ 0 so it won't show up when printing? Is this possible? Thanks a lot guys... First post!! Hi. I have a problem I cant seem to fix. On my page i have a javascript dropdown menu which i dont want search engines to read because it is very big. It consists of 434 links. Is there a way for me to exclude it from search engines? Thx in advance. I am trying to write an .htaccess file that accomplishes three things, but I can't get them to happen all at once. Do I have something out of order? (the file is not active right now) I am trying to: 1) redirect all non-www to www (for the root directory main site) 2) redirect two specific pages to new pages and retain the link juice 3) not redirect two subdirectories that have other domains pointed to them (www.bigcountryacres.info points to the first and www.kidslovedrbarton.com points to the 2nd) The following code almost works. The two old .htm pages on the main site are redirected to their .html versions just fine. When going to a subdirectory, you can reach the index page the first time. Then if you link to a subpage and then go back to the home page link (just index.htm), it gets redirected to my main site instead. Any idea of what I'm doing wrong? Options +FollowSymLinks RewriteEngine on RewriteCond %{REQUEST_URI} !^/_BigCountryAcres/ RewriteCond %{REQUEST_URI} !^/_DrBarton/ RewriteCond %{HTTP_HOST} ^integritivity.com [NC] RewriteRule ^(.*)$ http://www.integritivity.com/$1 [L,R=301] redirect 301 /WebDesign.htm http://www.integritivity.com/WebDesign.html redirect 301 /index.htm http://www.integritivity.com/index.html Thanks, Robin I have a long page with opening paragraphs that I wrote, followed by a long list that might be buried somewhere else on the Web (duplicate content). The list looks like spam (it isn't) and I'm concerned that the page will not get indexed. Is there a simple way to mark the sections that should not be crawled? As a last resort, I could put the list on a separate page with "nofollow" links. Here is the page: http://www.iaps.com/list-of-internet...ns-199010.html |