FusionBB
FusionBB Review (large)
Recent Members
Welcome them to our community!
FusionBB SWAG!

FusionBB golf shirts, t-shirts, mousepads and more.

Recent Topics
Tagging
FusionBBDev Recent Topics
Sponsored by Dreamers Empire - Helping entrepeneurs build their dreams.
Dreamers Empire
Username Post: robots.txt configuring help        (Topic#4403)
Coynster
FusionBB Enthusiast
Total Posts: 402
*
Birthday: 05-31 
Average Post Ranks%:                       
06-24-06 09:41 PM - Post#34789    



Thanks to help from some of you here, and a lot of trial and error, I finally got my video counter script to work properly.

ecoyne Videos

Now, I would like to let robots search that page, but not increase the video counter. Is there a way I can put an exclude into a robot.txt file that would allow this to happen?

Beta site: http://www.ecoyne.com/forum


 
White and Nerdy
FusionBB Fanatic
Total Posts: 1677
*
Birthday: 09-21 
Location: Fort Wayne
Average Post Ranks%:                       
06-28-06 10:44 PM - Post#34891    


    In response to Coynster

I know how to allow robots to search, but not how to prevent them from increasing the counter, sorry
www.tcoburn.com an archive of my ramblings for those who miss reading them. hehe!
My Facebook Profile


 
Coynster
FusionBB Enthusiast
Total Posts: 402
*
Birthday: 05-31 
Average Post Ranks%:                       
06-29-06 09:15 AM - Post#34898    


    In response to White and Nerdy

Is it possible to restrict them from navigating a certain file? If I can disallow them access to my getvid.php file, that'll be sufficient...


Beta site: http://www.ecoyne.com/forum


 
White and Nerdy
FusionBB Fanatic
Total Posts: 1677
*
Birthday: 09-21 
Location: Fort Wayne
Average Post Ranks%:                       
06-29-06 03:49 PM - Post#34911    


    In response to Coynster

this is strictly from memory, but I believe the syntax is the same for files as it is directories

disallow: /path/to/file/getvid.php

if that doesn't work, let me know and I'll look it up
www.tcoburn.com an archive of my ramblings for those who miss reading them. hehe!
My Facebook Profile


 
Dan
Alpha Tester
Total Posts: 1314
*
Birthday: 05-04 
Average Post Ranks%:                       
 
06-30-06 07:34 AM - Post#34922    


    In response to White and Nerdy

That is the correct code.

But, that would stop them visiting that page, thus not reading the link and indexing them. Ok, the counter will not go up, but then they wont show in search results either.


Not sure if there is a way to stop them from increasing the counter, yet still index the page
www.parent-forum.co.uk
Follow me on Twitter


 
Coynster
FusionBB Enthusiast
Total Posts: 402
*
Birthday: 05-31 
Average Post Ranks%:                       
06-30-06 08:39 AM - Post#34924    


    In response to Dan

  • TheDaddy Said:
That is the correct code.

But, that would stop them visiting that page, thus not reading the link and indexing them. Ok, the counter will not go up, but then they wont show in search results either.

Not sure if there is a way to stop them from increasing the counter, yet still index the page


If displaying the video information is listed in listvid.php, and only the counter starts functioning with the getvid.php - do you not think that by inputting the above code I would not increase the counter, yet still index the information on the page?

Beta site: http://www.ecoyne.com/forum


 
Dan
Alpha Tester
Total Posts: 1314
*
Birthday: 05-04 
Average Post Ranks%:                       
 
06-30-06 09:18 AM - Post#34925    


    In response to Coynster

Ah, in that case I would say it would as you want.

Why don't you try it then run a few of the checkers on the site.
www.parent-forum.co.uk
Follow me on Twitter


 
Coynster
FusionBB Enthusiast
Total Posts: 402
*
Birthday: 05-31 
Average Post Ranks%:                       
06-30-06 10:45 AM - Post#34928    


    In response to Dan

What kind of checker do you refer to that I can use to verify if that is working properly?

Beta site: http://www.ecoyne.com/forum


 
Dan
Alpha Tester
Total Posts: 1314
*
Birthday: 05-04 
Average Post Ranks%:                       
 
06-30-06 02:03 PM - Post#34941    


    In response to Coynster

This is worth checking anyway

http://www.widexl.com/remote/search-engi...

And run this one

http://tool.motoricerca.info/robots-chec...
www.parent-forum.co.uk
Follow me on Twitter


 
White and Nerdy
FusionBB Fanatic
Total Posts: 1677
*
Birthday: 09-21 
Location: Fort Wayne
Average Post Ranks%:                       
10-01-06 12:01 PM - Post#36796    


    In response to Dan

THeDaddy,

it says I'm missing "keywords", "description", "author", "robots" and "author" meta tags.. I already have a robots.txt file, so what would the correct syntax be to stop those errors from occuring?
www.tcoburn.com an archive of my ramblings for those who miss reading them. hehe!
My Facebook Profile


 
White and Nerdy
FusionBB Fanatic
Total Posts: 1677
*
Birthday: 09-21 
Location: Fort Wayne
Average Post Ranks%:                       
10-01-06 12:03 PM - Post#36797    


    In response to White and Nerdy

neermind, just copied it from the "view source" page here. hehe
www.tcoburn.com an archive of my ramblings for those who miss reading them. hehe!
My Facebook Profile


 
Icon Legend Permissions & Sharing Options Topic Options
Print Topic


2677 Views
Calendar
SMTWTFS
 1
2345678
9101112131415
16171819202122
23242526272829
30 
Current Quote
"FusionBB is to the on-line Bulletin/Message software business, the BENCHMARK on which all others will have to measure up to in the future if they are to remain in the game."
~ sam_w
FusionBB™ Version 3.2 | ©2003-2013 InteractivePHP, Inc.
Execution time: 0.266 seconds.   Total Queries: 211   Zlib Compression is on.
All times are (GMT-4). Current time is 08:53 PM
Top