Today's Posts Follow Us On Twitter! TFL Members on Twitter  
Forum search: Advanced Search  
Navigation
Marketplace
  Members Login:
Lost password?
  Forum Statistics:
Forum Members: 24,254
Total Threads: 80,792
Total Posts: 566,472
There are 2336 users currently browsing (tf).
 
  Our Partners:
 
  TalkFreelance     Design and Development     Programming     PHP and MySQL :

Treating googlebot as a registered wordpress user?

Thread title: Treating googlebot as a registered wordpress user?
Closed Thread    
    Thread tools Search this thread Display Modes  
05-09-2008, 01:59 AM
#1
hisham is offline hisham
hisham's Avatar
Status: I love this place
Join date: Jun 2006
Location: NZ
Expertise: IM
Software:
 
Posts: 678
iTrader: 10 / 92%
 

hisham is on a distinguished road

Send a message via MSN to hisham

  Old  Treating googlebot as a registered wordpress user?

My anime site is run using wordpress and there are some pages that require users to login before they can access the page- the problem with this is that googlebot will also see the page and index the error message.

How do I treat googlebot as a registered user so it can access the restricted content?

05-12-2008, 01:01 PM
#2
Artificial is offline Artificial
Status: I'm new around here
Join date: Oct 2006
Location:
Expertise:
Software:
 
Posts: 3
iTrader: 0 / 0%
 

Artificial is on a distinguished road

  Old

It would be a simple fix; most search engine spider's have various unique user agents. You could simply have your script check to see if the visitor's user agent is a search engine spider agent, and if so skip the error

Bit late here, I'll come online tomorrow afternoon and if you haven't figured it out or if nobody has posted I'll write you up a small section of code. Unfortunately I don't use Wordpress so you will have to adapt it a bit.

05-16-2008, 09:54 AM
#3
rightinpoint is offline rightinpoint
Status: I'm new around here
Join date: May 2008
Location:
Expertise:
Software:
 
Posts: 18
iTrader: 0 / 0%
 

rightinpoint is on a distinguished road

  Old

But I hope you understand, that it's not secure solution.
For example, there are firefox plugins, which allow to set the same browser agent as googlebot use.
Pretty useful, when you want to access some info without signing up

Closed Thread    


Currently Active Users Viewing This Thread: 1 (0 members and 1 guests)
 

  Posting Rules  
Smilies are On
[IMG] code is On
HTML code is Off
Forum Jump:
 
  Contains New Posts Forum Contains New Posts   Contains No New Posts Forum Contains No New Posts   A Closed Forum Forum is Closed