Printer Friendly Version
Email this thread to a friend
|
Featured Web Site Template |
|
There are 0 guests and 1 members in the forums right now.
Reflects user activity within the last 5 minutes
|
|
| Member |
Message |
stevey
Joined: Jul 17, 2004
# Posts: 10
|
Posted: 2004-Jul-18 02:11
hi, in Awstats where it says;
Robots/Spiders visitors (Top 25)
Googlebot (Google) Hits= 983+23
whats that mean? the google bot has visited 983 times? or 23? 
thanks
|
 |
samhainmoonherbs
Joined: Jul 25, 2004
# Posts: 1
|
Posted: 2004-Jul-26 02:20
I think that means Googlebot visited your site once and generated 983 hits, plus hitting your robots.txt file 23 times.
|
|
stevey
Joined: Jul 17, 2004
# Posts: 10
|
Posted: 2004-Jul-31 02:35
thanks 
|
|
kashyap_rajput
Joined: Feb 25, 2005
# Posts: 3
|
Posted: 2005-Feb-26 06:30
does awstat shows the data of Returning vistors?
Kashyap
|
|
joblisted
Joined: May 11, 2005
# Posts: 3
|
Posted: 2005-May-11 12:14
What is the main fuction of robots.txt?
|
|
g1smd
Staff
Joined: Jul 28, 2002
# Posts: 10418
|
Posted: 2005-May-11 22:26
The robots.txt file lists the folders and files that you don't want crawled. It doesn't prevent access, it merely asks that bots don't access those pages.
The URLs of those pages may still appear in search results as URL-only listings if anything links to them. The content will not be indexed.
|
|
OAC
Staff
Joined: Jan 25, 2001
# Posts: 6805
|
Posted: 2005-May-12 08:55
It is helpful to have a robots.txt file on your server, even if you don't want to block any robot from any directory. Simply create an empty file in a text editor such as Notepad and save it as robots.txt, then upload it to the server.
Why would you do this? Your stats program may show a high number of "page" errors. However, it is probable nearly all of them result from search engine spiders asking for a robots.txt file before they start spidering. If one doesn't exist, an error message is returned. This has no effect on the spiders, because then they will just spider the site, but it creates an error message in your log file. By creating a blank robots.txt file, the search engine spiders will see there are no instructions in it to stop them spidering all pages and no error message is created in your log file.
Thus, the error messages you will see in your stats, will be true errors.
|
|
You are not permitted to post messages in this forum or topic, because of one or more of the following reasons:
- You have not yet logged in, or registered properly as a member
- You are a member, but no longer have posting rights.
- This is a private forum, for which you do not have permissions.
If you are a recent member, it's possible that you simply have not yet confirmed your account. Please
check your email for a message entitled 'JimWorld Forums: Confirm Your Account' and follow the instructions
contained within.
If you cannot find this message, click here to Re-Send it.
|
If you are still experiencing problem, please read the
Login Assistance
Article for some advice on what may be causing your login not to work properly.
|
Switch to Advanced Editor and ...
Create a New Topic
or Reply to this Thread
|
|
Inbox
