Monday, May 2, 2016

// // Leave a Comment

How to use Robot.txt for blogger

how to submit Robot.txt to blogger
robot.txt file is also known as custom robot.txt
this file you can enable in blogger by opening
=>blogger.com=>settings=>search preferences=>
now scrolling down you will get crawling and
indexing with robot.txt and custom robot header tags

now lets enter to the topic
Robot.txt is a small lines of codes which help the
web crawels to search and index your webiste.

everyblogs hosted on blogger have its default Robot.txt
file which is look like this
User-agent: Media partners-Google
Disallow

Disallow: /Search
Allow: /
Sitemap: http://youryrl.com/feeds?posts?
default?orderby=UPDATED

this code is only for 25 posts to crawl now  if you want to
increase the number of your link in your sitemap then replace
defautl sitemap with below one . now this code will work for
recent 500 posts.

Sitemap: http://abc.blogspot.com/atom.xml?
redirect=false&start-index=1$max-results=500

if you have 500 posts then this links will work for you
to crawl and index your site.
here the next question rises what to do if you have
more than 500 posts.
now its also have next code,

Sitemap:http://abc.blogspot.com/atom.xml?redirect=false$start
index=1$max-results=500$max-reslts=1000

now to check the succcsessfull integreatin of robot.txt file
you need to do is
http://abc.blogspot.com/robot.txt
if your txt file displays the work is done and enjoy.
.
now you also need to submit this file  to your webmaster which help
you to index when you update your posts and helps
you to apper on search engine
now i will tell you how to do this
at first open webmaster on googlge
now add url on the  the given box

now you need to verify your site you can verify with different
methods given there there are many allternate ways to do
  after verifying place the same site map robot.txt file
and submit after submitting now you need to wait some time to index your links
if you want faster indexing
now you need to go to fetch google on the same page now you can put your url
which you want to index and click on fetch and rendering now its done your work
done wait some time up to bots will crawl and index after indexing
you will be alive on the search engine .

i am using this indexing word if you are confuse then listen
indexing means keeping the records of your url data by the web crawl spiders
they use their record when people search on search engine
related to your data.

now dissmuch for today in next article i will be avaiable soon about SEO techniques.
keep readin my articles.

0 comments:

Post a Comment

please comment if you like dislike any query and updates you want comment down