I don't know how to write WordPress robots.txt file. please help me.
Three answers:
?
2013-10-15 02:35:17 UTC
The Robot.txt is setup the same for a wordpress site as others, the issue may be that bloggers less often use manually edited files like that. There are SEO plugins that create Robot.txt files as part of their refinements, you might look into that, the plugin probably recommends the most logical pages to be blocked.
Ben
2013-10-15 07:28:13 UTC
robots.txt is no different for WordPress or any other site.
A simple one for wordpress might be:
User-agent: *
Disallow: /wp-admin/
Disallow: /wp-content/uploads
which will tell all robots to not index those two directories.
2013-10-15 02:30:50 UTC
The blog below should answer all your questions on how to write a successful bot file. As for which program to use for editing, I would suggest Notepad++ or Sublime Text
ⓘ
This content was originally posted on Y! Answers, a Q&A website that shut down in 2021.