AskBOT SEO/Sitemap management required
I almost never find askbot as a valid result for a subject related to LibeOffice when googling....
It seems that no robots can crawl/index inside Ask-LO...
Related to task #414:
- mark the fields on the profile page as not-to-be-indexed by search-engines
- verify proper sitemap with Google Webmaster Tools
Updated by Norbert Thiebaud about 5 years ago
- Priority changed from Normal to Low
I verified today
1/ robots.tx is being found by crawlers, including google
2/ sitemap.xml is being fetched (despite being a heavy request... 15 seconds or so from here to wget it)
3/ the logs showed that for the last 12 hours, when I checked, google bot alone crawled 11K+ pages
and a few google searches show that ask.libreoffice.org do show up....