User-agent: * Disallow: /news/donai/ Disallow: /news/politics/ Disallow: /cont/ Disallow: /news/fighters/ Disallow: /news/sapporo/ Disallow: /news/international/ Disallow: /news/2011local/ Disallow: /news/sports/ Disallow: /news/hsb/ Disallow: /news/economic/ Disallow: /news/aomori/ Disallow: /news/society/ Disallow: /news/editorial/ Disallow: /news/topic/ Disallow: /Php/ Disallow: /news/chiiki/ Disallow: /news/education/ Disallow: /news/environment/ Disallow: /news/entertainment/ Disallow: /news/agriculture/ Disallow: /news/consadole/ Disallow: /news/dogai/ Disallow: /news/life/ Disallow: /news/summit/ Disallow: /news/yuubari/ Disallow: /news/winter/ Disallow: /news/rerakamuy/ Disallow: /search/ Disallow: /sp/search/ # archive.is # none # Megalodon User-agent: Megalodon Disallow: / # matome.naver.jp User-agent: Yeti Disallow: / # archive.org User-agent: ia_archiver Disallow: /