User-agent: Googlebot Disallow: /amabook/ # Below CommonPart Disallow: /aff/ Disallow: /amazon/ Disallow: /amabook/amacom/ Disallow: /amabook/amapub/ Disallow: /amabook/amalib/ Disallow: /anlog*/ Disallow: /etclink/ Disallow: /lib/ Disallow: /libpub/ Disallow: /org/ Disallow: *.js Disallow: */admin.cgi Disallow: */help2.cgi Disallow: */printenv.cgi Disallow: */rank.cgi Disallow: */regist_ys.cgi Disallow: /ms/lock/ Disallow: /ms/log/ Disallow: /ms/pl/ Disallow: /ms/html/ Disallow: /ms/template/ Disallow: /msfun/lock/ Disallow: /msfun/log/ Disallow: /msfun/pl/ Disallow: /msfun/html/ Disallow: /msfun/template/ Disallow: /rss/ User-Agent: Slurp # Below CommonPart Disallow: /aff/ Disallow: /amazon/ Disallow: /amabook/amacom/ Disallow: /amabook/amapub/ Disallow: /amabook/amalib/ Disallow: /anlog*/ Disallow: /etclink/ Disallow: /lib/ Disallow: /libpub/ Disallow: /org/ Disallow: *.js Disallow: */admin.cgi Disallow: */help2.cgi Disallow: */printenv.cgi Disallow: */rank.cgi Disallow: */regist_ys.cgi Disallow: /ms/lock/ Disallow: /ms/log/ Disallow: /ms/pl/ Disallow: /ms/html/ Disallow: /ms/template/ Disallow: /msfun/lock/ Disallow: /msfun/log/ Disallow: /msfun/pl/ Disallow: /msfun/html/ Disallow: /msfun/template/ Disallow: /rss/ user-agent: Baiduspider crawl-delay:120 Disallow: /ms/ Disallow: /msfun/ # Below CommonPart Disallow: /aff/ Disallow: /amazon/ Disallow: /amabook/amacom/ Disallow: /amabook/amapub/ Disallow: /amabook/amalib/ Disallow: /anlog/ Disallow: /anlog2/ Disallow: /anlog3/ Disallow: /anlog4/ Disallow: /etclink/ Disallow: /lib/ Disallow: /libpub/ Disallow: /org/ Disallow: /rss/ User-agent: Yeti crawl-delay:120 Disallow: /ms/ Disallow: /msfun/ # Below CommonPart Disallow: /aff/ Disallow: /amazon/ Disallow: /amabook/amacom/ Disallow: /amabook/amapub/ Disallow: /amabook/amalib/ Disallow: /anlog/ Disallow: /anlog2/ Disallow: /anlog3/ Disallow: /anlog4/ Disallow: /etclink/ Disallow: /lib/ Disallow: /libpub/ Disallow: /org/ Disallow: /rss/ User-agent: * # Below CommonPart Disallow: /aff/ Disallow: /amazon/ Disallow: /amabook/amacom/ Disallow: /amabook/amapub/ Disallow: /amabook/amalib/ Disallow: /anlog*/ Disallow: /etclink/ Disallow: /lib/ Disallow: /libpub/ Disallow: /org/ Disallow: *.js Disallow: */admin.cgi Disallow: */printenv.cgi Disallow: */rank.cgi Disallow: */regist_ys.cgi Disallow: /ms/lock/ Disallow: /ms/log/ Disallow: /ms/pl/ Disallow: /ms/html/ Disallow: /ms/template/ Disallow: /msfun/lock/ Disallow: /msfun/log/ Disallow: /msfun/pl/ Disallow: /msfun/html/ Disallow: /msfun/template/ Disallow: /rss/