User-agent: * Disallow: /cgi-bin/ User-Agent: BaiduSpider Disallow: / User-Agent: SemrushBot Disallow: / User-Agent: AhrefsBot Disallow: / User-Agent: Sosospider Disallow: / User-Agent: YisouSpider Disallow: / User-agent: Sogou News Spider Disallow: / User-agent: YoudaoBot Disallow: / User-agent: YodaoBot Disallow: / User-agent: 360Spider Disallow: / User-agent: Sogou web spider Disallow: /