User-agent: * # 이미지 생성 스크립트 제외 (2026-08-01) - 색인 가치 없고 백엔드 부하만 큼 Disallow: /auction/thumb_1.php Disallow: /auction/thumb_1_abs.php Disallow: /auction/jpgfile.php Disallow: /auction/jpg.php # 2026-08-30: image/popup/print generators excluded - no index value, backend+VWorld quota cost only Disallow: /main/land_use_map.php Disallow: /a/view_pic.php Disallow: /search/detail_view_img.php Disallow: /content/detail_print.php Allow: / # AI/SEO scraper bots block (2026-07-16) - search bots (Googlebot/Yeti/Daum/bingbot) stay allowed User-agent: GPTBot User-agent: ClaudeBot User-agent: anthropic-ai User-agent: CCBot User-agent: Amazonbot User-agent: AhrefsBot User-agent: SemrushBot User-agent: MJ12bot User-agent: DotBot User-agent: BLEXBot User-agent: DataForSeoBot User-agent: Bytespider Disallow: / # Sitemap (2026-08-01 claude) - 피드는 166 /www/ 에 배포된다 Sitemap: https://www.dcart.co.kr/sitemap_www_dcart_co_kr.xml Sitemap: https://www.dcart.co.kr/rss_www_dcart_co_kr.xml # 2026-08-30: OAI-SearchBot throttled, not blocked - it powers ChatGPT search exposure. # generator excludes repeated here: a named group overrides '*' entirely. User-agent: OAI-SearchBot Crawl-delay: 30 Disallow: /auction/thumb_1.php Disallow: /auction/jpgfile.php Disallow: /auction/jpg.php Allow: /