# robots.txt generated at http://friendseat.com User-agent: * # Sitemaps Sitemap: http://friendseat.com/major_cities.xml Sitemap: http://friendseat.com/recipes.xml Sitemap: http://friendseat.com/restaurant1.xml Sitemap: http://friendseat.com/restaurant2.xml Sitemap: http://friendseat.com/restaurant3.xml Sitemap: http://friendseat.com/sitemaps/sitemap_local_1.xml Sitemap: http://friendseat.com/sitemap_homepage.xml # robots that maybe badguys User-agent: ia_archiver User-agent: SlySearch User-agent: turnitinbot User-agent: BlackWidow User-agent: ChinaClaw User-agent: Custo User-agent: DISCo User-agent: Download Demon User-agent: eCatch User-agent: EirGrabber User-agent: EmailSiphon User-agent: EmailWolf User-agent: Express WebPictures User-agent: ExtractorPro User-agent: EyeNetIE User-agent: FlashGet User-agent: GetRight User-agent: GetWeb! User-agent: Go!Zilla User-agent: Go-Ahead-Got-It User-agent: GrabNet User-agent: Grafula User-agent: HMView User-agent: HTTrack User-agent: Ichiro User-agent: Image Stripper User-agent: Image Sucker User-agent: Indy Library User-agent: InterGET User-agent: Internet Ninja User-agent: JetCar User-agent: JOC Web Spider User-agent: larbin User-agent: LeechFTP User-agent: ScoutJet User-agent: Mass Downloader User-agent: MIDown tool User-agent: Mister PiX User-agent: Navroad User-agent: NearSite User-agent: NetAnts User-agent: NetSpider User-agent: Net Vampire User-agent: NetZIP User-agent: Octopus User-agent: PageGrabber User-agent: Papa Foto User-agent: pavuk User-agent: pcBrowser User-agent: RealDownload User-agent: ReGet User-agent: SiteSnagger User-agent: SmartDownload User-agent: SuperBot User-agent: SuperHTTP User-agent: Surfbot User-agent: tAkeOut User-agent: Teleport Pro User-agent: VoidEYE User-agent: Web Image Collector User-agent: Web Sucker User-agent: WebAuto User-agent: WebCopier User-agent: WebFetch User-agent: WebGo IS User-agent: WebLeacher User-agent: WebReaper User-agent: WebSauger User-agent: Website eXtractor User-agent: Website Quester User-agent: WebStripper User-agent: WebWhacker User-agent: WebZIP User-agent: Wget User-agent: Widow User-agent: WWWOFFLE User-agent: Xaldon WebSpider User-agent: Zeus User-agent: robot User-agent: spider User-agent: crawl Disallow: / User-agent: Fasterfox Disallow: / User-agent: Nutch Disallow: / User-agent: spock Disallow: / User-agent: OmniExplorer_Bot Disallow: / User-agent: MJ12bot Disallow: / User-agent: TurnitinBot Disallow: / User-agent: BecomeBot Disallow: / User-agent: genieBot Disallow: / User-agent: dotbot Disallow: / User-agent: MLBot Disallow: / User-agent: 80bot Disallow: / # allow google image bot to search all images User-agent: Googlebot-Image Allow: /*.gif$ Allow: /*.png$ Allow: /*.jpeg$ Allow: /*.jpg$ Allow: /*.ico$ Allow: /*.jpg$ Allow: /images/