# See http://www.robotstxt.org/wc/norobots.html for documentation on how to use the robots.txt file # # To ban all spiders from the entire site uncomment the next two lines: User-Agent: * Disallow: /accounts Disallow: /main/new_transaction Disallow: /main/accounts Disallow: /members Disallow: /futures_instruments Disallow: /futures_terms Disallow: /futures_transactions Disallow: /positions Disallow: /instruments Disallow: /instrument_transactions Disallow: /instrument_options Disallow: /instrument_option_transactions Disallow: /leaders Disallow: /teams