User-Agent:* Allow:/ User-agent:Megalodon Disallow:/ User-agent:ia_archiver Disallow:/