User-agent: * Disallow: /techdiv/ Disallow: /aosdiv/ Disallow: /advaff/ Disallow: /abt/ Disallow: /tag/ Disallow: /tag/trackers/ Disallow: /tag/campaigns/ Disallow: /important-payout-information/ User-agent: ia_archiver Disallow: /