User-agent: * Disallow: /*.dat Disallow: /db*.php Disallow: /agb.htm