aboutsummaryrefslogtreecommitdiffstats
path: root/cgit-doc.css
diff options
context:
space:
mode:
authorGravatar Jason A. Donenfeld <Jason@zx2c4.com>2013-05-28 21:17:00 (JST)
committerGravatar Jason A. Donenfeld <Jason@zx2c4.com>2013-08-13 04:14:10 (JST)
commit23debef62104c70600be2b745ec3957538eeac6e (patch)
tree3b68eab7624907836b0e614328a529e686224830 /cgit-doc.css
parent830eb6f6ff9e6dded2bfae99d7cb46f049790470 (diff)
downloadcgit-23debef62104c70600be2b745ec3957538eeac6e.zip
cgit-23debef62104c70600be2b745ec3957538eeac6e.tar.gz
robots.txt: disallow access to snapshots
My dmesg is filled with the oom killer bringing down processes while the Bingbot downloads every snapshot for every commit of the Linux kernel in tar.xz format. Sure, I should be running with memory limits, and now I'm using cgroups, but a more general solution is to prevent crawlers from wasting resources like that in the first place. Suggested-by: Natanael Copa <ncopa@alpinelinux.org> Suggested-by: Julius Plenz <plenz@cis.fu-berlin.de> Signed-off-by: Jason A. Donenfeld <Jason@zx2c4.com>
Diffstat (limited to 'cgit-doc.css')
0 files changed, 0 insertions, 0 deletions