Bottle

Bottle offers a range of configurable tools, stats, and logging.

A live requests log shows all requests and helps you configure each of the throttle tools.

The throttle log shows which requests were throttled and why. It also shows when the PoW is solved and allows a client to bypass the throttle.

The paths log shows which URLs triggered the throttles, and the number of throttles per URL.

The IPs log shows which IPs triggered the throttles, and the number of throttles per IP.

Session IP Throttle is a tool that can throttle IPs that create too many new sessions too quickly.

Session Rate Throttle is a tool that can throttle sessions that request too many pages too quickly.

Request Rate per IP is a tool that throttles IPs that request too many pages too quickly.

Overall Page Matching Throttle is a tool that throttles a specific section of a website that is being abused by bots. (For instance, the courses catalog.) This is useful when a large website is being scraped by a bot network with rotating IPs.

404s is a tool that can block IPs that make requests for too many non-existant static files. Or, it can throttle IPs that request too many non-existant pages.

Exclude is a tool that lets you configure overrides for the throttle tools (URL begins with, URL contains, and IP address).

Proof-of-Work is an cryptographic puzzle displayed to users instead of an outright 429 HTTP code (throttle). Many bots do not process JavaScript and will not solve puzzles. The length is the complexity of the puzzle. A larger number generally takes longer to solve, so this is a measure of how long a delay your legitimate users will face when throttled.

Logging options includes log location and rotation settings. We recommend using the Request Logging tool only for setup or debugging and leave it disabled the rest of the time.

The Proof-of-Work presented to throttled clients.