How can I block bad bots that cause high CPU load from scraping websites on the server?

Overview

This article provides instructions for configuring Juggernaut Firewall to automatically block malicious bots that generate excessive CPU load through website scraping. Enabling the apache-useragents trigger allows the system to identify and restrict incoming requests containing known problematic user-agent strings.

Prerequisites

  • Administrative access to the Juggernaut Firewall management interface.
  • Familiarity with custom trigger configurations within the Login Failure Blocking module.

Configuration Steps

  1. Navigate to Juggernaut Firewall -> Settings -> Login Failure Blocking -> Login Failure Custom Triggers.
  2. Locate the apache-useragents trigger and click the edit button.
  3. Select the Enabled checkbox to activate the trigger.
  4. Click the Submit button to save your settings.
  5. Click the Restart button to restart the login failure daemon and apply the changes immediately.

apache-useragents

Customizing the User-Agent Pattern

The default configuration includes a predefined list of known malicious user-agent strings. Administrators can modify this pattern to align with specific server requirements or emerging bot signatures.

pattern

Troubleshooting

  • Changes not taking effect: Verify that the login failure daemon was restarted after modifying trigger settings. The service must be restarted for new rules to load into memory.
  • Legitimate traffic blocked: Review the custom pattern configuration and adjust string matches or regular expressions to exclude valid user-agent strings used by approved applications, monitoring tools, or search crawlers.
  • bots, scraping
  • 0 Benutzer fanden dies hilfreich
War diese Antwort hilfreich?

Verwandte Artikel

Where are the configuration files for Juggernaut Firewall located?

Configuration files are located in the /etc/csf/ directory with the main firewall configuration...

Can I use Juggernaut Firewall to block Wordpress bruteforce attacks?

Yes we support blocking attacks like these very easily. See below for more information: How can...

How can I install or upgrade the extension?

We provide free installation and configuration for all our paid licenses. Open a support ticket...

How can I change the interface language of the extension?

Overview This article provides instructions on how to change the interface language within the...

How can I get detailed help about a specific setting?

Overview This article outlines how to access contextual assistance and detailed configuration...