Skip to content
DnsLister Forum

Where domain hunters compare notes

How IP reputation databases work: how Scamalytics, Spur, and MaxMind score your proxy

You launch a fresh scraping worker, route it through a newly acquired European residential proxy, and hit a protected target. Before your browser even finishes executing JavaScript or rendering page fonts, you are blocked with a 403 Forbidden or hit with an impossible interactive CAPTCHA.

Developers usually assume that their browser fingerprint leaked, or that their request cadence was too aggressive. But on the first request, the target's web server has not had time to analyze your behavioral patterns.

In most cases, the decision to challenge your connection was made in less than ten milliseconds by querying an external IP reputation database.

Platforms like Scamalytics, Spur.us, IPQualityScore (IPQS), and MaxMind minFraud maintain vast, real-time threat intelligence feeds. When your connection arrives at a protected edge server, the security platform checks your IP against these databases. Understanding how these companies discover, test, and catalog proxy networks explains why clean proxies suddenly burn, and how fraud scores are calculated behind the scenes.

Commercial proxy mapping and vendor subscriptions

The biggest open secret in the fraud prevention industry is that threat intelligence companies actively buy subscriptions to commercial proxy services.

Firms like Spur.us do not wait for malicious traffic to hit customer websites. They sign up for paid accounts with major residential and mobile proxy providers, exactly like any other developer:

  • They connect to the provider's entry gateways and generate continuous streams of rotating requests across every available country pool.
  • On every request, their automated crawlers hit internal diagnostic endpoints to log the assigned public exit IP address, the local timestamp, and the Autonomous System Number (ASN).
  • By routing millions of requests through these networks around the clock, they map out the provider's active residential pools in real time.

When an end user installs a free desktop app with an embedded proxy SDK, that home router's public IP joins the proxy fleet. Within hours, a threat intelligence scanner connects through that exact peer, catalogs its IP address, and pushes an update to global fraud scoring feeds labeling that IP as an active commercial proxy.

By the time you rent that IP address to scrape an ecommerce store, the target's security system already knows the address belongs to a residential proxy pool.

Active probing and open port scanning

Another primary technique used by reputation engines is automated, outbound network probing.

When an IP address appears in security telemetry, reputation databases dispatch automated scanners to inspect that specific host for open ports and network artifacts:

  • They probe common proxy listener ports, including 1080 (SOCKS), 3128 (Squid), and 8080 (HTTP alternate).
  • They check whether the host behaves as an unauthenticated open relay that forwards arbitrary TCP connections.
  • They evaluate HTTP response headers to see if the host leaks forwarding markers like X-Forwarded-For, Via, or custom proxy identification strings.

On an ordinary consumer broadband connection, a home router should have all inbound ports closed or filtered by a hardware firewall.

If an automated scanner pings a residential IP and discovers port 1080 answering SOCKS5 handshakes, the reputation score degrades immediately. The system infers that the machine is either running commercial proxy software or is compromised by a botnet, bumping its fraud score to maximum risk.

Consortium telemetry and honeypot networks

Threat intelligence feeds do not operate in isolation. They rely on shared telemetry contributed by thousands of enterprise clients.

When a payment fraud ring uses a specific IP block to test stolen credit cards on a digital fashion retailer, that incident is logged. The retailer's fraud platform transmits the IP address, device fingerprints, and failure reason codes back to the central intelligence consortium.

Within minutes, that IP address is marked as high-risk across the entire network. If your crawler rotates into that same residential or cellular IP an hour later to check product availability on an entirely different platform, you inherit the bad reputation generated by the credit card fraudster.

Reputation databases also operate global honeypot networks. These are deliberately vulnerable servers placed across European cloud providers and telecom networks designed to attract automated scans.

If an IP address touches a honeypot while performing automated port scanning, SSH brute-forcing, or form spamming, that IP address is flagged across public and private blocklists.

Reverse DNS and BGP routing heuristics

When auditing a proxy pool you will often see reputation databases flag an IP address based purely on network-layer naming conventions.

Every IP address announced on the internet has a public Reverse DNS (rDNS or PTR) record. Internet Service Providers follow strict naming schemes for consumer broadband lines versus commercial server infrastructure:

  • A genuine German consumer broadband line on Deutsche Telekom typically resolves to a PTR record like p5b123456.dip0.t-ipconnect.de (where dip stands for dynamic IP).
  • A server hosted in an OVH facility resolves to a PTR record like vps-1234567.vps.ovh.net.

Reputation algorithms evaluate these PTR strings using regular expressions. If an IP address claims to be a residential user, but has an empty PTR record, an unconfigured domain, or a hostname containing words like static, host, cloud, or vps, the classification engine flags the IP as hosting space rather than consumer broadband.

How fraud scores decay over time

IP reputation is dynamic. Because consumer broadband ISPs assign dynamic IP addresses that recycle among ordinary subscribers, reputation engines cannot permanently blacklist an eyeball IP without eventually blocking legitimate human consumers.

Most modern fraud engines implement exponential decay models:

If an IP address stops generating automated scans, spam, or high-velocity requests, its risk score begins to cool down.

On residential networks, the standard cooldown window typically ranges between three and fourteen days of zero malicious traffic. Once an IP passes that quiet period without triggering honeypots or consortium alerts, its fraud score returns to a baseline clean rating.

On datacenter subnets, score decay takes significantly longer. Many enterprise feeds keep datacenter ASNs permanently flagged as automated infrastructure, regardless of how long the IP has been idle.

Practical takeaways for proxy management

Their is no way to prevent fraud databases from doing their job, but understanding their mechanics helps you maintain higher success rates across your infrastructure:

  • Always check assigned subnets against reputation APIs: Before launching high-volume jobs, query APIs like IPQualityScore or Scamalytics on a small sample of your pool to confirm baseline fraud scores sit below 20/100.
  • Avoid residential nodes with open inbound ports: If you manage your own local proxy farm or 4G dongle rig, configure your local firewall to block inbound external probes so internet scanners cannot detect your proxy daemon.
  • Match your request velocity to human limits: Rapidly cycling hundreds of requests through a single residential peer triggers velocity alerts on consortium feeds, burning the IP address for the next user.

When you know how reputation feeds catalog and evaluate network traffic, you stop blaming browser stealth scripts for blocks that were predetermined at the network layer.

Auditing your pool's historical fraud score before running production jobs ensures that you don't loose valuable time fighting automated blocks that have nothing to do with your code.

Source: r/EuroProxy · by /u/reddgsmtrx3x

Leave a Reply

Your email address will not be published. Required fields are marked *