Codexworker

Custom Web Scraping Development

I build scrapers that work: handle pagination, JavaScript-rendered content, rate limiting and anti-bot measures, and output clean structured data. Built to run reliably on a schedule.

I'm a backend developer with 10+ years of experience across PHP, Go, MySQL and Elasticsearch. Recent work includes Cenoskop (30M+ products daily), Niftycent (US price intelligence), and facha.sk (Go backend). I build, fix and optimize backend systems that handle real data and real traffic.

What I Can Help With

Build custom web scrapers that run reliably.

Typical Problems

single-page / JS-rendered targets pagination handling rate limiting and CAPTCHAs anti-bot detection structured data extraction output cleaning and normalization

Relevant Experience

Built scrapers for Cenoskop and Niftycent that extract product data from 500+ e-commerce sites. Handled JavaScript-rendered pages, anti-bot measures, pagination, and output normalization across different site structures. Scrapers run daily and process millions of product pages.

What Is Included

target analysis
scraper implementation
error handling and retries
output formatting
local run + scheduling setup

How It Works

We define the target data and how often it changes, build a scraper with proper error handling, and validate the output. From €1,000 for a first scraper.

Starting from €1,000

Initial scraper implementation. Multiple targets estimated separately.

Frequently Asked Questions

Legal risk of scraping?

I build the scraper technically; you're responsible for complying with the target's terms and laws. I structure scrapers to be respectful (rate limits, caching) by default.

What about sites that require login?

I can handle session/auth flows, but you provide valid credentials — I never collect yours.

Related Services

Other problems I help with.

Large-Scale Web Crawler Development

Build scalable web crawling infrastructure.

Details →

Large-Scale Web Crawling

Scale crawling to millions of URLs across many hosts.

Details →

Product Data Extraction

Extract and normalize product data from external sources.

Details →

Custom Data Pipeline Development

Build ETL/import/transform/export pipelines for large datasets.

Details →

Custom Price Monitoring Systems

Build price monitoring infrastructure for products/sellers.

Details →

Systems I've Built

Relevant production work.

Price Intelligence Engine

Cenoskop / Levnobot

Crawler monitoring millions of products. Processing 30M products daily and comparing them.

Built and maintain the full crawling pipeline — from scraping through Elasticsearch indexing to price comparison.

Data Aggregation Scraping ElasticSearch
US Price Intelligence

Niftycent

Price intelligence engine for the US market. Processing large-scale product data.

Built the data pipeline and crawling infrastructure for large-scale US product monitoring.

Data Aggregation Scraping Big Data
Job & Services Marketplace

facha.sk

Find a job or offer your services.

Built the Go backend — API, matching logic and deployment.

Job Marketplace Services Go
Secure Communication

Paidshield

Chat application with end-to-end encryption.

Built the backend and encryption layer for a secure chat application.

End-to-End Encryption Real-time Communication Security
Traffic Analysis

AnalyticsForWebsite

Custom solution for collecting and evaluating traffic metrics with emphasis on processing speed and minimizing backend load.

Designed and built the backend for fast traffic metric collection and evaluation.

Performance Optimization Data Collection
Security Scanner

remotedaemon.com

Remote security scanner with ping and certificate checking.

Built the scanning daemon and monitoring backend.

Security Ping Certificate
DNS Security

Synopsee

A Cleaner, Safer Internet. Take control of your DNS. Block ads, trackers, and malicious sites with customizable profiles.

Built the DNS resolution backend and profile management system.

DNS Security Privacy

Need Help With This?

Describe the problem in a few lines — I'll look at it and tell you what I think.

Discuss a scraping project