agent-browser CI/CD Testing: Version Locking, Headless Differences, and Flaky Tests
One Chrome auto-update, CI turns all red. Headless A11y element order differs from headed. Two parallel tests hijack each other's sessions.
Engineering Blog
18ip Engineering Blog
Production practices for proxy reliability, anti-blocking, compliance, and cost optimization.
C# Tunnel Proxy: HttpClient and HttpWebRequest
C# HttpClient and HttpWebRequest integrating 16Yun Crawler P...
agent-browser 101: AI-First Browser Automation CLI
npm install -g agent-browser, one command to open a browser, snapshot to understand page structure, click/fill to interact.
AI Browser Automation Cost Analysis (Part 2): Proxy and Compute Optimization
Tokens first, proxy second, compute third. Proxy optimization doesn't save much money but reduces latency. Compute optimization matters at scale.
Trafilatura + CloakBrowser: The Complete Full-Text Scraping Pipeline
CloakBrowser renders JS/SPA pages → Trafilatura extracts clean text. Solve the 'JS-rendered content can't be extracted' problem.
Rust Tunnel Proxy: reqwest and isahc
Rust reqwest and isahc HTTP clients integrating 16Yun Crawle...
AI Browser Automation Cost Analysis (Part 1): Tokens, Proxy, and Compute
One extraction task: tokens $0.05, proxy traffic $0.001, server $0.002. Tokens dominate. Proxy and compute are usually too cheap to optimize.
Ruby Tunnel Proxy: Faraday and HTTParty
Ruby Faraday and HTTParty integrating 16Yun Crawler Proxy....
Trafilatura Advanced: Custom Extraction, Language Detection & Performance
Advanced Trafilatura: custom element exclusion, language detection, offline batch processing, and incremental updates.
Chrome Cluster on K8s: Memory Config, /dev/shm, and Graceful Shutdown
Browsers aren't stateless microservices. 200-500MB per instance, /dev/shm config, WebSocket long connections — running browser clusters on K8s needs a completely different design.