Engineering Blog
3 posts under this tag.
The Executor's core is a for loop: Planner runs every N steps to guide direction, Navigator executes one operation per step. Planner says done → stop. Navigator says done → Planner validates. Consecutive failures hit the limit → abandon.
getClickableElements walks the DOM tree to find interactive elements. hashDomElement uses three-layer hashing (branch path + attributes + XPath) for unique fingerprints. A 30-line iterative stack replaces recursive DOM traversal.
getMarkdownContent uses turndown to convert DOM to Markdown. getReadabilityContent uses Mozilla Readability to extract article body. Both are under 40 lines in service.ts but the design tradeoffs matter for scraper developers.