BrightData
danielmiessler · Data & Analytics
一个渐进式网页抓取技能,按顺序尝试四种方法:内置WebFetch、带请求头的curl、浏览器自动化,最后是付费的Bright Data服务。通过逐级升级的方法处理反爬虫和JavaScript密集型网站。
A progressive web scraping skill that attempts four methods in sequence: built-in WebFetch, curl with headers, browser automation, and finally a paid Bright Data service. It handles bot detection and JavaScript-heavy sites by escalating through increasingly capable tiers.
npx skills add https://github.com/danielmiessler/Personal_AI_Infrastructure --skill BrightData
星标 15866 · 安装量 2