Author: ipipgo

Cell phone proxy IP in the end what is the use? Recently, people always ask me how to deal with the lag of the cell phone online, in fact, many people do not know, cell phones and computers can optimize the network environment through the proxy IP. For example, brushing short videos always load failure, game latency is ridiculously high, change a proxy IP may be smooth. But pay attention...

Axios proxy settings in the end what is the use? Crawler friends must have encountered the IP blocked tragedy, this time the proxy IP is a life-saving straw. To cite a real case: last week there was an e-commerce data capture brother, with a bare IP continuous request for a platform API, the result is less than 2 hours to be blacklisted. Later on...

Teach you to use Jsoup to catch web pages without blocking IP Recently, some of my friends do data collection with me to complain, said to write a crawler in Java is always blocked IP. this is something I have too much experience, last year to do e-commerce price monitoring, a day can trigger more than a dozen times the CAPTCHA. Later, I found a trick - to Jsoup set on the proxy IP ...

家装比价这事，没代理IP真玩不转 最近两年搞装修的朋友都有体会，家具家电的价格跟过山车似的。同一款沙发今天标价8999，明天可能就变7999，过两天又悄悄涨回原价。想抓住最佳入手时机，光靠人工刷新网页能…

Tool positioning is not the same way Let's first break these two tools to understand. Scrapy this thing is a serious crawler framework, from the network request to the data storage of the whole package, like building a house for you to build a good scaffolding. BeautifulSoup is an HTML parser, like the tweezers you use when eating crabs...

搞网站抓取总被封IP？手把手教你用代理ip绕坑 最近好些做数据采集的哥们跟我吐槽，说用BeautifulSoup抓个数据动不动就吃闭门羹。上周有个做电商比价的兄弟，刚跑两天脚本IP就被拉黑了，气得他直跳脚。今儿咱…

为啥你需要委内瑞拉代理？ 最近好多做跨境电商的朋友来问，说他们想搞懂南美市场的用户习惯，但是直接连当地网站老被卡脖子。举个真实例子，有个卖手机壳的卖家，想看看自家产品在委内瑞拉购物平台的展示效…

手把手教你用Node.js搓个HTTP代理 最近不少做数据采集的朋友都在问，自己搭代理服务器是不是特别麻烦？今儿咱就用最通俗的大白话，教你用Node.js整个能用的HTTP代理。别担心，就算你刚入门也能跟着做。 为啥…

手把手教你用Puppeteer配代理IP 搞网络爬虫的兄弟都知道，用Puppeteer做自动化经常碰到IP被封的糟心事。今天咱们就唠唠怎么用ipipgo的代理服务，给Node.js项目穿上”隐身衣”。 为啥要给Puppeteer…