- Joined
- Nov 6, 2002
- Messages
- 2,404
- Reaction score
- 214
Hey, I need some tech advice. I am a bit out of my league here.
I have a search engine script that archives data from a number of web sites I am monitoring (sort of like Google). Some of those sites are quite hostile to me, and don't want me crawling them.
I need to figure out how to find a proxy server that I can incorporate into my script, so when my server IP is banned, it can switch over and continue crawling under the radar.
The volume of data is fairly high, and I don't mind paying for a solution. I just don't know where to begin looking. When I Google 'proxy server', it brings me to sites that let me proxy from my desktop browser. That is not what I need - I need something that will mask my server IP.
Any suggestions?
I have a search engine script that archives data from a number of web sites I am monitoring (sort of like Google). Some of those sites are quite hostile to me, and don't want me crawling them.
I need to figure out how to find a proxy server that I can incorporate into my script, so when my server IP is banned, it can switch over and continue crawling under the radar.
The volume of data is fairly high, and I don't mind paying for a solution. I just don't know where to begin looking. When I Google 'proxy server', it brings me to sites that let me proxy from my desktop browser. That is not what I need - I need something that will mask my server IP.
Any suggestions?
