You are not logged in.
When I run a check, only the first 10 searches work, then the rest fail due to network error and proxy failure. Any clue on how to fix?
[2018-02-20 23:15:11,542] [google-0] INFO c.s.s.s.g.s.GoogleScraper - GOT status=[503] exception=[none]
[2018-02-20 23:15:11,542] [google-0] WARN c.s.s.t.g.GoogleTaskRunnable - scrap failed for #OBF#search-241# because of ERROR_NETWORK
[2018-02-20 23:15:11,542] [google-0] WARN c.s.s.t.g.GoogleTaskRunnable - no more proxy, stopping the thread
[2018-02-20 23:15:11,542] [google-0] INFO c.s.s.t.g.GoogleTaskRunnable - google thread stopped
[2018-02-20 23:15:13,548] [google-1] INFO c.s.s.s.g.s.GoogleScraper - GOT status=[200] exception=[none]
[2018-02-20 23:15:13,564] [google-1] TRACE c.s.s.s.g.s.GoogleScraper - sleeping 18790 milliseconds
[2018-02-20 23:15:32,362] [google-1] INFO c.s.s.t.g.GoogleTaskRunnable - search "#OBF#search-493#" | try 1 | total search done : 154/633
[2018-02-20 23:15:32,362] [google-1] DEBUG c.s.s.s.g.s.GoogleScraper - GET https://www.google.com/search?q=#OBF#se … w==&num=50 via proxy:http://#OBF#proxy-ip#:3128/ try 1
[2018-02-20 23:15:34,031] [google-1] INFO c.s.s.s.g.s.GoogleScraper - GOT status=[200] exception=[none]
[2018-02-20 23:15:34,046] [google-1] TRACE c.s.s.s.g.s.GoogleScraper - sleeping 13045 milliseconds
[2018-02-20 23:15:47,105] [google-1] INFO c.s.s.t.g.GoogleTaskRunnable - search "#OBF#search-306#" | try 1 | total search done : 155/633
[2018-02-20 23:15:47,105] [google-1] DEBUG c.s.s.s.g.s.GoogleScraper - GET https://www.google.com/search?q=#OBF#se … w==&num=50 via proxy:http://#OBF#proxy-ip#:3128/ try 1
[2018-02-20 23:15:48,699] [google-1] INFO c.s.s.s.g.s.GoogleScraper - GOT status=[200] exception=[none]
[2018-02-20 23:15:48,730] [google-1] TRACE c.s.s.s.g.s.GoogleScraper - sleeping 19324 milliseconds
[2018-02-20 23:16:08,057] [google-1] INFO c.s.s.t.g.GoogleTaskRunnable - search "#OBF#search-56#" | try 1 | total search done : 156/633
[2018-02-20 23:16:08,057] [google-1] DEBUG c.s.s.s.g.s.GoogleScraper - GET https://www.google.com/search?q=#OBF#se … w==&num=50 via proxy:http://#OBF#proxy-ip#:3128/ try 1
[2018-02-20 23:16:09,209] [google-1] INFO c.s.s.s.g.s.GoogleScraper - GOT status=[503] exception=[none]
[2018-02-20 23:16:09,209] [google-1] DEBUG c.s.s.s.g.s.GoogleScraper - GET https://www.google.com/search?q=#OBF#se … w==&num=50 via proxy:http://#OBF#proxy-ip#:3128/ try 2
[2018-02-20 23:16:10,417] [google-1] INFO c.s.s.s.g.s.GoogleScraper - GOT status=[503] exception=[none]
[2018-02-20 23:16:10,417] [google-1] DEBUG c.s.s.s.g.s.GoogleScraper - GET https://www.google.com/search?q=#OBF#se … w==&num=50 via proxy:http://#OBF#proxy-ip#:3128/ try 3
[2018-02-20 23:16:11,649] [google-1] INFO c.s.s.s.g.s.GoogleScraper - GOT status=[503] exception=[none]
[2018-02-20 23:16:11,649] [google-1] WARN c.s.s.t.g.GoogleTaskRunnable - scrap failed for #OBF#search-56# because of ERROR_NETWORK
[2018-02-20 23:16:11,649] [google-1] WARN c.s.s.t.g.GoogleTaskRunnable - no more proxy, stopping the thread
[2018-02-20 23:16:11,649] [google-1] INFO c.s.s.t.g.GoogleTaskRunnable - google thread stopped
[2018-02-20 23:16:11,671] [Thread-18] WARN c.s.s.t.g.GoogleTask - 10 proxies failed during the task
[2018-02-20 23:16:11,671] [Thread-18] WARN c.s.s.t.g.GoogleTask - 477 searches have not been checked
[2018-02-20 23:16:11,671] [Thread-18] INFO c.s.s.t.AbstractTask - task done for module GOOGLE
[2018-02-20 23:16:11,671] [pool-2-thread-1] INFO s.s.CronService - history pruning : 0 runs deleted
[2018-02-20 23:46:54,605] [pool-1-thread-1] INFO s.s.Scheduler - last version 2.8.0 | current version 2.8.0
Here are my options: http://prntscr.com/ihnu9y and I have tried adjusting them a bit.
Any advice?
Offline
Same problem here: https://forum.serphacker.com/viewtopic.php?pid=1276
Offline
I had the same problem with my proxies, I opened a ticket to my proxy provider and he replied:
1 thread to every 10 seconds is pretty fast, google recognize an automation when see one, please increase the timeout at least at 30 seconds. The proxies are not banned by google, are flagged and google check if you are a bot, if you solve that captcha one time, google will remove the flag for that IP
It works for me, my setting for the time out are "60 - 90".
Of course it takes more time (around 1:30 hour for 250 keywords) but the scan is completed.
(3 captchas and 0 error for the last check)
Offline