You are not logged in.
Pages: 1
Hello,
I keep getting this problem for like 4 days now, see log below. I dont use proxys
Can anybody help me plz, need the rankings!
[2017-11-28 09:39:19,310] [google-0] TRACE c.s.s.s.g.s.GoogleScraper - sleeping 5000 milliseconds
[2017-11-28 09:39:25,302] [google-0] INFO c.s.s.t.g.GoogleTaskRunnable - search "#OBF#search-1223#" | try 1 | total search done : 1/611
[2017-11-28 09:39:25,302] [google-0] DEBUG c.s.s.s.g.s.GoogleScraper - GET https://www.google.com/search?q=#OBF#se … nl&num=150 via proxy:direct try 1
[2017-11-28 09:39:26,156] [google-0] INFO c.s.s.s.g.s.GoogleScraper - GOT status=[200] exception=[none]
[2017-11-28 09:39:26,192] [google-0] TRACE c.s.s.s.g.s.GoogleScraper - sleeping 5000 milliseconds
[2017-11-28 09:39:33,091] [google-0] INFO c.s.s.t.g.GoogleTaskRunnable - search "#OBF#search-1098#" | try 1 | total search done : 2/611
[2017-11-28 09:39:33,091] [google-0] DEBUG c.s.s.s.g.s.GoogleScraper - GET https://www.google.com/search?q=#OBF#se … nl&num=150 via proxy:direct try 1
[2017-11-28 09:39:34,045] [google-0] INFO c.s.s.s.g.s.GoogleScraper - GOT status=[200] exception=[none]
[2017-11-28 09:39:34,071] [google-0] TRACE c.s.s.s.g.s.GoogleScraper - sleeping 5000 milliseconds
[2017-11-28 09:39:39,792] [google-0] INFO c.s.s.t.g.GoogleTaskRunnable - search "#OBF#search-816#" | try 1 | total search done : 3/611
[2017-11-28 09:39:39,792] [google-0] DEBUG c.s.s.s.g.s.GoogleScraper - GET https://www.google.com/search?q=#OBF#se … nl&num=150 via proxy:direct try 1
[2017-11-28 09:39:41,209] [google-0] INFO c.s.s.s.g.s.GoogleScraper - GOT status=[200] exception=[none]
[2017-11-28 09:39:41,229] [google-0] TRACE c.s.s.s.g.s.GoogleScraper - sleeping 5000 milliseconds
[2017-11-28 09:39:48,127] [google-0] INFO c.s.s.t.g.GoogleTaskRunnable - search "#OBF#search-103#" | try 1 | total search done : 4/611
[2017-11-28 09:39:48,127] [google-0] DEBUG c.s.s.s.g.s.GoogleScraper - GET https://www.google.com/search?q=#OBF#se … nl&num=150 via proxy:direct try 1
[2017-11-28 09:39:49,048] [google-0] INFO c.s.s.s.g.s.GoogleScraper - GOT status=[200] exception=[none]
[2017-11-28 09:39:49,082] [google-0] TRACE c.s.s.s.g.s.GoogleScraper - sleeping 5000 milliseconds
[2017-11-28 09:39:54,543] [google-0] INFO c.s.s.t.g.GoogleTaskRunnable - search "#OBF#search-194#" | try 1 | total search done : 5/611
[2017-11-28 09:39:54,544] [google-0] DEBUG c.s.s.s.g.s.GoogleScraper - GET https://www.google.com/search?q=#OBF#se … nl&num=150 via proxy:direct try 1
[2017-11-28 09:39:55,598] [google-0] INFO c.s.s.s.g.s.GoogleScraper - GOT status=[200] exception=[none]
[2017-11-28 09:39:55,618] [google-0] TRACE c.s.s.s.g.s.GoogleScraper - sleeping 5000 milliseconds
[2017-11-28 09:40:00,914] [google-0] INFO c.s.s.t.g.GoogleTaskRunnable - search "#OBF#search-71#" | try 1 | total search done : 6/611
[2017-11-28 09:40:00,914] [google-0] DEBUG c.s.s.s.g.s.GoogleScraper - GET https://www.google.com/search?q=#OBF#se … nl&num=150 via proxy:direct try 1
[2017-11-28 09:40:01,692] [google-0] INFO c.s.s.s.g.s.GoogleScraper - GOT status=[200] exception=[none]
[2017-11-28 09:40:01,713] [google-0] TRACE c.s.s.s.g.s.GoogleScraper - sleeping 5000 milliseconds
[2017-11-28 09:40:06,906] [google-0] INFO c.s.s.t.g.GoogleTaskRunnable - search "#OBF#search-11#" | try 1 | total search done : 7/611
[2017-11-28 09:40:06,906] [google-0] DEBUG c.s.s.s.g.s.GoogleScraper - GET https://www.google.com/search?q=#OBF#se … nl&num=150 via proxy:direct try 1
[2017-11-28 09:40:07,837] [google-0] INFO c.s.s.s.g.s.GoogleScraper - GOT status=[200] exception=[none]
[2017-11-28 09:40:10,281] [google-0] INFO c.s.s.t.g.GoogleTaskRunnable - search "#OBF#search-27#" | try 1 | total search done : 8/611
[2017-11-28 09:40:10,282] [google-0] DEBUG c.s.s.s.g.s.GoogleScraper - GET https://www.google.com/search?q=#OBF#se … nl&num=150 via proxy:direct try 1
[2017-11-28 09:40:11,367] [google-0] INFO c.s.s.s.g.s.GoogleScraper - GOT status=[200] exception=[none]
[2017-11-28 09:40:11,402] [google-0] TRACE c.s.s.s.g.s.GoogleScraper - sleeping 5000 milliseconds
[2017-11-28 09:40:16,649] [google-0] INFO c.s.s.t.g.GoogleTaskRunnable - search "#OBF#search-1102#" | try 1 | total search done : 9/611
[2017-11-28 09:40:16,649] [google-0] DEBUG c.s.s.s.g.s.GoogleScraper - GET https://www.google.com/search?q=#OBF#se … nl&num=150 via proxy:direct try 1
[2017-11-28 09:40:16,982] [google-0] INFO c.s.s.s.g.s.GoogleScraper - GOT status=[503] exception=[none]
[2017-11-28 09:40:16,982] [google-0] DEBUG c.s.s.s.g.s.GoogleScraper - GET https://www.google.com/search?q=#OBF#se … nl&num=150 via proxy:direct try 2
[2017-11-28 09:40:17,534] [google-0] INFO c.s.s.s.g.s.GoogleScraper - GOT status=[503] exception=[none]
[2017-11-28 09:40:17,535] [google-0] DEBUG c.s.s.s.g.s.GoogleScraper - GET https://www.google.com/search?q=#OBF#se … nl&num=150 via proxy:direct try 3
[2017-11-28 09:40:18,039] [google-0] INFO c.s.s.s.g.s.GoogleScraper - GOT status=[503] exception=[none]
[2017-11-28 09:40:18,039] [google-0] WARN c.s.s.t.g.GoogleTaskRunnable - scrap failed for #OBF#search-1102# because of ERROR_NETWORK
[2017-11-28 09:40:18,039] [google-0] WARN c.s.s.t.g.GoogleTaskRunnable - no more proxy, stopping the thread
[2017-11-28 09:40:18,039] [google-0] INFO c.s.s.t.g.GoogleTaskRunnable - google thread stopped
[2017-11-28 09:40:18,288] [Thread-55] WARN c.s.s.t.g.GoogleTask - 1 proxies failed during the task
[2017-11-28 09:40:18,289] [Thread-55] WARN c.s.s.t.g.GoogleTask - 602 searches have not been checked
[2017-11-28 09:40:18,290] [Thread-55] INFO c.s.s.t.AbstractTask - task done for module GOOGLE
Offline
I have the same problem
Offline
Having this issue too, I've tried with 10 proxies, following a tutorial with OVH VPS with 5 IP's, with two different captcha service.
I would pay to have this issue resolved.
Offline
Hi, maybe if you update serposcope (v2.8) ?
Offline
you need more proxy or increase pause between fetch to several minutes
Offline
Pages: 1