SERP Hacker support forum - serposcope

Support forum for open-source softwares built by serphacker.com : serposcope the rank checker.

You are not logged in.

Pages: 1

#1 2016-01-27 14:20:50

Kap
Member
Registered: 2016-01-27
Posts: 6

Stopper le check des positions.

Bonjour,

Petit problème lorsqu'on souhaite stopper une tâche. En l’occurrence, le check des positions. En cliquant sur "Abort", l'annulation se lance mais ne bouge pas.

_ OS : windows
_ serposcope version : 2.1.0
_ java version : Version 8 Update 71

Offline

#2 2016-01-28 12:12:15

serphacker
Administrator
Registered: 2014-06-13
Posts: 435

Re: Stopper le check des positions.

ça peut prendre du temps lorsque un service de captcha est en cours, mais jamais + de 5 minutes normalement (cas critique), qu'affiche les logs ?

Offline

#3 2016-01-28 13:22:40

Kap
Member
Registered: 2016-01-27
Posts: 6

Re: Stopper le check des positions.

Bonjour,

Cela fait plus d'une journée.

Aujourd'hui :

[2016-01-28 09:10:58,400] [Hikari housekeeper (pool HikariPool-0)] WARN  c.z.h.p.HikariPool - HikariPool-0 - Unusual system clock change detected, soft-evicting connections from pool.
[2016-01-28 11:48:16,724] [pool-1-thread-1] INFO  s.s.Scheduler - last version 2.0.0 | current version 2.1.0

Offline

#4 2016-01-28 13:23:28

serphacker
Administrator
Registered: 2014-06-13
Posts: 435

Re: Stopper le check des positions.

et les dernières lignes du logs d'hier ?

Offline

#5 2016-01-29 08:57:52

Kap
Member
Registered: 2016-01-27
Posts: 6

Re: Stopper le check des positions.

[2016-01-27 09:34:20,030] [Hikari housekeeper (pool HikariPool-0)] WARN  c.z.h.p.HikariPool - HikariPool-0 - Unusual system clock change detected, soft-evicting connections from pool.
[2016-01-27 09:39:06,203] [Thread-88] INFO  c.s.s.t.AbstractTask - task started for module GOOGLE of day 2016-01-27
[2016-01-27 09:39:06,228] [Thread-88] INFO  c.s.s.t.g.GoogleTask - captcha service : deathbycaptcha
[2016-01-27 09:39:06,994] [Thread-88] DEBUG c.s.s.t.g.GoogleTask - capcha service deathbycaptcha : remaining credit 688.5102
[2016-01-27 09:39:07,305] [google-0] INFO  c.s.s.t.g.GoogleTaskRunnable - google thread started
[2016-01-27 09:39:07,306] [google-0] INFO  c.s.s.t.g.GoogleTaskRunnable - search "Louane caen 2016" | try 1 | total search done : 0/96
[2016-01-27 09:39:07,307] [google-0] DEBUG c.s.s.s.g.s.GoogleScraper - GET https://www.google.fr/search?q=Louane+caen+2016&num=15 via proxy:http://195.154.231.43:3128/ try 1
[2016-01-27 09:39:07,317] [google-1] INFO  c.s.s.t.g.GoogleTaskRunnable - google thread started
[2016-01-27 09:39:07,331] [google-1] INFO  c.s.s.t.g.GoogleTaskRunnable - search "billets Louane caen" | try 1 | total search done : 0/96
[2016-01-27 09:39:07,331] [google-1] DEBUG c.s.s.s.g.s.GoogleScraper - GET https://www.google.fr/search?q=billets+ … aen&num=15 via proxy:http://178.32.87.230:3128/ try 1
[2016-01-27 09:39:07,341] [google-2] INFO  c.s.s.t.g.GoogleTaskRunnable - google thread started
[2016-01-27 09:39:07,341] [google-2] INFO  c.s.s.t.g.GoogleTaskRunnable - search "tickets Louane Pau" | try 1 | total search done : 0/96
[2016-01-27 09:39:07,342] [google-2] DEBUG c.s.s.s.g.s.GoogleScraper - GET https://www.google.fr/search?q=tickets+ … Pau&num=15 via proxy:http://178.33.191.53:3128/ try 1
[2016-01-27 09:39:08,372] [google-1] TRACE c.s.s.s.g.s.GoogleScraper - sleeping 11308 milliseconds
[2016-01-27 09:39:11,393] [google-2] TRACE c.s.s.s.g.s.GoogleScraper - sleeping 6342 milliseconds
[2016-01-27 09:39:17,735] [google-2] DEBUG c.s.s.s.g.s.GoogleScraper - GET https://www.google.fr/search?q=tickets+ … 5&start=15 via proxy:http://178.33.191.53:3128/ try 1
[2016-01-27 09:39:19,682] [google-1] DEBUG c.s.s.s.g.s.GoogleScraper - GET https://www.google.fr/search?q=billets+ … 5&start=15 via proxy:http://178.32.87.230:3128/ try 1
[2016-01-27 09:39:20,831] [google-1] DEBUG c.s.s.s.g.s.GoogleScraper - GET https://www.google.fr/search?q=billets+ … 5&start=15 via proxy:http://178.32.87.230:3128/ try 2
[2016-01-27 09:39:21,991] [google-1] DEBUG c.s.s.s.g.s.GoogleScraper - GET https://www.google.fr/search?q=billets+ … 5&start=15 via proxy:http://178.32.87.230:3128/ try 3
[2016-01-27 09:39:23,969] [google-1] TRACE c.s.s.s.g.s.GoogleScraper - sleeping 5731 milliseconds
[2016-01-27 09:39:29,701] [google-1] DEBUG c.s.s.s.g.s.GoogleScraper - GET https://www.google.fr/search?q=billets+ … 5&start=30 via proxy:http://178.32.87.230:3128/ try 1
[2016-01-27 09:39:31,194] [google-1] TRACE c.s.s.s.g.s.GoogleScraper - sleeping 6981 milliseconds
[2016-01-27 09:39:38,177] [google-1] DEBUG c.s.s.s.g.s.GoogleScraper - GET https://www.google.fr/search?q=billets+ … 5&start=45 via proxy:http://178.32.87.230:3128/ try 1
[2016-01-27 09:39:38,740] [google-2] DEBUG c.s.s.s.g.s.GoogleScraper - GET https://www.google.fr/search?q=tickets+ … 5&start=15 via proxy:http://178.33.191.53:3128/ try 2
[2016-01-27 09:39:39,094] [google-1] TRACE c.s.s.s.g.s.GoogleScraper - sleeping 13921 milliseconds
[2016-01-27 09:39:53,015] [google-1] DEBUG c.s.s.s.g.s.GoogleScraper - GET https://www.google.fr/search?q=billets+ … 5&start=60 via proxy:http://178.32.87.230:3128/ try 1
[2016-01-27 09:39:53,746] [google-1] TRACE c.s.s.s.g.s.GoogleScraper - sleeping 6737 milliseconds
[2016-01-27 09:39:59,762] [google-2] DEBUG c.s.s.s.g.s.GoogleScraper - GET https://www.google.fr/search?q=tickets+ … 5&start=15 via proxy:http://178.33.191.53:3128/ try 3
[2016-01-27 09:40:00,484] [google-1] DEBUG c.s.s.s.g.s.GoogleScraper - GET https://www.google.fr/search?q=billets+ … 5&start=75 via proxy:http://178.32.87.230:3128/ try 1
[2016-01-27 09:40:01,630] [google-1] DEBUG c.s.s.s.g.s.GoogleScraper - GET https://www.google.fr/search?q=billets+ … 5&start=75 via proxy:http://178.32.87.230:3128/ try 2
[2016-01-27 09:40:02,750] [google-1] DEBUG c.s.s.s.g.s.GoogleScraper - GET https://www.google.fr/search?q=billets+ … 5&start=75 via proxy:http://178.32.87.230:3128/ try 3
[2016-01-27 09:40:04,041] [google-1] TRACE c.s.s.s.g.s.GoogleScraper - sleeping 9631 milliseconds
[2016-01-27 09:40:06,254] [google-2] TRACE c.s.s.s.g.s.GoogleScraper - sleeping 9706 milliseconds
[2016-01-27 09:40:13,673] [google-1] DEBUG c.s.s.s.g.s.GoogleScraper - GET https://www.google.fr/search?q=billets+ … 5&start=90 via proxy:http://178.32.87.230:3128/ try 1
[2016-01-27 09:40:15,675] [google-1] INFO  c.s.s.t.g.GoogleTaskRunnable - search "billets ac/dc Marseille" | try 1 | total search done : 1/96
[2016-01-27 09:40:15,676] [google-1] DEBUG c.s.s.s.g.s.GoogleScraper - GET https://www.google.fr/search?q=billets+ … lle&num=15 via proxy:http://178.32.87.230:3128/ try 1
[2016-01-27 09:40:15,962] [google-2] DEBUG c.s.s.s.g.s.GoogleScraper - GET https://www.google.fr/search?q=tickets+ … 5&start=30 via proxy:http://178.33.191.53:3128/ try 1
[2016-01-27 09:40:16,990] [google-1] DEBUG c.s.s.s.g.s.GoogleScraper - GET https://www.google.fr/search?q=billets+ … lle&num=15 via proxy:http://178.32.87.230:3128/ try 2
[2016-01-27 09:40:18,200] [google-1] DEBUG c.s.s.s.g.s.GoogleScraper - GET https://www.google.fr/search?q=billets+ … lle&num=15 via proxy:http://178.32.87.230:3128/ try 3
[2016-01-27 09:40:19,339] [google-1] WARN  c.s.s.t.g.GoogleTaskRunnable - scrap failed for billets ac/dc Marseille because of ERROR_NETWORK
[2016-01-27 09:40:19,339] [google-1] WARN  c.s.s.t.g.GoogleTaskRunnable - no more proxy, stopping the thread
[2016-01-27 09:40:19,340] [google-1] INFO  c.s.s.t.g.GoogleTaskRunnable - google thread stopped
[2016-01-27 09:40:21,323] [google-2] TRACE c.s.s.s.g.s.GoogleScraper - sleeping 11798 milliseconds
[2016-01-27 09:40:33,121] [google-2] DEBUG c.s.s.s.g.s.GoogleScraper - GET https://www.google.fr/search?q=tickets+ … 5&start=45 via proxy:http://178.33.191.53:3128/ try 1
[2016-01-27 09:40:54,137] [google-2] DEBUG c.s.s.s.g.s.GoogleScraper - GET https://www.google.fr/search?q=tickets+ … 5&start=45 via proxy:http://178.33.191.53:3128/ try 2
[2016-01-27 09:41:15,142] [google-2] DEBUG c.s.s.s.g.s.GoogleScraper - GET https://www.google.fr/search?q=tickets+ … 5&start=45 via proxy:http://178.33.191.53:3128/ try 3
[2016-01-27 09:41:36,164] [google-2] WARN  c.s.s.t.g.GoogleTaskRunnable - scrap failed for tickets Louane Pau because of ERROR_NETWORK
[2016-01-27 09:41:36,165] [google-2] WARN  c.s.s.t.g.GoogleTaskRunnable - no more proxy, stopping the thread
[2016-01-27 09:41:36,165] [google-2] INFO  c.s.s.t.g.GoogleTaskRunnable - google thread stopped
[2016-01-27 09:43:06,873] [google-0] DEBUG c.s.s.s.g.s.GoogleScraper - GET https://www.google.fr/search?q=Louane+caen+2016&num=15 via proxy:http://195.154.231.43:3128/ try 2
[2016-01-27 09:47:06,885] [google-0] DEBUG c.s.s.s.g.s.GoogleScraper - GET https://www.google.fr/search?q=Louane+caen+2016&num=15 via proxy:http://195.154.231.43:3128/ try 3
[2016-01-27 09:51:06,899] [google-0] WARN  c.s.s.t.g.GoogleTaskRunnable - scrap failed for Louane caen 2016 because of ERROR_NETWORK
[2016-01-27 09:51:06,900] [google-0] WARN  c.s.s.t.g.GoogleTaskRunnable - no more proxy, stopping the thread
[2016-01-27 09:51:06,900] [google-0] INFO  c.s.s.t.g.GoogleTaskRunnable - google thread stopped
[2016-01-27 09:51:06,909] [Thread-88] WARN  c.s.s.t.g.GoogleTask - 3 proxies failed during the task
[2016-01-27 09:51:06,909] [Thread-88] WARN  c.s.s.t.g.GoogleTask - 95 searches have not been checked
[2016-01-27 09:51:06,912] [Thread-88] INFO  c.s.s.t.AbstractTask - task done for module GOOGLE
[2016-01-27 09:52:22,976] [Thread-94] INFO  c.s.s.t.AbstractTask - task started for module GOOGLE of day 2016-01-27
[2016-01-27 09:52:22,992] [Thread-94] INFO  c.s.s.t.g.GoogleTask - captcha service : deathbycaptcha
[2016-01-27 09:52:23,554] [Thread-94] DEBUG c.s.s.t.g.GoogleTask - capcha service deathbycaptcha : remaining credit 688.5102
[2016-01-27 09:52:23,851] [google-0] INFO  c.s.s.t.g.GoogleTaskRunnable - google thread started
[2016-01-27 09:52:23,852] [google-0] INFO  c.s.s.t.g.GoogleTaskRunnable - search "spectacle Cline Dion Paris 2016" | try 1 | total search done : 0/96
[2016-01-27 09:52:23,852] [google-0] DEBUG c.s.s.s.g.s.GoogleScraper - GET https://www.google.fr/search?q=spectacl … 016&num=15 via proxy:http://195.154.231.43:3128/ try 1
[2016-01-27 09:52:23,859] [google-1] INFO  c.s.s.t.g.GoogleTaskRunnable - google thread started
[2016-01-27 09:52:23,862] [google-1] INFO  c.s.s.t.g.GoogleTaskRunnable - search "billets Louane Bordeaux" | try 1 | total search done : 0/96
[2016-01-27 09:52:23,862] [google-1] DEBUG c.s.s.s.g.s.GoogleScraper - GET https://www.google.fr/search?q=billets+ … aux&num=15 via proxy:http://178.32.87.230:3128/ try 1
[2016-01-27 09:52:23,868] [google-2] INFO  c.s.s.t.g.GoogleTaskRunnable - google thread started
[2016-01-27 09:52:23,868] [google-2] INFO  c.s.s.t.g.GoogleTaskRunnable - search "Louane angers 2016" | try 1 | total search done : 0/96
[2016-01-27 09:52:23,869] [google-2] DEBUG c.s.s.s.g.s.GoogleScraper - GET https://www.google.fr/search?q=Louane+a … 016&num=15 via proxy:http://178.33.191.53:3128/ try 1
[2016-01-27 09:52:24,988] [google-1] DEBUG c.s.s.s.g.s.GoogleScraper - GET https://www.google.fr/search?q=billets+ … aux&num=15 via proxy:http://178.32.87.230:3128/ try 2
[2016-01-27 09:52:26,150] [google-1] DEBUG c.s.s.s.g.s.GoogleScraper - GET https://www.google.fr/search?q=billets+ … aux&num=15 via proxy:http://178.32.87.230:3128/ try 3
[2016-01-27 09:52:27,072] [google-2] TRACE c.s.s.s.g.s.GoogleScraper - sleeping 11031 milliseconds
[2016-01-27 09:52:27,308] [google-1] WARN  c.s.s.t.g.GoogleTaskRunnable - scrap failed for billets Louane Bordeaux because of ERROR_NETWORK
[2016-01-27 09:52:27,308] [google-1] WARN  c.s.s.t.g.GoogleTaskRunnable - no more proxy, stopping the thread
[2016-01-27 09:52:27,309] [google-1] INFO  c.s.s.t.g.GoogleTaskRunnable - google thread stopped
[2016-01-27 09:52:38,104] [google-2] DEBUG c.s.s.s.g.s.GoogleScraper - GET https://www.google.fr/search?q=Louane+a … 5&start=15 via proxy:http://178.33.191.53:3128/ try 1
[2016-01-27 09:52:44,792] [google-2] TRACE c.s.s.s.g.s.GoogleScraper - sleeping 11307 milliseconds
[2016-01-27 09:52:56,099] [google-2] DEBUG c.s.s.s.g.s.GoogleScraper - GET https://www.google.fr/search?q=Louane+a … 5&start=30 via proxy:http://178.33.191.53:3128/ try 1
[2016-01-27 09:53:17,117] [google-2] DEBUG c.s.s.s.g.s.GoogleScraper - GET https://www.google.fr/search?q=Louane+a … 5&start=30 via proxy:http://178.33.191.53:3128/ try 2
[2016-01-27 09:53:38,123] [google-2] DEBUG c.s.s.s.g.s.GoogleScraper - GET https://www.google.fr/search?q=Louane+a … 5&start=30 via proxy:http://178.33.191.53:3128/ try 3
[2016-01-27 09:53:59,132] [google-2] WARN  c.s.s.t.g.GoogleTaskRunnable - scrap failed for Louane angers 2016 because of ERROR_NETWORK
[2016-01-27 09:53:59,133] [google-2] WARN  c.s.s.t.g.GoogleTaskRunnable - no more proxy, stopping the thread
[2016-01-27 09:53:59,133] [google-2] INFO  c.s.s.t.g.GoogleTaskRunnable - google thread stopped
[2016-01-27 09:56:23,923] [google-0] DEBUG c.s.s.s.g.s.GoogleScraper - GET https://www.google.fr/search?q=spectacl … 016&num=15 via proxy:http://195.154.231.43:3128/ try 2
[2016-01-27 10:00:24,074] [google-0] DEBUG c.s.s.s.g.s.GoogleScraper - GET https://www.google.fr/search?q=spectacl … 016&num=15 via proxy:http://195.154.231.43:3128/ try 3
[2016-01-27 11:11:09,413] [pool-1-thread-1] INFO  s.s.Scheduler - last version 2.0.0 | current version 2.1.0
[2016-01-27 11:20:21,682] [Thread-110] INFO  c.s.s.t.p.ProxyChecker - starting proxy checking task, threads = 50, timeout in MS = 20000
[2016-01-27 11:20:21,823] [pool-10-thread-2] INFO  c.s.s.t.p.ProxyChecker - checking proxy:http://178.32.87.230:3128/
[2016-01-27 11:20:21,824] [pool-10-thread-1] INFO  c.s.s.t.p.ProxyChecker - checking proxy:http://195.154.231.43:3128/
[2016-01-27 11:20:21,829] [pool-10-thread-3] INFO  c.s.s.t.p.ProxyChecker - checking proxy:http://178.33.191.53:3128/
[2016-01-27 11:20:25,745] [Thread-110] INFO  c.s.s.t.p.ProxyChecker - proxy checking finished in 00:00:04.062
[2016-01-27 17:11:09,886] [pool-1-thread-1] INFO  s.s.Scheduler - last version 2.0.0 | current version 2.1.0

Offline

#6 2016-01-29 09:07:09

serphacker
Administrator
Registered: 2014-06-13
Posts: 435

Re: Stopper le check des positions.

C'est un bug critique, je vais m'occuper de ça rapidement, le problème c'est que je n'arrive pas à identifier l'origine juste à partir des logs et il va falloir que je parvienne à reproduire le bug.

Dans tous les cas tu peux redémarrer serposcope ça stopera ton run.

Aussi, tes proxies ne sont pas bons, peut etre qu'ils passent le "proxy check", mais google n'en veut pas, ils sont blacklistés. Surtout que pour une centaine de mot-clé, pas besoin de proxy, l'ip direct suffit, surtout que tu as deathbycaptcha configuré.

Offline

#7 2016-01-29 10:58:06

Kap
Member
Registered: 2016-01-27
Posts: 6

Re: Stopper le check des positions.

Redémarrer ? Ou lancer un check ?

Le 2nd ne marche pas.

Offline

#8 2016-01-29 13:33:39

Kap
Member
Registered: 2016-01-27
Posts: 6

Re: Stopper le check des positions.

OKay good smile

Offline

#9 2016-01-29 14:50:43

strem
Member
Registered: 2016-01-26
Posts: 19

Re: Stopper le check des positions.

Je continue sur ce sujet :
J'ai lancé un check manuel, il a tourné toute la nuit, s'est arrêté à 98%.
J'ai redemarré le service, mais j'ai perdu toutes mes données ! Alors qu'il m'en affichait avant le redémarrage...

Je précise que j'ai installé la nouvelle version hier, donc je n'ai perdu qu'un jour.
Je ne sais pas s'il a TOUT effacé, ou seulement les données "temporaires". Mais je trouve étrange qu'une annulation supprime les données.
On devrait pouvoir avoir l'option de les conserver, non ?

[2016-01-29 04:17:40,496] [pool-1-thread-1] INFO  s.s.Scheduler - last version 2.0.0 | current version 2.1.0
[2016-01-29 10:17:40,540] [pool-1-thread-1] INFO  s.s.Scheduler - last version 2.0.0 | current version 2.1.0
... redémarrage...
[2016-01-29 15:40:02,778] [NinjaJetty] INFO  c.SerposcopeConf - serposcope.version          : 2.1.0
[2016-01-29 15:40:02,778] [NinjaJetty] INFO  c.SerposcopeConf - serposcope.datadir          : /var/lib/serposcope
[2016-01-29 15:40:02,778] [NinjaJetty] INFO  c.SerposcopeConf - serposcope.logdir           : /home/mireage/logs/serposcope2/
...
...
...

et la fin des logs d'hier :

[2016-01-28 20:35:36,989] [google-2] DEBUG c.s.s.s.g.s.GoogleScraper - GET https://www.google.fr/search?q=mon+keyword&start=10 via proxy:http://118.193.10.141:3128/ try 1
[2016-01-28 20:36:26,296] [google-2] TRACE c.s.s.s.g.s.GoogleScraper - sleeping 10701 milliseconds
[2016-01-28 20:36:36,997] [google-2] DEBUG c.s.s.s.g.s.GoogleScraper - GET https://www.google.fr/search?q=mon+keyword&start=20 via proxy:http://118.193.10.141:3128/ try 1
[2016-01-28 20:37:07,027] [google-2] DEBUG c.s.s.s.g.s.GoogleScraper - GET https://www.google.fr/search?q=mon+keyword&start=20 via proxy:http://118.193.10.141:3128/ try 2
[2016-01-28 20:38:04,578] [google-2] TRACE c.s.s.s.g.s.GoogleScraper - sleeping 12788 milliseconds
[2016-01-28 20:45:37,856] [google-1] TRACE c.s.s.s.g.s.GoogleScraper - sleeping 15819 milliseconds
[2016-01-28 20:45:53,675] [google-1] DEBUG c.s.s.s.g.s.GoogleScraper - GET https://www.google.fr/search?q=mon+autre+keyword&start=10 via proxy:http://116.90.208.131:8080/ try 1
[2016-01-28 20:46:41,884] [google-1] TRACE c.s.s.s.g.s.GoogleScraper - sleeping 19899 milliseconds
[2016-01-28 20:47:01,784] [google-1] DEBUG c.s.s.s.g.s.GoogleScraper - GET https://www.google.fr/search?q=mon+autre+keyword&start=20 via proxy:http://116.90.208.131:8080/ try 1
[2016-01-28 20:47:13,817] [google-1] TRACE c.s.s.s.g.s.GoogleScraper - sleeping 15968 milliseconds
[2016-01-28 22:17:40,458] [pool-1-thread-1] INFO  s.s.Scheduler - last version 2.0.0 | current version 2.1.0

Offline

Pages: 1

Board footer