Commit Graph

62 Commits

Author SHA1 Message Date
Marvin Zhang
520e8fded8 updated frontend to adapt changes of golang version 2019-07-22 12:32:36 +08:00
Marvin Zhang
ece3659155 adapt changes to golang api 2019-07-21 16:48:58 +08:00
Marvin Zhang
64f0c763e0 updated Jenkinsfile 2019-06-21 22:33:53 +08:00
Marvin Zhang
5f06c493ac updated crontab 2019-06-17 13:18:51 +08:00
Marvin Zhang
0077976f3c updated crontab 2019-06-17 13:14:51 +08:00
Marvin Zhang
c30be9fa2e updated crontab 2019-06-17 13:06:47 +08:00
Marvin Zhang
f01180b893 updated crontab 2019-06-17 13:04:29 +08:00
Marvin Zhang
4795babf8c updated crontab 2019-06-17 13:04:17 +08:00
Marvin Zhang
829c9557e8 updated crontab 2019-06-17 13:01:20 +08:00
Marvin Zhang
2abd8df9d7 added virtual scroll list for log view 2019-06-09 19:06:37 +08:00
Marvin Zhang
0363d5636e added upload functionality 2019-06-04 21:15:54 +08:00
Marvin Zhang
dd08a8b0dc added upload functionality 2019-06-04 20:45:56 +08:00
Marvin Zhang
44a941c72a fixed send user stats issue 2019-06-04 20:26:33 +08:00
Marvin Zhang
a3a5916d8f added pagination for SpiderList 2019-06-04 13:40:37 +08:00
Marvin Zhang
5dc38372e7 updated auto field extraction 2019-06-04 07:55:51 +08:00
Marvin Zhang
392b2cc0b1 burying points for analytics 2019-05-30 21:14:30 +08:00
Marvin Zhang
6fc2cb3730 download results 2019-05-30 13:07:09 +08:00
Marvin Zhang
42daea50dd fixed issue https://github.com/tikazyq/crawlab/issues/45 2019-05-30 12:22:17 +08:00
Marvin Zhang
4752efe11d fixed issue https://github.com/tikazyq/crawlab/issues/45 2019-05-30 12:21:01 +08:00
Marvin Zhang
eb43e1f273 added baidu tongji for analytics 2019-05-29 22:06:43 +08:00
Marvin Zhang
68a2a9fa4e Merge remote-tracking branch 'origin/develop' into develop
# Conflicts:
#	frontend/src/views/spider/SpiderList.vue
2019-05-26 19:19:43 +08:00
Marvin Zhang
d3f776802e updated configurable spider 2019-05-26 17:10:04 +08:00
Marvin Zhang
5477099f15 prepared for configurable spiders 2019-05-24 17:28:25 +08:00
Marvin Zhang
2fce5efab8 UI adjustment 2019-05-23 17:12:29 +08:00
Marvin Zhang
3c1d3a65ea updated SiteList 2019-05-22 22:39:02 +08:00
Marvin Zhang
f63b58906e updated SiteList 2019-05-22 22:33:43 +08:00
Marvin Zhang
c69c8e5f64 updated SiteList 2019-05-22 19:24:27 +08:00
Marvin Zhang
f96339cdcb added i18n for tags-view 2019-05-22 13:02:14 +08:00
woshixiaoqianbi
2eb91123b0 restore router tag 2019-05-21 18:00:03 +08:00
Marvin Zhang
d7f8ee13de 添加robots.txt协议解析 2019-05-21 13:34:07 +08:00
Marvin Zhang
b7b89cf72d added jd spider 2019-05-10 21:25:17 +08:00
Marvin Zhang
133f1197fd link site to spider 2019-05-10 13:27:13 +08:00
Marvin Zhang
6a12dfe7b7 added site list 2019-05-09 22:28:12 +08:00
Marvin Zhang
4bd93db193 added site list 2019-05-09 22:14:37 +08:00
Marvin Zhang
a9f59dc110 added analytics for spider 2019-04-28 13:17:40 +08:00
Marvin Zhang
677d6e36a9 added stats for spider 2019-04-23 20:25:15 +08:00
Marvin Zhang
c342d81fe1 request task list every 5 seconds 2019-04-23 19:52:06 +08:00
Marvin Zhang
22fd9ba848 added filter for TaskList 2019-04-22 21:26:58 +08:00
Marvin Zhang
3407e4e8df added params for spider schedules 2019-04-20 20:04:09 +08:00
Marvin Zhang
aa6f414e42 added filter for TaskList 2019-04-17 21:50:30 +08:00
Marvin Zhang
c48bb96b2f updated ScheduleList 2019-04-17 13:25:14 +08:00
Marvin Zhang
a46b8e2270 updated ScheduleList 2019-04-17 13:23:28 +08:00
Marvin Zhang
aa9dcef9b6 added schedule functionality 2019-04-17 12:53:19 +08:00
Marvin Zhang
ffaccd67fd added lianjia example 2019-04-16 20:19:22 +08:00
Marvin Zhang
d48fee0d03 enforce deploy before running a spider 2019-04-15 19:50:25 +08:00
Marvin Zhang
f004c1a70a added environment variables for spider page 2019-04-10 22:16:25 +08:00
Marvin Zhang
563ecea96f updated README.md
code cleanup
2019-04-03 19:58:21 +08:00
cxa
61f7ff6a89 fix bug 2019-04-03 16:32:35 +08:00
Marvin Zhang
d44e5d2518 updated Multi Language for a few pages 2019-03-27 12:35:22 +08:00
Marvin Zhang
3af510a417 updated Multi Language for a few pages 2019-03-26 19:33:03 +08:00