Commit Graph

87 Commits

Author SHA1 Message Date
Marvin Zhang
e6310a2ae6 allow user to 1-command to run server 2019-06-01 16:55:44 +08:00
Marvin Zhang
54ed076efe updated Jenkinsfile 2019-06-01 15:11:30 +08:00
Marvin Zhang
02c8909a3d updated .env.production 2019-06-01 15:07:46 +08:00
Marvin Zhang
b835064698 fixed localhost issue 2019-05-30 21:30:04 +08:00
Marvin Zhang
a27cef6868 burying points for analytics 2019-05-30 21:14:30 +08:00
Marvin Zhang
6cd8d0585b updated README 2019-05-30 19:18:56 +08:00
Marvin Zhang
4db1fe4c1a added docs file 2019-05-30 19:09:57 +08:00
Marvin Zhang
2a8e33d3c7 download results 2019-05-30 13:07:09 +08:00
Marvin Zhang
c4c1777844 fixed issue https://github.com/tikazyq/crawlab/issues/45 2019-05-30 12:22:17 +08:00
Marvin Zhang
571acd9728 fixed issue https://github.com/tikazyq/crawlab/issues/45 2019-05-30 12:21:01 +08:00
Marvin Zhang
fe329941ca updated README 2019-05-30 10:25:13 +08:00
Marvin Zhang
2dd0a7cebf added baidu tongji for analytics 2019-05-29 22:22:54 +08:00
Marvin Zhang
0b406937c9 added baidu tongji for analytics 2019-05-29 22:06:43 +08:00
Marvin Zhang
19679327d2 fixed bugs 2019-05-29 19:35:04 +08:00
Marvin Zhang
7492c34c4a added extracting list fields functionality 2019-05-29 17:51:44 +08:00
Marvin Zhang
144b3600e3 Merge remote-tracking branch 'origin/develop' into develop 2019-05-29 14:45:30 +08:00
Marvin Zhang
4b08751868 updated env files 2019-05-29 14:44:33 +08:00
Marvin Zhang
f3da64d8b7 code cleanup 2019-05-29 13:10:31 +08:00
Marvin Zhang
d03197042d allow generate URLs by pattern 2019-05-28 14:59:21 +08:00
Marvin Zhang
8d3d7b3869 Merge remote-tracking branch 'origin/develop' into develop
# Conflicts:
#	frontend/src/views/spider/SpiderList.vue
2019-05-26 19:19:43 +08:00
Marvin Zhang
113be056ae updated configurable spider 2019-05-26 19:17:02 +08:00
Marvin Zhang
e30c1c122a updated configurable spider 2019-05-26 19:16:46 +08:00
Marvin Zhang
5daebcb39b updated configurable spider 2019-05-26 17:10:04 +08:00
Marvin Zhang
15f9b7ef05 added configurable spider: add/edit fields, preview results 2019-05-25 20:18:27 +08:00
Marvin Zhang
04789febc8 prepared for configurable spiders 2019-05-24 17:28:25 +08:00
Marvin Zhang
1ec23af3e1 UI adjustment 2019-05-23 17:12:29 +08:00
Marvin Zhang
d3ed3694a6 updated SiteList 2019-05-22 22:39:02 +08:00
Marvin Zhang
c5a3d32579 updated SiteList 2019-05-22 22:33:43 +08:00
Marvin Zhang
841b5d95d9 updated SiteList 2019-05-22 19:24:27 +08:00
Marvin Zhang
366ec7d857 added i18n for tags-view 2019-05-22 13:02:14 +08:00
woshixiaoqianbi
b5dc9ca30d restore router tag 2019-05-21 18:00:03 +08:00
Marvin Zhang
97752ba705 添加robots.txt协议解析 2019-05-21 13:34:07 +08:00
Marvin Zhang
1f015730c1 refactor code 2019-05-21 12:28:33 +08:00
Marvin Zhang
bc4a04bc6c updated version 2019-05-10 21:25:51 +08:00
Marvin Zhang
73e3bc2dec added jd spider 2019-05-10 21:25:17 +08:00
Marvin Zhang
433b945eeb link site to spider 2019-05-10 13:27:13 +08:00
Marvin Zhang
93f9612b9b added site list 2019-05-09 22:28:12 +08:00
Marvin Zhang
e822c65eb2 added site list 2019-05-09 22:15:58 +08:00
Marvin Zhang
0ad0303285 added site list 2019-05-09 22:14:37 +08:00
Marvin Zhang
34871213d5 fixed translation typo 2019-05-09 19:46:49 +08:00
Marvin Zhang
c96dd102d9 updated analytics for spider 2019-04-28 21:25:32 +08:00
Marvin Zhang
21f7864c68 updated analytics for spider 2019-04-28 21:16:31 +08:00
Marvin Zhang
9bd819c384 updated analytics for spider 2019-04-28 19:52:10 +08:00
Marvin Zhang
60d658de5f updated analytics for spider 2019-04-28 19:41:44 +08:00
Marvin Zhang
efc32886ae updated analytics for spider 2019-04-28 19:32:18 +08:00
Marvin Zhang
70d392ef62 updated analytics for spider 2019-04-28 19:24:03 +08:00
Marvin Zhang
a41415a041 added analytics for spider 2019-04-28 13:17:40 +08:00
Marvin Zhang
ae29708d99 request task list every 5 seconds 2019-04-23 20:36:31 +08:00
Marvin Zhang
b7ed4ad442 added stats for spider 2019-04-23 20:25:15 +08:00
Marvin Zhang
db0f58f9b9 request task list every 5 seconds 2019-04-23 19:52:06 +08:00