git-sync/crawlab
1
0
Fork 0
mirror of https://github.com/crawlab-team/crawlab.git synced 2026-01-24 17:41:03 +01:00
Code Issues Packages Projects Releases Wiki Activity
949 Commits 6 Branches 35 Tags
d65e37517e7bc67b8beaf25324f43062591eaa83
Commit Graph

55 Commits

Author SHA1 Message Date
marvzhang
d65e37517e 优化可配置爬虫前端界面 2019-11-28 21:36:17 +08:00
陈景阳
bdeaa587f9 爬虫列表 2019-09-26 20:52:45 +08:00
陈景阳
82999225de fix 无法获取task的错误 2019-09-25 15:11:27 +08:00
Marvin Zhang
5013233481 added param to task 2019-09-04 20:13:28 +08:00
陈景阳
f8e50fc829 Merge branch 'develop' of https://github.com/crawlab-team/crawlab into v0.4.0 2019-08-31 16:54:26 +08:00
yaziming
b3cdb231ac Backend: 
1.[improve]
       使用gin提供的RouteGroup功能简化中间件逻辑
    2.[break change]
       移除Authorization Middleware中对登录注册下载特殊处理逻辑
    3.[unsafe problem]
       下载任务csv增加登录验证
Frontend:
    1. 更改csv下载方式
    2. task list页面table section 移除固定width设置,采用自适应,防止大屏空白断裂问题
 2019-08-31 15:00:38 +08:00
陈景阳
cbd549255e fix 前端报错的问题 2019-08-31 13:50:01 +08:00
Marvin Zhang
eb247f2516 fixed upload bug 2019-07-29 20:30:39 +08:00
Marvin Zhang
92d443f19d optimized user auth 2019-07-27 14:55:03 +08:00
Marvin Zhang
087e8e65aa added user management 2019-07-27 00:56:28 +08:00
Marvin Zhang
607ad029dd added user login/signup 2019-07-26 23:02:30 +08:00
Marvin Zhang
946bb7ceba added spider stats 2019-07-26 17:07:24 +08:00
Marvin Zhang
2dc51c48fc updated file edit 2019-07-24 19:51:29 +08:00
Marvin Zhang
6b3a2a369f added file management 2019-07-24 13:37:03 +08:00
Marvin Zhang
0bd721795b code clean up 2019-07-23 21:09:08 +08:00
Marvin Zhang
c5620bc2d1 added system info 2019-07-23 20:08:29 +08:00
Marvin Zhang
c6bd35bd02 updated frontend to adapt changes of golang version 2019-07-22 12:32:36 +08:00
Marvin Zhang
67c299e5d9 adapt changes to golang api 2019-07-21 16:48:58 +08:00
Marvin Zhang
2b9cd566eb updated auto field extraction 2019-06-04 23:43:47 +08:00
Marvin Zhang
571acd9728 fixed issue https://github.com/tikazyq/crawlab/issues/45 2019-05-30 12:21:01 +08:00
Marvin Zhang
0b406937c9 added baidu tongji for analytics 2019-05-29 22:06:43 +08:00
Marvin Zhang
7492c34c4a added extracting list fields functionality 2019-05-29 17:51:44 +08:00
Marvin Zhang
d03197042d allow generate URLs by pattern 2019-05-28 14:59:21 +08:00
Marvin Zhang
113be056ae updated configurable spider 2019-05-26 19:17:02 +08:00
Marvin Zhang
5daebcb39b updated configurable spider 2019-05-26 17:10:04 +08:00
Marvin Zhang
15f9b7ef05 added configurable spider: add/edit fields, preview results 2019-05-25 20:18:27 +08:00
Marvin Zhang
04789febc8 prepared for configurable spiders 2019-05-24 17:28:25 +08:00
Marvin Zhang
c5a3d32579 updated SiteList 2019-05-22 22:33:43 +08:00
Marvin Zhang
433b945eeb link site to spider 2019-05-10 13:27:13 +08:00
Marvin Zhang
93f9612b9b added site list 2019-05-09 22:28:12 +08:00
Marvin Zhang
e822c65eb2 added site list 2019-05-09 22:15:58 +08:00
Marvin Zhang
0ad0303285 added site list 2019-05-09 22:14:37 +08:00
Marvin Zhang
efc32886ae updated analytics for spider 2019-04-28 19:32:18 +08:00
Marvin Zhang
a41415a041 added analytics for spider 2019-04-28 13:17:40 +08:00
Marvin Zhang
daeaa05d85 added filter for TaskList 2019-04-17 21:50:30 +08:00
Marvin Zhang
747dc470bb updated scheduler 2019-04-17 13:08:06 +08:00
Marvin Zhang
b169f09e12 added lianjia example 2019-04-16 20:19:22 +08:00
Marvin Zhang
63ff2d1894 enforce deploy before running a spider 2019-04-15 19:50:25 +08:00
Marvin Zhang
6712b3a5f1 added environment variables for spider page 2019-04-10 22:16:25 +08:00
Marvin Zhang
7ce74e06d7 updated README.md 
code cleanup
 2019-04-03 19:58:21 +08:00
cxa
df43a7fc96 fix bug 2019-04-03 16:32:35 +08:00
Marvin Zhang
d6cd8ff8f7 added Multi Language support 2019-03-23 23:48:08 +08:00
Marvin Zhang
e526b4215b changed the way how task is saved to database 2019-03-16 21:29:30 +08:00
Marvin Zhang
53a80046d1 changed the way how task is saved to database 2019-03-13 21:33:47 +08:00
Marvin Zhang
ff631e1095 updated README 2019-03-13 19:27:14 +08:00
Marvin Zhang
1ec3074012 added pagination for tasks results 2019-03-12 21:20:22 +08:00
Marvin Zhang
489768d097 added pagination for tasks 2019-03-12 21:00:35 +08:00
Marvin Zhang
ce5e5d8f1d fixed inconsistency of timestamp issue 2019-03-12 20:28:50 +08:00
Marvin Zhang
0df8d84105 added stop task 2019-03-09 16:18:39 +08:00
Marvin Zhang
647fac1efe added cron tasks for spiders 2019-03-09 14:05:14 +08:00