62 Commits

Author	SHA1	Message	Date
marvzhang	82c7cd63b7	优化 https://github.com/crawlab-team/crawlab/issues/185	2019-12-04 16:33:02 +08:00
marvzhang	589190d674	加入Spiderfile模版	2019-12-03 13:37:41 +08:00
marvzhang	af680d576a	更新可配置爬虫	2019-12-02 22:35:45 +08:00
marvzhang	8eafbf480c	完成可配置爬虫设置部分	2019-12-02 13:29:00 +08:00
marvzhang	9b0b7b3b01	修复bug	2019-11-29 13:00:33 +08:00
marvzhang	638a52dc2f	添加可配置爬虫翻译	2019-11-28 22:38:49 +08:00
marvzhang	7dcc35b8c2	加入添加可配置爬虫	2019-11-28 22:19:49 +08:00
marvzhang	ba4f5fd20c	优化可配置爬虫前端界面	2019-11-28 21:36:17 +08:00
陈景阳	277e52ea61	爬虫列表	2019-09-26 20:52:45 +08:00
陈景阳	613b5eb139	fix 无法获取task的错误	2019-09-25 15:11:27 +08:00
Marvin Zhang	eb1a80ec2d	added param to task	2019-09-04 20:13:28 +08:00
陈景阳	18d66d8ad3	Merge branch 'develop' of https://github.com/crawlab-team/crawlab into v0.4.0	2019-08-31 16:54:26 +08:00
yaziming	d8acab7753	Backend: ... 1.[improve] 使用gin提供的RouteGroup功能简化中间件逻辑 2.[break change] 移除Authorization Middleware中对登录注册下载特殊处理逻辑 3.[unsafe problem] 下载任务csv增加登录验证 Frontend: 1. 更改csv下载方式 2. task list页面table section 移除固定width设置,采用自适应,防止大屏空白断裂问题	2019-08-31 15:00:38 +08:00
陈景阳	f750fe5f8a	fix 前端报错的问题	2019-08-31 13:50:01 +08:00
Marvin Zhang	fc0c8209f7	fixed upload bug	2019-07-29 20:30:39 +08:00
Marvin Zhang	66a33e83ac	optimized user auth	2019-07-27 14:55:03 +08:00
Marvin Zhang	a5fa5702e5	added user management	2019-07-27 00:56:28 +08:00
Marvin Zhang	be9339ff3f	added user login/signup	2019-07-26 23:02:30 +08:00
Marvin Zhang	253c643e8e	added spider stats	2019-07-26 17:07:24 +08:00
Marvin Zhang	4b532fe9d5	updated file edit	2019-07-24 19:51:29 +08:00
Marvin Zhang	b01d265060	added file management	2019-07-24 13:37:03 +08:00
Marvin Zhang	f6ba3b04c8	code clean up	2019-07-23 21:09:08 +08:00
Marvin Zhang	350dfae858	added system info	2019-07-23 20:08:29 +08:00
Marvin Zhang	520e8fded8	updated frontend to adapt changes of golang version	2019-07-22 12:32:36 +08:00
Marvin Zhang	ece3659155	adapt changes to golang api	2019-07-21 16:48:58 +08:00
Marvin Zhang	f39c20bbd2	updated auto field extraction	2019-06-04 23:43:47 +08:00
Marvin Zhang	4752efe11d	fixed issue https://github.com/tikazyq/crawlab/issues/45	2019-05-30 12:21:01 +08:00
Marvin Zhang	eb43e1f273	added baidu tongji for analytics	2019-05-29 22:06:43 +08:00
Marvin Zhang	925f643cd8	added extracting list fields functionality	2019-05-29 17:51:44 +08:00
Marvin Zhang	f710d327b1	allow generate URLs by pattern	2019-05-28 14:59:21 +08:00
Marvin Zhang	dfcaf22f55	updated configurable spider	2019-05-26 19:17:02 +08:00
Marvin Zhang	d3f776802e	updated configurable spider	2019-05-26 17:10:04 +08:00
Marvin Zhang	96a9c22077	added configurable spider: add/edit fields, preview results	2019-05-25 20:18:27 +08:00
Marvin Zhang	5477099f15	prepared for configurable spiders	2019-05-24 17:28:25 +08:00
Marvin Zhang	f63b58906e	updated SiteList	2019-05-22 22:33:43 +08:00
Marvin Zhang	133f1197fd	link site to spider	2019-05-10 13:27:13 +08:00
Marvin Zhang	6a12dfe7b7	added site list	2019-05-09 22:28:12 +08:00
Marvin Zhang	42e4ba9093	added site list	2019-05-09 22:15:58 +08:00
Marvin Zhang	4bd93db193	added site list	2019-05-09 22:14:37 +08:00
Marvin Zhang	cac76245ad	updated analytics for spider	2019-04-28 19:32:18 +08:00
Marvin Zhang	a9f59dc110	added analytics for spider	2019-04-28 13:17:40 +08:00
Marvin Zhang	aa6f414e42	added filter for TaskList	2019-04-17 21:50:30 +08:00
Marvin Zhang	686a900917	updated scheduler	2019-04-17 13:08:06 +08:00
Marvin Zhang	ffaccd67fd	added lianjia example	2019-04-16 20:19:22 +08:00
Marvin Zhang	d48fee0d03	enforce deploy before running a spider	2019-04-15 19:50:25 +08:00
Marvin Zhang	f004c1a70a	added environment variables for spider page	2019-04-10 22:16:25 +08:00
Marvin Zhang	563ecea96f	updated README.md ... code cleanup	2019-04-03 19:58:21 +08:00
cxa	61f7ff6a89	fix bug	2019-04-03 16:32:35 +08:00
Marvin Zhang	9a7ade8e6e	added Multi Language support	2019-03-23 23:48:08 +08:00
Marvin Zhang	b27a36befc	changed the way how task is saved to database	2019-03-16 21:29:30 +08:00