207 Commits

Author	SHA1	Message	Date
marvzhang	0d8ce3a29f	准备可配置爬虫后端数据	2019-11-26 13:38:54 +08:00
marvzhang	b676a84e49	加入xpath	2019-11-26 13:02:49 +08:00
marvzhang	bfce15d54e	加入Spiderfile限制条件	2019-11-26 12:44:24 +08:00
marvzhang	a87950e369	加入环境变量	2019-11-25 22:07:20 +08:00
marvzhang	dccfb23901	加入储存逻辑	2019-11-25 17:52:19 +08:00
marvzhang	1c32c92c54	refactor code	2019-11-25 16:45:55 +08:00
marvzhang	3f12302cf9	更新可配置爬虫：添加上传GridFS	2019-11-25 13:36:14 +08:00
marvzhang	5a286f98af	更新可配置爬虫，修复一些问题	2019-11-24 19:45:21 +08:00
marvzhang	8b451c8b2b	更新可配置爬虫，修复一些问题	2019-11-24 18:51:32 +08:00
marvzhang	9c282ddb4d	加入可配置爬虫	2019-11-24 17:57:12 +08:00
marvzhang	6d9c2ce653	Merge remote-tracking branch 'origin/develop' into develop	2019-11-24 12:25:46 +08:00
marvzhang	7003951561	fixed https://github.com/crawlab-team/crawlab/issues/315	2019-11-24 12:20:44 +08:00
Marvin Zhang	f1c951d575	Merge pull request #313 from hantmac/develop ... bug fix	2019-11-24 11:34:50 +08:00
marvzhang	7b86d35a0f	code cleanup	2019-11-23 18:16:24 +08:00
marvzhang	607ce70f5c	准备可配置爬虫	2019-11-23 18:13:47 +08:00
marvzhang	010968a7ce	Merge remote-tracking branch 'origin/develop' into develop	2019-11-23 16:48:19 +08:00
marvzhang	464054d1c2	added vendor files	2019-11-23 16:47:05 +08:00
韩山杰	d4525116ea	modity redis DialWriteTimeout to 15s	2019-11-22 22:29:02 +08:00
韩山杰	86d4c611c6	bug fix	2019-11-22 15:32:23 +08:00
Jeremy	7755c3e74c	bug fix register.go ... fix data race because of register solve issue https://github.com/crawlab-team/crawlab/issues/308	2019-11-19 17:03:46 +08:00
陈景阳	9427283e3a	fix 循环依赖的问题	2019-10-28 13:51:12 +08:00
陈景阳	965553b285	fix 代码遗漏	2019-10-28 12:36:00 +08:00
陈景阳	76ab8f1fcd	fix 优化代码	2019-10-28 12:03:02 +08:00
陈景阳	5525c82835	读取日志修改为2M	2019-10-28 11:38:39 +08:00
暗音	bcf3978600	Merge branch 'develop' into develop	2019-10-28 11:06:13 +08:00
陈景阳	418d728825	修改日志获取问题	2019-10-17 17:54:19 +08:00
陈景阳	4ab4892471	fix 环境变量的问题	2019-10-16 15:39:25 +08:00
陈景阳	b3b2efd611	fix 定时任务参数错误的问题	2019-10-16 15:27:12 +08:00
陈景阳	3fc97e78d8	fix 时区的问题	2019-10-16 11:26:15 +08:00
陈景阳	467796b55a	fix 一些东西	2019-10-16 10:11:00 +08:00
陈景阳	f92d2d4266	优化代码	2019-10-16 09:45:50 +08:00
陈景阳	d4c152f93a	代码优化	2019-10-15 17:23:03 +08:00
陈景阳	04a35e8bec	Merge remote-tracking branch 'upstream/develop' into upstream-develop	2019-10-12 07:16:37 +08:00
陈景阳	6af06efc17	fix worker无法获取到当前Node的问题	2019-10-12 07:16:11 +08:00
暗音	2d2034326a	Merge pull request #4 from crawlab-team/master ... 同步源库	2019-10-12 06:41:34 +08:00
陈景阳	5bd30d8046	fix 定时任务管理	2019-10-11 23:53:07 +08:00
陈景阳	b56399451e	fix 定时任务管理	2019-10-11 23:22:25 +08:00
陈景阳	7dae91ab50	fix	2019-10-11 22:48:06 +08:00
陈景阳	973251a0fb	优化节点信息	2019-10-11 21:57:25 +08:00
yaziming	738d607d78	ignore add super admin account error	2019-10-11 16:54:13 +08:00
yaziming	ee808e0e60	refactor(all): refactor code ... remove redundant code and some code refactor	2019-10-11 16:01:57 +08:00
陈景阳	46d89c8cce	添加日志打印	2019-10-10 19:56:04 +08:00
yaziming	63fab3917b	feat(backend): support server graceful down ... 1.support server graceful down	2019-10-09 11:21:01 +08:00
暗音	ffe69f3d74	Merge pull request #245 from wo10378931/develop ... Develop	2019-10-08 20:28:47 +08:00
陈景阳	f5af83dcce	修改版本号	2019-10-08 20:26:08 +08:00
陈景阳	6b90d86ea2	fix 状态的问题	2019-10-08 20:20:48 +08:00
陈景阳	a081b02c13	fix 状态的问题	2019-10-08 20:16:49 +08:00
陈景阳	4c8b38f40b	fix 状态错误的问题	2019-10-08 19:41:29 +08:00
暗音	9a973ab43f	Merge pull request #242 from wo10378931/develop ... Develop	2019-10-07 13:07:53 +08:00
陈景阳	4a40d38844	fix md5值不一致的问题	2019-10-07 12:49:37 +08:00