187 Commits

Author	SHA1	Message	Date
marvzhang	cdaf3363c8	添加Scrapy设置后端	2020-02-17 10:31:59 +08:00
marvzhang	69e4c23115	更新scrapy参数	2020-02-16 10:38:41 +08:00
marvzhang	01fefbee88	加入scrapy日志选择	2020-02-15 21:25:21 +08:00
marvzhang	acdf4d5951	加入scrapy爬虫支持	2020-02-15 18:28:37 +08:00
marvzhang	1c7c20c11c	优化爬虫执行逻辑	2020-02-11 15:37:06 +08:00
marvzhang	6b32709a39	兼容Node.js爬虫	2020-02-10 13:23:34 +08:00
marvzhang	a448c0f06b	fixed unable to sync spiders to nodes error	2020-02-03 16:08:43 +08:00
marvzhang	de2d230e1a	changed dir	2020-02-03 11:58:05 +08:00
marvzhang	be3235cefa	added demo for general spiders	2020-02-03 10:30:04 +08:00
marvzhang	cb6a8f79d8	added demo spiders	2020-02-03 09:21:41 +08:00
marvzhang	5740774ccc	添加demo爬虫	2020-02-02 22:56:11 +08:00
marvzhang	633740f1c2	fixed https://github.com/crawlab-team/crawlab/issues/485	2020-02-01 19:18:30 +08:00
陈景阳	100e7631fb	fix 启动报错的问题	2020-02-01 12:53:44 +08:00
陈景阳	81edf9ab72	fix 无法及时同步爬虫的问题	2020-01-28 15:43:57 +08:00
陈景阳	092c1a2617	feature 新增全局环境变量	2020-01-28 15:12:12 +08:00
marvzhang	39c6df11c1	调整在线编辑文件	2020-01-15 20:10:43 +08:00
marvzhang	ef2a4b3531	加入树形结构文件目录	2020-01-15 17:44:11 +08:00
marvzhang	b70949cc87	加入消息通知类型选择	2020-01-15 14:39:51 +08:00
marvzhang	1fde42b932	将发送消息通知调整为异步	2020-01-15 13:51:12 +08:00
marvzhang	9c24126223	完成钉钉机器人消息通知	2020-01-15 13:04:59 +08:00
marvzhang	32bfb63d8f	完成钉钉机器人消息通知	2020-01-15 13:03:43 +08:00
marvzhang	9e61e4c149	added vendor	2020-01-15 10:31:58 +08:00
marvzhang	8069000956	added dingtalk	2020-01-14 20:03:04 +08:00
marvzhang	c227cdeaba	默认为不触发通知	2020-01-14 15:42:51 +08:00
marvzhang	875332dba7	更新邮件通知	2020-01-14 11:49:42 +08:00
marvzhang	c67c1be52a	加入用户设置与邮件通知	2020-01-13 19:56:13 +08:00
marvzhang	117ae581de	updated vendor	2020-01-13 15:57:29 +08:00
marvzhang	6f36e2fd3e	improved compatibility with crawlab-sdk	2020-01-13 12:32:06 +08:00
marvzhang	c89a6f4bf2	added pointer to node list	2020-01-11 16:42:04 +08:00
marvzhang	09cef0a10a	fixed "nil returned" error	2020-01-10 18:42:37 +08:00
marvzhang	65261a5797	修复rpc timeout 报错问题	2020-01-10 15:16:34 +08:00
marvzhang	edece9a768	fixed duplicated AssignTask method	2020-01-07 13:54:24 +08:00
陈景阳	6d5d408031	fix 定时任务无法正常运行的问题	2020-01-07 04:01:22 +08:00
陈景阳	515f3b3695	fix 前端报错的问题	2020-01-07 01:32:11 +08:00
暗音	081f8adc2b	Merge branch 'develop' into develop	2020-01-07 00:53:18 +08:00
marvzhang	04905f38b5	加入爬虫列表排序	2020-01-06 13:18:29 +08:00
marvzhang	877289e382	fixed https://github.com/crawlab-team/crawlab/issues/423	2020-01-06 12:35:17 +08:00
marvzhang	ec2a738958	添加docker安装node	2020-01-03 15:45:18 +08:00
marvzhang	7310df1be6	兼容Node.js执行	2020-01-03 14:21:47 +08:00
marvzhang	7076985898	加入Node.js依赖安装和语言安装	2020-01-03 13:53:06 +08:00
marvzhang	33fbf96efb	优化代码	2020-01-03 11:12:46 +08:00
marvzhang	98cc4646a3	优化依赖安装	2020-01-03 10:54:20 +08:00
marvzhang	53c77eb6e9	加入卸载依赖逻辑	2020-01-02 17:38:39 +08:00
marvzhang	836dc12703	加入RPC机制，完成部分依赖安装逻辑	2020-01-02 15:53:53 +08:00
marvzhang	af93733bc5	fixed https://github.com/crawlab-team/crawlab/issues/391	2020-01-02 12:51:21 +08:00
marvzhang	857bcdba16	fixed https://github.com/crawlab-team/crawlab/issues/391	2020-01-02 11:16:42 +08:00
陈景阳	52a8fce894	优化UI界面	2020-01-02 10:07:21 +08:00
marvzhang	32b1f31340	加入依赖安装前端	2019-12-31 17:05:15 +08:00
marvzhang	5811242af9	更新依赖安装逻辑	2019-12-31 12:02:47 +08:00
marvzhang	01aea28c9c	添加文件管理功能（后端）	2019-12-25 20:49:43 +08:00