407 Commits

Author	SHA1	Message	Date
marvzhang	a2422bc3ac	try to fix java install issue	2020-03-05 13:48:18 +08:00
marvzhang	28f1da9c97	try to fix java install issue	2020-03-05 11:59:47 +08:00
marvzhang	28b4c1cb20	try to fix java install issue	2020-03-05 11:24:47 +08:00
marvzhang	da000f3b74	暂时关闭java	2020-03-05 11:01:58 +08:00
marvzhang	d7aa8d115f	try to fix install java error	2020-03-05 09:31:11 +08:00
marvzhang	6b39167a8b	加入hostname注册	2020-03-05 08:56:01 +08:00
marvzhang	47fcae9456	updated install-java.sh	2020-03-05 08:09:12 +08:00
marvzhang	f2ddce5fec	updated install-java.sh	2020-03-04 12:23:03 +08:00
marvzhang	64e2e98aeb	Merge branch 'develop' of https://github.com/crawlab-team/crawlab into develop	2020-03-04 10:37:08 +08:00
marvzhang	40f84de307	added java env	2020-03-04 10:36:58 +08:00
hantmac	3b41b086e6	bug fix issue 603	2020-03-02 10:45:29 +08:00
marvzhang	4f24ac15a1	加入帮助文档	2020-03-01 20:55:52 +08:00
marvzhang	11defc16c2	默认关闭教程	2020-03-01 10:24:31 +08:00
marvzhang	8ffab990fd	updated version	2020-02-24 16:48:46 +08:00
marvzhang	cc2ec7a34c	fixed https://github.com/crawlab-team/crawlab/issues/577	2020-02-24 09:48:23 +08:00
marvzhang	8cdedba1e1	Merge branch 'develop' of https://github.com/crawlab-team/crawlab into develop	2020-02-24 09:13:35 +08:00
marvzhang	7315deefee	加入复制爬虫	2020-02-24 09:12:03 +08:00
Marvin Zhang	8c6ab3f4d8	Merge pull request #587 from hantmac/develop ... bug fix: fix concurrent map write error	2020-02-23 18:57:17 +08:00
hantmac	29d932d2cc	move redundant log	2020-02-23 16:35:38 +08:00
hantmac	cdaf14500a	bug fix: fix concurrent map write error	2020-02-23 16:33:18 +08:00
marvzhang	6000667b7d	updated dockerpush.yml	2020-02-23 09:19:18 +08:00
marvzhang	dd3264768a	加入批量运行爬虫	2020-02-22 19:12:24 +08:00
marvzhang	2e6b6e4e70	加入批量删除爬虫任务	2020-02-22 17:35:51 +08:00
marvzhang	eb167ead1e	暂时停用自动检测Scrapy项目功能	2020-02-22 12:48:15 +08:00
marvzhang	ba720b356c	加入批量删除爬虫	2020-02-22 12:44:58 +08:00
marvzhang	cddc09405b	加入scrapy spider跳转	2020-02-21 22:28:41 +08:00
marvzhang	21323f0d28	加入scrapy pipelines支持	2020-02-21 17:12:57 +08:00
marvzhang	38af9e9173	加入scrapy items.py支持	2020-02-21 15:07:54 +08:00
marvzhang	1ddac86fe1	加入添加scrapy项目	2020-02-20 17:33:45 +08:00
marvzhang	17bdbaf8dd	优化爬虫列表页面	2020-02-20 11:52:28 +08:00
marvzhang	ec8bf33535	加入版本检测	2020-02-19 13:16:46 +08:00
marvzhang	16263a9423	fixed ssh-keygen issue	2020-02-18 15:20:57 +08:00
marvzhang	357a2d26a8	fixed unable to update is_scrapy issue	2020-02-18 14:57:57 +08:00
marvzhang	fb9b6e1619	更改ssh逻辑	2020-02-18 13:42:31 +08:00
marvzhang	2ce289c8f3	加入Git同步	2020-02-18 12:15:40 +08:00
marvzhang	3bb1fe2a74	加入git同步	2020-02-17 18:12:59 +08:00
marvzhang	534a29ebc3	加入添加scrapy爬虫	2020-02-17 14:06:16 +08:00
marvzhang	9abf577e74	完成scrapy设置	2020-02-17 11:52:26 +08:00
marvzhang	dec566d1e5	加入settings.py同步	2020-02-17 11:15:16 +08:00
marvzhang	a9277f3412	添加Scrapy设置后端	2020-02-17 10:31:59 +08:00
marvzhang	fc4d92c4d6	更新scrapy参数	2020-02-16 10:38:41 +08:00
marvzhang	3b8702ed58	加入scrapy日志选择	2020-02-15 21:25:21 +08:00
marvzhang	d46f43b05b	加入scrapy爬虫支持	2020-02-15 18:28:37 +08:00
marvzhang	88d8f1f907	updated version	2020-02-13 13:45:12 +08:00
marvzhang	fd62adc8ba	优化爬虫执行逻辑	2020-02-11 15:37:06 +08:00
marvzhang	a0c47e54e8	updated spiders	2020-02-11 10:06:03 +08:00
marvzhang	a62fec9c01	updated install-nodejs.sh	2020-02-11 09:36:34 +08:00
marvzhang	7e85f561bf	updated install-nodejs.sh	2020-02-10 19:28:47 +08:00
marvzhang	e1e363eb40	updated install-nodejs.sh	2020-02-10 17:45:47 +08:00
marvzhang	3363d08797	updated install-nodejs.sh	2020-02-10 17:41:14 +08:00