57 Commits

This Branch

This Branch

All Branches

Author	SHA1	Message	Date
Marvin Zhang	0dc5c64bc1	added spider for segmentfault	2019-03-11 13:15:00 +08:00
Marvin Zhang	3aba022922	updated error message	2019-03-09 16:27:23 +08:00
Marvin Zhang	0df8d84105	added stop task	2019-03-09 16:18:39 +08:00
Marvin Zhang	c74d289e3b	added requirements.txt	2019-03-09 15:39:29 +08:00
Marvin Zhang	768628737c	updated cron tasks: fixed task run duplication issue	2019-03-09 15:35:48 +08:00
Marvin Zhang	647fac1efe	added cron tasks for spiders	2019-03-09 14:05:14 +08:00
Marvin Zhang	2f0107fff4	updated README	2019-03-08 22:40:47 +08:00
Marvin Zhang	4b076ad6aa	updated README.md	2019-03-06 17:14:17 +08:00
Marvin Zhang	9ba2f83e71	updated README.md	2019-03-06 16:40:54 +08:00
Marvin Zhang	7683d0d257	updated README.md	2019-03-06 16:13:37 +08:00
Marvin Zhang	8f8c639c82	updated README.md	2019-03-06 16:06:14 +08:00
Marvin Zhang	a71f9488ec	support multi-node log view	2019-03-06 15:43:14 +08:00
Marvin Zhang	437e4f7e3f	added images	2019-03-06 13:16:05 +08:00
Marvin Zhang	7321b9ac1d	updated README.md	2019-03-06 13:14:59 +08:00
Marvin Zhang	af21ab4841	added Results	2019-03-06 13:14:26 +08:00
Marvin Zhang	675e9e1495	updated README.md	2019-03-06 10:52:38 +08:00
Marvin Zhang	68e0b98d8a	updated README.md	2019-03-06 10:46:41 +08:00
Marvin Zhang	a473aef621	restructured code	2019-03-06 10:11:07 +08:00
Marvin Zhang	6b9c0581c2	updated methodologies of deployment and running spider	2019-03-05 13:22:23 +08:00
Marvin Zhang	ab2279c647	added github import	2019-03-04 12:07:14 +08:00
Marvin Zhang	fd1d4f3839	added License	2019-03-03 11:00:50 +08:00
Marvin Zhang	5d9bf710d6	added License	2019-03-03 10:58:47 +08:00
Marvin Zhang	25ee4b8d22	updated setup.py	2019-03-03 10:57:19 +08:00
Marvin Zhang	c16c6f49eb	Merge remote-tracking branch 'origin/master'	2019-03-03 10:48:19 +08:00
Marvin Zhang	8361c04de9	added setup.py	2019-03-03 10:48:04 +08:00
Marvin Zhang	23fb1b86dc	Delete LICENSE	2019-03-03 10:44:42 +08:00
Marvin Zhang	d26f43e09e	updated README.md	2019-03-02 10:07:05 +08:00
Marvin Zhang	307a1872f1	fixed deploy/run task issue	2019-03-02 09:37:55 +08:00
Marvin Zhang	f3ff0a464a	updated execute spider logic	2019-03-01 12:07:28 +08:00
Marvin Zhang	d8766f2a97	updated Dockerfile	2019-03-01 11:45:32 +08:00
Marvin Zhang	007752ce3a	updated Dockerfile	2019-02-28 18:57:44 +08:00
Marvin Zhang	be887cef22	prepare for multi-node deployment	2019-02-26 13:00:06 +08:00
Marvin Zhang	8b8db8e94e	updated requirements.txt	2019-02-26 12:42:12 +08:00
Marvin Zhang	318e5876a6	fixed sorting issue	2019-02-25 19:32:43 +08:00
Marvin Zhang	dc9f27e720	updated home page	2019-02-25 13:18:26 +08:00
Marvin Zhang	55733a7b8c	added pagination	2019-02-23 21:40:26 +08:00
Marvin Zhang	278d6e72f5	added TaskOverview	2019-02-23 18:39:22 +08:00
Marvin Zhang	c7cf064c21	updated TODO	2019-02-21 17:00:35 +08:00
Marvin Zhang	99c538f972	updated spider/node overviews	2019-02-21 16:52:50 +08:00
Marvin Zhang	4e6e2e76de	return existing nodes	2019-02-21 14:18:26 +08:00
Marvin Zhang	913c0644c9	updated node/spider overviews	2019-02-21 14:08:48 +08:00
Marvin Zhang	5eb69a4b0d	overview pages updated	2019-02-20 21:24:28 +08:00
Marvin Zhang	6b13975af4	added log file for task	2019-02-19 22:55:52 +08:00
Marvin Zhang	a4a0fdd67b	added tasks	2019-02-18 21:16:40 +08:00
Marvin Zhang	06575c8ae5	update deploy and crawl functionality	2019-02-18 13:27:57 +08:00
Marvin Zhang	21ac8e9894	finalize file management	2019-02-17 22:30:52 +08:00
Marvin Zhang	714ccd18aa	update SpiderDetail	2019-02-17 11:14:22 +08:00
Marvin Zhang	2cca685a71	adapt changes for SpiderList and NodeList	2019-02-16 22:56:58 +08:00
Yeqing Zhang	7d160d8665	update routes	2019-02-15 12:33:19 +08:00
Yeqing Zhang	bbeb5ca5b5	added deploys	2019-02-13 20:53:15 +08:00