61 Commits

This Branch

This Branch

All Branches

Author	SHA1	Message	Date
Marvin Zhang	849a812e23	added pagination for tasks	2019-03-12 21:00:35 +08:00
Marvin Zhang	508712ba07	fixed inconsistency of timestamp issue	2019-03-12 20:28:50 +08:00
Marvin Zhang	9180e00d94	modified task status update logic	2019-03-12 13:10:24 +08:00
Marvin Zhang	c532d0614d	fixed deploy issue	2019-03-12 13:01:18 +08:00
Marvin Zhang	b7bf01e5f2	added spider for segmentfault	2019-03-11 13:15:00 +08:00
Marvin Zhang	4d4228d7ce	updated error message	2019-03-09 16:27:23 +08:00
Marvin Zhang	8d4ccddd8c	added stop task	2019-03-09 16:18:39 +08:00
Marvin Zhang	1821c31cf7	added requirements.txt	2019-03-09 15:39:29 +08:00
Marvin Zhang	189d7da299	updated cron tasks: fixed task run duplication issue	2019-03-09 15:35:48 +08:00
Marvin Zhang	cc4a0eefc3	added cron tasks for spiders	2019-03-09 14:05:14 +08:00
Marvin Zhang	7e685541ac	updated README	2019-03-08 22:40:47 +08:00
Marvin Zhang	bd71e10506	updated README.md	2019-03-06 17:14:17 +08:00
Marvin Zhang	00330b706f	updated README.md	2019-03-06 16:40:54 +08:00
Marvin Zhang	64a7745fcd	updated README.md	2019-03-06 16:13:37 +08:00
Marvin Zhang	67146ba759	updated README.md	2019-03-06 16:06:14 +08:00
Marvin Zhang	1fb09e4d1f	support multi-node log view	2019-03-06 15:43:14 +08:00
Marvin Zhang	a9f555d9b9	added images	2019-03-06 13:16:05 +08:00
Marvin Zhang	a18e21a634	updated README.md	2019-03-06 13:14:59 +08:00
Marvin Zhang	a31893b48a	added Results	2019-03-06 13:14:26 +08:00
Marvin Zhang	205ea778ae	updated README.md	2019-03-06 10:52:38 +08:00
Marvin Zhang	72e7a0202b	updated README.md	2019-03-06 10:46:41 +08:00
Marvin Zhang	fc4c98eccf	restructured code	2019-03-06 10:11:07 +08:00
Marvin Zhang	de3247269c	updated methodologies of deployment and running spider	2019-03-05 13:22:23 +08:00
Marvin Zhang	95cf526013	added github import	2019-03-04 12:07:14 +08:00
Marvin Zhang	e3287ab593	added License	2019-03-03 11:00:50 +08:00
Marvin Zhang	705a200841	added License	2019-03-03 10:58:47 +08:00
Marvin Zhang	768781f6d5	updated setup.py	2019-03-03 10:57:19 +08:00
Marvin Zhang	b8417bb7f8	Merge remote-tracking branch 'origin/master'	2019-03-03 10:48:19 +08:00
Marvin Zhang	cc59e1cfce	added setup.py	2019-03-03 10:48:04 +08:00
Marvin Zhang	562e6344db	Delete LICENSE	2019-03-03 10:44:42 +08:00
Marvin Zhang	93fefc9b81	updated README.md	2019-03-02 10:07:05 +08:00
Marvin Zhang	7b88488966	fixed deploy/run task issue	2019-03-02 09:37:55 +08:00
Marvin Zhang	7d98cbddf8	updated execute spider logic	2019-03-01 12:07:28 +08:00
Marvin Zhang	1a8757a781	updated Dockerfile	2019-03-01 11:45:32 +08:00
Marvin Zhang	ae5ea03043	updated Dockerfile	2019-02-28 18:57:44 +08:00
Marvin Zhang	cf1d1ca878	prepare for multi-node deployment	2019-02-26 13:00:06 +08:00
Marvin Zhang	6d2370f58b	updated requirements.txt	2019-02-26 12:42:12 +08:00
Marvin Zhang	264339e394	fixed sorting issue	2019-02-25 19:32:43 +08:00
Marvin Zhang	6b5115d38d	updated home page	2019-02-25 13:18:26 +08:00
Marvin Zhang	3ebd35384d	added pagination	2019-02-23 21:40:26 +08:00
Marvin Zhang	e27d606230	added TaskOverview	2019-02-23 18:39:22 +08:00
Marvin Zhang	ee38c22e1b	updated TODO	2019-02-21 17:00:35 +08:00
Marvin Zhang	c4c07a28d0	updated spider/node overviews	2019-02-21 16:52:50 +08:00
Marvin Zhang	040d1918be	return existing nodes	2019-02-21 14:18:26 +08:00
Marvin Zhang	0480984cdb	updated node/spider overviews	2019-02-21 14:08:48 +08:00
Marvin Zhang	7959fd03ad	overview pages updated	2019-02-20 21:24:28 +08:00
Marvin Zhang	1e03b44677	added log file for task	2019-02-19 22:55:52 +08:00
Marvin Zhang	140a43d1b3	added tasks	2019-02-18 21:16:40 +08:00
Marvin Zhang	8ea3072b72	update deploy and crawl functionality	2019-02-18 13:27:57 +08:00
Marvin Zhang	f4d6606df4	finalize file management	2019-02-17 22:30:52 +08:00