41 Commits

This Branch

This Branch

All Branches

Author	SHA1	Message	Date
Marvin Zhang	68e0b98d8a	updated README.md	2019-03-06 10:46:41 +08:00
Marvin Zhang	a473aef621	restructured code	2019-03-06 10:11:07 +08:00
Marvin Zhang	6b9c0581c2	updated methodologies of deployment and running spider	2019-03-05 13:22:23 +08:00
Marvin Zhang	ab2279c647	added github import	2019-03-04 12:07:14 +08:00
Marvin Zhang	fd1d4f3839	added License	2019-03-03 11:00:50 +08:00
Marvin Zhang	5d9bf710d6	added License	2019-03-03 10:58:47 +08:00
Marvin Zhang	25ee4b8d22	updated setup.py	2019-03-03 10:57:19 +08:00
Marvin Zhang	c16c6f49eb	Merge remote-tracking branch 'origin/master'	2019-03-03 10:48:19 +08:00
Marvin Zhang	8361c04de9	added setup.py	2019-03-03 10:48:04 +08:00
Marvin Zhang	23fb1b86dc	Delete LICENSE	2019-03-03 10:44:42 +08:00
Marvin Zhang	d26f43e09e	updated README.md	2019-03-02 10:07:05 +08:00
Marvin Zhang	307a1872f1	fixed deploy/run task issue	2019-03-02 09:37:55 +08:00
Marvin Zhang	f3ff0a464a	updated execute spider logic	2019-03-01 12:07:28 +08:00
Marvin Zhang	d8766f2a97	updated Dockerfile	2019-03-01 11:45:32 +08:00
Marvin Zhang	007752ce3a	updated Dockerfile	2019-02-28 18:57:44 +08:00
Marvin Zhang	be887cef22	prepare for multi-node deployment	2019-02-26 13:00:06 +08:00
Marvin Zhang	8b8db8e94e	updated requirements.txt	2019-02-26 12:42:12 +08:00
Marvin Zhang	318e5876a6	fixed sorting issue	2019-02-25 19:32:43 +08:00
Marvin Zhang	dc9f27e720	updated home page	2019-02-25 13:18:26 +08:00
Marvin Zhang	55733a7b8c	added pagination	2019-02-23 21:40:26 +08:00
Marvin Zhang	278d6e72f5	added TaskOverview	2019-02-23 18:39:22 +08:00
Marvin Zhang	c7cf064c21	updated TODO	2019-02-21 17:00:35 +08:00
Marvin Zhang	99c538f972	updated spider/node overviews	2019-02-21 16:52:50 +08:00
Marvin Zhang	4e6e2e76de	return existing nodes	2019-02-21 14:18:26 +08:00
Marvin Zhang	913c0644c9	updated node/spider overviews	2019-02-21 14:08:48 +08:00
Marvin Zhang	5eb69a4b0d	overview pages updated	2019-02-20 21:24:28 +08:00
Marvin Zhang	6b13975af4	added log file for task	2019-02-19 22:55:52 +08:00
Marvin Zhang	a4a0fdd67b	added tasks	2019-02-18 21:16:40 +08:00
Marvin Zhang	06575c8ae5	update deploy and crawl functionality	2019-02-18 13:27:57 +08:00
Marvin Zhang	21ac8e9894	finalize file management	2019-02-17 22:30:52 +08:00
Marvin Zhang	714ccd18aa	update SpiderDetail	2019-02-17 11:14:22 +08:00
Marvin Zhang	2cca685a71	adapt changes for SpiderList and NodeList	2019-02-16 22:56:58 +08:00
Yeqing Zhang	7d160d8665	update routes	2019-02-15 12:33:19 +08:00
Yeqing Zhang	bbeb5ca5b5	added deploys	2019-02-13 20:53:15 +08:00
Yeqing Zhang	55b2d5064f	optimized api base	2019-02-13 13:08:35 +08:00
Yeqing Zhang	4f2a29bd42	added models	2019-02-12 13:08:04 +08:00
Marvin Zhang	9f84e2fad1	added base class for api handling	2019-02-12 07:00:19 +08:00
Yeqing Zhang	04c5d69c9f	added base class for api handling	2019-02-12 06:58:54 +08:00
Marvin Zhang	2610f76719	task CRUD update	2019-02-11 22:29:35 +08:00
Marvin Zhang	7e8531aa57	added celery functionality ... added CRUD base	2019-02-11 13:25:33 +08:00
Yeqing Zhang	426fb19238	Initial commit	2019-02-10 14:02:00 +08:00