git-sync/crawlab
1
0
Fork 0
mirror of https://github.com/crawlab-team/crawlab.git synced 2026-01-30 18:00:56 +01:00
Code Issues Packages Projects Releases Wiki Activity
771 Commits 6 Branches 35 Tags
166c49550cc6bd169ca51e89eacf5f341051bf48
Commit Graph

29 Commits

Author SHA1 Message Date
Marvin Zhang
5013233481 added param to task 2019-09-04 20:13:28 +08:00
Marvin Zhang
946bb7ceba added spider stats 2019-07-26 17:07:24 +08:00
Marvin Zhang
6b3a2a369f added file management 2019-07-24 13:37:03 +08:00
Marvin Zhang
0bd721795b code clean up 2019-07-23 21:09:08 +08:00
Marvin Zhang
c6bd35bd02 updated frontend to adapt changes of golang version 2019-07-22 12:32:36 +08:00
Marvin Zhang
67c299e5d9 adapt changes to golang api 2019-07-21 16:48:58 +08:00
Marvin Zhang
2b9cd566eb updated auto field extraction 2019-06-04 23:43:47 +08:00
Marvin Zhang
7492c34c4a added extracting list fields functionality 2019-05-29 17:51:44 +08:00
Marvin Zhang
d03197042d allow generate URLs by pattern 2019-05-28 14:59:21 +08:00
Marvin Zhang
113be056ae updated configurable spider 2019-05-26 19:17:02 +08:00
Marvin Zhang
5daebcb39b updated configurable spider 2019-05-26 17:10:04 +08:00
Marvin Zhang
15f9b7ef05 added configurable spider: add/edit fields, preview results 2019-05-25 20:18:27 +08:00
Marvin Zhang
04789febc8 prepared for configurable spiders 2019-05-24 17:28:25 +08:00
Marvin Zhang
c5a3d32579 updated SiteList 2019-05-22 22:33:43 +08:00
Marvin Zhang
433b945eeb link site to spider 2019-05-10 13:27:13 +08:00
Marvin Zhang
e822c65eb2 added site list 2019-05-09 22:15:58 +08:00
Marvin Zhang
efc32886ae updated analytics for spider 2019-04-28 19:32:18 +08:00
Marvin Zhang
a41415a041 added analytics for spider 2019-04-28 13:17:40 +08:00
Marvin Zhang
63ff2d1894 enforce deploy before running a spider 2019-04-15 19:50:25 +08:00
Marvin Zhang
6712b3a5f1 added environment variables for spider page 2019-04-10 22:16:25 +08:00
Marvin Zhang
e526b4215b changed the way how task is saved to database 2019-03-16 21:29:30 +08:00
Marvin Zhang
ff631e1095 updated README 2019-03-13 19:27:14 +08:00
Marvin Zhang
ce5e5d8f1d fixed inconsistency of timestamp issue 2019-03-12 20:28:50 +08:00
Marvin Zhang
647fac1efe added cron tasks for spiders 2019-03-09 14:05:14 +08:00
Marvin Zhang
a71f9488ec support multi-node log view 2019-03-06 15:43:14 +08:00
Marvin Zhang
af21ab4841 added Results 2019-03-06 13:14:26 +08:00
Marvin Zhang
6b9c0581c2 updated methodologies of deployment and running spider 2019-03-05 13:22:23 +08:00
Marvin Zhang
ab2279c647 added github import 2019-03-04 12:07:14 +08:00
Marvin Zhang
8361c04de9 added setup.py 2019-03-03 10:48:04 +08:00