43 Commits

Author	SHA1	Message	Date
marvzhang	72692133ee	fixed unable to check is page error for configurable spider	2019-12-19 10:45:11 +08:00
marvzhang	34eef73283	更新百度统计事件名称	2019-12-13 13:53:27 +08:00
marvzhang	556b2841ec	将可配置爬虫stages调整为列表	2019-12-13 13:11:06 +08:00
marvzhang	127c01f264	将可配置爬虫stages调整为列表	2019-12-13 13:01:00 +08:00
marvzhang	70c23c3a45	强制在运行之前保存爬虫	2019-12-06 15:57:42 +08:00
marvzhang	50b53b9ed4	优化可配置爬虫可视化：Tooltip信息	2019-12-04 15:34:41 +08:00
marvzhang	2d5c5952ee	优化可配置爬虫可视化：顺序排列	2019-12-04 15:26:56 +08:00
marvzhang	c73990d19c	优化可配置爬虫可视化：顺序排列	2019-12-04 15:26:06 +08:00
marvzhang	514afa05b4	当stage被删除时，重置next_stage被设置为该stage的field	2019-12-04 15:03:22 +08:00
marvzhang	be4a5f6667	优先调整xpath顺序	2019-12-04 13:57:27 +08:00
marvzhang	589190d674	加入Spiderfile模版	2019-12-03 13:37:41 +08:00
marvzhang	8eafbf480c	完成可配置爬虫设置部分	2019-12-02 13:29:00 +08:00
marvzhang	8f3a1f12f5	加入可配置爬虫设置页面	2019-12-02 12:43:44 +08:00
marvzhang	08c7aec49c	加入可配置爬虫阶段设置	2019-11-30 10:58:54 +08:00
marvzhang	ad148c0d17	准备可配置爬虫设置配置	2019-11-29 13:46:41 +08:00
marvzhang	a1bfe00eee	准备可配置爬虫自定义设置变量	2019-11-29 13:42:50 +08:00
marvzhang	76a47df2c5	修复bug	2019-11-29 13:00:19 +08:00
marvzhang	ba4f5fd20c	优化可配置爬虫前端界面	2019-11-28 21:36:17 +08:00
marvzhang	6e26b7fb42	优化可配置爬虫前端界面	2019-11-28 13:32:33 +08:00
marvzhang	550d98326e	fixed 配置下划线不显示的问题	2019-11-28 12:54:56 +08:00
marvzhang	24880175e2	fixed: 点击列表按钮导航进入详情页面问题	2019-11-28 12:39:07 +08:00
marvzhang	c5f4c7237d	可配置爬虫加入可视化	2019-11-27 20:33:25 +08:00
marvzhang	6ada352ac0	可配置爬虫前端样式调整	2019-11-27 19:59:38 +08:00
marvzhang	28a91b2be4	可配置爬虫前端样式调整	2019-11-27 15:26:50 +08:00
marvzhang	28b67580b4	更新前端可配置爬虫编辑器	2019-11-27 12:41:32 +08:00
marvzhang	2e569c44c4	加入前端可配置编辑器	2019-11-27 12:18:51 +08:00
Marvin Zhang	f6ba3b04c8	code clean up	2019-07-23 21:09:08 +08:00
Marvin Zhang	c48a926907	pagination change	2019-06-09 16:51:03 +08:00
Marvin Zhang	f39c20bbd2	updated auto field extraction	2019-06-04 23:43:47 +08:00
Marvin Zhang	a51183d083	updated ConfigList: allow edit field name on preview	2019-06-04 13:09:57 +08:00
Marvin Zhang	02c2a17844	Merge remote-tracking branch 'origin/develop' into develop	2019-06-03 12:56:40 +08:00
Marvin Zhang	392b2cc0b1	burying points for analytics	2019-05-30 21:14:30 +08:00
Marvin Zhang	bc001eea79	updated ConfigList	2019-05-30 11:47:17 +08:00
Marvin Zhang	e10745da87	fixed bugs	2019-05-29 19:35:04 +08:00
Marvin Zhang	925f643cd8	added extracting list fields functionality	2019-05-29 17:51:44 +08:00
Marvin Zhang	e67e356a4b	Merge remote-tracking branch 'origin/develop' into develop	2019-05-29 14:45:30 +08:00
Marvin Zhang	0ebdb3a823	updated env files	2019-05-29 14:44:33 +08:00
Marvin Zhang	87c81deefb	code cleanup	2019-05-29 13:10:31 +08:00
Marvin Zhang	f710d327b1	allow generate URLs by pattern	2019-05-28 14:59:21 +08:00
Marvin Zhang	83f4be648c	updated configurable spider	2019-05-26 19:16:46 +08:00
Marvin Zhang	d3f776802e	updated configurable spider	2019-05-26 17:10:04 +08:00
Marvin Zhang	96a9c22077	added configurable spider: add/edit fields, preview results	2019-05-25 20:18:27 +08:00
Marvin Zhang	5477099f15	prepared for configurable spiders	2019-05-24 17:28:25 +08:00