-
Notifications
You must be signed in to change notification settings - Fork 14
/
Copy pathTODO
45 lines (42 loc) · 2.51 KB
/
TODO
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
Features/issues priority:
High:
easy - indicate name clash
trivial - field buttons should not be tab navigatable
easy - json editor fields sorted properly
medium - inject helpful selecting utilities into page js context
(sel() function, pageOwnVars() function which returns js variables set by page)
medium - make selector input use textarea which exapnds on with its content
hard - visual intuitive expression editor:
full element(s) path shown, clicking on parents, their classes, id's and other attributes to include inside expression
medium - make css-to-xpath button
easy - fixed header
hard - instead of making any page/css mutations do all highlighting and picking over a click-through overlay canvas
easy - allow traversing upwards (if rejects are present - kill them)
easy - smart upwards - on multuple elements selected -> traverse up to find uppermost parent element that is still a unique parent for each in the selected set
hard - nested selectors
trivial - allow specifying field meta after a colon within field name
(e.g. 'next-page-link:relative') as a way to provide additional info to the actual scraping tool
Implement testing capabilities:
medium - sweep over selected templates downloading and testing them on their respective pages
medium - allow to specify and edit template matching pages
medium - implement some sorta contracts to verify templates
very hard - automatic structure discovery by matching html trees of multiple similarly structured pages (e.g. product pages on the same website)
Medium:
medium - exclude from picker by clicking on row in a data tab
easy - n key -> new field, p key -> pick field, esc -> blur current input, esc on main window body -> focus sidebar
easy - dont allow selecting ourselves / selectorgadget controls
easy - syntax highlight html and json inside data control tab
medium - highlight target element when hovered over in a .data.many control tab
Low:
easy - sort templates upper to lower domain levels
medium - thorough logging
hard - rework styles into something sensible
medium - beautify and rework html
medium - detect obfuscated classes/ids and warn perhaps?
easy - separator of templates list header is below scrollbar
medium - link patterns mode?
easy - template shift select many
hard - fix styles for firefox gtk build
easy - "show hidden elements" button (use jq ":hidden" selector maybe)
hard - "highlight all" mode - highlights all elements on the page using different color for each respective field
hard - also draw field titles written on top of highlight area