Skip to content

Latest commit

 

History

History
44 lines (43 loc) · 1.99 KB

todo.org

File metadata and controls

44 lines (43 loc) · 1.99 KB

TODO DOT ORG

Tasks earlier development

Successfully scrape images and albums

[#A] Finish setting up gender filtering

  • [x] Write Function
  • [x] integrate into scrypt
  • [ ] Test functionality

[#B] Find means to mitigate error of no attribute in next page functions.

CANCELED [#B] Rewrite scrap_profile function

  • [ ] combine this with the scraper_control
  • [ ] rearrage flow of script to fully complete one user at a time

[#B] create function for album walkthrough to reduce size of code.

  • [x] create independent function
  • [x] remove redundancy

[#A] Find a solution to the infinite page loop dilemna

[#A] Find solution for locating individual image links from thumbnail page

  • [x] I totally have no idea what is preventing this from success
  • [x] I added a line to print the link it is scraping, which it skips everytime.

[#A] Find solution for stale element exception that is plagueing the script currently.

[#A] Troubleshoot new error of elements “temporarily unable to be viewed”

[#B] Combine `get_fullphoto()` with gallery_walker

[#B] rewrite gallery_walker to walk gallery pages not images

[#B] Control which ID gets scraped

Scrape albums

Scrape Friends

Scrape Based on genders

Setup config.py for easier configuration by users

Why am I doing this? I do not know…

Remove useless, broken, and unused bits of code.

Later stage developement

Setup config.py for easier configuration

move from username to userid

Correct failed creation of folder hierarchy

link call to ensure folder structure with userid.

Docs