Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Incremental loading P2 Add update-dataset to bash #361

Open
6 tasks
alexglasertpx opened this issue Mar 5, 2025 · 0 comments
Open
6 tasks

Incremental loading P2 Add update-dataset to bash #361

alexglasertpx opened this issue Mar 5, 2025 · 0 comments

Comments

@alexglasertpx
Copy link
Contributor

alexglasertpx commented Mar 5, 2025

Overview
Following from ticket #352 we now want to add a new function to the bash scripts and check results are valid.

Checklist

  • Create a command called 'dataset-update' in cli.py, that calls the already merged update_dataset command in commands.py [0.5]
  • Create an 'update-dataset' make variable (that is similar to 'build-dataset' but calls the dataset_update function) [0.5]
  • For each other command (in update-dataset) check that when we run with new resources that the outputs are the same as the old method [2]
    • Ensure that resource.csv has elements added to them rather than just printing out the new resources only
    • Pay close attention to csvstack
  • Add acceptance test 'test_dataset_update' (should be quite similar to 'test_dataset_create') [1]
@alexglasertpx alexglasertpx moved this to Refine, Prioritise & Plan in Infrastructure Mar 5, 2025
@CarlosCoelhoSL CarlosCoelhoSL marked this as a duplicate of #352 Mar 12, 2025
@gmatchett gmatchett moved this from Refine, Prioritise & Plan to Sprint Backlog in Infrastructure Mar 12, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
Status: Sprint Backlog
Development

No branches or pull requests

1 participant