Feature/cross device simulation#504

Merged

ahellander merged 278 commits intomasterfrom feature/cross-device-simulation

Jan 29, 2024

+673-153

This pull request is big! We're only showing the most recent 250 commits

Commits on Jun 7, 2022

Increase sleep for reducers and clients
mcapuccini
committed
Improve logs
mcapuccini
committed
Always print logs
mcapuccini
committed
Fix PyTorch example data mount path in compose file
Marco Capuccini
authored
Merge branch 'bugfix/torchexample' into feature/ci-matrix
mcapuccini
committed
mets many python versions
mcapuccini
committed
quotes
mcapuccini
committed

Commits on Jun 8, 2022

Fix CI sleep time
mcapuccini
committed
Add Python versiong
mcapuccini
committed
don't fail fast
mcapuccini
committed
remove python 3.10
mcapuccini
committed
remove python 3.10
mcapuccini
committed
fix numpy for py 3.7
mcapuccini
committed
Merge branch 'feature/ci-matrix' into feature/inference
mcapuccini
committed
Merge branch 'bugfix/ci-time' into feature/inference
mcapuccini
committed
Merge branch 'develop' into feature/inference
mcapuccini
committed

Commits on Jun 9, 2022

Merge branch 'develop' into feature/inference
mcapuccini
committed

Commits on Jun 10, 2022

Merge branch 'develop' into feature/inference
mcapuccini
committed
Inference CI
mcapuccini
committed
minor
mcapuccini
committed
fix
mcapuccini
committed
fix
mcapuccini
committed
fix
mcapuccini
committed
fix
mcapuccini
committed
fix
mcapuccini
committed
fix
mcapuccini
committed
fix
mcapuccini
committed

Commits on Jun 13, 2022

reduce CI time
mcapuccini
committed

Commits on Jun 15, 2022

update and fix conflicts
mcapuccini
committed
fix conflict
mcapuccini
committed

Commits on Jul 4, 2022

upstream updates
mcapuccini
committed

Commits on Jul 6, 2022

Initial implementation toggle ssl for REST service
Andreas Hellander
committed
Removed unused reducer inference interface mockup
Andreas Hellander
committed
Removed geoip2 dependency
Andreas Hellander
committed
Dockerfile update, install developer tools
Andreas Hellander
committed

Commits on Jul 7, 2022

Draft implementation
Andreas Hellander
committed
Update and fix conflicts
mcapuccini
committed
update and fix conflict
mcapuccini
committed
Merge branch 'develop' into feature/toggle-ssl
Andreas Hellander
committed

Commits on Jul 8, 2022

Remove mocked inference endpoint in restservice
Andreas Hellander
committed

Commits on Jul 11, 2022

Develop (#418 )

ahellander
and
Marco Capuccini
authored
fix code-checks
Wrede
committed
insecure mode in ci (http)
Wrede
committed
secure option to package download and checksum
Wrede
committed
work in progress
Andreas Hellander
committed
merge conflicts
Andreas Hellander
committed

Commits on Jul 12, 2022

fix flake8 warning
Wrede
committed

Commits on Jul 13, 2022

Merge branch 'feature/toggle-ssl' of https://github.com/scaleoutsystems/fedn into feature/toggle-ssl
Andreas Hellander
committed
Remove Talisman
Andreas Hellander
committed
bugfix, combiner now correctly uses secure flag in connector
Andreas Hellander
committed
Revert accidetal change to compose file
Andreas Hellander
committed
sort import
Andreas Hellander
committed
Changed combiner ssl default config to False
Andreas Hellander
committed

Commits on Jul 14, 2022

Fixed code checks
Andreas Hellander
committed
Code checks
Andreas Hellander
committed
Add docstings in connecy.py
Andreas Hellander
committed
Add docstings in certificatemanager
Andreas Hellander
committed

Commits on Jul 28, 2022

Docstrings
Andreas Hellander
committed
Changed some parameter names in reducer CLI
Andreas Hellander
committed

Commits on Aug 2, 2022

Default no-ssl for REST, ssl for gRPC
Andreas Hellander
committed

Commits on Aug 3, 2022

Fix code check
Andreas Hellander
committed
Harmoize option names between combiner and reducer
Andreas Hellander
committed
Add help text for combiner options
Andreas Hellander
committed
Make --secure option flag
Andreas Hellander
committed

Commits on Aug 10, 2022

Works to disable secure grpc
Andreas Hellander
committed

Commits on Aug 12, 2022

Added back use of copy
Andreas Hellander
committed

Commits on Aug 15, 2022

Remove possibility to generate cert for reducer
Andreas Hellander
committed
Default to insecure gRPC setting
Andreas Hellander
committed
Fix code scanning alerts
Andreas Hellander
committed

Commits on Aug 16, 2022

Initial refactor
Andreas Hellander
committed

Commits on Aug 18, 2022

Initial refactor reducer
Andreas Hellander
committed
Introduce base class for controller
Andreas Hellander
committed

Commits on Aug 26, 2022

More refactoring and cleaning
Andreas Hellander
committed

Commits on Aug 29, 2022

refactored look-aside loadbalancer
Andreas Hellander
committed

Commits on Aug 30, 2022

Refactored load-balancer
Andreas Hellander
committed

Commits on Aug 31, 2022

Fixed code checks
Andreas Hellander
committed
latest
Andreas Hellander
committed

Commits on Sep 1, 2022

work in progress
Andreas Hellander
committed

Commits on Sep 5, 2022

Resolved conflicts
Andreas Hellander
committed
Fixed code checks
Andreas Hellander
committed
Update control page
Andreas Hellander
committed

Commits on Sep 14, 2022

added metadata field to modelupdaterequest
Andreas Hellander
committed

Commits on Sep 15, 2022

Client passes on metadata dict with model update
Andreas Hellander
committed

Commits on Sep 16, 2022

Latest
Andreas Hellander
committed

Commits on Sep 19, 2022

Latest
Andreas Hellander
committed

Commits on Oct 3, 2022

Merge branch 'develop' into feature/refactor-control
Andreas Hellander
committed
latest
Andreas Hellander
committed
Resolve conflict
Andreas Hellander
committed

Commits on Oct 17, 2022

Refactor aggregation
Andreas Hellander
committed
Fix
Andreas Hellander
committed
Merge branch 'bugfix/430' into feature/429
Andreas Hellander
committed
Add docstring for load_model_update
Andreas Hellander
committed
Extract model update metadata and make available in aggregator
Andreas Hellander
committed
Added some docstrings
Andreas Hellander
committed
More docstrings
Andreas Hellander
committed
Renamed aggregator files and base class
Andreas Hellander
committed
suppress LOG status messages in stdout
Andreas Hellander
committed
Introduce policy for when to trigger aggregation at combiner
Andreas Hellander
committed

Commits on Oct 23, 2022

Latest
Andreas Hellander
committed
Merge branch 'develop' into feature/429
Andreas Hellander
committed

Commits on Oct 24, 2022

Added files
Andreas Hellander
committed

Commits on Oct 30, 2022

Fixes
Andreas Hellander
committed

Commits on Oct 31, 2022

Fixed broken congig file generation.
Andreas Hellander
committed
Added option to parse client name from config file
Andreas Hellander
committed

Commits on Nov 1, 2022

Flattened client config file, generalized so that all settings can be passed in the file
Andreas Hellander
committed
Fixed file generation
Andreas Hellander
committed
Resolved conflict
Andreas Hellander
committed
Latest
Andreas Hellander
committed
Updated config template
Andreas Hellander
committed

Commits on Nov 2, 2022

Merge branch 'feature/438' into feature/429
Andreas Hellander
committed

Commits on Jan 25, 2023

Resolved conflict
Andreas Hellander
committed

Commits on Jan 26, 2023

Removed mongotracing in control, will refactor to have all tracing data in one collection
Andreas Hellander
committed
Refactored combiner job submit
Andreas Hellander
committed
Remove psutil tracing
Andreas Hellander
committed
Refactor tracer
Andreas Hellander
committed
cleaning
Andreas Hellander
committed
get latest round refactored
Andreas Hellander
committed

Commits on Jan 27, 2023

Enable early termination by default
Andreas Hellander
committed

Commits on Jan 29, 2023

Removed unused round_config object
Andreas Hellander
committed

Commits on Jan 30, 2023

Remove printout of sensitive information
Andreas Hellander
committed
Remove old control, make new version default
Andreas Hellander
committed
Remove unused code
Andreas Hellander
committed
Changed default name for fedn network in config template
Andreas Hellander
committed

Commits on Feb 8, 2023

Cleaning, docstrings
Andreas Hellander
committed
bugfix
Andreas Hellander
committed
Variable name changes
Andreas Hellander
committed
Removed old combine models implementation
Andreas Hellander
committed
bugfix
Andreas Hellander
committed
Add a hook to validate the model update before putting it on the aggregation queue
Andreas Hellander
committed
Validate metadata on model 'update
Andreas Hellander
committed
Validate metadata on model 'update
Andreas Hellander
committed

Commits on Feb 11, 2023

incremental weighted average in new style aggregator
Andreas Hellander
committed
small cleaning in control form
Andreas Hellander
committed
Added instructions in controller form, rearranged menu items
Andreas Hellander
committed

Commits on Feb 16, 2023

Merge pull request #1 from scaleoutsystems/feature/inference
ahellander
authored
latest
Andreas Hellander
committed
started mergin
Andreas Hellander
committed
Resolve merge conflicts
Andreas Hellander
committed

Commits on Feb 17, 2023

Added back accidentally removed file
Andreas Hellander
committed
Conflict resolution
Andreas Hellander
committed
Remove unused readme file
Andreas Hellander
committed
More merging
Andreas Hellander
committed

Commits on Feb 21, 2023

latest
Andreas Hellander
committed

Commits on Feb 23, 2023

Fixed round_config regression
Andreas Hellander
committed
Controller polls db instead of combiners
Andreas Hellander
committed

Commits on Feb 27, 2023

More api docs
Andreas Hellander
committed
Add infer_instruct
Andreas Hellander
committed
Cleaning
Andreas Hellander
committed

Commits on Mar 6, 2023

Added training metadata for keras example
Andreas Hellander
committed
work in progress db cleanup
Andreas Hellander
committed

Commits on Mar 7, 2023

Refactor
Andreas Hellander
committed

Commits on Mar 13, 2023

More refactoring in db backend
Andreas Hellander
committed
Remove 'control' setting from reducer config file
Andreas Hellander
committed
Flatten combiner config
Andreas Hellander
committed
Flatten combiner config
Andreas Hellander
committed
Flatten combiner config
Andreas Hellander
committed
Harmonize CLI option names
Andreas Hellander
committed
Refactor helpers
Andreas Hellander
committed

Commits on Mar 14, 2023

Refactor helpers
Andreas Hellander
committed
Merge branch 'master' into feature/refactor
Andreas Hellander
committed

Commits on Mar 22, 2023

Refactor helpers
Andreas Hellander
committed
Refactor helpers
Andreas Hellander
committed

Commits on Mar 23, 2023

Refactor helpers
Andreas Hellander
committed

Commits on Mar 27, 2023

Plugin arch for helpers
Andreas Hellander
committed
Updated UI config
Andreas Hellander
committed

Commits on Mar 28, 2023

Raise exception if misconfigured helper
Andreas Hellander
committed
Added tracing of sessions in the db
Andreas Hellander
committed

Commits on Mar 31, 2023

Update version to 0.5-dev
Andreas Hellander
committed

Commits on Apr 9, 2023

Merge branch 'develop' into feature/refactor
ahellander
authored

Commits on Apr 11, 2023

Updated torch version
Andreas Hellander
committed
resolved conflict
Andreas Hellander
committed
Updated torch version
Andreas Hellander
committed

Commits on Apr 14, 2023

bugfix
Andreas Hellander
committed

Commits on Apr 16, 2023

Skip osx tests
Andreas Hellander
committed

Commits on May 9, 2023

latest
Andreas Hellander
committed
change helper name
Wrede
committed
fix formatting and syntax
Wrede
committed
fix formatting and syntax errors
Wrede
committed

Commits on May 15, 2023

Resolved conflicts
Andreas Hellander
committed
Merge branch 'develop' of github.com:scaleoutsystems/fedn into feature/refactor
Wrede
committed

Commits on May 16, 2023

update ci new db
Wrede
committed

Commits on May 17, 2023

Commits on May 19, 2023

update doc strings for client and combiner
Wrede
committed

Commits on May 23, 2023

Merge branch 'feature/refactor' of https://github.com/scaleoutsystems/fedn into feature/refactor
Andreas Hellander
committed
Resolve conflict
Andreas Hellander
committed

Commits on May 25, 2023

formatting
Andreas Hellander
committed

Commits on May 29, 2023

Commits on Aug 16, 2023

work in progress
Andreas Hellander
committed

Commits on Aug 18, 2023

Refactor of controller
Andreas Hellander
committed

Commits on Aug 19, 2023

Refactor of controller
Andreas Hellander
committed

Commits on Aug 21, 2023

Refactor polling in control
Andreas Hellander
committed
Refactor polling in control
Andreas Hellander
committed

Commits on Aug 22, 2023

Refactor polling in control
Andreas Hellander
committed

Commits on Aug 30, 2023

Merge conflicts
Andreas Hellander
committed
Functioning
Andreas Hellander
committed

Commits on Sep 25, 2023

start on new simulation example
Andreas Hellander
committed
Merge branch 'master' of https://github.com/scaleoutsystems/fedn
Andreas Hellander
committed

Commits on Oct 16, 2023

Merge branch 'develop' into feature/SK-521
Andreas Hellander
committed

Commits on Oct 17, 2023

update
Andreas Hellander
committed

Commits on Oct 19, 2023

Updated test
Andreas Hellander
committed
Fix typos
Andreas Hellander
committed
Removed accidentally committed files
Andreas Hellander
committed
update api
Andreas Hellander
committed

Commits on Oct 21, 2023

added new async-simulation example
Andreas Hellander
committed
rename example
Andreas Hellander
committed

Commits on Oct 25, 2023

latest
Andreas Hellander
committed

Commits on Oct 30, 2023

Updates after code review
Andreas Hellander
committed
Merge branch 'feature/SK-521' into feature/cross-device-simulation
Andreas Hellander
committed
Resolve conflict
Andreas Hellander
committed
Merge branch 'develop' into feature/cross-device-simulation
Andreas Hellander
committed

Commits on Nov 2, 2023

Resolved merge conflicts
Andreas Hellander
committed
Resolved merge conflicts
Andreas Hellander
committed
Updated docstrings
Andreas Hellander
committed

Commits on Nov 4, 2023

Fixed docstrings
Andreas Hellander
committed
Fixes
Andreas Hellander
committed
Fixed code check
Andreas Hellander
committed

Commits on Nov 5, 2023

use setter
Andreas Hellander
committed
Merge branch 'feature/SK-521' into feature/cross-device-simulation
Andreas Hellander
committed

Commits on Nov 8, 2023

latest
Andreas Hellander
committed
removed script for combiners
Andreas Hellander
committed

Commits on Nov 14, 2023

Merge branch 'master' of https://github.com/scaleoutsystems/fedn
Andreas Hellander
committed

Commits on Nov 21, 2023

Merge branch 'master' of https://github.com/scaleoutsystems/fedn
Andreas Hellander
committed
Merge branch 'master' into feature/cross-device-simulation
Andreas Hellander
committed

Commits on Nov 24, 2023

Fix numpyarrayhelper
Andreas Hellander
committed

Commits on Jan 26, 2024

Resolved conflict
Andreas Hellander
committed

Commits on Jan 28, 2024

work in progress
Andreas Hellander
committed
Use latest mongodb and bump version number
Andreas Hellander
committed
Merge branch 'hotfix/broken-mongo' into feature/cross-device-simulation
Andreas Hellander
committed
Fixed bug in client
Andreas Hellander
committed
Client sends model only once, combiner deletes staged model after training round
Andreas Hellander
committed

Commits on Jan 29, 2024

Merge branch 'bugfix/SK-649' into feature/cross-device-simulation
Andreas Hellander
committed
Cleaned up new example/test
Andreas Hellander
committed
Change naming of temp storage class member in modelservice, for clarity
Andreas Hellander
committed
Make detach() public
Andreas Hellander
committed
Renamed some methods in client for clarity
Andreas Hellander
committed
refactored set_model to avoide code duplication on client
Andreas Hellander
committed
Refactored modelservice for code reuse
Andreas Hellander
committed
Fix dashboard package upload
Andreas Hellander
committed
Fix default helper in session
Andreas Hellander
committed
Delete combiner level model from minio after reduce
Andreas Hellander
committed
resolved conflicts
Andreas Hellander
committed
delete combiner models from minio by default
Andreas Hellander
committed
code checks
Andreas Hellander
committed
changes following review
Andreas Hellander
committed