Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: local loop prototype #579

Open
wants to merge 26 commits into
base: master
Choose a base branch
from
Open

feat: local loop prototype #579

wants to merge 26 commits into from

Commits on May 19, 2022

  1. Implement prototype local join and train loop

    This consumes the binary parser to do most of the work and is implemented as part of rlsim.
    jackgerrits committed May 19, 2022
    Configuration menu
    Copy the full SHA
    c1054ce View commit details
    Browse the repository at this point in the history

Commits on Oct 13, 2022

  1. Configuration menu
    Copy the full SHA
    63fd388 View commit details
    Browse the repository at this point in the history

Commits on Oct 14, 2022

  1. Configuration menu
    Copy the full SHA
    f78183a View commit details
    Browse the repository at this point in the history
  2. Fix build errors

    byronxu99 committed Oct 14, 2022
    Configuration menu
    Copy the full SHA
    349e555 View commit details
    Browse the repository at this point in the history
  3. clang format

    byronxu99 committed Oct 14, 2022
    Configuration menu
    Copy the full SHA
    15f4143 View commit details
    Browse the repository at this point in the history

Commits on Oct 19, 2022

  1. Configuration menu
    Copy the full SHA
    99cac6b View commit details
    Browse the repository at this point in the history

Commits on Oct 20, 2022

  1. Configuration menu
    Copy the full SHA
    daee5a6 View commit details
    Browse the repository at this point in the history

Commits on Oct 21, 2022

  1. Configuration menu
    Copy the full SHA
    8ed5ab7 View commit details
    Browse the repository at this point in the history

Commits on Nov 9, 2022

  1. Configuration menu
    Copy the full SHA
    e473556 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    7355faa View commit details
    Browse the repository at this point in the history

Commits on Jan 10, 2023

  1. Add local joining and training for federated learning (#523)

    This change implements a local joining and training loop in rlclientlib
    byronxu99 authored Jan 10, 2023
    Configuration menu
    Copy the full SHA
    0f0e1f8 View commit details
    Browse the repository at this point in the history
  2. Merge branch 'master' of github.com:VowpalWabbit/reinforcement_learni…

    …ng into local_loop_prototype
    byronxu99 committed Jan 10, 2023
    Configuration menu
    Copy the full SHA
    13e744e View commit details
    Browse the repository at this point in the history

Commits on Jan 17, 2023

  1. remove old implementation of local model (#539)

    * remove old implementation of local model
    
    * Formatting
    jackgerrits authored Jan 17, 2023
    Configuration menu
    Copy the full SHA
    3477f23 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    f553882 View commit details
    Browse the repository at this point in the history

Commits on Jan 18, 2023

  1. Configuration menu
    Copy the full SHA
    5506c1f View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    d592156 View commit details
    Browse the repository at this point in the history

Commits on Jan 20, 2023

  1. Add ctr to cb and add an option to refresh after every n examples (#543)

    * Add ctr to cb and add an option to refresh after every n examples
    
    * formatting
    jackgerrits authored Jan 20, 2023
    Configuration menu
    Copy the full SHA
    7703abb View commit details
    Browse the repository at this point in the history

Commits on Jan 24, 2023

  1. Configuration menu
    Copy the full SHA
    ab01bee View commit details
    Browse the repository at this point in the history

Commits on Feb 10, 2023

  1. Configuration menu
    Copy the full SHA
    05f6d82 View commit details
    Browse the repository at this point in the history

Commits on Feb 13, 2023

  1. Update order of steps in local loop controller (#563)

    New order:
    Get model from federated client
    If new model received, train it on events generated with old model
    If new model received, upload delta to client
    Return latest model data for local inference
    
    Old order:
    Train model on local events
    If new model received on previous call, generate a delta and upload to client
    Ask client for updated model
    Return latest model data for local inference
    
    Also merge changes from master branch
    byronxu99 authored Feb 13, 2023
    Configuration menu
    Copy the full SHA
    9f4ff7d View commit details
    Browse the repository at this point in the history

Commits on Apr 5, 2023

  1. merge

    bassmang committed Apr 5, 2023
    Configuration menu
    Copy the full SHA
    5b7aa3f View commit details
    Browse the repository at this point in the history
  2. clang

    bassmang committed Apr 5, 2023
    Configuration menu
    Copy the full SHA
    60d3f4e View commit details
    Browse the repository at this point in the history

Commits on Apr 7, 2023

  1. Configuration menu
    Copy the full SHA
    a8e4782 View commit details
    Browse the repository at this point in the history

Commits on Apr 10, 2023

  1. feat: add id and counter (#580)

    * feat: add id and counter
    
    * clang
    
    * user id field
    
    * clang
    
    * rm move
    
    * cl;ang
    
    * try catch
    
    * tidy
    
    * add id to config
    
    * fix test
    bassmang authored Apr 10, 2023
    Configuration menu
    Copy the full SHA
    f699c63 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    4d2cbf0 View commit details
    Browse the repository at this point in the history

Commits on Apr 26, 2023

  1. Configuration menu
    Copy the full SHA
    60e3e3c View commit details
    Browse the repository at this point in the history