Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Design a multi-stage programming model #14

Closed
kijungs opened this issue Mar 31, 2015 · 1 comment
Closed

Design a multi-stage programming model #14

kijungs opened this issue Mar 31, 2015 · 1 comment

Comments

@kijungs
Copy link
Contributor

kijungs commented Mar 31, 2015

Objective:

  • Design a programming model that is simple but able to express various ML algorithms

Specification:

  • Each Job consists of one or more Stages
  • Stages are executed on the same evaluators, which maintain Contexts, stage by stage
  • Data can be passed among Stages using Key-value Store Service
  • Each Stage follows a BSP programming model
  • Each Stage consists of one Controller Task and one or more homogeneous Compute Tasks
  • The Controller Tasks and Compute Tasks communicate each other through Group Communication
  • Group Communication includes BroadCast, Reduce, Gatter, and Scatter of arbitrary types of data
  • Each Compute Task and Controller Task consists of initialize, run, and cleanup step.
@kijungs kijungs changed the title Design a programming model Design a multi-stage programming model Apr 8, 2015
@jsjason
Copy link
Contributor

jsjason commented Apr 29, 2015

Closed via #19.

@jsjason jsjason closed this as completed Apr 29, 2015
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants