Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

⭐ IRS Order API for Scalable Job and Batch Delegation #893

Open
6 tasks
mkanal opened this issue Oct 28, 2024 · 0 comments
Open
6 tasks

⭐ IRS Order API for Scalable Job and Batch Delegation #893

mkanal opened this issue Oct 28, 2024 · 0 comments

Comments

@mkanal
Copy link
Contributor

mkanal commented Oct 28, 2024

As system architect,
I want to design the IRS Order API to support scalable job and batch processing by delegating tasks to multiple IRS instances, either through a master instance or a set of equal peer workers,
so that to improve performance and efficiency.

To handle an increasing volume of job and batch requests, the IRS Order API will be designed to enable horizontal scaling of the IRS. The API should support distributing jobs and batches to multiple IRS instances dynamically, either through a master instance that controls job delegation or through a cluster of equal peer worker instances that coordinate job processing among themselves.

Hints / Details

Decision:
The IRS Order API will be redesigned to support one of the following modes of job and batch delegation:

  • Master Instance Mode: A single master IRS instance will manage job delegation and distribute tasks to multiple worker irs instances.
  • Peer-to-Peer Worker Mode: Multiple IRS instances will act as equal peers, coordinating among themselves to process jobs and batches without a central master instance.

image

Acceptance Criteria

Concept and ADR created covering following criteria

  • The IRS Order API must support job and batch delegation to multiple IRS instances.
  • Concept evaluates multiple approaches : a master instance model and a peer-to-peer worker model or alternatives
  • The solution should ensure that jobs are evenly distributed across available IRS instances to optimize resource utilization.
  • The system should be resilient to failures, with automatic recovery and rebalancing of jobs if an IRS instance becomes unavailable.
  • The API should provide monitoring and logging capabilities to track job statuses, delegation, and instance performance.
  • The API should support secure communication between IRS instances, ensuring data integrity and confidentiality.

Out of Scope

  • ...
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
Status: inbox
Development

No branches or pull requests

1 participant