Skip to content

Commit

Permalink
[IMP] queue_job_cron_jobrunner: pre-commit auto fixes
Browse files Browse the repository at this point in the history
  • Loading branch information
sanderlienaerts committed Dec 1, 2023
1 parent e786195 commit 87eb6f0
Show file tree
Hide file tree
Showing 11 changed files with 129 additions and 107 deletions.
81 changes: 44 additions & 37 deletions queue_job_cron_jobrunner/README.rst
Original file line number Diff line number Diff line change
Expand Up @@ -17,31 +17,34 @@ Queue Job Cron Jobrunner
:target: http://www.gnu.org/licenses/agpl-3.0-standalone.html
:alt: License: AGPL-3
.. |badge3| image:: https://img.shields.io/badge/github-OCA%2Fqueue-lightgray.png?logo=github
:target: https://github.com/OCA/queue/tree/16.0/queue_job_cron_jobrunner
:target: https://github.com/OCA/queue/tree/17.0/queue_job_cron_jobrunner
:alt: OCA/queue
.. |badge4| image:: https://img.shields.io/badge/weblate-Translate%20me-F47D42.png
:target: https://translation.odoo-community.org/projects/queue-16-0/queue-16-0-queue_job_cron_jobrunner
:target: https://translation.odoo-community.org/projects/queue-17-0/queue-17-0-queue_job_cron_jobrunner
:alt: Translate me on Weblate
.. |badge5| image:: https://img.shields.io/badge/runboat-Try%20me-875A7B.png
:target: https://runboat.odoo-community.org/builds?repo=OCA/queue&target_branch=16.0
:target: https://runboat.odoo-community.org/builds?repo=OCA/queue&target_branch=17.0
:alt: Try me on Runboat

|badge1| |badge2| |badge3| |badge4| |badge5|

This module implements a simple ``queue.job`` runner using ``ir.cron`` triggers.
This module implements a simple ``queue.job`` runner using ``ir.cron``
triggers.

It's meant to be used on environments where the regular job runner can't be run, like
on Odoo.sh.
It's meant to be used on environments where the regular job runner can't
be run, like on Odoo.sh.

Unlike the regular job runner, where jobs are dispatched to the HttpWorkers, jobs are
processed on the CronWorker threads by the job runner crons. This is a design decision
because:
Unlike the regular job runner, where jobs are dispatched to the
HttpWorkers, jobs are processed on the CronWorker threads by the job
runner crons. This is a design decision because:

* Odoo.sh puts HttpWorkers to sleep when there's no network activity
* HttpWorkers are meant for traffic. Users shouldn't pay the price of background tasks.
- Odoo.sh puts HttpWorkers to sleep when there's no network activity
- HttpWorkers are meant for traffic. Users shouldn't pay the price of
background tasks.

For now, it only implements the most basic features of the ``queue_job`` runner, notably
no channel capacity nor priorities. Please check the ROADMAP for further details.
For now, it only implements the most basic features of the ``queue_job``
runner, notably no channel capacity nor priorities. Please check the
ROADMAP for further details.

.. IMPORTANT::
This is an alpha version, the data model and design can change at any time without warning.
Expand All @@ -56,62 +59,66 @@ no channel capacity nor priorities. Please check the ROADMAP for further details
Configuration
=============

.. warning::
Warning

Don't use this module if you're already running the regular ``queue_job`` runner.
Don't use this module if you're already running the regular
``queue_job`` runner.

For the easiest case, no configuration is required besides installing
the module.

For the easiest case, no configuration is required besides installing the module.
To avoid CronWorker CPU timeout from abruptly stopping the job
processing cron, it's recommended to launch Odoo with
``--limit-time-real-cron=0``, to disable the CronWorker timeout
altogether.

To avoid CronWorker CPU timeout from abruptly stopping the job processing cron, it's
recommended to launch Odoo with ``--limit-time-real-cron=0``, to disable the CronWorker
timeout altogether.
Note

.. note::
In Odoo.sh, this is done by default.

In Odoo.sh, this is done by default.
Parallel execution of jobs can be achieved by leveraging multiple
``ir.cron`` records:


Parallel execution of jobs can be achieved by leveraging multiple ``ir.cron`` records:

* Make sure you have enough CronWorkers available (Odoo CLI ``--max-cron-threads``)
* Duplicate the ``queue_job_cron`` cron record as many times as needed, until you have
as much records as cron workers.
- Make sure you have enough CronWorkers available (Odoo CLI
``--max-cron-threads``)
- Duplicate the ``queue_job_cron`` cron record as many times as needed,
until you have as much records as cron workers.

Known issues / Roadmap
======================

* Support channel capacity and priority. (See ``_acquire_one_job``)
* Gracefully handle CronWorker CPU timeouts. (See ``_job_runner``)
* Commit transaction after job state updated to started. (See ``_process``)
- Support channel capacity and priority. (See ``_acquire_one_job``)
- Gracefully handle CronWorker CPU timeouts. (See ``_job_runner``)
- Commit transaction after job state updated to started. (See
``_process``)

Bug Tracker
===========

Bugs are tracked on `GitHub Issues <https://github.com/OCA/queue/issues>`_.
In case of trouble, please check there if your issue has already been reported.
If you spotted it first, help us to smash it by providing a detailed and welcomed
`feedback <https://github.com/OCA/queue/issues/new?body=module:%20queue_job_cron_jobrunner%0Aversion:%2016.0%0A%0A**Steps%20to%20reproduce**%0A-%20...%0A%0A**Current%20behavior**%0A%0A**Expected%20behavior**>`_.
`feedback <https://github.com/OCA/queue/issues/new?body=module:%20queue_job_cron_jobrunner%0Aversion:%2017.0%0A%0A**Steps%20to%20reproduce**%0A-%20...%0A%0A**Current%20behavior**%0A%0A**Expected%20behavior**>`_.

Do not contact contributors directly about support or help with technical issues.

Credits
=======

Authors
~~~~~~~
-------

* Camptocamp SA

Contributors
~~~~~~~~~~~~
------------

* `Camptocamp <https://www.camptocamp.com>`_
- `Camptocamp <https://www.camptocamp.com>`__

* Iván Todorovich <[email protected]>
- Iván Todorovich <[email protected]>

Maintainers
~~~~~~~~~~~
-----------

This module is maintained by the OCA.

Expand All @@ -131,6 +138,6 @@ Current `maintainer <https://odoo-community.org/page/maintainer-role>`__:

|maintainer-ivantodorovich|

This module is part of the `OCA/queue <https://github.com/OCA/queue/tree/16.0/queue_job_cron_jobrunner>`_ project on GitHub.
This module is part of the `OCA/queue <https://github.com/OCA/queue/tree/17.0/queue_job_cron_jobrunner>`_ project on GitHub.

You are welcome to contribute. To learn how please visit https://odoo-community.org/page/Contribute.
3 changes: 3 additions & 0 deletions queue_job_cron_jobrunner/pyproject.toml
Original file line number Diff line number Diff line change
@@ -0,0 +1,3 @@
[build-system]
requires = ["whool"]
build-backend = "whool.buildapi"
24 changes: 24 additions & 0 deletions queue_job_cron_jobrunner/readme/CONFIGURE.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,24 @@
Warning

Don't use this module if you're already running the regular `queue_job`
runner.

For the easiest case, no configuration is required besides installing
the module.

To avoid CronWorker CPU timeout from abruptly stopping the job
processing cron, it's recommended to launch Odoo with
`--limit-time-real-cron=0`, to disable the CronWorker timeout
altogether.

Note

In Odoo.sh, this is done by default.

Parallel execution of jobs can be achieved by leveraging multiple
`ir.cron` records:

- Make sure you have enough CronWorkers available (Odoo CLI
`--max-cron-threads`)
- Duplicate the `queue_job_cron` cron record as many times as needed,
until you have as much records as cron workers.
21 changes: 0 additions & 21 deletions queue_job_cron_jobrunner/readme/CONFIGURE.rst

This file was deleted.

3 changes: 3 additions & 0 deletions queue_job_cron_jobrunner/readme/CONTRIBUTORS.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,3 @@
- [Camptocamp](https://www.camptocamp.com)

> - Iván Todorovich \<<[email protected]>\>
3 changes: 0 additions & 3 deletions queue_job_cron_jobrunner/readme/CONTRIBUTORS.rst

This file was deleted.

17 changes: 17 additions & 0 deletions queue_job_cron_jobrunner/readme/DESCRIPTION.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,17 @@
This module implements a simple `queue.job` runner using `ir.cron`
triggers.

It's meant to be used on environments where the regular job runner can't
be run, like on Odoo.sh.

Unlike the regular job runner, where jobs are dispatched to the
HttpWorkers, jobs are processed on the CronWorker threads by the job
runner crons. This is a design decision because:

- Odoo.sh puts HttpWorkers to sleep when there's no network activity
- HttpWorkers are meant for traffic. Users shouldn't pay the price of
background tasks.

For now, it only implements the most basic features of the `queue_job`
runner, notably no channel capacity nor priorities. Please check the
ROADMAP for further details.
14 changes: 0 additions & 14 deletions queue_job_cron_jobrunner/readme/DESCRIPTION.rst

This file was deleted.

4 changes: 4 additions & 0 deletions queue_job_cron_jobrunner/readme/ROADMAP.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,4 @@
- Support channel capacity and priority. (See `_acquire_one_job`)
- Gracefully handle CronWorker CPU timeouts. (See `_job_runner`)
- Commit transaction after job state updated to started. (See
`_process`)
3 changes: 0 additions & 3 deletions queue_job_cron_jobrunner/readme/ROADMAP.rst

This file was deleted.

63 changes: 34 additions & 29 deletions queue_job_cron_jobrunner/static/description/index.html
Original file line number Diff line number Diff line change
Expand Up @@ -369,19 +369,22 @@ <h1 class="title">Queue Job Cron Jobrunner</h1>
!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!
!! source digest: sha256:ea15f976f55eddd46d51fc2bb989455756811717bbdc8f69764d02a0d6014b32
!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!! -->
<p><a class="reference external image-reference" href="https://odoo-community.org/page/development-status"><img alt="Alpha" src="https://img.shields.io/badge/maturity-Alpha-red.png" /></a> <a class="reference external image-reference" href="http://www.gnu.org/licenses/agpl-3.0-standalone.html"><img alt="License: AGPL-3" src="https://img.shields.io/badge/licence-AGPL--3-blue.png" /></a> <a class="reference external image-reference" href="https://github.com/OCA/queue/tree/16.0/queue_job_cron_jobrunner"><img alt="OCA/queue" src="https://img.shields.io/badge/github-OCA%2Fqueue-lightgray.png?logo=github" /></a> <a class="reference external image-reference" href="https://translation.odoo-community.org/projects/queue-16-0/queue-16-0-queue_job_cron_jobrunner"><img alt="Translate me on Weblate" src="https://img.shields.io/badge/weblate-Translate%20me-F47D42.png" /></a> <a class="reference external image-reference" href="https://runboat.odoo-community.org/builds?repo=OCA/queue&amp;target_branch=16.0"><img alt="Try me on Runboat" src="https://img.shields.io/badge/runboat-Try%20me-875A7B.png" /></a></p>
<p>This module implements a simple <tt class="docutils literal">queue.job</tt> runner using <tt class="docutils literal">ir.cron</tt> triggers.</p>
<p>It’s meant to be used on environments where the regular job runner can’t be run, like
on Odoo.sh.</p>
<p>Unlike the regular job runner, where jobs are dispatched to the HttpWorkers, jobs are
processed on the CronWorker threads by the job runner crons. This is a design decision
because:</p>
<p><a class="reference external image-reference" href="https://odoo-community.org/page/development-status"><img alt="Alpha" src="https://img.shields.io/badge/maturity-Alpha-red.png" /></a> <a class="reference external image-reference" href="http://www.gnu.org/licenses/agpl-3.0-standalone.html"><img alt="License: AGPL-3" src="https://img.shields.io/badge/licence-AGPL--3-blue.png" /></a> <a class="reference external image-reference" href="https://github.com/OCA/queue/tree/17.0/queue_job_cron_jobrunner"><img alt="OCA/queue" src="https://img.shields.io/badge/github-OCA%2Fqueue-lightgray.png?logo=github" /></a> <a class="reference external image-reference" href="https://translation.odoo-community.org/projects/queue-17-0/queue-17-0-queue_job_cron_jobrunner"><img alt="Translate me on Weblate" src="https://img.shields.io/badge/weblate-Translate%20me-F47D42.png" /></a> <a class="reference external image-reference" href="https://runboat.odoo-community.org/builds?repo=OCA/queue&amp;target_branch=17.0"><img alt="Try me on Runboat" src="https://img.shields.io/badge/runboat-Try%20me-875A7B.png" /></a></p>
<p>This module implements a simple <tt class="docutils literal">queue.job</tt> runner using <tt class="docutils literal">ir.cron</tt>
triggers.</p>
<p>It’s meant to be used on environments where the regular job runner can’t
be run, like on Odoo.sh.</p>
<p>Unlike the regular job runner, where jobs are dispatched to the
HttpWorkers, jobs are processed on the CronWorker threads by the job
runner crons. This is a design decision because:</p>
<ul class="simple">
<li>Odoo.sh puts HttpWorkers to sleep when there’s no network activity</li>
<li>HttpWorkers are meant for traffic. Users shouldn’t pay the price of background tasks.</li>
<li>HttpWorkers are meant for traffic. Users shouldn’t pay the price of
background tasks.</li>
</ul>
<p>For now, it only implements the most basic features of the <tt class="docutils literal">queue_job</tt> runner, notably
no channel capacity nor priorities. Please check the ROADMAP for further details.</p>
<p>For now, it only implements the most basic features of the <tt class="docutils literal">queue_job</tt>
runner, notably no channel capacity nor priorities. Please check the
ROADMAP for further details.</p>
<div class="admonition important">
<p class="first admonition-title">Important</p>
<p class="last">This is an alpha version, the data model and design can change at any time without warning.
Expand All @@ -404,39 +407,41 @@ <h1 class="title">Queue Job Cron Jobrunner</h1>
</div>
<div class="section" id="configuration">
<h1><a class="toc-backref" href="#toc-entry-1">Configuration</a></h1>
<div class="admonition warning">
<p class="first admonition-title">Warning</p>
<p class="last">Don’t use this module if you’re already running the regular <tt class="docutils literal">queue_job</tt> runner.</p>
</div>
<p>For the easiest case, no configuration is required besides installing the module.</p>
<p>To avoid CronWorker CPU timeout from abruptly stopping the job processing cron, it’s
recommended to launch Odoo with <tt class="docutils literal"><span class="pre">--limit-time-real-cron=0</span></tt>, to disable the CronWorker
timeout altogether.</p>
<div class="admonition note">
<p class="first admonition-title">Note</p>
<p class="last">In Odoo.sh, this is done by default.</p>
</div>
<p>Parallel execution of jobs can be achieved by leveraging multiple <tt class="docutils literal">ir.cron</tt> records:</p>
<p>Warning</p>
<p>Don’t use this module if you’re already running the regular
<tt class="docutils literal">queue_job</tt> runner.</p>
<p>For the easiest case, no configuration is required besides installing
the module.</p>
<p>To avoid CronWorker CPU timeout from abruptly stopping the job
processing cron, it’s recommended to launch Odoo with
<tt class="docutils literal"><span class="pre">--limit-time-real-cron=0</span></tt>, to disable the CronWorker timeout
altogether.</p>
<p>Note</p>
<p>In Odoo.sh, this is done by default.</p>
<p>Parallel execution of jobs can be achieved by leveraging multiple
<tt class="docutils literal">ir.cron</tt> records:</p>
<ul class="simple">
<li>Make sure you have enough CronWorkers available (Odoo CLI <tt class="docutils literal"><span class="pre">--max-cron-threads</span></tt>)</li>
<li>Duplicate the <tt class="docutils literal">queue_job_cron</tt> cron record as many times as needed, until you have
as much records as cron workers.</li>
<li>Make sure you have enough CronWorkers available (Odoo CLI
<tt class="docutils literal"><span class="pre">--max-cron-threads</span></tt>)</li>
<li>Duplicate the <tt class="docutils literal">queue_job_cron</tt> cron record as many times as needed,
until you have as much records as cron workers.</li>
</ul>
</div>
<div class="section" id="known-issues-roadmap">
<h1><a class="toc-backref" href="#toc-entry-2">Known issues / Roadmap</a></h1>
<ul class="simple">
<li>Support channel capacity and priority. (See <tt class="docutils literal">_acquire_one_job</tt>)</li>
<li>Gracefully handle CronWorker CPU timeouts. (See <tt class="docutils literal">_job_runner</tt>)</li>
<li>Commit transaction after job state updated to started. (See <tt class="docutils literal">_process</tt>)</li>
<li>Commit transaction after job state updated to started. (See
<tt class="docutils literal">_process</tt>)</li>
</ul>
</div>
<div class="section" id="bug-tracker">
<h1><a class="toc-backref" href="#toc-entry-3">Bug Tracker</a></h1>
<p>Bugs are tracked on <a class="reference external" href="https://github.com/OCA/queue/issues">GitHub Issues</a>.
In case of trouble, please check there if your issue has already been reported.
If you spotted it first, help us to smash it by providing a detailed and welcomed
<a class="reference external" href="https://github.com/OCA/queue/issues/new?body=module:%20queue_job_cron_jobrunner%0Aversion:%2016.0%0A%0A**Steps%20to%20reproduce**%0A-%20...%0A%0A**Current%20behavior**%0A%0A**Expected%20behavior**">feedback</a>.</p>
<a class="reference external" href="https://github.com/OCA/queue/issues/new?body=module:%20queue_job_cron_jobrunner%0Aversion:%2017.0%0A%0A**Steps%20to%20reproduce**%0A-%20...%0A%0A**Current%20behavior**%0A%0A**Expected%20behavior**">feedback</a>.</p>
<p>Do not contact contributors directly about support or help with technical issues.</p>
</div>
<div class="section" id="credits">
Expand Down Expand Up @@ -468,7 +473,7 @@ <h2><a class="toc-backref" href="#toc-entry-7">Maintainers</a></h2>
promote its widespread use.</p>
<p>Current <a class="reference external" href="https://odoo-community.org/page/maintainer-role">maintainer</a>:</p>
<p><a class="reference external image-reference" href="https://github.com/ivantodorovich"><img alt="ivantodorovich" src="https://github.com/ivantodorovich.png?size=40px" /></a></p>
<p>This module is part of the <a class="reference external" href="https://github.com/OCA/queue/tree/16.0/queue_job_cron_jobrunner">OCA/queue</a> project on GitHub.</p>
<p>This module is part of the <a class="reference external" href="https://github.com/OCA/queue/tree/17.0/queue_job_cron_jobrunner">OCA/queue</a> project on GitHub.</p>
<p>You are welcome to contribute. To learn how please visit <a class="reference external" href="https://odoo-community.org/page/Contribute">https://odoo-community.org/page/Contribute</a>.</p>
</div>
</div>
Expand Down

0 comments on commit 87eb6f0

Please sign in to comment.