Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Logging message handling. #67

Open
YooSunYoung opened this issue Aug 7, 2024 · 0 comments
Open

Logging message handling. #67

YooSunYoung opened this issue Aug 7, 2024 · 0 comments
Labels
bug Something isn't working

Comments

@YooSunYoung
Copy link
Contributor

def _individual_message_commit(offline_ingestors, consumer, logger):
    logger.info("{} offline ingestors running".format(len(offline_ingestors)))
    for job_id, job_item in offline_ingestors.items():
        result = job_item["proc"].poll()
        if result is not None:
            logger.info("Offline ingestor for job id {} ended with result {}".format(job_id,result))
            if result == 0:
                logger.info("Executing commit for message with job id {}".format(job_id))
                consumer.commit(message=job_item["message"])
            logger.info("Removed ingestor for message with job id {} from queue".format(job_id))

Currently this code is run only when config.kafka.individual_message_commit option is active.
But it has some logging lines that need to be run always.

@YooSunYoung YooSunYoung added the bug Something isn't working label Aug 7, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

1 participant