Skip to content

Commit

Permalink
Update 2024-10-22-credit-agricole-case-study.md (#1903)
Browse files Browse the repository at this point in the history
Co-authored-by: ca-jle <[email protected]>
  • Loading branch information
Ben8t and ca-jle authored Oct 24, 2024
1 parent eed8073 commit 08fd2f1
Showing 1 changed file with 6 additions and 7 deletions.
13 changes: 6 additions & 7 deletions content/blogs/2024-10-22-credit-agricole-case-study.md
Original file line number Diff line number Diff line change
@@ -1,23 +1,23 @@
---
title: "Scaling Data Operations at Crédit Agricole with Kestra"
description: Julien Legrand from Crédit Agricole shares how the bank’s Data Team use Kestra to optimize infrastructure management, enhance security, and scale data pipelines for mission-critical operations across 50+ MongoDB clusters.
description: Julien Legrand from Crédit Agricole shares how the bank’s Data Team use Kestra to optimize infrastructure management, enhance security, and scale data pipelines for mission-critical operations across 100+ clusters serving nosql, mlops, streaming & big data usages.
date: 2024-10-22T17:00:00
category: Solutions
author:
name: Julien Legrand
image: jlegrand
role: Product Owner Data
role: Data & AI Product Owner
image: /blogs/2024-10-22-credit-agricole-case-study.jpg
---

CAGIP is the IT production entity of Crédit Agricole Group, a leading French banking and financial services company, acting as the central provider of IT services for the entire group. In the Data team we own several products that are used by different entities to host transactional, streaming or analytical data. We provide most of our solutions as SaaS hosted on a private cloud. Expectations regarding security, regulation and high availability imply specific needs regarding infrastructure operations.

## The challenges we faced in scaling data pipelines.

For a long time, we used Ansible & Jenkins to manage all the tasks that must be done on every of our deployments. Lately, we faced a real scale up in the number of clusters and services we manage. To keep up all the requirements related to hosting critical services in a banking environment we have to:
⁃ parallelize more (operating on +50 mongoDB clusters)
⁃ optimize the resources consumed (using containers instead of virtual machines)
⁃ and enhance the security (activating key rotation at scale)
For a long time, we used Ansible & Jenkins to manage all the tasks that must be done on every of our deployments. Lately, we faced a real scale up in the number of clusters and services we manage. To keep up all the requirements related to hosting critical services in a banking environment we have to:
⁃ parallelize more (operating on +50 mongoDB clusters)
⁃ optimize the resources consumed (using containers instead of virtual machines)
⁃ and enhance the security (activating key rotation at scale)

## Experimenting with Kestra

Expand All @@ -41,7 +41,6 @@ We see many obvious use cases:

But I’m sure that this will be just a start and we’ll soon cover more complex processes like certificates management that we want to deal with an event driven approach.

As we continue to expand Kestra’s role across our operations, we’re excited to explore even more use cases in the future. If this resonates with your challenges, consider giving Kestra a star on GitHub and becoming a part of the growing community. You can also join the conversation and share your feedback directly on Slack or by opening a GitHub issue.

As we continue to expand Kestra’s role across our operations, we’re excited to explore even more use cases in the future. If this resonates with your challenges, consider giving Kestra [a GitHub star](https://github.com/kestra-io/kestra) and join [the community](https://kestra.io/slack).

Expand Down

0 comments on commit 08fd2f1

Please sign in to comment.