Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

ED-1242 : Add OCI support superseeds PR 1603 #1608

Open
wants to merge 187 commits into
base: release-5.1.1
Choose a base branch
from
Open

ED-1242 : Add OCI support superseeds PR 1603 #1608

wants to merge 187 commits into from

Conversation

ddevadat
Copy link

For deploy jobs
Deploy/DataPipeline/AnalyticsCore
Deploy/DataPipeline/CoreDataProducts
Deploy/DataPipeline/EdDataProducts
Deploy/DataPipeline/SparkBDSClusterSubmitJobs
Deploy/DataPipeline/SparkClusterSubmitJobs-Response
Deploy/DataPipeline/SparkClusterSubmitJobs-Userinfo

ddevadat and others added 30 commits December 22, 2022 13:16
@ddevadat
added artifact upload role for oci oss
12de5e6 
Signed-off-by: Deepak Devadathan <[email protected]>
@ddevadat
overwrite file in oss if the file exists
ea2c778 
Signed-off-by: Deepak Devadathan <[email protected]>
@ddevadat
added artifact download for oci role
852a610 
Signed-off-by: Deepak Devadathan <[email protected]>
@ddevadat
added role to install oci-cli
3ee3b85 
Signed-off-by: Deepak Devadathan <[email protected]>
@ddevadat
added csp choice based cloud cli installation
3ee652e 
Signed-off-by: Deepak Devadathan <[email protected]>
@ddevadat
added env variables for oci cli for analytics user
4ffea4d 
Signed-off-by: Deepak Devadathan <[email protected]>
@ddevadat
install oci cli as analytics user
8a70a47 
Signed-off-by: Deepak Devadathan <[email protected]>
@ddevadat
adding oci cli in PATH variable for analytics user
69f2e83 
Signed-off-by: Deepak Devadathan <[email protected]>
@ddevadat
install oci-cli in analytics home location
4ce637d 
Signed-off-by: Deepak Devadathan <[email protected]>
@ddevadat
disabled cloud cli temporarlily
2733374 
Signed-off-by: Deepak Devadathan <[email protected]>
@ddevadat
setting env variable with double quotes
2e4cf61 
Signed-off-by: Deepak Devadathan <[email protected]>
@ddevadat
placed oci cli env variables in /etc/environment file
2bbab17 
Signed-off-by: Deepak Devadathan <[email protected]>
@ddevadat
added jinja2 template for oci cli config
d0d1b1d 
Signed-off-by: Deepak Devadathan <[email protected]>
@ddevadat
renamed dir templates to template
cc11113 
Signed-off-by: Deepak Devadathan <[email protected]>
@ddevadat
disabled only oci cli temporarily
2e11eaf 
Signed-off-by: Deepak Devadathan <[email protected]>
@ddevadat
testing idempotency for oci cli
054d9db 
Signed-off-by: Deepak Devadathan <[email protected]>
@heungheung
change Spark provision task with Ruby 2.6
b1de737 
In release 4.6.0, Ruby 2.6 is being used. Don't know why in 4.10 / 5.0, Ruby suddenly became 2.2.

In fact, there is NO ruby2.2-dev for bionic. Changing to Ruby 2.6 to proceed
@ddevadat
added apiversion selector
07d4e5e 
Signed-off-by: Deepak Devadathan <[email protected]>
@ddevadat
Merge branch 'oci-5.1.0' of https://github.com/ocisunbird/sunbird-dat…
17de1fa 
…a-pipeline into oci-5.1.0
@ddevadat
added the oci oss bucket upload
9ba6497 
Signed-off-by: Deepak Devadathan <[email protected]>
@ddevadat
added full path of oci from analaytics home
5fa0e00 
Signed-off-by: Deepak Devadathan <[email protected]>
@ddevadat
correction in oci cli location
329e820 
Signed-off-by: Deepak Devadathan <[email protected]>
@ddevadat
check bucket existence before creating
86b024d 
Signed-off-by: Deepak Devadathan <[email protected]>
@ddevadat
testing the logic for register variable
51894db 
Signed-off-by: Deepak Devadathan <[email protected]>
@ddevadat
using full path for oci cli
cbb93c1 
Signed-off-by: Deepak Devadathan <[email protected]>
@ddevadat
testing the bucket check
47ccff0 
Signed-off-by: Deepak Devadathan <[email protected]>
@ddevadat
added the always tag individually
d3b24a9 
Signed-off-by: Deepak Devadathan <[email protected]>
@ddevadat
place an oci os upload command for every upload
3c79310 
Signed-off-by: Deepak Devadathan <[email protected]>
@ddevadat
corrected typo for oci cli command
5e4749e 
Signed-off-by: Deepak Devadathan <[email protected]>
@ddevadat
corrected typo for oci cli command
b7daec6 
Signed-off-by: Deepak Devadathan <[email protected]>
dicdiksha and others added 29 commits August 7, 2023 19:27
@dicdiksha
Merge pull request #16 from manojkumarsah13/oci-5.1.0-JAPACCOE-2839-r…
5bbee98 
…elease-5.1.0-bds-v2-5

Update cluster-config.json.j2
@manojkumarsah13
Update cluster-config.json.j2
f505a60 
Updated executed heartbeat and network timeout
@balasaheb-karjule
Merge pull request #17 from manojkumarsah13/oci-5.1.0-JAPACCOE-2839-r…
acb3562 
…elease-5.1.0-bds-v2-6

Update cluster-config.json.j2
@manojkumarsah13
Update cluster-config.json.j2
4bd6cc7 
Update cluster-config.json.j2 driver memory updated
@balasaheb-karjule
Merge pull request #18 from manojkumarsah13/patch-1
7552d44 
Update cluster-config.json.j2
@manojkumarsah13
Update cluster-config.json.j2
e245128 
Update cluster-config.json.j2
@balasaheb-karjule
Merge pull request #19 from manojkumarsah13/patch-2
b563b95 
Update cluster-config.json.j2
@manojkumarsah13
Update cluster-config.json.j2
43fc84f 
Oracle Suggested Changes
@dicdiksha
Merge pull request #22 from manojkumarsah13/patch-4
4df0562 
Update cluster-config.json.j2
@manojkumarsah13
Update cluster-config.json.j2
bd42a0c 
updated the config
@dicdiksha
Merge pull request #23 from manojkumarsah13/patch-5
c74ac58 
Update cluster-config.json.j2
@manojkumarsah13
Update cluster-config.json.j2
1c2e97b 
Memory configuration changes
@dicdiksha
Merge pull request #24 from manojkumarsah13/patch-6
6238f3e 
Update cluster-config.json.j2
@manojkumarsah13
Update cluster-config.json.j2
939269a 
Memory config changes
@dicdiksha
Merge pull request #25 from manojkumarsah13/patch-7
a467146 
Update cluster-config.json.j2
@manojkumarsah13
Update collection-summary-ingestion-spec.j2
fa3d061 
collection-summary-reports-v2 ingestion Spec updated
@dicdiksha
Merge pull request #30 from manojkumarsah13/patch-8
01933dc 
Update collection-summary-ingestion-spec.j2
@manojkumarsah13
Update cluster-config.json.j2 - Heap memory settings changes
d041265 
Update cluster-config.json.j2 - Heap memory settings changes
@balasaheb-karjule
Merge pull request #31 from manojkumarsah13/patch-9
33a9436 
Update cluster-config.json.j2 - Heap memory settings changes
@shubham72a
Update cluster-config.json.j2
e329e2b 
increase buffer size
@balasaheb-karjule
Merge pull request #32 from shubham72a/patch-1
f634e64 
Update cluster-config.json.j2 - increase buffer size
@shubham72a
Update cluster-config.json.j2-increase heap memory to 4G
a893537
@balasaheb-karjule
Merge pull request #34 from shubham72a/patch-2
2523ee4 
Update cluster-config.json.j2-increase heap memory to 4G
@shubham72a
Update jets3t.j2-increas buffer size to 10
88e3840
@dicdiksha
Merge pull request #35 from shubham72a/patch-3
97af769 
Update jets3t.j2-increas buffer size to 10 GB
@shubham72a
Update jets3t.j2-set buffer-size to 8gb
942ffbb
@lakshman-uppada1
Merge pull request #36 from shubham72a/patch-4
5e5472e 
Update jets3t.j2-set buffer-size to 8gb
@shubham72a
Update jets3t.j2-revert buffer size
faca646
@balasaheb-karjule
Merge pull request #37 from shubham72a/patch-5
e33c574 
Update jets3t.j2-revert buffer size
@sonarqubecloud SonarQubeCloud
Copy link

Kudos, SonarCloud Quality Gate passed!    Quality Gate passed

Bug A 0 Bugs
Vulnerability A 0 Vulnerabilities
Security Hotspot A 0 Security Hotspots
Code Smell A 0 Code Smells

No Coverage information No Coverage information
No Duplication information No Duplication information

warning The version of Java (11.0.8) you have used to run this analysis is deprecated and we will stop accepting it soon. Please update to at least Java 17.
Read more here

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
8 participants
@ddevadat @heungheung @subhashchandrab @manojkumarsah13 @dicdiksha @balasaheb-karjule @shubham72a @lakshman-uppada1