Skip to content

Commit

Permalink
Uploading Talend connection doc and fixing the links to jdbc-thin-wal…
Browse files Browse the repository at this point in the history
…let connection
  • Loading branch information
rrumale committed Aug 29, 2023
1 parent 452cd03 commit 97101d2
Show file tree
Hide file tree
Showing 20 changed files with 239 additions and 10 deletions.
File renamed without changes.
6 changes: 3 additions & 3 deletions connector-template/workshops/freetier/manifest.json
Original file line number Diff line number Diff line change
Expand Up @@ -10,17 +10,17 @@
{
"title": "Connecting with Wallet",
"description": "Connecting with Wallet",
"filename": "../../common/wallet/wallet.md"
"filename": "../../../common/wallet/wallet.md"
},
{
"title": "Connecting without Wallet",
"description": "Connecting without Wallet",
"filename": "../../common/tls-no-wallet/no-wallet.md"
"filename": "../../../common/tls-no-wallet/no-wallet.md"
},
{
"title": "JDBC Configuration",
"description": "JDBC Configuration",
"filename": "../../common/jdbc/jdbc-thin-wallet.md"
"filename": "../../../common/jdbc/jdbc-thin-wallet.md"
}
]
}
2 changes: 1 addition & 1 deletion data-virtuality-pipes/workshops/freetier/manifest.json
Original file line number Diff line number Diff line change
Expand Up @@ -15,7 +15,7 @@
{
"title": "Connecting with Wallet",
"description": "Wallet",
"filename": "../../../common/wallet/wallet.md"
"filename": "../../../common/wallet/jdbc-thin-wallet"
}
]
}
2 changes: 1 addition & 1 deletion dataiku/workshops/freetier/manifest.json
Original file line number Diff line number Diff line change
Expand Up @@ -20,7 +20,7 @@
{
"title": "Appendix 3. Oracle JDBC Download and Configuration",
"description": "Configuration",
"filename": "../../../common/jdbc/jdbc-thin.md"
"filename": "../../../common/jdbc/jdbc-thin-wallet"
}
]
}
2 changes: 1 addition & 1 deletion flexdeploy/workshops/freetier/manifest.json
Original file line number Diff line number Diff line change
Expand Up @@ -20,7 +20,7 @@
{
"title": "JDBC Configuration",
"description": "JDBC Configuration",
"filename": "../../../common/jdbc/jdbc-thin.md"
"filename": "../../../common/jdbc/jdbc-thin-wallet.md"
}
]
}
2 changes: 1 addition & 1 deletion sap-business-objects/workshops/freetier/manifest.json
Original file line number Diff line number Diff line change
Expand Up @@ -20,7 +20,7 @@
{
"title": "Appendix 3. Oracle JDBC Download and Configuration",
"description": "Configuration",
"filename": "../../../common/jdbc/jdbc-thin.md"
"filename": "../../../common/jdbc/jdbc-thin-wallet.md"
}
]
}
6 changes: 3 additions & 3 deletions simba/workshops/freetier/manifest.json
Original file line number Diff line number Diff line change
Expand Up @@ -10,17 +10,17 @@
{
"title": "Connecting with Wallet",
"description": "Connecting with Wallet",
"filename": "../../common/wallet/wallet.md"
"filename": "../../../common/wallet/wallet.md"
},
{
"title": "Connecting without Wallet",
"description": "Connecting without Wallet",
"filename": "../../common/tls-no-wallet/no-wallet.md"
"filename": "../../../common/tls-no-wallet/no-wallet.md"
},
{
"title": "JDBC Configuration",
"description": "JDBC Configuration",
"filename": "../../common/jdbc/jdbc-thin-wallet.md"
"filename": "../../../common/jdbc/jdbc-thin-wallet.md"
}
]
}
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added talend/images/check_module_installed.jpeg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added talend/images/create-new-connection.jpeg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added talend/images/jar_file_selection.jpeg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added talend/images/list-installed-modules.jpeg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added talend/images/talend-connection-flow-chart.jpg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added talend/images/test-connection.jpeg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added talend/images/three_dots_icon.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added talend/images/windows_navgation.jpeg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
64 changes: 64 additions & 0 deletions talend/talend-connection-adw.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,64 @@
**Creating a connection from Talend ETL Tool to Oracle Autonomous Data Warehouse**


|**Certification Matrix** |**Version** |
| - | - |
|Talend ETL Tool |7\.x or higher |
|Oracle JDBC |ojdbc8.jar or higher |

Here is the overview of the install and configuration process to get Talend connected to ADWC ![](../images/Aspose.W.aa831d9e-0d9b-4016-80e6-79b47d4aaaa2.001.png)

Talend needs Oracle ![](../images/Aspose.W.aa831d9e-0d9b-4016-80e6-79b47d4aaaa2.002.png)![](../images/Aspose.W.aa831d9e-0d9b-4016-80e6-79b47d4aaaa2.003.png)Provision Download credentials ojdbc8.jar to connect to ![](../images/Aspose.W.aa831d9e-0d9b-4016-80e6-79b47d4aaaa2.004.png)ADWC file to Talend ETL ADWC

system

Install Configure Test Talend ETL ![ref1] ![ref1] Download ojdbc8.jar ![ref1] Talent ETL JOB connection

from otn.oracle.com

1. This document assumes that the Autonomous Data Warehouse has been provisioned and the corresponding client credentials.zip file has been downloaded to the system that has the Talend installed. For the Oracle documentation to provision ADW please check[ here.](https://docs.oracle.com/en/cloud/paas/autonomous-database/adbsa/autonomous-provision.html#GUID-0B230036-0A05-4CA3-AF9D-97A255AE0C08) Also check[ Downloading Client Credentials (Wallets). ](https://docs.oracle.com/en/cloud/paas/autonomous-database/adbsa/connect-download-wallet.html#GUID-B06202D2-0597-41AA-9481-3B174F75D4B1)
1. Follow the instructions from the Talend documentation to install the software on the desktop. As a prerequisite make sure that you have installed the Oracle JDK and configured for JDBC prerequisites.
1. All connections to Autonomous Data Warehouse use certificate-based authentication and Secure Sockets Layer (SSL). Copy the client credentials file that you downloaded in step 1 to the system running the Talend ETL and uncompress it into a secure folder.
1. Download ojdbc8.jar from the Oracle website. You need it to connect Talend 7.x to ADW. If you currently have Talend 7.x installed check to see if ojdbc7.jar has been configured. You need to replace ojdbc7.jar with ojdbc8.jar You could still create an ETL job to load ojdbc8.jar (TLibraryLoad) in your Job Design Canvas, and override the existing ojdbc7.jar configuration.
5. The simpler solution is to go through a fresh install of Talend 7.x and configure ojdbc8.jar.Download the latest 18.3 JDBC Thin driver (ojdbc8.jar and ucp.jar) from[ Oracle Database 18c (18.3) JDBC Driver & UCP Downloads.](https://www.oracle.com/technetwork/database/application-development/jdbc/downloads/jdbc-ucp-183-5013470.html)
5. You also need the additional jars: oraclepki.jar, osdt\_core.jar, and osdt\_cert.jar for use with Oracle wallets. Include them in your classpath.![](../images/Aspose.W.aa831d9e-0d9b-4016-80e6-79b47d4aaaa2.006.png)
5. In the Talend studio, display the Module View navigate to Window à Show view… à search for “Module” à click Module.

![](../images/Aspose.W.aa831d9e-0d9b-4016-80e6-79b47d4aaaa2.007.jpeg)

8. Search for ojdbc7.jar and click on ![](../images/Aspose.W.aa831d9e-0d9b-4016-80e6-79b47d4aaaa2.008.png)

![](../images/Aspose.W.aa831d9e-0d9b-4016-80e6-79b47d4aaaa2.009.jpeg)

9. Browse to the directory where you downloaded ojdbc8.jar in step 4 to replace ojdbc7.jar If ojdbc7.jar is already installed, you will see error that the module is already installed.

![](../images/Aspose.W.aa831d9e-0d9b-4016-80e6-79b47d4aaaa2.010.jpeg)

10. Once the ojdbc8.jar driver is loaded, you can now create a Metadata DB connection. Click Metadataà Database Connectionà Create Connection.

![](../images/Aspose.W.aa831d9e-0d9b-4016-80e6-79b47d4aaaa2.011.jpeg)

Enter connection name and click next.

11. Choose Oracle Custom driver, enter the login username and password. And enter the jdbc url. Here is a sample syntax/example: **jdbc:oracle:thin:@(description=(address=(protocol=tcps)(port=1522 )(host=adwcHostName))(connect\_data=(service\_name=serviceName))(security=(my\_wallet \_directory=/your wallet/wallet-directory-path))**

Note- in the my\_wallet\_directory you have to use your complete wallet directory path.

Add the following in “Additional Parameters” **javax.net.ssl.trustStoreType=SSO & javax.net.ssl.keyStoreType=SSO**

Enable check box for “Use Encryption“ and “Need Client Authentication”. Enter the full path for the cwallet.sso file extracted from the credentials.zip in step 1 and add it to the TrustStore and KeyStore parameters. Password is not required for the cwallet.sso file. Click “Test Connection”.

For the first time you “Test Connection” a pop-up window will appear that will ask for more jar files to be installed. Click “Download and Install All Modules Available”.

![](../images/Aspose.W.aa831d9e-0d9b-4016-80e6-79b47d4aaaa2.012.jpeg)

12. Click “Test Connection” again.

![](../images/Aspose.W.aa831d9e-0d9b-4016-80e6-79b47d4aaaa2.013.jpeg)

A message box will appear indicating that the connection was successful. You have now successfully validated a connection from Talend 7.x to ADW. You could use this DbConnection object in your job design canvas to connect to ADW

13. If you want to execute job from different source, initialize the Database connection with in the ETL job as pre job to run the job successfully.
** 6![](../images/Aspose.W.aa831d9e-0d9b-4016-80e6-79b47d4aaaa2.014.png)

[ref1]: ../images/Aspose.W.aa831d9e-0d9b-4016-80e6-79b47d4aaaa2.005.png
77 changes: 77 additions & 0 deletions talend/talend-connector-guide.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,77 @@
**Introduction**

Talend is an ETL tool for Data Integration. It provides software solutions for data preparation, data quality, data integration, application integration, data management and big data.

Here is the overview of the install and configuration process to get Talend connected to ADWC.
![Talend Connection Flow Chart](./images/talend-connection-flow-chart.jpg)

| Validation Matrix | Version |
| --- | --- |
| Talend ETL Tool | 7\.x or higher |
| Oracle JDBC | ojdbc8.jar or higher |

### **Prerequisites**

- Required access and credits to provision ADWC instance on Oracle Cloud.
- Download Oracle JDBC Thin driver is downloaded on the app server.
- If ADWC is already configured you have the ADMIN user password and ADB Wallet is downloaded on app server.
- Talend needs Oracle Provision Download credentials ojdbc8.jar to connect to ADWC file to Talend ETL ADWC system

## **Configure the Connection**

1. This document assumes that the Autonomous Data Warehouse has been provisioned and the corresponding client credentials.zip file has been downloaded to the system that has the Talend installed. For the Oracle documentation to provision ADW please check[ here.](https://docs.oracle.com/en/cloud/paas/autonomous-database/adbsa/autonomous-provision.html#GUID-0B230036-0A05-4CA3-AF9D-97A255AE0C08) Also check[ Downloading Client Credentials (Wallets). ](https://docs.oracle.com/en/cloud/paas/autonomous-database/adbsa/connect-download-wallet.html#GUID-B06202D2-0597-41AA-9481-3B174F75D4B1)

2. Follow the instructions from the Talend documentation to install the software on the desktop. As a prerequisite make sure that you have installed the Oracle JDK and configured for JDBC prerequisites.

3. All connections to Autonomous Data Warehouse use certificate-based authentication and Secure Sockets Layer (SSL). Copy the client credentials file that you downloaded in step 1 to the system running the Talend ETL and uncompress it into a secure folder.

4. Download ojdbc8.jar from the Oracle website. You need it to connect Talend 7.x to ADW. If you currently have Talend 7.x installed check to see if ojdbc7.jar has been configured. You need to replace ojdbc7.jar with ojdbc8.jar You could still create an ETL job to load ojdbc8.jar (TLibraryLoad) in your Job Design Canvas, and override the existing ojdbc7.jar configuration.

5. The simpler solution is to go through a fresh install of Talend 7.x and configure ojdbc8.jar.Download the latest 18.3 JDBC Thin driver (ojdbc8.jar and ucp.jar) from[ Oracle Database 18c (18.3) JDBC Driver & UCP Downloads.](https://www.oracle.com/technetwork/database/application-development/jdbc/downloads/jdbc-ucp-183-5013470.html)

6. You also need the additional jars: oraclepki.jar, osdt\_core.jar, and osdt\_cert.jar for use with Oracle wallets. Include them in your classpath.![](./images/Aspose.W.aa831d9e-0d9b-4016-80e6-79b47d4aaaa2.006.png)

7. In the Talend studio, display the Module View navigate to Window -> Show view… -> search for “Module” -> click Module.

![Navigtation to Modules](./images/windows_navgation.jpeg)

8. Search for ojdbc7.jar and click on ![Three dots icon](./images/three_dots_icon.png)

![Select the appropriate jar file](./images/jar_file_selection.jpeg)

9. Browse to the directory where you downloaded ojdbc8.jar in step 4 to replace ojdbc7.jar If ojdbc7.jar is already installed, you will see error that the module is already installed.

![](./images/check_module_installed.jpeg)

10. Once the ojdbc8.jar driver is loaded, you can now create a Metadata DB connection. Click Metadata -> Database Connection -> Create Connection.

![](./images/create-new-connection.jpeg)

Enter connection name and click next.

11. Choose Oracle Custom driver, enter the login username and password. And enter the jdbc url. Here is a sample syntax/example: **jdbc:oracle:thin:@(description=(address=(protocol=tcps)(port=1522 )(host=adwcHostName))(connect\_data=(service\_name=serviceName))(security=(my\_wallet \_directory=/your wallet/wallet-directory-path))**

Note- in the my\_wallet\_directory you have to use your complete wallet directory path.

Add the following in “Additional Parameters” **javax.net.ssl.trustStoreType=SSO & javax.net.ssl.keyStoreType=SSO**

Enable check box for “Use Encryption“ and “Need Client Authentication”. Enter the full path for the cwallet.sso file extracted from the credentials.zip in step 1 and add it to the TrustStore and KeyStore parameters. Password is not required for the cwallet.sso file. Click “Test Connection”.

For the first time you “Test Connection” a pop-up window will appear that will ask for more jar files to be installed. Click “Download and Install All Modules Available”.

![](./images/list-installed-modules.jpeg)

12. Click “Test Connection” again.

![](./images/test-connection.jpeg)

A message box will appear indicating that the connection was successful. You have now successfully validated a connection from Talend 7.x to ADW. You could use this DbConnection object in your job design canvas to connect to ADW

13. If you want to execute job from different source, initialize the Database connection with in the ETL job as pre job to run the job successfully.



## **Acknowledgements**
* **Author(s)** - Vijay Balebail, Satyabrata Mishra
* **Contributor(s)** -
* **Last Updated By/Date** -
62 changes: 62 additions & 0 deletions talend/workshops/freetier/index.html
Original file line number Diff line number Diff line change
@@ -0,0 +1,62 @@
<!DOCTYPE html>
<html lang="en">

<head>
<meta charset="utf-8">
<meta http-equiv="X-UA-Compatible" content="IE=edge">
<meta name="viewport" content="width=device-width, initial-scale=1">
<meta name="description" content="Oracle LiveLabs gives you access to Oracle's products to run a wide variety of labs and workshops; allowing you to experience our best technology, live!">
<title>Oracle LiveLabs</title>

<script src="https://oracle-livelabs.github.io/common/redwood-hol/js/jquery-1.11.0.min.js"></script>
<script src="https://oracle-livelabs.github.io/common/redwood-hol/js/jquery-ui-1.10.4.custom.js"></script>
<script src="https://oracle-livelabs.github.io/common/redwood-hol/js/main.min.js"></script>

<link rel="stylesheet" href="https://oracle-livelabs.github.io/common/redwood-hol/css/style.min.css" />
<link rel="shortcut icon" href="https://oracle-livelabs.github.io/common/redwood-hol/img/favicon.ico" />
</head>

<body>
<header class="hol-Header" role="banner">
<div class="hol-Header-wrap">
<div class="hol-Header-logo"><span>Oracle LiveLabs</span></div>
<a href="https://developer.oracle.com/livelabs" target="_blank" id="livelabs" title="Oracle LiveLabs"></a>
<div class="hol-Header-actions">
<button id="openNav" class="hol-Header-button hol-Header-button--menu rightNav" aria-label="Open Menu"
title="Open Menu">
<span class="hol-Header-toggleIcon"></span>
</button>
</div>
</div>
</header>

<div id="container">
<div id="leftNav">
<div id="toc"></div>
</div>
<div id="contentBox">
<main class="hol-Content" id="module-content"></main>
</div>
</div>

<footer class="hol-Footer">
<a class="hol-Footer-topLink" href="#top">Return to Top</a>
<div id="footer-banner"><div class="footer-row">
<div class="footer-content"><ul class="footer-links">
<li><a href="https://docs.oracle.com/pls/topic/lookup?ctx=en/legal&id=cpyr" target="_blank" aria-label="Open a new window to Oracle legal notices" data-lbl="copyright">© Oracle</a></li>
<li><a href="https://www.oracle.com/corporate/index.html" target="_blank" aria-label="Open a new window to learn more about oracle" data-lbl="about-oracle">About Oracle</a></li>
<li><a href="https://www.oracle.com/corporate/contact/" target="_blank" aria-label="Open a new window to contact oracle" data-lbl="contact-us">Contact Us</a></li>
<li class="footer-links-break"></li>
<li><a href="https://docs.oracle.com/en/browseall.html" target="_blank" aria-label="Open a new window to products a-z" data-lbl="products-a-z">Products A-Z</a></li>
<li><a href="https://www.oracle.com/legal/privacy/" target="_blank" aria-label="Open a new window to read more about Oracle terms of use and privacy" data-lbl="terms-of-use-and-privacy">Terms of Use & Privacy</a></li>
<li><a href="https://www.oracle.com/legal/privacy/privacy-policy.html#11" target="_blank" aria-label="Open a new window to read more about managing Oracle cookie preferences" data-lbl="cookie-preferences">Cookie Preferences</a></li>
<li><a href="https://www.oracle.com/legal/privacy/marketing-cloud-data-cloud-privacy-policy.html#adchoices" target="_blank" aria-label="Open a new window to ad choices" data-lbl="ad-choices">Ad Choices</a></li>
<li class="footer-links-break"></li><li class="last"><a href="https://docs.oracle.com/pls/topic/lookup?ctx=en/legal&id=cpyr" target="_blank" aria-label="Open a new window to Oracle legal notices" data-lbl="copyright">© Oracle</a></li>
</ul>
</div>
</div>
</div>
</footer>
</body>

</html>
26 changes: 26 additions & 0 deletions talend/workshops/freetier/manifest.json
Original file line number Diff line number Diff line change
@@ -0,0 +1,26 @@
{
"workshoptitle": "Connecting Talend to Oracle Autonomous Database",
"help": "[email protected]",
"tutorials": [
{
"title": "Connection Guide",
"description": "Connection Guide",
"filename": "../../talend-connector-guide.md"
},
{
"title": "Connecting with Wallet",
"description": "Connecting with Wallet",
"filename": "../../../common/wallet/wallet.md"
},
{
"title": "Connecting without Wallet",
"description": "Connecting without Wallet",
"filename": "../../../common/tls-no-wallet/no-wallet.md"
},
{
"title": "JDBC Configuration",
"description": "JDBC Configuration",
"filename": "../../../common/jdbc/jdbc-thin-wallet.md"
}
]
}

0 comments on commit 97101d2

Please sign in to comment.