Skip to content

dmeibusch/oci-hdfs-connector

 
 

Repository files navigation

Oracle Cloud Infrastructure HDFS Connector for Object Storage

About

oci-hdfs-connector provides the public HDFS connector that integrates with the Oracle Cloud Infrastructure Object Storage Service.

The project is open source and maintained by Oracle Corp. The home page for the project is here.

Installation

See the documentation for details.

Examples

Examples can be found here.

Documentation

Full documentation, including prerequisites and installation and configuration instructions, can be found here.

API reference can be found here.

Help

See the “Questions or Feedback?” section here.

Version

The first three numbers of HDFS connector version are Hadoop version that the connector was compiled and tested against.

Build

Building HDFS connector relies on Maven artifacts that are provided by the Java SDK. To obtain the artifacts, you must download the Java SDK and build it locally. You can then build the HDFS connector.

Important: The Java SDK file version that you download from the Oracle Releases page must match the HDFS connector version, which you can find in the hdfs-connector/pom.xml file in the tag block that has the groupId attribute com.oracle.oci.sdk.

Changes

See CHANGELOG.

Contributing

oci-hdfs-connector is an open source project. See CONTRIBUTING for details.

Oracle gratefully acknowledges the contributions to oci-hdfs-connector that have been made by the community.

Known Issues

You can find information on any known issues with the connector here and under the “Issues” tab of this GitHub repository. You can find information on any known issues with the SDK here and under the “Issues” tab of this GitHub repository.

Potential data corruption issue for OCI HDFS Connector with RefreshableOnNotAuthenticatedProvider

Details: If you are using version 3.2.1.1 or earlier of the OCI HDFS Connector and you use a RefreshableOnNotAuthenticatedProvider (e.g. InstancePrincipalsCustomAuthenticator, or generally for Resource Principals or Instance Principals) you may be affected by silent data corruption.

Workaround: Update the OCI HDFS Connector to version 3.2.1.3 or later. For more information about this issue and workarounds, see Potential data corruption issue for OCI HDFS Connector with RefreshableOnNotAuthenticatedProvider.

Direct link to this issue: Potential data corruption issue with OCI HDFS Connector on binary data upload with RefreshableOnNotAuthenticatedProvider

License

Copyright (c) 2016, 2020, Oracle and/or its affiliates. All rights reserved. This software is dual-licensed to you under the Universal Permissive License (UPL) 1.0 as shown at https://oss.oracle.com/licenses/upl or Apache License 2.0 as shown at http://www.apache.org/licenses/LICENSE-2.0. You may choose either license.

See LICENSE for more details.

About

HDFS Connector for Oracle Cloud Infrastructure

Resources

License

Stars

Watchers

Forks

Packages

No packages published

Languages

  • Java 99.4%
  • HTML 0.6%