Skip to content

Latest commit

 

History

History
757 lines (679 loc) · 178 KB

README.md

File metadata and controls

757 lines (679 loc) · 178 KB

Package apache-airflow-backport-providers-google

Release: 2020.6.24

Table of contents

Backport package

This is a backport providers package for google provider. All classes for this provider package are in airflow.providers.google python package.

Only Python 3.6+ is supported for this backport package.

While Airflow 1.10.* continues to support Python 2.7+ - you need to upgrade python to 3.6+ if you want to use this backport package.

Installation

You can install this package on top of an existing airflow 1.10.* installation via pip install apache-airflow-backport-providers-google

Compatibility

For full compatibility and test status of the backport packages check Airflow Backport Package Compatibility

PIP requirements

PIP package Version required
PyOpenSSL
google-ads >=4.0.0
google-api-python-client >=1.6.0, <2.0.0dev
google-auth >=1.0.0, <2.0.0dev
google-auth-httplib2 >=0.0.1
google-cloud-automl >=0.4.0
google-cloud-bigquery-datatransfer >=0.4.0
google-cloud-bigtable >=1.0.0
google-cloud-container >=0.1.1
google-cloud-datacatalog >=0.5.0,<0.8
google-cloud-dataproc >=0.5.0
google-cloud-dlp >=0.11.0
google-cloud-kms >=1.2.1
google-cloud-language >=1.1.1
google-cloud-logging >=1.14.0
google-cloud-monitoring >=0.34.0
google-cloud-pubsub >=1.0.0
google-cloud-redis >=0.3.0
google-cloud-secret-manager >=0.2.0
google-cloud-spanner >=1.10.0
google-cloud-speech >=0.36.3
google-cloud-storage >=1.16
google-cloud-tasks >=1.2.1
google-cloud-texttospeech >=0.4.0,<2
google-cloud-translate >=1.5.0
google-cloud-videointelligence >=1.7.0
google-cloud-vision >=0.35.2
grpcio-gcp >=0.2.2
pandas-gbq

Cross provider package dependencies

Those are dependencies that might be needed in order to use all the features of the package. You need to install the specified backport providers package in order to use them.

You can install such cross-provider dependencies when installing from PyPI. For example:

pip install apache-airflow-backport-providers-google[amazon]
Dependent package Extra
apache-airflow-backport-providers-amazon amazon
apache-airflow-backport-providers-apache-cassandra apache.cassandra
apache-airflow-backport-providers-cncf-kubernetes cncf.kubernetes
apache-airflow-backport-providers-facebook facebook
apache-airflow-backport-providers-microsoft-azure microsoft.azure
apache-airflow-backport-providers-microsoft-mssql microsoft.mssql
apache-airflow-backport-providers-mysql mysql
apache-airflow-backport-providers-postgres postgres
apache-airflow-backport-providers-presto presto
apache-airflow-backport-providers-sftp sftp

Provider classes summary

In Airflow 2.0, all operators, transfers, hooks, sensors, secrets for the google provider are in the airflow.providers.google package. You can read more about the naming conventions used in Naming conventions for provider packages

Operators

New operators

New Airflow 2.0 operators: airflow.providers.google package
ads.operators.ads.GoogleAdsListAccountsOperator
cloud.operators.automl.AutoMLBatchPredictOperator
cloud.operators.automl.AutoMLCreateDatasetOperator
cloud.operators.automl.AutoMLDeleteDatasetOperator
cloud.operators.automl.AutoMLDeleteModelOperator
cloud.operators.automl.AutoMLDeployModelOperator
cloud.operators.automl.AutoMLGetModelOperator
cloud.operators.automl.AutoMLImportDataOperator
cloud.operators.automl.AutoMLListDatasetOperator
cloud.operators.automl.AutoMLPredictOperator
cloud.operators.automl.AutoMLTablesListColumnSpecsOperator
cloud.operators.automl.AutoMLTablesListTableSpecsOperator
cloud.operators.automl.AutoMLTablesUpdateDatasetOperator
cloud.operators.automl.AutoMLTrainModelOperator
cloud.operators.bigquery.BigQueryInsertJobOperator
cloud.operators.bigquery_dts.BigQueryCreateDataTransferOperator
cloud.operators.bigquery_dts.BigQueryDataTransferServiceStartTransferRunsOperator
cloud.operators.bigquery_dts.BigQueryDeleteDataTransferConfigOperator
cloud.operators.cloud_memorystore.CloudMemorystoreCreateInstanceAndImportOperator
cloud.operators.cloud_memorystore.CloudMemorystoreCreateInstanceOperator
cloud.operators.cloud_memorystore.CloudMemorystoreDeleteInstanceOperator
cloud.operators.cloud_memorystore.CloudMemorystoreExportAndDeleteInstanceOperator
cloud.operators.cloud_memorystore.CloudMemorystoreExportInstanceOperator
cloud.operators.cloud_memorystore.CloudMemorystoreFailoverInstanceOperator
cloud.operators.cloud_memorystore.CloudMemorystoreGetInstanceOperator
cloud.operators.cloud_memorystore.CloudMemorystoreImportOperator
cloud.operators.cloud_memorystore.CloudMemorystoreListInstancesOperator
cloud.operators.cloud_memorystore.CloudMemorystoreScaleInstanceOperator
cloud.operators.cloud_memorystore.CloudMemorystoreUpdateInstanceOperator
cloud.operators.cloud_storage_transfer_service.CloudDataTransferServiceGCSToGCSOperator
cloud.operators.cloud_storage_transfer_service.CloudDataTransferServiceS3ToGCSOperator
cloud.operators.datacatalog.CloudDataCatalogCreateEntryGroupOperator
cloud.operators.datacatalog.CloudDataCatalogCreateEntryOperator
cloud.operators.datacatalog.CloudDataCatalogCreateTagOperator
cloud.operators.datacatalog.CloudDataCatalogCreateTagTemplateFieldOperator
cloud.operators.datacatalog.CloudDataCatalogCreateTagTemplateOperator
cloud.operators.datacatalog.CloudDataCatalogDeleteEntryGroupOperator
cloud.operators.datacatalog.CloudDataCatalogDeleteEntryOperator
cloud.operators.datacatalog.CloudDataCatalogDeleteTagOperator
cloud.operators.datacatalog.CloudDataCatalogDeleteTagTemplateFieldOperator
cloud.operators.datacatalog.CloudDataCatalogDeleteTagTemplateOperator
cloud.operators.datacatalog.CloudDataCatalogGetEntryGroupOperator
cloud.operators.datacatalog.CloudDataCatalogGetEntryOperator
cloud.operators.datacatalog.CloudDataCatalogGetTagTemplateOperator
cloud.operators.datacatalog.CloudDataCatalogListTagsOperator
cloud.operators.datacatalog.CloudDataCatalogLookupEntryOperator
cloud.operators.datacatalog.CloudDataCatalogRenameTagTemplateFieldOperator
cloud.operators.datacatalog.CloudDataCatalogSearchCatalogOperator
cloud.operators.datacatalog.CloudDataCatalogUpdateEntryOperator
cloud.operators.datacatalog.CloudDataCatalogUpdateTagOperator
cloud.operators.datacatalog.CloudDataCatalogUpdateTagTemplateFieldOperator
cloud.operators.datacatalog.CloudDataCatalogUpdateTagTemplateOperator
cloud.operators.datafusion.CloudDataFusionCreateInstanceOperator
cloud.operators.datafusion.CloudDataFusionCreatePipelineOperator
cloud.operators.datafusion.CloudDataFusionDeleteInstanceOperator
cloud.operators.datafusion.CloudDataFusionDeletePipelineOperator
cloud.operators.datafusion.CloudDataFusionGetInstanceOperator
cloud.operators.datafusion.CloudDataFusionListPipelinesOperator
cloud.operators.datafusion.CloudDataFusionRestartInstanceOperator
cloud.operators.datafusion.CloudDataFusionStartPipelineOperator
cloud.operators.datafusion.CloudDataFusionStopPipelineOperator
cloud.operators.datafusion.CloudDataFusionUpdateInstanceOperator
cloud.operators.dataproc.DataprocSubmitJobOperator
cloud.operators.dataproc.DataprocUpdateClusterOperator
cloud.operators.functions.CloudFunctionInvokeFunctionOperator
cloud.operators.gcs.GCSDeleteBucketOperator
cloud.operators.gcs.GCSFileTransformOperator
cloud.operators.gcs.GCSSynchronizeBucketsOperator
cloud.operators.life_sciences.LifeSciencesRunPipelineOperator
cloud.operators.mlengine.MLEngineCreateModelOperator
cloud.operators.mlengine.MLEngineCreateVersionOperator
cloud.operators.mlengine.MLEngineDeleteModelOperator
cloud.operators.mlengine.MLEngineDeleteVersionOperator
cloud.operators.mlengine.MLEngineGetModelOperator
cloud.operators.mlengine.MLEngineListVersionsOperator
cloud.operators.mlengine.MLEngineSetDefaultVersionOperator
cloud.operators.mlengine.MLEngineTrainingCancelJobOperator
cloud.operators.pubsub.PubSubPullOperator
cloud.operators.stackdriver.StackdriverDeleteAlertOperator
cloud.operators.stackdriver.StackdriverDeleteNotificationChannelOperator
cloud.operators.stackdriver.StackdriverDisableAlertPoliciesOperator
cloud.operators.stackdriver.StackdriverDisableNotificationChannelsOperator
cloud.operators.stackdriver.StackdriverEnableAlertPoliciesOperator
cloud.operators.stackdriver.StackdriverEnableNotificationChannelsOperator
cloud.operators.stackdriver.StackdriverListAlertPoliciesOperator
cloud.operators.stackdriver.StackdriverListNotificationChannelsOperator
cloud.operators.stackdriver.StackdriverUpsertAlertOperator
cloud.operators.stackdriver.StackdriverUpsertNotificationChannelOperator
cloud.operators.tasks.CloudTasksQueueCreateOperator
cloud.operators.tasks.CloudTasksQueueDeleteOperator
cloud.operators.tasks.CloudTasksQueueGetOperator
cloud.operators.tasks.CloudTasksQueuePauseOperator
cloud.operators.tasks.CloudTasksQueuePurgeOperator
cloud.operators.tasks.CloudTasksQueueResumeOperator
cloud.operators.tasks.CloudTasksQueueUpdateOperator
cloud.operators.tasks.CloudTasksQueuesListOperator
cloud.operators.tasks.CloudTasksTaskCreateOperator
cloud.operators.tasks.CloudTasksTaskDeleteOperator
cloud.operators.tasks.CloudTasksTaskGetOperator
cloud.operators.tasks.CloudTasksTaskRunOperator
cloud.operators.tasks.CloudTasksTasksListOperator
cloud.operators.vision.CloudVisionAddProductToProductSetOperator
firebase.operators.firestore.CloudFirestoreExportDatabaseOperator
marketing_platform.operators.analytics.GoogleAnalyticsDataImportUploadOperator
marketing_platform.operators.analytics.GoogleAnalyticsDeletePreviousDataUploadsOperator
marketing_platform.operators.analytics.GoogleAnalyticsGetAdsLinkOperator
marketing_platform.operators.analytics.GoogleAnalyticsListAccountsOperator
marketing_platform.operators.analytics.GoogleAnalyticsModifyFileHeadersDataImportOperator
marketing_platform.operators.analytics.GoogleAnalyticsRetrieveAdsLinksListOperator
marketing_platform.operators.campaign_manager.GoogleCampaignManagerBatchInsertConversionsOperator
marketing_platform.operators.campaign_manager.GoogleCampaignManagerBatchUpdateConversionsOperator
marketing_platform.operators.campaign_manager.GoogleCampaignManagerDeleteReportOperator
marketing_platform.operators.campaign_manager.GoogleCampaignManagerDownloadReportOperator
marketing_platform.operators.campaign_manager.GoogleCampaignManagerInsertReportOperator
marketing_platform.operators.campaign_manager.GoogleCampaignManagerRunReportOperator
marketing_platform.operators.display_video.GoogleDisplayVideo360CreateReportOperator
marketing_platform.operators.display_video.GoogleDisplayVideo360CreateSDFDownloadTaskOperator
marketing_platform.operators.display_video.GoogleDisplayVideo360DeleteReportOperator
marketing_platform.operators.display_video.GoogleDisplayVideo360DownloadLineItemsOperator
marketing_platform.operators.display_video.GoogleDisplayVideo360DownloadReportOperator
marketing_platform.operators.display_video.GoogleDisplayVideo360RunReportOperator
marketing_platform.operators.display_video.GoogleDisplayVideo360SDFtoGCSOperator
marketing_platform.operators.display_video.GoogleDisplayVideo360UploadLineItemsOperator
marketing_platform.operators.search_ads.GoogleSearchAdsDownloadReportOperator
marketing_platform.operators.search_ads.GoogleSearchAdsInsertReportOperator
suite.operators.sheets.GoogleSheetsCreateSpreadsheetOperator

Moved operators

Airflow 2.0 operators: airflow.providers.google package Airflow 1.10.* previous location (usually airflow.contrib)
cloud.operators.bigquery.BigQueryCheckOperator contrib.operators.bigquery_check_operator.BigQueryCheckOperator
cloud.operators.bigquery.BigQueryCreateEmptyDatasetOperator contrib.operators.bigquery_operator.BigQueryCreateEmptyDatasetOperator
cloud.operators.bigquery.BigQueryCreateEmptyTableOperator contrib.operators.bigquery_operator.BigQueryCreateEmptyTableOperator
cloud.operators.bigquery.BigQueryCreateExternalTableOperator contrib.operators.bigquery_operator.BigQueryCreateExternalTableOperator
cloud.operators.bigquery.BigQueryDeleteDatasetOperator contrib.operators.bigquery_operator.BigQueryDeleteDatasetOperator
cloud.operators.bigquery.BigQueryDeleteTableOperator contrib.operators.bigquery_table_delete_operator.BigQueryTableDeleteOperator
cloud.operators.bigquery.BigQueryExecuteQueryOperator contrib.operators.bigquery_operator.BigQueryOperator
cloud.operators.bigquery.BigQueryGetDataOperator contrib.operators.bigquery_get_data.BigQueryGetDataOperator
cloud.operators.bigquery.BigQueryGetDatasetOperator contrib.operators.bigquery_operator.BigQueryGetDatasetOperator
cloud.operators.bigquery.BigQueryGetDatasetTablesOperator contrib.operators.bigquery_operator.BigQueryGetDatasetTablesOperator
cloud.operators.bigquery.BigQueryIntervalCheckOperator contrib.operators.bigquery_check_operator.BigQueryIntervalCheckOperator
cloud.operators.bigquery.BigQueryPatchDatasetOperator contrib.operators.bigquery_operator.BigQueryPatchDatasetOperator
cloud.operators.bigquery.BigQueryUpdateDatasetOperator contrib.operators.bigquery_operator.BigQueryUpdateDatasetOperator
cloud.operators.bigquery.BigQueryUpsertTableOperator contrib.operators.bigquery_operator.BigQueryUpsertTableOperator
cloud.operators.bigquery.BigQueryValueCheckOperator contrib.operators.bigquery_check_operator.BigQueryValueCheckOperator
cloud.operators.bigtable.BigtableCreateInstanceOperator contrib.operators.gcp_bigtable_operator.BigtableInstanceCreateOperator
cloud.operators.bigtable.BigtableCreateTableOperator contrib.operators.gcp_bigtable_operator.BigtableTableCreateOperator
cloud.operators.bigtable.BigtableDeleteInstanceOperator contrib.operators.gcp_bigtable_operator.BigtableInstanceDeleteOperator
cloud.operators.bigtable.BigtableDeleteTableOperator contrib.operators.gcp_bigtable_operator.BigtableTableDeleteOperator
cloud.operators.bigtable.BigtableUpdateClusterOperator contrib.operators.gcp_bigtable_operator.BigtableClusterUpdateOperator
cloud.operators.cloud_build.CloudBuildCreateBuildOperator contrib.operators.gcp_cloud_build_operator.CloudBuildCreateBuildOperator
cloud.operators.cloud_sql.CloudSQLBaseOperator contrib.operators.gcp_sql_operator.CloudSqlBaseOperator
cloud.operators.cloud_sql.CloudSQLCreateInstanceDatabaseOperator contrib.operators.gcp_sql_operator.CloudSqlInstanceDatabaseCreateOperator
cloud.operators.cloud_sql.CloudSQLCreateInstanceOperator contrib.operators.gcp_sql_operator.CloudSqlInstanceCreateOperator
cloud.operators.cloud_sql.CloudSQLDeleteInstanceDatabaseOperator contrib.operators.gcp_sql_operator.CloudSqlInstanceDatabaseDeleteOperator
cloud.operators.cloud_sql.CloudSQLDeleteInstanceOperator contrib.operators.gcp_sql_operator.CloudSqlInstanceDeleteOperator
cloud.operators.cloud_sql.CloudSQLExecuteQueryOperator contrib.operators.gcp_sql_operator.CloudSqlQueryOperator
cloud.operators.cloud_sql.CloudSQLExportInstanceOperator contrib.operators.gcp_sql_operator.CloudSqlInstanceExportOperator
cloud.operators.cloud_sql.CloudSQLImportInstanceOperator contrib.operators.gcp_sql_operator.CloudSqlInstanceImportOperator
cloud.operators.cloud_sql.CloudSQLInstancePatchOperator contrib.operators.gcp_sql_operator.CloudSqlInstancePatchOperator
cloud.operators.cloud_sql.CloudSQLPatchInstanceDatabaseOperator contrib.operators.gcp_sql_operator.CloudSqlInstanceDatabasePatchOperator
cloud.operators.cloud_storage_transfer_service.CloudDataTransferServiceCancelOperationOperator contrib.operators.gcp_transfer_operator.GcpTransferServiceOperationCancelOperator
cloud.operators.cloud_storage_transfer_service.CloudDataTransferServiceCreateJobOperator contrib.operators.gcp_transfer_operator.GcpTransferServiceJobCreateOperator
cloud.operators.cloud_storage_transfer_service.CloudDataTransferServiceDeleteJobOperator contrib.operators.gcp_transfer_operator.GcpTransferServiceJobDeleteOperator
cloud.operators.cloud_storage_transfer_service.CloudDataTransferServiceGetOperationOperator contrib.operators.gcp_transfer_operator.GcpTransferServiceOperationGetOperator
cloud.operators.cloud_storage_transfer_service.CloudDataTransferServiceListOperationsOperator contrib.operators.gcp_transfer_operator.GcpTransferServiceOperationsListOperator
cloud.operators.cloud_storage_transfer_service.CloudDataTransferServicePauseOperationOperator contrib.operators.gcp_transfer_operator.GcpTransferServiceOperationPauseOperator
cloud.operators.cloud_storage_transfer_service.CloudDataTransferServiceResumeOperationOperator contrib.operators.gcp_transfer_operator.GcpTransferServiceOperationResumeOperator
cloud.operators.cloud_storage_transfer_service.CloudDataTransferServiceUpdateJobOperator contrib.operators.gcp_transfer_operator.GcpTransferServiceJobUpdateOperator
cloud.operators.compute.ComputeEngineBaseOperator contrib.operators.gcp_compute_operator.GceBaseOperator
cloud.operators.compute.ComputeEngineCopyInstanceTemplateOperator contrib.operators.gcp_compute_operator.GceInstanceTemplateCopyOperator
cloud.operators.compute.ComputeEngineInstanceGroupUpdateManagerTemplateOperator contrib.operators.gcp_compute_operator.GceInstanceGroupManagerUpdateTemplateOperator
cloud.operators.compute.ComputeEngineSetMachineTypeOperator contrib.operators.gcp_compute_operator.GceSetMachineTypeOperator
cloud.operators.compute.ComputeEngineStartInstanceOperator contrib.operators.gcp_compute_operator.GceInstanceStartOperator
cloud.operators.compute.ComputeEngineStopInstanceOperator contrib.operators.gcp_compute_operator.GceInstanceStopOperator
cloud.operators.dataflow.DataflowCreateJavaJobOperator contrib.operators.dataflow_operator.DataFlowJavaOperator
cloud.operators.dataflow.DataflowCreatePythonJobOperator contrib.operators.dataflow_operator.DataFlowPythonOperator
cloud.operators.dataflow.DataflowTemplatedJobStartOperator contrib.operators.dataflow_operator.DataflowTemplateOperator
cloud.operators.dataproc.DataprocCreateClusterOperator contrib.operators.dataproc_operator.DataprocClusterCreateOperator
cloud.operators.dataproc.DataprocDeleteClusterOperator contrib.operators.dataproc_operator.DataprocClusterDeleteOperator
cloud.operators.dataproc.DataprocInstantiateInlineWorkflowTemplateOperator contrib.operators.dataproc_operator.DataprocWorkflowTemplateInstantiateInlineOperator
cloud.operators.dataproc.DataprocInstantiateWorkflowTemplateOperator contrib.operators.dataproc_operator.DataprocWorkflowTemplateInstantiateOperator
cloud.operators.dataproc.DataprocJobBaseOperator contrib.operators.dataproc_operator.DataProcJobBaseOperator
cloud.operators.dataproc.DataprocScaleClusterOperator contrib.operators.dataproc_operator.DataprocClusterScaleOperator
cloud.operators.dataproc.DataprocSubmitHadoopJobOperator contrib.operators.dataproc_operator.DataProcHadoopOperator
cloud.operators.dataproc.DataprocSubmitHiveJobOperator contrib.operators.dataproc_operator.DataProcHiveOperator
cloud.operators.dataproc.DataprocSubmitPigJobOperator contrib.operators.dataproc_operator.DataProcPigOperator
cloud.operators.dataproc.DataprocSubmitPySparkJobOperator contrib.operators.dataproc_operator.DataProcPySparkOperator
cloud.operators.dataproc.DataprocSubmitSparkJobOperator contrib.operators.dataproc_operator.DataProcSparkOperator
cloud.operators.dataproc.DataprocSubmitSparkSqlJobOperator contrib.operators.dataproc_operator.DataProcSparkSqlOperator
cloud.operators.datastore.CloudDatastoreExportEntitiesOperator contrib.operators.datastore_export_operator.DatastoreExportOperator
cloud.operators.datastore.CloudDatastoreImportEntitiesOperator contrib.operators.datastore_import_operator.DatastoreImportOperator
cloud.operators.dlp.CloudDLPCancelDLPJobOperator contrib.operators.gcp_dlp_operator.CloudDLPCancelDLPJobOperator
cloud.operators.dlp.CloudDLPCreateDLPJobOperator contrib.operators.gcp_dlp_operator.CloudDLPCreateDLPJobOperator
cloud.operators.dlp.CloudDLPCreateDeidentifyTemplateOperator contrib.operators.gcp_dlp_operator.CloudDLPCreateDeidentifyTemplateOperator
cloud.operators.dlp.CloudDLPCreateInspectTemplateOperator contrib.operators.gcp_dlp_operator.CloudDLPCreateInspectTemplateOperator
cloud.operators.dlp.CloudDLPCreateJobTriggerOperator contrib.operators.gcp_dlp_operator.CloudDLPCreateJobTriggerOperator
cloud.operators.dlp.CloudDLPCreateStoredInfoTypeOperator contrib.operators.gcp_dlp_operator.CloudDLPCreateStoredInfoTypeOperator
cloud.operators.dlp.CloudDLPDeidentifyContentOperator contrib.operators.gcp_dlp_operator.CloudDLPDeidentifyContentOperator
cloud.operators.dlp.CloudDLPDeleteDLPJobOperator contrib.operators.gcp_dlp_operator.CloudDLPDeleteDlpJobOperator
cloud.operators.dlp.CloudDLPDeleteDeidentifyTemplateOperator contrib.operators.gcp_dlp_operator.CloudDLPDeleteDeidentifyTemplateOperator
cloud.operators.dlp.CloudDLPDeleteInspectTemplateOperator contrib.operators.gcp_dlp_operator.CloudDLPDeleteInspectTemplateOperator
cloud.operators.dlp.CloudDLPDeleteJobTriggerOperator contrib.operators.gcp_dlp_operator.CloudDLPDeleteJobTriggerOperator
cloud.operators.dlp.CloudDLPDeleteStoredInfoTypeOperator contrib.operators.gcp_dlp_operator.CloudDLPDeleteStoredInfoTypeOperator
cloud.operators.dlp.CloudDLPGetDLPJobOperator contrib.operators.gcp_dlp_operator.CloudDLPGetDlpJobOperator
cloud.operators.dlp.CloudDLPGetDLPJobTriggerOperator contrib.operators.gcp_dlp_operator.CloudDLPGetJobTripperOperator
cloud.operators.dlp.CloudDLPGetDeidentifyTemplateOperator contrib.operators.gcp_dlp_operator.CloudDLPGetDeidentifyTemplateOperator
cloud.operators.dlp.CloudDLPGetInspectTemplateOperator contrib.operators.gcp_dlp_operator.CloudDLPGetInspectTemplateOperator
cloud.operators.dlp.CloudDLPGetStoredInfoTypeOperator contrib.operators.gcp_dlp_operator.CloudDLPGetStoredInfoTypeOperator
cloud.operators.dlp.CloudDLPInspectContentOperator contrib.operators.gcp_dlp_operator.CloudDLPInspectContentOperator
cloud.operators.dlp.CloudDLPListDLPJobsOperator contrib.operators.gcp_dlp_operator.CloudDLPListDlpJobsOperator
cloud.operators.dlp.CloudDLPListDeidentifyTemplatesOperator contrib.operators.gcp_dlp_operator.CloudDLPListDeidentifyTemplatesOperator
cloud.operators.dlp.CloudDLPListInfoTypesOperator contrib.operators.gcp_dlp_operator.CloudDLPListInfoTypesOperator
cloud.operators.dlp.CloudDLPListInspectTemplatesOperator contrib.operators.gcp_dlp_operator.CloudDLPListInspectTemplatesOperator
cloud.operators.dlp.CloudDLPListJobTriggersOperator contrib.operators.gcp_dlp_operator.CloudDLPListJobTriggersOperator
cloud.operators.dlp.CloudDLPListStoredInfoTypesOperator contrib.operators.gcp_dlp_operator.CloudDLPListStoredInfoTypesOperator
cloud.operators.dlp.CloudDLPRedactImageOperator contrib.operators.gcp_dlp_operator.CloudDLPRedactImageOperator
cloud.operators.dlp.CloudDLPReidentifyContentOperator contrib.operators.gcp_dlp_operator.CloudDLPReidentifyContentOperator
cloud.operators.dlp.CloudDLPUpdateDeidentifyTemplateOperator contrib.operators.gcp_dlp_operator.CloudDLPUpdateDeidentifyTemplateOperator
cloud.operators.dlp.CloudDLPUpdateInspectTemplateOperator contrib.operators.gcp_dlp_operator.CloudDLPUpdateInspectTemplateOperator
cloud.operators.dlp.CloudDLPUpdateJobTriggerOperator contrib.operators.gcp_dlp_operator.CloudDLPUpdateJobTriggerOperator
cloud.operators.dlp.CloudDLPUpdateStoredInfoTypeOperator contrib.operators.gcp_dlp_operator.CloudDLPUpdateStoredInfoTypeOperator
cloud.operators.functions.CloudFunctionDeleteFunctionOperator contrib.operators.gcp_function_operator.GcfFunctionDeleteOperator
cloud.operators.functions.CloudFunctionDeployFunctionOperator contrib.operators.gcp_function_operator.GcfFunctionDeployOperator
cloud.operators.gcs.GCSBucketCreateAclEntryOperator contrib.operators.gcs_acl_operator.GoogleCloudStorageBucketCreateAclEntryOperator
cloud.operators.gcs.GCSCreateBucketOperator contrib.operators.gcs_operator.GoogleCloudStorageCreateBucketOperator
cloud.operators.gcs.GCSDeleteObjectsOperator contrib.operators.gcs_delete_operator.GoogleCloudStorageDeleteOperator
cloud.operators.gcs.GCSListObjectsOperator contrib.operators.gcs_list_operator.GoogleCloudStorageListOperator
cloud.operators.gcs.GCSObjectCreateAclEntryOperator contrib.operators.gcs_acl_operator.GoogleCloudStorageObjectCreateAclEntryOperator
cloud.operators.kubernetes_engine.GKECreateClusterOperator contrib.operators.gcp_container_operator.GKEClusterCreateOperator
cloud.operators.kubernetes_engine.GKEDeleteClusterOperator contrib.operators.gcp_container_operator.GKEClusterDeleteOperator
cloud.operators.kubernetes_engine.GKEStartPodOperator contrib.operators.gcp_container_operator.GKEPodOperator
cloud.operators.mlengine.MLEngineManageModelOperator contrib.operators.mlengine_operator.MLEngineModelOperator
cloud.operators.mlengine.MLEngineManageVersionOperator contrib.operators.mlengine_operator.MLEngineVersionOperator
cloud.operators.mlengine.MLEngineStartBatchPredictionJobOperator contrib.operators.mlengine_operator.MLEngineBatchPredictionOperator
cloud.operators.mlengine.MLEngineStartTrainingJobOperator contrib.operators.mlengine_operator.MLEngineTrainingOperator
cloud.operators.natural_language.CloudNaturalLanguageAnalyzeEntitiesOperator contrib.operators.gcp_natural_language_operator.CloudLanguageAnalyzeEntitiesOperator
cloud.operators.natural_language.CloudNaturalLanguageAnalyzeEntitySentimentOperator contrib.operators.gcp_natural_language_operator.CloudLanguageAnalyzeEntitySentimentOperator
cloud.operators.natural_language.CloudNaturalLanguageAnalyzeSentimentOperator contrib.operators.gcp_natural_language_operator.CloudLanguageAnalyzeSentimentOperator
cloud.operators.natural_language.CloudNaturalLanguageClassifyTextOperator contrib.operators.gcp_natural_language_operator.CloudLanguageClassifyTextOperator
cloud.operators.pubsub.PubSubCreateSubscriptionOperator contrib.operators.pubsub_operator.PubSubSubscriptionCreateOperator
cloud.operators.pubsub.PubSubCreateTopicOperator contrib.operators.pubsub_operator.PubSubTopicCreateOperator
cloud.operators.pubsub.PubSubDeleteSubscriptionOperator contrib.operators.pubsub_operator.PubSubSubscriptionDeleteOperator
cloud.operators.pubsub.PubSubDeleteTopicOperator contrib.operators.pubsub_operator.PubSubTopicDeleteOperator
cloud.operators.pubsub.PubSubPublishMessageOperator contrib.operators.pubsub_operator.PubSubPublishOperator
cloud.operators.spanner.SpannerDeleteDatabaseInstanceOperator contrib.operators.gcp_spanner_operator.CloudSpannerInstanceDatabaseDeleteOperator
cloud.operators.spanner.SpannerDeleteInstanceOperator contrib.operators.gcp_spanner_operator.CloudSpannerInstanceDeleteOperator
cloud.operators.spanner.SpannerDeployDatabaseInstanceOperator contrib.operators.gcp_spanner_operator.CloudSpannerInstanceDatabaseDeployOperator
cloud.operators.spanner.SpannerDeployInstanceOperator contrib.operators.gcp_spanner_operator.CloudSpannerInstanceDeployOperator
cloud.operators.spanner.SpannerQueryDatabaseInstanceOperator contrib.operators.gcp_spanner_operator.CloudSpannerInstanceDatabaseQueryOperator
cloud.operators.spanner.SpannerUpdateDatabaseInstanceOperator contrib.operators.gcp_spanner_operator.CloudSpannerInstanceDatabaseUpdateOperator
cloud.operators.speech_to_text.CloudSpeechToTextRecognizeSpeechOperator contrib.operators.gcp_speech_to_text_operator.GcpSpeechToTextRecognizeSpeechOperator
cloud.operators.text_to_speech.CloudTextToSpeechSynthesizeOperator contrib.operators.gcp_text_to_speech_operator.GcpTextToSpeechSynthesizeOperator
cloud.operators.translate.CloudTranslateTextOperator contrib.operators.gcp_translate_operator.CloudTranslateTextOperator
cloud.operators.translate_speech.CloudTranslateSpeechOperator contrib.operators.gcp_translate_speech_operator.CloudTranslateSpeechOperator
cloud.operators.video_intelligence.CloudVideoIntelligenceDetectVideoExplicitContentOperator contrib.operators.gcp_video_intelligence_operator.CloudVideoIntelligenceDetectVideoExplicitContentOperator
cloud.operators.video_intelligence.CloudVideoIntelligenceDetectVideoLabelsOperator contrib.operators.gcp_video_intelligence_operator.CloudVideoIntelligenceDetectVideoLabelsOperator
cloud.operators.video_intelligence.CloudVideoIntelligenceDetectVideoShotsOperator contrib.operators.gcp_video_intelligence_operator.CloudVideoIntelligenceDetectVideoShotsOperator
cloud.operators.vision.CloudVisionCreateProductOperator contrib.operators.gcp_vision_operator.CloudVisionProductCreateOperator
cloud.operators.vision.CloudVisionCreateProductSetOperator contrib.operators.gcp_vision_operator.CloudVisionProductSetCreateOperator
cloud.operators.vision.CloudVisionCreateReferenceImageOperator contrib.operators.gcp_vision_operator.CloudVisionReferenceImageCreateOperator
cloud.operators.vision.CloudVisionDeleteProductOperator contrib.operators.gcp_vision_operator.CloudVisionProductDeleteOperator
cloud.operators.vision.CloudVisionDeleteProductSetOperator contrib.operators.gcp_vision_operator.CloudVisionProductSetDeleteOperator
cloud.operators.vision.CloudVisionDetectImageLabelsOperator contrib.operators.gcp_vision_operator.CloudVisionDetectImageLabelsOperator
cloud.operators.vision.CloudVisionDetectImageSafeSearchOperator contrib.operators.gcp_vision_operator.CloudVisionDetectImageSafeSearchOperator
cloud.operators.vision.CloudVisionDetectTextOperator contrib.operators.gcp_vision_operator.CloudVisionDetectTextOperator
cloud.operators.vision.CloudVisionGetProductOperator contrib.operators.gcp_vision_operator.CloudVisionProductGetOperator
cloud.operators.vision.CloudVisionGetProductSetOperator contrib.operators.gcp_vision_operator.CloudVisionProductSetGetOperator
cloud.operators.vision.CloudVisionImageAnnotateOperator contrib.operators.gcp_vision_operator.CloudVisionAnnotateImageOperator
cloud.operators.vision.CloudVisionRemoveProductFromProductSetOperator contrib.operators.gcp_vision_operator.CloudVisionRemoveProductFromProductSetOperator
cloud.operators.vision.CloudVisionTextDetectOperator contrib.operators.gcp_vision_operator.CloudVisionDetectDocumentTextOperator
cloud.operators.vision.CloudVisionUpdateProductOperator contrib.operators.gcp_vision_operator.CloudVisionProductUpdateOperator
cloud.operators.vision.CloudVisionUpdateProductSetOperator contrib.operators.gcp_vision_operator.CloudVisionProductSetUpdateOperator

New transfer operators

New Airflow 2.0 transfers: airflow.providers.google package
ads.transfers.ads_to_gcs.GoogleAdsToGcsOperator
cloud.transfers.facebook_ads_to_gcs.FacebookAdsReportToGcsOperator
cloud.transfers.gcs_to_local.GCSToLocalFilesystemOperator
cloud.transfers.gcs_to_sftp.GCSToSFTPOperator
cloud.transfers.presto_to_gcs.PrestoToGCSOperator
cloud.transfers.sftp_to_gcs.SFTPToGCSOperator
cloud.transfers.sheets_to_gcs.GoogleSheetsToGCSOperator
suite.transfers.gcs_to_sheets.GCSToGoogleSheetsOperator

Moved transfer operators

Airflow 2.0 transfers: airflow.providers.google package Airflow 1.10.* previous location (usually airflow.contrib)
cloud.transfers.adls_to_gcs.ADLSToGCSOperator contrib.operators.adls_to_gcs.AdlsToGoogleCloudStorageOperator
cloud.transfers.bigquery_to_bigquery.BigQueryToBigQueryOperator contrib.operators.bigquery_to_bigquery.BigQueryToBigQueryOperator
cloud.transfers.bigquery_to_gcs.BigQueryToGCSOperator contrib.operators.bigquery_to_gcs.BigQueryToCloudStorageOperator
cloud.transfers.bigquery_to_mysql.BigQueryToMySqlOperator contrib.operators.bigquery_to_mysql_operator.BigQueryToMySqlOperator
cloud.transfers.cassandra_to_gcs.CassandraToGCSOperator contrib.operators.cassandra_to_gcs.CassandraToGoogleCloudStorageOperator
cloud.transfers.gcs_to_bigquery.GCSToBigQueryOperator contrib.operators.gcs_to_bq.GoogleCloudStorageToBigQueryOperator
cloud.transfers.gcs_to_gcs.GCSToGCSOperator contrib.operators.gcs_to_gcs.GoogleCloudStorageToGoogleCloudStorageOperator
cloud.transfers.local_to_gcs.LocalFilesystemToGCSOperator contrib.operators.file_to_gcs.FileToGoogleCloudStorageOperator
cloud.transfers.mssql_to_gcs.MSSQLToGCSOperator contrib.operators.mssql_to_gcs.MsSqlToGoogleCloudStorageOperator
cloud.transfers.mysql_to_gcs.MySQLToGCSOperator contrib.operators.mysql_to_gcs.MySqlToGoogleCloudStorageOperator
cloud.transfers.postgres_to_gcs.PostgresToGCSOperator contrib.operators.postgres_to_gcs_operator.PostgresToGoogleCloudStorageOperator
cloud.transfers.s3_to_gcs.S3ToGCSOperator contrib.operators.s3_to_gcs_operator.S3ToGCSOperator
cloud.transfers.sql_to_gcs.BaseSQLToGCSOperator contrib.operators.sql_to_gcs.BaseSQLToGoogleCloudStorageOperator
suite.transfers.gcs_to_gdrive.GCSToGoogleDriveOperator contrib.operators.gcs_to_gdrive_operator.GCSToGoogleDriveOperator

Sensors

New sensors

New Airflow 2.0 sensors: airflow.providers.google package
cloud.sensors.bigquery_dts.BigQueryDataTransferServiceTransferRunSensor
marketing_platform.sensors.campaign_manager.GoogleCampaignManagerReportSensor
marketing_platform.sensors.display_video.GoogleDisplayVideo360GetSDFDownloadOperationSensor
marketing_platform.sensors.display_video.GoogleDisplayVideo360ReportSensor
marketing_platform.sensors.search_ads.GoogleSearchAdsReportSensor

Moved sensors

Airflow 2.0 sensors: airflow.providers.google package Airflow 1.10.* previous location (usually airflow.contrib)
cloud.sensors.bigquery.BigQueryTableExistenceSensor contrib.sensors.bigquery_sensor.BigQueryTableSensor
cloud.sensors.bigtable.BigtableTableReplicationCompletedSensor contrib.operators.gcp_bigtable_operator.BigtableTableWaitForReplicationSensor
cloud.sensors.cloud_storage_transfer_service.CloudDataTransferServiceJobStatusSensor contrib.sensors.gcp_transfer_sensor.GCPTransferServiceWaitForJobStatusSensor
cloud.sensors.gcs.GCSObjectExistenceSensor contrib.sensors.gcs_sensor.GoogleCloudStorageObjectSensor
cloud.sensors.gcs.GCSObjectUpdateSensor contrib.sensors.gcs_sensor.GoogleCloudStorageObjectUpdatedSensor
cloud.sensors.gcs.GCSObjectsWtihPrefixExistenceSensor contrib.sensors.gcs_sensor.GoogleCloudStoragePrefixSensor
cloud.sensors.gcs.GCSUploadSessionCompleteSensor contrib.sensors.gcs_sensor.GoogleCloudStorageUploadSessionCompleteSensor
cloud.sensors.pubsub.PubSubPullSensor contrib.sensors.pubsub_sensor.PubSubPullSensor

Hooks

New hooks

New Airflow 2.0 hooks: airflow.providers.google package
ads.hooks.ads.GoogleAdsHook
cloud.hooks.automl.CloudAutoMLHook
cloud.hooks.bigquery_dts.BiqQueryDataTransferServiceHook
cloud.hooks.cloud_memorystore.CloudMemorystoreHook
cloud.hooks.datacatalog.CloudDataCatalogHook
cloud.hooks.datafusion.DataFusionHook
cloud.hooks.life_sciences.LifeSciencesHook
cloud.hooks.secret_manager.SecretsManagerHook
cloud.hooks.stackdriver.StackdriverHook
common.hooks.discovery_api.GoogleDiscoveryApiHook
firebase.hooks.firestore.CloudFirestoreHook
marketing_platform.hooks.analytics.GoogleAnalyticsHook
marketing_platform.hooks.campaign_manager.GoogleCampaignManagerHook
marketing_platform.hooks.display_video.GoogleDisplayVideo360Hook
marketing_platform.hooks.search_ads.GoogleSearchAdsHook
suite.hooks.sheets.GSheetsHook

Moved hooks

Airflow 2.0 hooks: airflow.providers.google package Airflow 1.10.* previous location (usually airflow.contrib)
cloud.hooks.bigquery.BigQueryHook contrib.hooks.bigquery_hook.BigQueryHook
cloud.hooks.bigtable.BigtableHook contrib.hooks.gcp_bigtable_hook.BigtableHook
cloud.hooks.cloud_build.CloudBuildHook contrib.hooks.gcp_cloud_build_hook.CloudBuildHook
cloud.hooks.cloud_sql.CloudSQLDatabaseHook contrib.hooks.gcp_sql_hook.CloudSqlDatabaseHook
cloud.hooks.cloud_sql.CloudSQLHook contrib.hooks.gcp_sql_hook.CloudSqlHook
cloud.hooks.cloud_storage_transfer_service.CloudDataTransferServiceHook contrib.hooks.gcp_transfer_hook.GCPTransferServiceHook
cloud.hooks.compute.ComputeEngineHook contrib.hooks.gcp_compute_hook.GceHook
cloud.hooks.dataflow.DataflowHook contrib.hooks.gcp_dataflow_hook.DataFlowHook
cloud.hooks.dataproc.DataprocHook contrib.hooks.gcp_dataproc_hook.DataProcHook
cloud.hooks.datastore.DatastoreHook contrib.hooks.datastore_hook.DatastoreHook
cloud.hooks.dlp.CloudDLPHook contrib.hooks.gcp_dlp_hook.CloudDLPHook
cloud.hooks.functions.CloudFunctionsHook contrib.hooks.gcp_function_hook.GcfHook
cloud.hooks.gcs.GCSHook contrib.hooks.gcs_hook.GoogleCloudStorageHook
cloud.hooks.kms.CloudKMSHook contrib.hooks.gcp_kms_hook.GoogleCloudKMSHook
cloud.hooks.kubernetes_engine.GKEHook contrib.hooks.gcp_container_hook.GKEClusterHook
cloud.hooks.mlengine.MLEngineHook contrib.hooks.gcp_mlengine_hook.MLEngineHook
cloud.hooks.natural_language.CloudNaturalLanguageHook contrib.hooks.gcp_natural_language_hook.CloudNaturalLanguageHook
cloud.hooks.pubsub.PubSubHook contrib.hooks.gcp_pubsub_hook.PubSubHook
cloud.hooks.spanner.SpannerHook contrib.hooks.gcp_spanner_hook.CloudSpannerHook
cloud.hooks.speech_to_text.CloudSpeechToTextHook contrib.hooks.gcp_speech_to_text_hook.GCPSpeechToTextHook
cloud.hooks.tasks.CloudTasksHook contrib.hooks.gcp_tasks_hook.CloudTasksHook
cloud.hooks.text_to_speech.CloudTextToSpeechHook contrib.hooks.gcp_text_to_speech_hook.GCPTextToSpeechHook
cloud.hooks.translate.CloudTranslateHook contrib.hooks.gcp_translate_hook.CloudTranslateHook
cloud.hooks.video_intelligence.CloudVideoIntelligenceHook contrib.hooks.gcp_video_intelligence_hook.CloudVideoIntelligenceHook
cloud.hooks.vision.CloudVisionHook contrib.hooks.gcp_vision_hook.CloudVisionHook
common.hooks.base_google.GoogleBaseHook contrib.hooks.gcp_api_base_hook.GoogleBaseHook
suite.hooks.drive.GoogleDriveHook contrib.hooks.gdrive_hook.GoogleDriveHook

Secrets

Moved secrets

Airflow 2.0 protocols: airflow.providers.google package Airflow 1.10.* previous location (usually airflow.contrib)
cloud.secrets.secret_manager.CloudSecretManagerBackend contrib.secrets.gcp_secrets_manager.CloudSecretsManagerBackend

Releases

Release 2020.6.24

Commit Committed Subject
416334e2e 2020-06-19 Properly propagated warnings in operators (#9348)
12af6a080 2020-06-19 Final cleanup for 2020.6.23rc1 release preparation (#9404)
c7e5bce57 2020-06-19 Prepare backport release candidate for 2020.6.23rc1 (#9370)
4e09c6442 2020-06-18 Adds GCP Secret Manager Hook (#9368)
40bf8f28f 2020-06-18 Detect automatically the lack of reference to the guide in the operator descriptions (#9290)
f6bd817a3 2020-06-16 Introduce 'transfers' packages (#9320)
639972d99 2020-06-16 Add support for latest Apache Beam SDK in Dataflow operators (#9323)
1459970b3 2020-06-15 Rename CloudBuildCreateBuildOperator to CloudBuildCreateOperator (#9314)
431ea3291 2020-06-15 Resolve upstream tasks when template field is XComArg (#8805)
aee6ab94e 2020-06-15 Wait for pipeline state in Data Fusion operators (#8954)
fb1c8b83d 2020-06-10 Add test for BQ operations using location (#9206)
a26afbfa5 2020-06-10 Make generated job_id more informative in BQ insert_job (#9203)
c41192fa1 2020-06-10 Upgrade pendulum to latest major version ~2.0 (#9184)
b1c8c5ed5 2020-06-09 Allows using private endpoints in GKEStartPodOperator (#9169)
5918efc86 2020-06-05 Add 3.8 to the test matrices (#8836)
9bcdadaf7 2020-06-05 Add 'main' param to template_fields in DataprocSubmitPySparkJobOperator (#9154)
f56811dff 2020-06-05 [AIRFLOW-6290] Create guide for GKE operators (#8883)
76962867b 2020-06-04 Fix sql_to_gcs hook gzip of schema_file (#9140)
17adcea83 2020-06-02 Fix handling of subprocess error handling in s3_file_transform and gcs (#9106)
789852546 2020-06-01 Add BigQueryInsertJobOperator (#8868)
29eb68b90 2020-05-31 Create guide for Dataproc Operators (#9037)
886afaf62 2020-05-29 Add example dag and system test for LocalFilesystemToGCSOperator (#9043)
a779c4dfc 2020-05-29 add separate example dags and system tests for GCSToGoogleSheetsOperator (#9066)
ada26be23 2020-05-29 Add correct description for dst param in LocalFilesystemToGCSOperator (#9055)
81b2761b8 2020-05-29 add example dag and system test for GoogleSheetsToGCSOperator (#9056)
0b0e4f7a4 2020-05-26 Preparing for RC3 release of backports (#9026)
00642a46d 2020-05-26 Fixed name of 20 remaining wrongly named operators. (#8994)
3994030ea 2020-05-26 Refactor BigQuery operators (#8858)
cdb3f2545 2020-05-26 All classes in backport providers are now importable in Airflow 1.10 (#8991)
1d36b0303 2020-05-23 Fix references in docs (#8984)
cf5cf45e1 2020-05-23 Support YAML input for CloudBuildCreateOperator (#8808)
499493c5c 2020-05-19 [AIRFLOW-6586] Improvements to gcs sensor (#7197)
375d1ca22 2020-05-19 Release candidate 2 for backport packages 2020.05.20 (#8898)
841d81664 2020-05-19 Allow setting the pooling time in DLPHook (#8824)
12c5e5d8a 2020-05-17 Prepare release candidate for backport packages (#8891)
f3521fb0e 2020-05-16 Regenerate readme files for backport package release (#8886)
15273f0ea 2020-05-16 Check for same task instead of Equality to detect Duplicate Tasks (#8828)
92585ca4c 2020-05-15 Added automated release notes generation for backport operators (#8807)
e1e833bb2 2020-05-13 Update GoogleBaseHook to not follow 308 and use 60s timeout (#8816)
8b5491971 2020-05-12 Refactor BigQuery hook methods to use python library (#8631)
6911dfe83 2020-05-12 Fix template fields in Google operators (#8840)
4b06fde0f 2020-05-12 Fix Flake8 errors (#8841)
1d12c347c 2020-05-12 Refactor BigQuery check operators (#8813)
493b685d7 2020-05-10 Add separate example DAGs and system tests for google cloud speech (#8778)
79ef8bed8 2020-05-10 Added Upload Multiple Entity Read Files to specified big query dataset (#8610)
280f1f0c4 2020-05-10 Correctly restore upstream_task_ids when deserializing Operators (#8775)
58aefb23b 2020-05-08 Added SDFtoGCSOperator (#8740)
723c52c94 2020-05-07 Add documentation for SpannerDeployInstanceOperator (#8750)
25ee4211b 2020-05-06 Support all RuntimeEnvironment parameters in DataflowTemplatedJobStartOperator (#8531)
8d6f1aa4b 2020-05-05 Support num_retries field in env var for GCP connection (#8700)
67caae0f2 2020-05-04 Add system test for gcs_to_bigquery (#8556)
bc45fa675 2020-05-03 Add system test and docs for Facebook Ads operators (#8503)
a28c66f23 2020-04-30 [AIRFLOW-4734] Upsert functionality for PostgresHook.insert_rows() (#8625)
992a24ce4 2020-04-28 Split and improve BigQuery example DAG (#8529)
c1fb28230 2020-04-28 Refactor BigQueryHook dataset operations (#8477)
e8d0f8fea 2020-04-26 Improve idempodency in CloudDataTransferServiceCreateJobOperator (#8430)
37fdfa977 2020-04-26 [AIRFLOW-6281] Create guide for GCS to GCS transfer operators (#8442)
14b22e6ff 2020-04-25 Add hook and operator for Google Cloud Life Sciences (#8481)
72ddc94d1 2020-04-23 Pass location using parmamter in Dataflow integration (#8382)
912aa4b42 2020-04-23 Added GoogleDisplayVideo360DownloadLineItemsOperator (#8174)
57c8c0583 2020-04-22 Use python client in BQ hook create_empty_table/dataset and table_exists (#8377)
5d3a7eef3 2020-04-20 Allow multiple extra_packages in Dataflow (#8394)
79c99b1b6 2020-04-18 Added location parameter to BigQueryCheckOperator (#8273)
79d3f33c1 2020-04-17 Clean up temporary files in Dataflow operators (#8313)
efcffa323 2020-04-16 Add Dataproc SparkR Example (#8240)
b198a1fa9 2020-04-15 Create guide for BigQuery operators (#8276)
2636cc932 2020-04-14 Raise exception when GCP credential doesn't support account impersonation (#8213)
eee4ebaee 2020-04-14 Added Facebook Ads Operator #7887 (#8008)
8cae07ea1 2020-04-14 fixed typo (#8294)
45c898330 2020-04-13 Less aggressive eager upgrade of requirements (#8267)
1fd9ed384 2020-04-13 Add mypy plugin for decorators. (#8145)
327b0a9f7 2020-04-13 Added GoogleDisplayVideo360UploadLineItemsOperator (#8216)
bb5e403a3 2020-04-10 Honor schema type for MySQL to GCS data pre-process (#8090)
87969a350 2020-04-09 [AIRFLOW-6515] Change Log Levels from Info/Warn to Error (#8170)
3fc89f29f 2020-04-06 [AIRFLOW-7106] Cloud data fusion integration - Allow to pass args to start pipeline (#7849)
7ef75d239 2020-04-03 [AIRFLOW-7117] Honor self.schema in sql_to_gcs as schema to upload (#8049)
ed2bc0057 2020-04-02 Add Google Ads list accounts operator (#8007)
3808a6206 2020-04-01 Unify Google class/package names (#8033)
8a0240257 2020-03-31 Rename CloudBaseHook to GoogleBaseHook and move it to google.common (#8011)
8e8978007 2020-03-31 Add more refactor steps for providers.google (#8010)
aae3b8fb2 2020-03-31 Individual package READMEs (#8012)
779023968 2020-03-30 [AIRFLOW-7075] Operators for storing information from GCS into GA (#7743)
49abce521 2020-03-30 Improve system tests for Cloud Build (#8003)
0f19a930d 2020-03-29 Remove GKEStartPodOperator when backporting (#7908)
0e1c238b2 2020-03-28 Get Airflow Variables from GCP Secrets Manager (#7946)
eb4af4f94 2020-03-28 Make BaseSecretsBackend.build_path generic (#7948)
01f99426f 2020-03-28 Add download/upload operators for GCS and Google Sheets (#7866)
892522f8e 2020-03-26 Change signature of GSheetsHook methods (#7853)
bfd425157 2020-03-26 Improve idempotency in MLEngineHook.create_model (#7811)
f9c226343 2020-03-26 Fix CloudSecretsManagerBackend invalid connections_prefix (#7861)
e3920f12f 2020-03-26 Improve setUp/tearDown in Cloud Firestore system test (#7862)
8ba8a7295 2020-03-26 Improve example DAGs for Cloud Memorystore (#7855)
f7d1a437c 2020-03-26 Fix CloudMemorystoreCreateInstanceAndImportOperator operator (#7856)
beef6c230 2020-03-26 Improve authorization in GCP system tests (#7863)
5f165f3e4 2020-03-26 [AIRFLOW-5801] Get GCP credentials from file instead of JSON blob (#7869)
686d7d50b 2020-03-25 Standardize SecretBackend class names (#7846)
1982c3fdc 2020-03-24 Run Dataflow for ML Engine summary in venv (#7809)
eef87b995 2020-03-23 [AIRFLOW-7105] Unify Secrets Backend method interfaces (#7830)
529db07b2 2020-03-23 Improve Google PubSub hook publish method (#7831)
4bde99f13 2020-03-23 Make airflow/providers pylint compatible (#7802)
a001489b5 2020-03-23 Improve example DAG for ML Engine (#7810)
9e5a8e7f8 2020-03-23 Add call to Super class in 'google' providers (#7823)
b86bf79bf 2020-03-23 Fix typo in GCP credentials_provider's docstring (#7818)
56c013ce9 2020-03-23 Add missing docstring in BigQueryHook.create_empty_table (#7817)
426a79847 2020-03-23 Imrove support for laatest API in MLEngineStartTrainingJobOperator (#7812)
cdf1809fc 2020-03-23 [AIRFLOW-7104] Add Secret backend for GCP Secrets Manager (#7795)
27dac00e1 2020-03-22 [AIRFLOW-7099] Improve system test for cloud transfer service (#7794)
0daf5d729 2020-03-22 Add ability to specify a maximum modified time for objects in GCSToGCSOperator (#7791)
c8088c2bd 2020-03-20 [AIRFLOW-7100] Add GoogleAnalyticsGetAdsLinkOperator (#7781)
5106a2931 2020-03-20 [AIRFLOW-6752] Add GoogleAnalyticsRetrieveAdsLinksListOperator (#7748)
759ce2a80 2020-03-20 [AIRFLOW-6978] Add PubSubPullOperator (#7766)
6b9b214e4 2020-03-20 [AIRFLOW-6732] Add GoogleAdsHook and GoogleAdsToGcsOperator (#7692)
b11891696 2020-03-19 [AIRFLOW-7069] Fix cloudsql system tests (#7770)
ae854cae5 2020-03-19 [AIRFLOW-7082] Remove catch_http_exception decorator in GCP hooks (#7756)
7e1e954d2 2020-03-19 [AIRFLOW-7085] Cache credentials, project_id in GCP Base Hook (#7759)
6e21c139b 2020-03-19 [AIRFLOW-XXXX] Fix reference to GCP classes in guides (#7762)
ce022a3f7 2020-03-19 [AIRFLOW-XXXX] Add cross-references for operators guide (#7760)
029c84e55 2020-03-18 [AIRFLOW-5421] Add Presto to GCS transfer operator (#7718)
63a3102ed 2020-03-18 [AIRFLOW-7064] Add CloudFirestoreExportDatabaseOperator (#7725)
73305c7bd 2020-03-18 [AIRFLOW-7081] Remove env variables from GCP guide (#7755)
60fdbf6d9 2020-03-18 [AIRFLOW-5610] Add ability to specify multiple objects to copy in GCSToGCSOperator (#7728)
de7e934ca 2020-03-17 [AIRFLOW-7079] Remove redundant code for storing template_fields (#7750)
0de0347b2 2020-03-17 [AIRFLOW-6855]: Escape project_dataset_table in SQL query in gcs to bq … (#7475)
91557c6f8 2020-03-17 [AIRFLOW-7073] GKEStartPodOperator always use connection credentials (#7738)
51161dbd9 2020-03-16 [AIRFLOW-5664] Store timestamps with microseconds precision (#6354)
2bc020c43 2020-03-14 [AIRFLOW-7055] Verbose logging option for google provider (#7711)
c997cab42 2020-03-13 [AIRFLOW-6724] Add Google Analytics 360 Accounts Retrieve Operator (#7630)
137896f32 2020-03-12 [AIRFLOW-7034] Remove feature: Assigning Dag to task using Bitshift Op (#7685)
1f77f943d 2020-03-10 [AIRFLOW-6980] Improve system tests and building providers package (#7615)
bf9b6b6d7 2020-03-09 [AIRFLOW-5013] Add GCP Data Catalog Hook and operators (#7664)
e5130dc9f 2020-03-09 [AIRFLOW-2911] Add job cancellation capability to Dataflow service (#7659)
faf0df4b9 2020-03-09 [AIRFLOW-XXXX] Fix upsert operator in BQ example DAG (#7666)
42eef3821 2020-03-07 [AIRFLOW-6877] Add cross-provider dependencies as extras (#7506)
b5b9795f0 2020-03-07 [AIRFLOW-6973] Make GCSCreateBucketOperator idempotent (fix) (#7624)
6b65038fb 2020-03-06 [AIRFLOW-6990] Improve system tests for Google Marketing Platform (#7631)
755fe5224 2020-03-05 [AIRFLOW-6915] Add AI Platform Console Link for MLEngineStartTrainingJobOperator (#7535)
cb2f33911 2020-03-04 [AIRFLOW-6973] Make GCSCreateBucketOperator idempotent (#7609)
09fea3ce8 2020-03-04 [AIRFLOW-6977] Fix BigQuery DTS example DAG (#7612)
8230ccc48 2020-03-04 [AIRFLOW-6926] Fix Google Tasks operators return types and idempotency (#7547)
0d1e3088a 2020-03-04 [AIRFLOW-6970] Improve GCP Video Intelligence system tests (#7604)
ab6bb0012 2020-03-03 [AIRFLOW-6971] Fix return type in CloudSpeechToTextRecognizeSpeechOperator (#7607)
3db4ade3d 2020-02-29 [AIRFLOW-6924] Fix Google DLP operators return types (#7546)
008b4bab1 2020-02-27 [AIRFLOW-6730] Use total_seconds instead of seconds (#7363)
bb552b2d9 2020-02-25 [AIRFLOW-6908] Lazy load AirflowException (#7528)
d1a34246a 2020-02-25 [AIRFLOW-6593] Add GCP Stackdriver Alerting Hooks and Operators (#7322)
3320e432a 2020-02-24 [AIRFLOW-6817] Lazy-load airflow.DAG to keep user-facing API untouched (#7517)
dcf874352 2020-02-24 [AIRFLOW-6894] Prevent db query in example_dags (#7516)
4d03e33c1 2020-02-22 [AIRFLOW-6817] remove imports from airflow/__init__.py, replaced implicit imports with explicit imports, added entry to UPDATING.MD - squashed/rebased (#7456)
35b961637 2020-02-21 [AIRFLOW-4973] Add Cloud Data Fusion Pipeline integration (#7486)
aff3a361b 2020-02-20 [AIRFLOW-6558] Campaign Manager operators for conversions (#7420)
9cbd7de6d 2020-02-18 [AIRFLOW-6792] Remove _operator/_hook/_sensor in providers package and add tests (#7412)
5b199cb86 2020-02-17 [AIRFLOW-XXXX] Typo in example_bigquery DAG (#7429)
2c9345a8e 2020-02-17 [AIRFLOW-6759] Added MLEngine operator/hook to cancel MLEngine jobs (#7400)
946bdc23c 2020-02-16 [AIRFLOW-6405] Add GCP BigQuery Table Upsert Operator (#7126)
2381c820c 2020-02-13 [AIRFLOW-6505] Let emoji encoded properly for json.dumps() (#7399)
04c1fefbf 2020-02-03 [AIRFLOW-6676] added GCSDeleteBucketOperator (#7307)
a0252748f 2020-02-03 [AIRFLOW-6717] Remove non-existent field from templated_fields (#7340)
97a429f9d 2020-02-02 [AIRFLOW-6714] Remove magic comments about UTF-8 (#7338)
9d8d07557 2020-02-03 [AIRFLOW-6715] Fix Google Cloud DLP Example DAG (#7337)
cf141506a 2020-02-02 [AIRFLOW-6708] Set unique logger names (#7330)
373c6aa4a 2020-01-30 [AIRFLOW-6682] Move GCP classes to providers package (#7295)
83c037873 2020-01-30 [AIRFLOW-6674] Move example_dags in accordance with AIP-21 (#7287)
057f3ae3a 2020-01-29 [AIRFLOW-6670][depends on AIRFLOW-6669] Move contrib operators to providers package (#7286)
ceea293c1 2020-01-28 [AIRFLOW-6656] Fix AIP-21 moving (#7272)
c42a375e7 2020-01-27 [AIRFLOW-6644][AIP-21] Move service classes to providers package (#7265)
059eda05f 2020-01-21 [AIRFLOW-6610] Move software classes to providers package (#7231)
f4d3e5e54 2020-01-13 [AIRFLOW-6102] [AIP-21] Rename Dataproc operators (#7151)
e7bf8ecb4 2020-01-13 [AIRFLOW-6119] [AIP-21] Rename GCS operators, hooks and sensors (#7125)
5b6772cb8 2020-01-09 [AIRFLOW-6125] [AIP-21] Rename S3 operator and SFTP operator (#7112)
4f8592ae8 2020-01-08 [AIRFLOW-6118] [AIP-21] Rename Pubsub operators and hook (#7046)
20299473f 2020-01-03 [AIRFLOW-6115] [AIP-21] Rename GCP vision operators (#7020)
18e8cea4e 2020-01-03 [AIRFLOW-6428] Fix import path for airflow.utils.dates.days_ago in Example DAGs (#7007)
95087af14 2019-12-31 [AIRFLOW-6110] [AIP-21] Rename natural_language service (#6968)
69629a5a9 2019-12-09 [AIRFLOW-5807] Move SFTP from contrib to providers. (#6464)
25e9047a4 2019-12-09 [AIRFLOW-6193] Do not use asserts in Airflow main code (#6749)
ed0a14f32 2019-12-09 [AIRFLOW-6120] Rename GoogleCloudBaseHook (#6734)
2f2f89c14 2019-12-01 [AIRFLOW-6139] Consistent spaces in pylint enable/disable (#6701)
03c870a61 2019-11-26 [AIRFLOW-6010] Remove cyclic imports and pylint hacks (#6601)
5c4cfea8c 2019-11-15 [AIRFLOW-5718] Add SFTPToGoogleCloudStorageOperator (#6393)
44a8c37a9 2019-11-13 [AIRFLOW-XXX] Fix the docstring for Dataproc get_job method (#6581)
d633d3ac4 2019-11-13 [AIRFLOW-5691] Rewrite Dataproc operators to use python library (#6371)
d985c02d9 2019-11-05 [AIRFLOW-XXX] Add How-To-Guide to GCP PubSub (#6497)
a296cdabd 2019-11-04 [AIRFLOW-5743] Move Google PubSub to providers package (#6476)
470b2a779 2019-10-30 [AIRFLOW-5741] Move Cloud Natural Language to providers (#6421)
f2caa451f 2019-10-27 [AIRFLOW-5742] Move Google Cloud Vision to providers package (#6424)
16d7accb2 2019-10-22 [AIRFLOW-4971] Add Google Display & Video 360 integration (#6170)
4e661f535 2019-10-22 [AIRFLOW-5379] Add Google Search Ads 360 operators (#6228)
19e32b4e2 2019-10-18 [AIRFLOW-5656] Rename provider to providers module (#6333)