forked from GoogleCloudPlatform/generative-ai
-
Notifications
You must be signed in to change notification settings - Fork 0
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
- Noxfile - Owlbot - Renovate - Github super linter
- Loading branch information
1 parent
6198d2a
commit 3495535
Showing
7 changed files
with
399 additions
and
0 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,17 @@ | ||
# Copyright 2022 Google LLC | ||
# | ||
# Licensed under the Apache License, Version 2.0 (the "License"); | ||
# you may not use this file except in compliance with the License. | ||
# You may obtain a copy of the License at | ||
# | ||
# http://www.apache.org/licenses/LICENSE-2.0 | ||
# | ||
# Unless required by applicable law or agreed to in writing, software | ||
# distributed under the License is distributed on an "AS IS" BASIS, | ||
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. | ||
# See the License for the specific language governing permissions and | ||
# limitations under the License. | ||
|
||
docker: | ||
image: gcr.io/cloud-devrel-public-resources/owlbot-python:latest | ||
digest: sha256:b3500c053313dc34e07b1632ba9e4e589f4f77036a7cf39e1fe8906811ae0fce |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,16 @@ | ||
# Copyright 2022 Google LLC | ||
# | ||
# Licensed under the Apache License, Version 2.0 (the "License"); | ||
# you may not use this file except in compliance with the License. | ||
# You may obtain a copy of the License at | ||
# | ||
# http://www.apache.org/licenses/LICENSE-2.0 | ||
# | ||
# Unless required by applicable law or agreed to in writing, software | ||
# distributed under the License is distributed on an "AS IS" BASIS, | ||
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. | ||
# See the License for the specific language governing permissions and | ||
# limitations under the License. | ||
|
||
docker: | ||
image: gcr.io/cloud-devrel-public-resources/owlbot-python:latest |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,6 @@ | ||
title = "gitleaks config" | ||
|
||
[extend] | ||
# useDefault will extend the base configuration with the default gitleaks config: | ||
# https://github.com/zricethezav/gitleaks/blob/master/config/gitleaks.toml | ||
useDefault = true |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,57 @@ | ||
--- | ||
################################# | ||
################################# | ||
## Super Linter GitHub Actions ## | ||
################################# | ||
################################# | ||
name: Lint Code Base | ||
|
||
# | ||
# Documentation: | ||
# https://docs.github.com/en/actions/learn-github-actions/workflow-syntax-for-github-actions | ||
# | ||
|
||
############################# | ||
# Start the job on all push # | ||
############################# | ||
on: | ||
push: | ||
branches-ignore: [main] | ||
# Remove the line above to run when pushing to master | ||
pull_request: | ||
branches: [main] | ||
|
||
############### | ||
# Set the Job # | ||
############### | ||
jobs: | ||
build: | ||
# Name the Job | ||
name: Lint Code Base | ||
# Set the agent to run on | ||
runs-on: ubuntu-latest | ||
|
||
################## | ||
# Load all steps # | ||
################## | ||
steps: | ||
########################## | ||
# Checkout the code base # | ||
########################## | ||
- name: Checkout Code | ||
uses: actions/checkout@v3 | ||
with: | ||
# Full git history is needed to get a proper list of changed files within `super-linter` | ||
fetch-depth: 0 | ||
|
||
################################ | ||
# Run Linter against code base # | ||
################################ | ||
- name: Lint Code Base | ||
uses: github/super-linter/slim@v5 | ||
env: | ||
DEFAULT_BRANCH: main | ||
GITHUB_TOKEN: ${{ secrets.GITHUB_TOKEN }} | ||
LOG_LEVEL: WARN | ||
SHELLCHECK_OPTS: -e SC1091 -e 2086 | ||
VALIDATE_ALL_CODEBASE: false |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,240 @@ | ||
# -*- coding: utf-8 -*- | ||
# | ||
# Copyright 2018 Google LLC | ||
# | ||
# Licensed under the Apache License, Version 2.0 (the "License"); | ||
# you may not use this file except in compliance with the License. | ||
# You may obtain a copy of the License at | ||
# | ||
# https://www.apache.org/licenses/LICENSE-2.0 | ||
# | ||
# Unless required by applicable law or agreed to in writing, software | ||
# distributed under the License is distributed on an "AS IS" BASIS, | ||
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. | ||
# See the License for the specific language governing permissions and | ||
# limitations under the License. | ||
|
||
# Generated by synthtool. DO NOT EDIT! | ||
|
||
from __future__ import absolute_import | ||
import os | ||
import pathlib | ||
import shutil | ||
|
||
import nox | ||
|
||
|
||
BLACK_VERSION = "black==22.3.0" | ||
BLACK_PATHS = ["."] | ||
|
||
DEFAULT_PYTHON_VERSION = "3.8" | ||
SYSTEM_TEST_PYTHON_VERSIONS = ["3.8"] | ||
UNIT_TEST_PYTHON_VERSIONS = ["3.6", "3.7", "3.8", "3.9", "3.10"] | ||
|
||
CURRENT_DIRECTORY = pathlib.Path(__file__).parent.absolute() | ||
|
||
# 'docfx' is excluded since it only needs to run in 'docs-presubmit' | ||
nox.options.sessions = [ | ||
"unit", | ||
"system", | ||
"cover", | ||
"lint", | ||
"lint_setup_py", | ||
"blacken", | ||
"docs", | ||
] | ||
|
||
# Error if a python version is missing | ||
nox.options.error_on_missing_interpreters = True | ||
|
||
|
||
@nox.session(python=DEFAULT_PYTHON_VERSION) | ||
def lint(session): | ||
"""Run linters. | ||
Returns a failure if the linters find linting errors or sufficiently | ||
serious code quality issues. | ||
""" | ||
session.install("flake8", BLACK_VERSION) | ||
session.run( | ||
"black", | ||
"--check", | ||
*BLACK_PATHS, | ||
) | ||
session.run("flake8", "google", "tests") | ||
|
||
|
||
@nox.session(python=DEFAULT_PYTHON_VERSION) | ||
def blacken(session): | ||
"""Run black. Format code to uniform standard.""" | ||
session.install(BLACK_VERSION) | ||
session.run( | ||
"black", | ||
*BLACK_PATHS, | ||
) | ||
|
||
|
||
@nox.session(python=DEFAULT_PYTHON_VERSION) | ||
def lint_setup_py(session): | ||
"""Verify that setup.py is valid (including RST check).""" | ||
session.install("docutils", "pygments") | ||
session.run("python", "setup.py", "check", "--restructuredtext", "--strict") | ||
|
||
|
||
def default(session): | ||
# Install all test dependencies, then install this package in-place. | ||
|
||
constraints_path = str( | ||
CURRENT_DIRECTORY / "testing" / f"constraints-{session.python}.txt" | ||
) | ||
session.install( | ||
"mock", | ||
"asyncmock", | ||
"pytest", | ||
"pytest-cov", | ||
"pytest-asyncio", | ||
"-c", | ||
constraints_path, | ||
) | ||
|
||
session.install("-e", ".", "-c", constraints_path) | ||
|
||
# Run py.test against the unit tests. | ||
session.run( | ||
"py.test", | ||
"--quiet", | ||
f"--junitxml=unit_{session.python}_sponge_log.xml", | ||
"--cov=google", | ||
"--cov=tests/unit", | ||
"--cov-append", | ||
"--cov-config=.coveragerc", | ||
"--cov-report=", | ||
"--cov-fail-under=0", | ||
os.path.join("tests", "unit"), | ||
*session.posargs, | ||
) | ||
|
||
|
||
@nox.session(python=UNIT_TEST_PYTHON_VERSIONS) | ||
def unit(session): | ||
"""Run the unit test suite.""" | ||
default(session) | ||
|
||
|
||
@nox.session(python=SYSTEM_TEST_PYTHON_VERSIONS) | ||
def system(session): | ||
"""Run the system test suite.""" | ||
constraints_path = str( | ||
CURRENT_DIRECTORY / "testing" / f"constraints-{session.python}.txt" | ||
) | ||
system_test_path = os.path.join("tests", "system.py") | ||
system_test_folder_path = os.path.join("tests", "system") | ||
|
||
# Check the value of `RUN_SYSTEM_TESTS` env var. It defaults to true. | ||
if os.environ.get("RUN_SYSTEM_TESTS", "true") == "false": | ||
session.skip("RUN_SYSTEM_TESTS is set to false, skipping") | ||
# Install pyopenssl for mTLS testing. | ||
if os.environ.get("GOOGLE_API_USE_CLIENT_CERTIFICATE", "false") == "true": | ||
session.install("pyopenssl") | ||
|
||
system_test_exists = os.path.exists(system_test_path) | ||
system_test_folder_exists = os.path.exists(system_test_folder_path) | ||
# Sanity check: only run tests if found. | ||
if not system_test_exists and not system_test_folder_exists: | ||
session.skip("System tests were not found") | ||
|
||
# Use pre-release gRPC for system tests. | ||
session.install("--pre", "grpcio") | ||
|
||
# Install all test dependencies, then install this package into the | ||
# virtualenv's dist-packages. | ||
session.install("mock", "pytest", "google-cloud-testutils", "-c", constraints_path) | ||
session.install("-e", ".", "-c", constraints_path) | ||
|
||
# Run py.test against the system tests. | ||
if system_test_exists: | ||
session.run( | ||
"py.test", | ||
"--quiet", | ||
f"--junitxml=system_{session.python}_sponge_log.xml", | ||
system_test_path, | ||
*session.posargs, | ||
) | ||
if system_test_folder_exists: | ||
session.run( | ||
"py.test", | ||
"--quiet", | ||
f"--junitxml=system_{session.python}_sponge_log.xml", | ||
system_test_folder_path, | ||
*session.posargs, | ||
) | ||
|
||
|
||
@nox.session(python=DEFAULT_PYTHON_VERSION) | ||
def cover(session): | ||
"""Run the final coverage report. | ||
This outputs the coverage report aggregating coverage from the unit | ||
test runs (not system test runs), and then erases coverage data. | ||
""" | ||
session.install("coverage", "pytest-cov") | ||
session.run("coverage", "report", "--show-missing", "--fail-under=100") | ||
|
||
session.run("coverage", "erase") | ||
|
||
|
||
@nox.session(python=DEFAULT_PYTHON_VERSION) | ||
def docs(session): | ||
"""Build the docs for this library.""" | ||
|
||
session.install("-e", ".") | ||
session.install("sphinx==4.0.1", "alabaster", "recommonmark") | ||
|
||
shutil.rmtree(os.path.join("docs", "_build"), ignore_errors=True) | ||
session.run( | ||
"sphinx-build", | ||
"-W", # warnings as errors | ||
"-T", # show full traceback on exception | ||
"-N", # no colors | ||
"-b", | ||
"html", | ||
"-d", | ||
os.path.join("docs", "_build", "doctrees", ""), | ||
os.path.join("docs", ""), | ||
os.path.join("docs", "_build", "html", ""), | ||
) | ||
|
||
|
||
@nox.session(python=DEFAULT_PYTHON_VERSION) | ||
def docfx(session): | ||
"""Build the docfx yaml files for this library.""" | ||
|
||
session.install("-e", ".") | ||
session.install( | ||
"sphinx==4.0.1", "alabaster", "recommonmark", "gcp-sphinx-docfx-yaml" | ||
) | ||
|
||
shutil.rmtree(os.path.join("docs", "_build"), ignore_errors=True) | ||
session.run( | ||
"sphinx-build", | ||
"-T", # show full traceback on exception | ||
"-N", # no colors | ||
"-D", | ||
( | ||
"extensions=sphinx.ext.autodoc," | ||
"sphinx.ext.autosummary," | ||
"docfx_yaml.extension," | ||
"sphinx.ext.intersphinx," | ||
"sphinx.ext.coverage," | ||
"sphinx.ext.napoleon," | ||
"sphinx.ext.todo," | ||
"sphinx.ext.viewcode," | ||
"recommonmark" | ||
), | ||
"-b", | ||
"html", | ||
"-d", | ||
os.path.join("docs", "_build", "doctrees", ""), | ||
os.path.join("docs", ""), | ||
os.path.join("docs", "_build", "html", ""), | ||
) |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,34 @@ | ||
# Copyright 2022 Google LLC | ||
# | ||
# Licensed under the Apache License, Version 2.0 (the "License"); | ||
# you may not use this file except in compliance with the License. | ||
# You may obtain a copy of the License at | ||
# | ||
# http://www.apache.org/licenses/LICENSE-2.0 | ||
# | ||
# Unless required by applicable law or agreed to in writing, software | ||
# distributed under the License is distributed on an "AS IS" BASIS, | ||
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. | ||
# See the License for the specific language governing permissions and | ||
# limitations under the License. | ||
|
||
import synthtool as s | ||
import synthtool.gcp as gcp | ||
|
||
templated_files = gcp.CommonTemplates().py_library() | ||
|
||
# Copy the standard noxfile from templated_files | ||
s.move(templated_files / "noxfile.py") | ||
|
||
# Update BLACK_PATHS in order to run black on all files | ||
s.replace( | ||
"noxfile.py", | ||
r"""BLACK_PATHS = \["docs", "google", "tests", "noxfile.py", "setup.py"\]""", | ||
r"""BLACK_PATHS = ["."]""", | ||
) | ||
|
||
# ---------------------------------------------------------------------------- | ||
# Run blacken session | ||
# ---------------------------------------------------------------------------- | ||
|
||
s.shell.run(["nox", "-s", "blacken"], hide_output=False) |
Oops, something went wrong.