Added compatibility with TensorRT version 8.0

.gitignore

@@ -0,0 +1,19 @@
+.ninja_deps
+.ninja_log
+build.ninja
+tags
+*.o
+*.pb.o
+torch2trt.egg-info
+build/
+dist/
+__pycache__/
+*.so
+*.pb.h
+*.pb.cc
+*_pb2.py
+*.pyc
+*.ipynb_checkpoints
+*.pth
+docs/converters.md
+site

CHANGELOG.md

@@ -0,0 +1,20 @@
+# Changes
+
+## [Master]
+
+## [0.2.0] - 03/02/2021
+
+- Added converter for ``torch.Tensor.flatten``
+- Added converter for ``torch.nn.functional.conv2d`` and ``torch.nn.functional.conv3d``
+
+### Added 
+
+- Added converter for ``torch.Tensor.expand``
+- Added support for custom converters for methods defined outside of ``torch`` module
+- Added names for TensorRT layers
+- Added GroupNorm plugin which internally uses PyTorch aten::group_norm
+- Replaced Tensor.ndim references with len(tensor.shape) to support older pytorch versions
+- Added reduced precision documentation page
+- Added converters for ``floordiv``, ``mod``, ``ne``, and ``torch.tensor`` operations
+- Extended ``relu`` converter to support ``Tensor.relu`` operation
+- Extended ``sigmoid`` converter to support ``Tensor.sigmoid`` operation

CLA.md

@@ -0,0 +1,58 @@
+## Individual Contributor License Agreement (CLA)
+
+**Thank you for submitting your contributions to this project.**
+
+By signing this CLA, you agree that the following terms apply to all of your past, present and future contributions
+to the project.
+
+### License.
+
+You hereby represent that all present, past and future contributions are governed by the
+[MIT License](https://opensource.org/licenses/MIT)
+copyright statement.
+
+This entails that to the extent possible under law, you transfer all copyright and related or neighboring rights
+of the code or documents you contribute to the project itself or its maintainers.
+Furthermore you also represent that you have the authority to perform the above waiver
+with respect to the entirety of you contributions.
+
+### Moral Rights.
+
+To the fullest extent permitted under applicable law, you hereby waive, and agree not to
+assert, all of your “moral rights” in or relating to your contributions for the benefit of the project.
+
+### Third Party Content.
+
+If your Contribution includes or is based on any source code, object code, bug fixes, configuration changes, tools,
+specifications, documentation, data, materials, feedback, information or other works of authorship that were not
+authored by you (“Third Party Content”) or if you are aware of any third party intellectual property or proprietary
+rights associated with your Contribution (“Third Party Rights”),
+then you agree to include with the submission of your Contribution full details respecting such Third Party
+Content and Third Party Rights, including, without limitation, identification of which aspects of your
+Contribution contain Third Party Content or are associated with Third Party Rights, the owner/author of the
+Third Party Content and Third Party Rights, where you obtained the Third Party Content, and any applicable
+third party license terms or restrictions respecting the Third Party Content and Third Party Rights. For greater
+certainty, the foregoing obligations respecting the identification of Third Party Content and Third Party Rights
+do not apply to any portion of a Project that is incorporated into your Contribution to that same Project.
+
+### Representations.
+
+You represent that, other than the Third Party Content and Third Party Rights identified by
+you in accordance with this Agreement, you are the sole author of your Contributions and are legally entitled
+to grant the foregoing licenses and waivers in respect of your Contributions. If your Contributions were
+created in the course of your employment with your past or present employer(s), you represent that such
+employer(s) has authorized you to make your Contributions on behalf of such employer(s) or such employer
+(s) has waived all of their right, title or interest in or to your Contributions.
+
+### Disclaimer.
+
+To the fullest extent permitted under applicable law, your Contributions are provided on an "as is"
+basis, without any warranties or conditions, express or implied, including, without limitation, any implied
+warranties or conditions of non-infringement, merchantability or fitness for a particular purpose. You are not
+required to provide support for your Contributions, except to the extent you desire to provide support.
+
+### No Obligation.
+
+You acknowledge that the maintainers of this project are under no obligation to use or incorporate your contributions
+into the project. The decision to use or incorporate your contributions into the project will be made at the
+sole discretion of the maintainers or their authorized delegates.

CONTRIBUTING.md

@@ -0,0 +1,104 @@
+# Contributing
+
+## Forms of contribution
+
+### Submit an Issue
+
+torch2trt is use case driven.  We originally created it to solve
+use cases related to NVIDIA Jetson, but the layer support has grown
+largely since it's release and we've found that it has 
+helped many other developers as well.  
+
+The growth of torch2trt has been largely driven by issues submitted on [GitHub](https://github.com/NVIDIA-AI-IOT/torch2trt/issues).
+We learn a lot from the reported issues. Submitting an issue it is one of the best ways to begin contributing to torch2trt.
+
+The reported issues typically are one of the following,
+
+* A bug or unexpected result
+* A model with unsupported layers
+
+If you report an issue, we typically find the following information helpful
+
+* PyTorch version
+* TensorRT version
+* Platform (ie: Jetson Nano)
+* The PyTorch Module you're attempting to convert
+* The steps taken to convert the PyTorch module
+
+If you're not sure how to provide any of these pieces of information, don't worry.  Just open the issue
+and we're happy to discuss and help work out the details.
+
+### Ask a Question
+
+Another great way to contribute is to ask a question on [GitHub](https://github.com/NVIDIA-AI-IOT/torch2trt/issues).
+There are often other developers who share your question, and they may find the discussion helpful.  This also
+helps us gauge feature interest and identify gaps in documentation.
+
+### Submit a Pull Request
+
+torch2trt is use case driven and has limited maintainence, for this reason we value community contributions greatly.
+Another great way to contribute is by submitting a pull request.  Pull requests which are most likely to be accepted are
+
+* A new converter
+* A test case
+* A bug fix
+
+If you add a new converter, it is best to include a few test
+cases that cross validate the converter against the original PyTorch.  We provide a utility function to do this,
+as described in the [Custom Converter](usage/custom_converter.md) usage guide.
+
+Ideally pull requests solve one thing at a time.  This makes it easy
+to evaluate the impact that the changes have on the project step-by-step.  The more confident we are that
+the changes will not adversely impact the experience of other developers, the more likely we are to accept them.
+
+## Running module test cases
+
+Before any change is accepted, we run the test cases on at least one platform.  This performs a large number
+of cross validation checks against PyTorch.  To do this
+
+```bash
+python3 -m torch2trt.test --name=converters --tolerance=1e-2
+```
+
+This will not hard-fail, but will highlight any build errors or max error checks.  It is helpful if you include
+the status of this command in any pull-request, as well as system information like
+
+* PyTorch version
+* TensorRT version
+* Platform (ie: Jetson Nano)
+
+## Testing documentation
+
+If you have a change that modifies the documentation, it is relatively straightforward to test.  We
+use ``mkdocs-material`` for documentation, which parses markdown files in the ``docs`` folder.
+
+To view the docs, simply call
+
+```
+./scripts/test_docs.sh
+```
+
+And then navigate to ``https://<ip_address>:8000``.
+
+Please note, this will not include dynamically generated documentation pages like the converters page.
+These contain cross reference links to the GitHub source code. If you want to test these
+you can call 
+
+```bash
+./scripts/build_docs.sh <github url> <tag>
+```
+
+Pointing to the public reflection
+of your local repository.  For example, if we're working off the upstream master branch, we
+would call 
+
+```bash
+./scripts/build_docs.sh https://github.com/NVIDIA-AI-IOT/torch2trt master
+```
+
+If your changes are pushed to your fork, you would do 
+
+```bash
+./scripts/build_docs.sh https://github.com/<user>/torch2trt my_branch
+```
+

CONTRIBUTORS.md

@@ -0,0 +1,47 @@
+# Contributors
+
+Below is a list of developers who have contributed to torch2trt.  This is also used to track contributors
+who have agreed to torch2trt's Contributor License Agreement.
+
+- [John Welsh](https://github.com/jaybdub) (CLA)
+
+## Becoming a Contributor
+
+If you've made a notable contribution to torch2trt and wish to be listed as a contributor, simply do the following.
+
+1. Modify ``CONTRIBUTORS.md`` and add your name with a hyperlink to your GitHub account to the end of the contributors list.
+
+    ```md
+    - [<Full name or GitHub account>](https://github.com/<GitHub account>)
+    ```
+
+2. Stage the changes in a standalone commit
+
+    ```md
+    git add CONTRIBUTORS.md
+    ```
+
+3. Make a signed commit with the following message text
+
+    ```md
+    git commit -m "Added <Full name or GitHub account> to CONTRIBUTORS.md"
+    ```
+
+## Signing Contributor License Agreement (CLA)
+
+In some instances, you may be requested to sign torch2trt's Contributor License Agreement (CLA). To do so,
+
+1. If you're not already listed as a contributor in CONTRIBUTORS.md, make a commit as described above to add yourself to CONTRIBUTORS.md
+
+2. Add the text ``(CLA)`` after your name in ``CONTRIBUTORS.md``
+3. Stage the changes in a standalone commit
+
+   ```md
+   git add CONTRIBUTORS.md
+   ```
+4. Make a signed commit with the following text
+
+   ```md
+   git commit -S -m "I have read and agree to the Contributor License Agreement as written in the file CLA.md of this project.  Signed, <Full Name>"
+   ```
+

LICENSE.md

@@ -0,0 +1,7 @@
+Copyright (c) 2019, NVIDIA CORPORATION. All rights reserved.
+
+Permission is hereby granted, free of charge, to any person obtaining a copy of this software and associated documentation files (the "Software"), to deal in the Software without restriction, including without limitation the rights to use, copy, modify, merge, publish, distribute, sublicense, and/or sell copies of the Software, and to permit persons to whom the Software is furnished to do so, subject to the following conditions:
+
+The above copyright notice and this permission notice shall be included in all copies or substantial portions of the Software.
+
+THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE SOFTWARE.