Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update DTensor docs, lint notebooks #2276

Merged
merged 3 commits into from
Sep 29, 2023

Conversation

8bitmp3
Copy link
Contributor

@8bitmp3 8bitmp3 commented Sep 29, 2023

No description provided.

@8bitmp3 8bitmp3 requested a review from a team as a code owner September 29, 2023 17:46
@8bitmp3 8bitmp3 self-assigned this Sep 29, 2023
@github-actions
Copy link

Preview

Preview and run these notebook edits with Google Colab: Rendered notebook diffs available on ReviewNB.com.

Format and style

Use the TensorFlow docs notebook tools to format for consistent source diffs and lint for style:
$ python3 -m pip install -U --user git+https://github.com/tensorflow/docs

$ python3 -m tensorflow_docs.tools.nbfmt notebook.ipynb
$ python3 -m tensorflow_docs.tools.nblint --arg=repo:tensorflow/docs notebook.ipynb
If commits are added to the pull request, synchronize your local branch: git pull origin update-dtensor

@@ -98,7 +100,7 @@
},
"outputs": [],
"source": [
"!pip install --quiet --upgrade --pre tensorflow"
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@MarkDaoust removed the "--pre"

@@ -76,7 +76,7 @@
"\n",
"By decoupling the application from sharding directives, DTensor enables running the same application on a single device, multiple devices, or even multiple clients, while preserving its global semantics.\n",
"\n",
"This guide introduces DTensor concepts for distributed computing, and how DTensor integrates with TensorFlow. To see a demo of using DTensor in model training, see [Distributed training with DTensor](https://www.tensorflow.org/tutorials/distribute/dtensor_ml_tutorial) tutorial."
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@MarkDaoust introduced a relative link

@@ -107,9 +109,9 @@
"id": "O3pG29uZIWYO"
},
"source": [
"Once installed, import `tensorflow` and `tf.experimental.dtensor`. Then configure TensorFlow to use 6 virtual CPUs.\n",
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@MarkDaoust full API with tf.experimental is mentioned in the beginning of the section, so shortened this.

Later, "vCPU" -> "virtual CPU"

MarkDaoust
MarkDaoust previously approved these changes Sep 29, 2023
@@ -98,7 +100,7 @@
},
"outputs": [],
"source": [
"!pip install --quiet --upgrade --pre tensorflow"
"!pip install --quiet --upgrade tensorflow"
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We usually don't bother with installing tensorflow. It was only here because the pre-installed version was insufficient.

@@ -99,7 +102,7 @@
},
"outputs": [],
"source": [
"!pip install --quiet --upgrade --pre tensorflow tensorflow-datasets"
"!pip install --quiet --upgrade tensorflow tensorflow-datasets"
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Same.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Will remove this, and lint the notebooks

@8bitmp3 8bitmp3 added the ready to pull Start merge process label Sep 29, 2023
@copybara-service copybara-service bot merged commit 07c2960 into tensorflow:master Sep 29, 2023
4 of 5 checks passed
@8bitmp3 8bitmp3 deleted the update-dtensor branch September 30, 2023 10:43
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
ready to pull Start merge process
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants