forked from AMReX-Astro/workflow
-
Notifications
You must be signed in to change notification settings - Fork 0
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
- Loading branch information
Showing
44 changed files
with
15,801 additions
and
1 deletion.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -1,3 +1,4 @@ | ||
*~ | ||
\#* | ||
.#* | ||
sphinx_docs/build |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,26 @@ | ||
.. pyro documentation master file, created by | ||
sphinx-quickstart on Mon Dec 25 18:42:54 2017. | ||
You can adapt this file completely to your liking, but it should at least | ||
contain the root `toctree` directive. | ||
************************ | ||
AMReX Astrophysics Suite | ||
************************ | ||
|
||
`http://github.com/AMReX-Astro <http://github.com/AMReX-Astro>`_ | ||
|
||
.. toctree:: | ||
:maxdepth: 1 | ||
:caption: pyro basics | ||
|
||
intro | ||
nersc | ||
olcf | ||
workstations | ||
|
||
|
||
Indices and tables | ||
================== | ||
|
||
* :ref:`genindex` | ||
* :ref:`search` |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,96 @@ | ||
Working at NERSC | ||
================ | ||
|
||
Edison | ||
------ | ||
|
||
Intel | ||
^^^^^ | ||
|
||
Intel is the default programming environment on edison and appear to | ||
be the preferred compilers. The Intel 18.0.2 compilers seem to work | ||
well at NERSC. These are not currently the default, so you will need | ||
to do a ``module swap`` to load them. Note: 18.0.1 do not seem to work. | ||
|
||
|
||
Cray | ||
^^^^ | ||
|
||
No current information. | ||
|
||
|
||
GNU | ||
^^^ | ||
|
||
You need to swap environments:: | ||
|
||
module swap PrgEnv-{intel,gnu} | ||
|
||
There are no known issues with GNU. | ||
|
||
|
||
Hypre | ||
^^^^^ | ||
|
||
On Edison, the Cray _Third Party Scientific Libraries_ provide ``hypre`` | ||
in a form that works directly with the compiler wrappers used on that | ||
machine (``CC``, ``ftn``, ...). To use this, simply do:: | ||
|
||
module load cray-tpsl | ||
|
||
There is no need to set ``HYPRE_DIR``, but note however that the | ||
dependency checker script (``BoxLib/Tools/C_scripts/mkdep``) will | ||
complain about:: | ||
|
||
/path/to/Hypre--with-openmp/include does not exist | ||
|
||
This can be ignored an compilation will finish. If you do wish to | ||
silence it, you can set ``HYPRE_DIR`` to the path shown by:: | ||
|
||
module show cray-tpsl | ||
|
||
as:: | ||
|
||
export HYPRE_DIR=${CRAY_TPSL_PREFIX_DIR} | ||
|
||
This path will change dynamically to reflect which compiler programming | ||
environment you have loaded. (You can also see that this is the path | ||
sent to the compilation by doing ``ftn -craype-verbose``). | ||
|
||
|
||
|
||
Preferred configuration | ||
^^^^^^^^^^^^^^^^^^^^^^^ | ||
|
||
There are 24 cores per node on Edison. Generally, using 4 or 6 OpenMP | ||
threads with 6 or 4 MPI tasks works best. | ||
|
||
|
||
|
||
|
||
|
||
|
||
Cori Haswell | ||
------------ | ||
|
||
|
||
|
||
Cori KNL | ||
-------- | ||
|
||
Regardless of the compiler, you need to swap the compiler weappers to | ||
use the AVX-512 instruction set supported on the Intel Phi processors | ||
(instead of the AVX-2 on the Haswell chips). This is done as:: | ||
|
||
module swap craype-{haswell,mic-knl} | ||
|
||
It could happen that even when the various verbosities are set to 0, | ||
when using several nodes (more than 64) in a run compiled with Intel, | ||
the follwing error shows:: | ||
|
||
forrtl: severe (40): recursive I/O operation, unit -1, file unknown | ||
|
||
Seems like the error is due to all threads printing to stdout. Adding | ||
the following to the ``inputs`` file, prevents this error to occur:: | ||
|
||
castro.print_fortran_warnings = 0 |
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Oops, something went wrong.