Skip to content
This repository has been archived by the owner on Jul 16, 2024. It is now read-only.

Commit

Permalink
Merge pull request #1 from helq/main
Browse files Browse the repository at this point in the history
Creating a basic Tachyon's webpage using Jekyll
  • Loading branch information
carothersc authored Mar 6, 2024
2 parents 3a8a1c9 + 2636572 commit 5287dd0
Show file tree
Hide file tree
Showing 60 changed files with 2,378 additions and 56 deletions.
2 changes: 2 additions & 0 deletions .bundle/config
Original file line number Diff line number Diff line change
@@ -0,0 +1,2 @@
---
BUNDLE_PATH: "vendor"
5 changes: 5 additions & 0 deletions .gitignore
Original file line number Diff line number Diff line change
@@ -0,0 +1,5 @@
_site
.sass-cache
.jekyll-cache
.jekyll-metadata
vendor
25 changes: 25 additions & 0 deletions 404.html
Original file line number Diff line number Diff line change
@@ -0,0 +1,25 @@
---
permalink: /404.html
layout: default
---

<style type="text/css" media="screen">
.container {
margin: 10px auto;
max-width: 600px;
text-align: center;
}
h1 {
margin: 30px 0;
font-size: 4em;
line-height: 1;
letter-spacing: -1px;
}
</style>

<div class="container">
<h1>404</h1>

<p><strong>Page not found :(</strong></p>
<p>The requested page could not be found.</p>
</div>
35 changes: 35 additions & 0 deletions Gemfile
Original file line number Diff line number Diff line change
@@ -0,0 +1,35 @@
source "https://rubygems.org"
# Hello! This is where you manage which Jekyll version is used to run.
# When you want to use a different version, change it below, save the
# file and run `bundle install`. Run Jekyll with `bundle exec`, like so:
#
# bundle exec jekyll serve
#
# This will help ensure the proper Jekyll version is running.
# Happy Jekylling!
gem "jekyll", "~> 4.3.3"
# This is the default theme for new Jekyll sites. You may change this to anything you like.
gem "minima", "~> 2.5"
# If you want to use GitHub Pages, remove the "gem "jekyll"" above and
# uncomment the line below. To upgrade, run `bundle update github-pages`.
# gem "github-pages", group: :jekyll_plugins
# If you have any plugins, put them here!
group :jekyll_plugins do
gem "jekyll-feed", "~> 0.12"
end

# Windows and JRuby does not include zoneinfo files, so bundle the tzinfo-data gem
# and associated library.
platforms :mingw, :x64_mingw, :mswin, :jruby do
gem "tzinfo", ">= 1", "< 3"
gem "tzinfo-data"
end

# Performance-booster for watching directories on Windows
gem "wdm", "~> 0.1.1", :platforms => [:mingw, :x64_mingw, :mswin]

# Lock `http_parser.rb` gem to `v0.6.x` on JRuby builds since newer versions of the gem
# do not have a Java counterpart.
gem "http_parser.rb", "~> 0.6.0", :platforms => [:jruby]

gem "json"
132 changes: 132 additions & 0 deletions Gemfile.lock
Original file line number Diff line number Diff line change
@@ -0,0 +1,132 @@
GEM
remote: https://rubygems.org/
specs:
addressable (2.8.6)
public_suffix (>= 2.0.2, < 6.0)
colorator (1.1.0)
concurrent-ruby (1.2.3)
em-websocket (0.5.3)
eventmachine (>= 0.12.9)
http_parser.rb (~> 0)
eventmachine (1.2.7)
ffi (1.16.3)
forwardable-extended (2.6.0)
google-protobuf (3.25.2)
google-protobuf (3.25.2-aarch64-linux)
google-protobuf (3.25.2-arm64-darwin)
google-protobuf (3.25.2-x86-linux)
google-protobuf (3.25.2-x86_64-darwin)
google-protobuf (3.25.2-x86_64-linux)
http_parser.rb (0.8.0)
i18n (1.14.1)
concurrent-ruby (~> 1.0)
jekyll (4.3.3)
addressable (~> 2.4)
colorator (~> 1.0)
em-websocket (~> 0.5)
i18n (~> 1.0)
jekyll-sass-converter (>= 2.0, < 4.0)
jekyll-watch (~> 2.0)
kramdown (~> 2.3, >= 2.3.1)
kramdown-parser-gfm (~> 1.0)
liquid (~> 4.0)
mercenary (>= 0.3.6, < 0.5)
pathutil (~> 0.9)
rouge (>= 3.0, < 5.0)
safe_yaml (~> 1.0)
terminal-table (>= 1.8, < 4.0)
webrick (~> 1.7)
jekyll-feed (0.17.0)
jekyll (>= 3.7, < 5.0)
jekyll-sass-converter (3.0.0)
sass-embedded (~> 1.54)
jekyll-seo-tag (2.8.0)
jekyll (>= 3.8, < 5.0)
jekyll-watch (2.2.1)
listen (~> 3.0)
json (2.7.1)
kramdown (2.4.0)
rexml
kramdown-parser-gfm (1.1.0)
kramdown (~> 2.0)
liquid (4.0.4)
listen (3.8.0)
rb-fsevent (~> 0.10, >= 0.10.3)
rb-inotify (~> 0.9, >= 0.9.10)
mercenary (0.4.0)
minima (2.5.1)
jekyll (>= 3.5, < 5.0)
jekyll-feed (~> 0.9)
jekyll-seo-tag (~> 2.1)
pathutil (0.16.2)
forwardable-extended (~> 2.6)
public_suffix (5.0.4)
rb-fsevent (0.11.2)
rb-inotify (0.10.1)
ffi (~> 1.0)
rexml (3.2.6)
rouge (4.2.0)
safe_yaml (1.0.5)
sass-embedded (1.69.5-aarch64-linux-android)
google-protobuf (~> 3.23)
sass-embedded (1.69.5-aarch64-linux-gnu)
google-protobuf (~> 3.23)
sass-embedded (1.69.5-aarch64-linux-musl)
google-protobuf (~> 3.23)
sass-embedded (1.69.5-arm-linux-androideabi)
google-protobuf (~> 3.23)
sass-embedded (1.69.5-arm-linux-gnueabihf)
google-protobuf (~> 3.23)
sass-embedded (1.69.5-arm-linux-musleabihf)
google-protobuf (~> 3.23)
sass-embedded (1.69.5-arm64-darwin)
google-protobuf (~> 3.23)
sass-embedded (1.69.5-x86-linux-android)
google-protobuf (~> 3.23)
sass-embedded (1.69.5-x86-linux-gnu)
google-protobuf (~> 3.23)
sass-embedded (1.69.5-x86-linux-musl)
google-protobuf (~> 3.23)
sass-embedded (1.69.5-x86_64-darwin)
google-protobuf (~> 3.23)
sass-embedded (1.69.5-x86_64-linux-android)
google-protobuf (~> 3.23)
sass-embedded (1.69.5-x86_64-linux-gnu)
google-protobuf (~> 3.23)
sass-embedded (1.69.5-x86_64-linux-musl)
google-protobuf (~> 3.23)
terminal-table (3.0.2)
unicode-display_width (>= 1.1.1, < 3)
unicode-display_width (2.5.0)
webrick (1.8.1)

PLATFORMS
aarch64-linux
aarch64-linux-android
aarch64-linux-gnu
aarch64-linux-musl
arm-linux-androideabi
arm-linux-gnueabihf
arm-linux-musleabihf
arm64-darwin
x86-linux
x86-linux-android
x86-linux-gnu
x86-linux-musl
x86_64-darwin
x86_64-linux-android
x86_64-linux-gnu
x86_64-linux-musl

DEPENDENCIES
http_parser.rb (~> 0.6.0)
jekyll (~> 4.3.3)
jekyll-feed (~> 0.12)
json
minima (~> 2.5)
tzinfo (>= 1, < 3)
tzinfo-data
wdm (~> 0.1.1)

BUNDLED WITH
2.5.4
93 changes: 37 additions & 56 deletions README.md
Original file line number Diff line number Diff line change
@@ -1,56 +1,37 @@
# Tachyon
DOE Tachyon Project

<h3 align="center">Project Summary</h3>

The success of DOE ``big science'' is increasingly tied to data analysis on extreme-scale distributed computing infrast
ructure. The DOE High Energy Physics (HEP) program in Neutrino and Collider science has been a key driver in applying a
nd adapting data-intensive science and simulation codes to extreme-scale platforms. These complex, highly distributed w
orkflows will continue to push the limits of current and future extreme-scale systems, especially as they evolve to ut\
lize increasingly sophisticated AI/ML techniques for their data analysis. For example, the next generation of neutrino
oscillation experiments, led by the DUNE experiment, are based on the liquid argon time project chamber technology. The
se detectors generate petabytes of high-resolution image data that capture high-energy, complex interactions of neutrin
os on argon nuclei and allow for the measurement of fundamental parameters in the neutrino mixing model. The expected d
ata rates for the DUNE far detectors (located 1,000 miles from FNAL) are capable of producing 6 GB of readout data per
5 milliseconds, providing a resolution, fidelity, and data volume nearly 300 times greater than the equivalent interact
ions being captured with the current generation technologies. Components of this high-fidelity experimental data stream
are intended to be analyzed in near real-time, requiring leadership-class computing resources to do so. The hierarchy
of complex, high-performance computing, network, and storage components, as well as pathways from the experimental and
leadership computing facilities, need to be {\em modeled}, {\em analyzed}, and {\em tuned} to meet the necessary respo
nse times and resiliency to disruption under nominal and atypical operational conditions.

To address this modeling grand challenge and build on past successful collaborations, the *Tachyon Project* five-in
stitution team proposes a framework that enables the scalable modeling, simulation, and validation of key performance c
haracteristics for the Fermilab (FNAL) to Argonne Leadership Computing Facility (ALCF) distributed infrastructure and a
ssociated HEP workflows. Our proposed framework is a multi-scale HEP workflow simulation model that will accurately mod
el and predict the end-to-end workflow performance over the wide range of timescales and job/system failure scenarios t
hat a resilient distributed HEP infrastructure must operate now and in the future.

The proposed research program is divided into Core Research Tasks (CRTs) and leverages design outcomes from the DOE EXP
RESS {\em Kronos} Project as well as the CODES systems modeling framework to integrate comple
mentary modeling methodologies: parallel discrete-event simulation (PDES), surrogate machine learning (ML) m
odels} and {\em analytic models} into an overall {\em scalable system model} (CRT T3). This scalable system model is co
upled with extensive facility-supported performance data (CRT T1), resilient job scheduling (CRT T2), and highly infor
mative visualization and performance analysis (CRT T4).

The {\bf Tachyon Project} will model the entire HEP distributed infrastructure and workflow campaign by creating surrog
ate ML models that are trained using both historical facility data as well as massively parallel CODES-generated simula
tion data that has been validated using extensive interactive visualization and analysis of the data and models via fac
ility performance data repositories. By leveraging validated, high-fidelity CODES simulation data, we are able to drama
tically increase the predictive range of surrogate ML models beyond the preset job and system configurations contained
within current historical performance data repositories.

To capture the importance of resiliency, job placement, and scheduling in our scalable system modeling framework, the C
QSim scheduling simulator will be extended and integrated with CODES to enable workflow-centric/facility-centric sched
uling and reliability modeling. To address the need for understanding phenomena in both the real distributed infrastruc
ture and the scalable system model, visual analytic methods will be developed for the facility performance data, system
s simulators, and surrogate models.

<h3>Project Impact: </h3>
Our proposed scalable system model will have a target accuracy of 90\% and perform significantly faster than existing h
igh-fidelity modeling approaches, yielding a highly valuable ``what-if'' planning tool for future distributed HEP exper
iments. More broadly, {\em scalable modeling} of distributed HEP systems and exploring their stability will allow us to
design workflow topologies and operational envelopes which will match the mission demands of other distributed science
domains. {\bf In turn, the Tachyon Project scalable system modeling framework will maximize the impact of the DOE’s in
vestment in distributed infrastructures like FNAL and ALCF by improving their resiliency and increasing the rate of sci
entific discoveries across the breadth of the DOE's experimental and computing resources.
# Generating Webpage

## Prerequisites

First, we need some basic tools. Install, Ruby and Bundle, then run (under this directory):

``` bash
bundle config set --local path 'vendor'
bundle install
```

## Generation

All we need to do now is:

``` bash
bundle exec jekyll build -d docs
```

That will generate the webpage.

## Adding a new post

See one of the examples inside `_posts` and follow their template. If lost, google
"jekyll post example template for minima".

## Checking whether post or change looks good before commiting

Continuosly build and run http server with:

```bash
bundle exec jekyll serve --baseurl ''
```

Now go to: <http://localhost:4000>

**Do NOT forget to `build` the website before commiting! ("generation" section above).**
61 changes: 61 additions & 0 deletions _config.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,61 @@
# Welcome to Jekyll!
#
# This config file is meant for settings that affect your whole blog, values
# which you are expected to set up once and rarely edit after that. If you find
# yourself editing this file very often, consider using Jekyll's data files
# feature for the data you need to update frequently.
#
# For technical reasons, this file is *NOT* reloaded automatically when you use
# 'bundle exec jekyll serve'. If you change this file, please restart the server process.
#
# If you need help with YAML syntax, here are some quick references for you:
# https://learn-the-web.algonquindesign.ca/topics/markdown-yaml-cheat-sheet/#yaml
# https://learnxinyminutes.com/docs/yaml/
#
# Site settings
# These are used to personalize your new site. If you look in the HTML files,
# you will see them accessed via {{ site.title }}, {{ site.email }}, and so on.
# You can create any custom variable you would like, and they will be accessible
# in the templates via {{ site.myvariable }}.

title: Tachyon
author: "DOE"
list_title: News
#email: [email protected]
description: >- # this means to ignore newlines until "baseurl:"
DOE Tachyon Project (description here)
baseurl: "tachyon" # the subpath of your site, e.g. /blog
url: "" # the base hostname & protocol for your site, e.g. http://example.com
#twitter_username: jekyllrb
github_username: codes-org
rss: News

# Build settings
theme: minima
#plugins:
# - jekyll-feed

show_excerpts: true

# Exclude from processing.
# The following items will not be processed, by default.
# Any item listed under the `exclude:` key here will be automatically added to
# the internal "default list".
#
# Excluded items can be processed by explicitly listing the directories or
# their entries' file path in the `include:` list.
#
# exclude:
# - .sass-cache/
# - .jekyll-cache/
# - gemfiles/
# - Gemfile
# - Gemfile.lock
# - node_modules/
# - vendor/bundle/
# - vendor/cache/
# - vendor/gems/
# - vendor/ruby/
exclude:
- vendor/
- README.md
8 changes: 8 additions & 0 deletions _posts/2024-01-29-we-are-live.markdown
Original file line number Diff line number Diff line change
@@ -0,0 +1,8 @@
---
layout: post
title: "We are live!"
date: 2024-01-29 17:40:27 -0500
categories: update
---

Expect a stream of news from us. A couple of items a year.
Loading

0 comments on commit 5287dd0

Please sign in to comment.