-
Notifications
You must be signed in to change notification settings - Fork 4
/
Copy pathindex.html
153 lines (126 loc) · 5.98 KB
/
index.html
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
<!DOCTYPE html>
<html>
<head>
<meta charset='utf-8'>
<meta http-equiv="X-UA-Compatible" content="chrome=1">
<meta name="viewport" content="width=device-width, initial-scale=1, maximum-scale=1">
<link href='https://fonts.googleapis.com/css?family=Architects+Daughter' rel='stylesheet' type='text/css'>
<link rel="stylesheet" type="text/css" href="stylesheets/stylesheet.css" media="screen">
<link rel="stylesheet" type="text/css" href="stylesheets/github-light.css" media="screen">
<link rel="stylesheet" type="text/css" href="stylesheets/print.css" media="print">
<!--[if lt IE 9]>
<script src="//html5shiv.googlecode.com/svn/trunk/html5.js"></script>
<![endif]-->
<title>Measuring DevOps Flow by otomato</title>
</head>
<body>
<header>
<div class="inner">
<h1>Measuring DevOps Flow</h1>
<h2>12 DevOps Flow Metrics as defined by Otomato™</h2>
<a href="https://github.com/otomato-gh/devops-kpis" class="button"><small>View project on</small> GitHub</a>
<!-- a href="http://otomato.link" class="button"><logo><small>Go to</small> Otomato</logo></a-->
</div>
</header>
<div id="content-wrapper">
<div class="inner clearfix">
<section id="main-content">
<h2>
<a id="introduction" class="anchor" href="#introduction" aria-hidden="true"><span aria-hidden="true" class="octicon octicon-link"></span></a>Introduction</h2>
<p>DevOps transformation goals can be defined as:</p>
<ul>
<li>Heightened Release Agility</li>
<li>Improved Software Quality</li>
</ul>
<p>Or simply:</p>
<hr>
<h1>
<a id="delivering-better-software-faster" class="anchor" href="#delivering-better-software-faster" aria-hidden="true"><span aria-hidden="true" class="octicon octicon-link"></span></a>Delivering Better Software Faster</h1>
<hr>
<p>Therefore measurable DevOps success criteria would be:</p>
<ul>
<li>Being able to release versions faster and more often</li>
<li>Having less defects and failures</li>
</ul>
<p>We all know that improvement doesn't happen overnight, but instead is an iterative, continuous process.
We want to be able to measure our improvement by applying a scientific step sequence of hypothesis->test->analysis->proceed on the outcome->...</p>
<p>In order to measure DevOps flow improvement we need to have metrics for 2 categories:</p>
<ul>
<li>
<strong>Velocity</strong> (time it takes to complete each step in the release/delivery cycle, number of releases per time period.)</li>
<li>
<strong>Quality</strong> (rate of defects per change, etc)</li>
</ul>
<p>Here are the 12 core KPIs we've come up with. Also known as the <b> DevOps Flow Metrics. </b> <br> 6 for Velocity and 6 for Quality:</p>
<h2>
<a id="velocity-kpis" class="anchor" href="#velocity-kpis" aria-hidden="true"><span aria-hidden="true" class="octicon octicon-link"></span></a>Velocity KPIs</h2>
<ol>
<li>
<strong>MLT</strong> (Mean Lead Time)<br>
how long does it take for a bit of code to get built, tested and deployed.</li>
<li>
<strong>DCR</strong> (Daily Change Rate)<br>
number of changes getting committed to mainline and tested per day. </li>
<li>
<strong>MTTE</strong> (Mean Time To Environment)<br>
how much time it takes developers/testers to bring up a testing environment for verifying each delivered change. "</li>
<li>
<strong>MTTD</strong> (Mean Time to Detect)<br>
how much time passes since the original commit of code until the bug it introduces gets detected.</li>
<li>
<strong>MTTR</strong> (Mean Time To Resolve)<br>
how much time it takes to resolve an issue after it’s detected</li>
<li>
<strong>MTTA</strong> (MeanTime To Approve)<br>
how much time it takes to approve and verify a release. (Measured from the moment all release content has been delivered and until the release has passed all the defined test and verification cycles)</li>
</ol>
<h2>
<a id="quality-kpis" class="anchor" href="#quality-kpis" aria-hidden="true"><span aria-hidden="true" class="octicon octicon-link"></span></a>Quality KPIs</h2>
<ol>
<li>
<strong>BFR</strong> (Build Failure Rate)<br>
% of failed builds<br>
</li>
<li>
<strong>DFR</strong> (Deployment Failure Rate)<br>
% of failed deployments<br>
</li>
<li>
<strong>IRFR</strong> (Infrastructure-Related Failure Rate)<br>
% of build/deployment failures related to infrastructure issues</li>
<li>
<strong>RWR</strong> (Rework Rate)<br>
% of tickets being reopened</li>
<li>
<strong>ADR</strong> (Automated Detection Rate)<br>
% of defects being detected by automated testing cycles<br>
</li>
<li>
<strong>UWR</strong> (Unplanned Work Rate)<br>
% of unplanned issues</li>
</ol>
We'll be happy if these metrics help you improve your DevOps flow.<br>
If you have comments or suggestions - feel free to open github issues or comments.<br>
If you'd like advice or assistance with KPI collection or analysis, or with any CI/CD/DevOps implementation issues - contact us through the form below.
<form action="https://formspree.io/[email protected]"
method="POST">
<input name="email" placeholder="Your email" type="email"> <br><br>
<input type="hidden" name="_subject" value="from DevOps KPIs page" />
<textarea name="message" placeholder="Your message"></textarea> <br><br>
<button type="submit">Send</button>
</form>
<br>
© 2016 Anton Weiss (otomato) All Rights Reserved - <a href="http://otomato.link">http://otomato.link</a>
</section>
<aside id="sidebar">
<a href="https://github.com/otomato-gh/devops-kpis/raw/gh-pages/pdf/MeasuringFlow.pdf" class="button">
<small>Download</small>
.pdf preso
</a>
<p class="repo-owner"><a href="https://github.com/otomato-gh/devops-kpis"></a> is maintained by <a href="https://github.com/otomato-gh">otomato-gh</a>.</p>
<p>This page was generated by <a href="https://pages.github.com">GitHub Pages</a> using the Architect theme by <a href="https://twitter.com/jasonlong">Jason Long</a>.</p>
</aside>
</div>
</div>
</body>
</html>