XD-2894 added kafka POC

kafka-rt-analytics/README.md

@@ -0,0 +1,49 @@
+#Spring XD Kafka RT Analysis
+
+##Contents
+
+* **firehose-simulator** - Generates events. The total number of sources emiting events and the distribution of sources and events are configuruble. Output payload type : `AppEvent`. See [firehose-simulator/README.md](firehose-simulator/README.md)
+*  **event-aggregator** - Aggregates events (raw data) by source into 1 second buckets. Input payload type: `AppEvent`. Output payload type: `SourceEventBucket`
+* **metrics** - Calculates various metrics for each bucket. Output payload type: `List<Tuple>`. Currently configured with metrics: `eventCount`, `httpErrorCount`, `loginCount`, `httpResponseTime`,`errorMessageCount`, processed serially.
+* **event-domain** - Common domain types
+
+##Requirements
+
+Requires Java 1.8
+
+##Installing in XD
+
+Edit scripts `copyLibs.sh` and `uploadModules.script` and change the paths for your environment.
+
+Build:
+
+```
+$mvn clean package (-DskipTests)
+```
+
+Copy shared jars to xd/lib
+
+```
+$./copyLibs.sh
+```
+
+Start XD runtime
+
+Install custom modules
+
+```
+xd:>script <path-to>/uploadModules.script
+```
+
+
+##Sample Streams
+
+These streams currently process up to ~28k/sec with xd-singlenode my MacBook Pro and output individual metrics as Tuples.
+
+```
+stream create basic --definition "firehose-simulator | event-aggregator | metrics | splitter | log"
+```
+
+```
+stream create eventCount --definition "firehose-simulator --numSources=10  --sourceDistribution=75,20 | event-aggregator | metrics | splitter | filter --expression='payload.getString(''metricName'')==''eventCount'''| log"
+```

kafka-rt-analytics/copyLibs.sh

@@ -0,0 +1,2 @@
+#!/bin/bash
+cp ./event-domain/target/*.jar $XD_DIST_HOME/xd/lib

kafka-rt-analytics/dashboard/application.properties

@@ -0,0 +1,2 @@
+# Spring Boot Configuration
+server.port=9889

kafka-rt-analytics/dashboard/dashboard.groovy

@@ -0,0 +1,2 @@
+//The presence of an @Controller will trigger Boot Autoconfiguration
+@Controller class DashBoardApp{}

kafka-rt-analytics/dashboard/public/c3/c3.css

@@ -0,0 +1,173 @@
+/*
+ * Copyright 2015 the original author or authors.
+ * Licensed under the Apache License, Version 2.0 (the "License");
+ * you may not use this file except in compliance with the License.
+ * You may obtain a copy of the License at
+ *
+ *      http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+/*-- Chart --*/
+.c3 svg {
+  font: 10px sans-serif; }
+
+.c3 path, .c3 line {
+  fill: none;
+  stroke: #000; }
+
+.c3 text {
+  -webkit-user-select: none;
+  -moz-user-select: none;
+  user-select: none; }
+
+.c3-legend-item-tile, .c3-xgrid-focus, .c3-ygrid, .c3-event-rect, .c3-bars path {
+  shape-rendering: crispEdges; }
+
+.c3-chart-arc path {
+  stroke: #fff; }
+
+.c3-chart-arc text {
+  fill: #fff;
+  font-size: 13px; }
+
+/*-- Axis --*/
+/*-- Grid --*/
+.c3-grid line {
+  stroke: #aaa; }
+
+.c3-grid text {
+  fill: #aaa; }
+
+.c3-xgrid, .c3-ygrid {
+  stroke-dasharray: 3 3; }
+
+/*-- Text on Chart --*/
+.c3-text.c3-empty {
+  fill: #808080;
+  font-size: 2em; }
+
+/*-- Line --*/
+.c3-line {
+  stroke-width: 1px; }
+
+/*-- Point --*/
+.c3-circle._expanded_ {
+  stroke-width: 1px;
+  stroke: white; }
+
+.c3-selected-circle {
+  fill: white;
+  stroke-width: 2px; }
+
+/*-- Bar --*/
+.c3-bar {
+  stroke-width: 0; }
+
+.c3-bar._expanded_ {
+  fill-opacity: 0.75; }
+
+/*-- Focus --*/
+.c3-target.c3-focused {
+  opacity: 1; }
+
+.c3-target.c3-focused path.c3-line, .c3-target.c3-focused path.c3-step {
+  stroke-width: 2px; }
+
+.c3-target.c3-defocused {
+  opacity: 0.3 !important; }
+
+/*-- Region --*/
+.c3-region {
+  fill: steelblue;
+  fill-opacity: 0.1; }
+
+/*-- Brush --*/
+.c3-brush .extent {
+  fill-opacity: 0.1; }
+
+/*-- Select - Drag --*/
+/*-- Legend --*/
+.c3-legend-item {
+  font-size: 12px; }
+
+.c3-legend-item-hidden {
+  opacity: 0.15; }
+
+.c3-legend-background {
+  opacity: 0.75;
+  fill: white;
+  stroke: lightgray;
+  stroke-width: 1; }
+
+/*-- Tooltip --*/
+.c3-tooltip-container {
+  z-index: 10; }
+
+.c3-tooltip {
+  border-collapse: collapse;
+  border-spacing: 0;
+  background-color: #fff;
+  empty-cells: show;
+  -webkit-box-shadow: 7px 7px 12px -9px #777777;
+  -moz-box-shadow: 7px 7px 12px -9px #777777;
+  box-shadow: 7px 7px 12px -9px #777777;
+  opacity: 0.9; }
+
+.c3-tooltip tr {
+  border: 1px solid #CCC; }
+
+.c3-tooltip th {
+  background-color: #aaa;
+  font-size: 14px;
+  padding: 2px 5px;
+  text-align: left;
+  color: #FFF; }
+
+.c3-tooltip td {
+  font-size: 13px;
+  padding: 3px 6px;
+  background-color: #fff;
+  border-left: 1px dotted #999; }
+
+.c3-tooltip td > span {
+  display: inline-block;
+  width: 10px;
+  height: 10px;
+  margin-right: 6px; }
+
+.c3-tooltip td.value {
+  text-align: right; }
+
+/*-- Area --*/
+.c3-area {
+  stroke-width: 0;
+  opacity: 0.2; }
+
+/*-- Arc --*/
+.c3-chart-arcs-title {
+  dominant-baseline: middle;
+  font-size: 1.3em; }
+
+.c3-chart-arcs .c3-chart-arcs-background {
+  fill: #e0e0e0;
+  stroke: none; }
+
+.c3-chart-arcs .c3-chart-arcs-gauge-unit {
+  fill: #000;
+  font-size: 16px; }
+
+.c3-chart-arcs .c3-chart-arcs-gauge-max {
+  fill: #777; }
+
+.c3-chart-arcs .c3-chart-arcs-gauge-min {
+  fill: #777; }
+
+.c3-chart-arc .c3-gauge-value {
+  fill: #000;
+  /*  font-size: 28px !important;*/ }