Uptime_monitor is a ragios plugin that uses a real web browser to perform transactions on a website to ensure that features of the site are still working correctly. It can check elements of a webpage to ensure they still exist and it can also perform transactions like a website login to ensure that the process still works correctly.
##Requirements Ragios
##Installation: Add the uptime_monitor gem to your ragios Gemfile
gem "uptime_monitor"Run bundle install from the ragios root directory
bundle install
Restart ragios
##usage: A quick example, to monitor the title tag of a web page to ensure that it hasn't changed. Using Ragios ruby client
monitor = {
monitor: "My Blog title tag",
url: "http://obi-akubue.org",
every: "5m",
contact: "[email protected]",
via: "gmail_notifier",
plugin: "uptime_monitor",
exists?: [
[:title, [text: "Obi Akubue"]]
],
browser: ["firefox"]
}
ragios.create(monitor)
```
The above example will create a ragios monitor that will, every 5 minutes, use firefox to visit the website url http://obi-akubue.org, and verify that the title tag on the page matches the text "Obi Akubue". When the title tag doesn't match the text, a failure notification will be sent out to the contact.
###Using the plugin
To use the uptime monitor plugin add the key/value pair to the monitor
```ruby
plugin: "uptime_monitor"
```
###Browsers
A browser is specified, by adding a browser key/value pair to the monitor
```ruby
browser: ["firefox"]
```
Supported browsers include Firefox, Chrome, Safari and Phantomjs. Other browsers can be specified as
```ruby
browser: ["chrome"]
browser: ["safari"]
browser: ["phantomjs"]
```
uptime_monitor uses [Watir Webdriver](http://watirwebdriver.com), firefox runs out of the box with no configuration required. To use Chrome or Safari see the Watir Webdriver documentation on downloading the appropriate driver binary and configuration.
By default, the browsers don't run headless, to run the browser headless, you can specify it in the format below:
```ruby
browser: ["firefox", headless: true]
```
This will run firefox as a headless browser. You should have [Xvfb](https://en.wikipedia.org/wiki/Xvfb) installed to run a non-headless browsers as headless. Headless browsers like Phantomjs don't require Xvfb.
You can also specify headless as false
```ruby
browser: ["firefox", headless: false]
```
The above example will run firefox as a non-headless browser.
###Validations
To verify that a html element exists on the web page, a validation needs to be added to the monitor. Validations are specified with the exists? key/value pair which takes an array of html elements as it's value. It verifies that the html elements in the array exists on the current web page.
```ruby
exists?: [
[:h1]
[:div]
]
```
The above example will verify that a h1 and a div exists on the page.
####HTML Elements
The simplest way to specify a html element is using a symbol.
```ruby
exists?: [
[:h1]
[:div]
[:a]
[:img]
[:span]
]
```
HTML elements can also be specified as a hash with their name as key and attributes as value.
```ruby
exists?: [
[div: {class: "box_content"}]
]
```
The above will verify that a div with class "box_content" exists on the page.
Other examples:
```ruby
[img: {src: "https://fc03.deviantart.net/fs14/f/2007/047/f/2/Street_Addiction_by_gizmodus.jpg"}]
```
Specifies an img tag with src="https://fc03.deviantart.net/fs14/f/2007/047/f/2/Street_Addiction_by_gizmodus.jpg".
```ruby
[div: {id:"test", class: "test-section"}]
```
Specifes a div with id="test" and class="test-section".
####Standard attributes
Only standard attributes for an element can be included in the hash, for example a div can only include all or any of the following attributes id, class, lang, dir, title, align, onclick, ondblclick, onmousedown, onmouseup, onmouseover, onmousemove, onmouseout, onkeypress, onkeydown, onkeyup.
Custom or data attributes cannot be included, for example
```html
<div data-brand="toyota">
```
The following
```ruby
[div: {"data-brand" => "toyota"}]
```
will give an error because "data-brand" is not a standard attibute for div, to specify elements by data or custom attributes use css selectors, see below.
####Using CSS Selectors
HTML elements can also be specified with css selectors.
```ruby
[element: {css: '#rss-link'}]
```
This specifies an element with id="rss-link".
To specify an element by data attributes
```ruby
[element: {css: '[data-brand="toyota"]'}]
```
####Helpers for HTML elements
Helpers are available to make some elements easier to reason about:
#####Links
An anchor tag could be specified with a link helper, this makes it more readable and easier to reason about.
Using the anchor tag
```ruby
[a: {text: "Click Here"}]
```
More readble using a helper
```ruby
[link: {text: "Click Here"}]
```
```ruby
[link: {href: "https://www.southmunn.com/aboutus"}]
```
#####Buttons
```ruby
[button: {id: "searchsubmit"}]
```
#####Text Fields
```ruby
[text_field: {id: "search"}]
```
More readable than the input tag
```ruby
[input: {id: "search"}]
```
#####Checkboxes
```ruby
[checkbox: {value: "Butter"}]
```
#####Radio Buttons
```ruby
[radio: {name: "group1", value: "Milk"}]
```
#####Drop Down menus
```html
<select name="mydropdown">
<option value="Milk">Fresh Milk</option>
<option value="Cheese">Old Cheese</option>
<option value="Bread">Hot Bread</option>
</select>
```
Helper
```ruby
[select_list: {name: "mydropdown"}]
```
Or HTML select tag
```ruby
[select: {name: "mydropdown"}]
```
Options of the drop-down menu can be specified using option
```ruby
[option: {value: "Milk"}]
```
####Text Validations
A text validation is used to verify that the text content of a html element hasn't changed. For example,
```ruby
exists?: [
[:title, [text: "Welcome to my site"]]
]
```
The above example first verifies that a title tag exists on the page, then it verifies that title tag text is equal to "Welcome to my site".
The following is a text validation:
```ruby
[text: "Welcome to my site"]
```
Text validations can also verify that the html element's text includes the provided string, in the format below:
```ruby
exists?: [
[:title, [includes_text: "Welcome"]]
]
```
The above example verifies that the title tag's text includes the string "Welcome".
Another example, to verify that a div with class="box_content" includes the string "SouthMunn is a Website"
```ruby
exists?: [
[{div: {class: "box_content"}}, [includes_text: "SouthMunn is a Website"]]
]
```
Text validations can be used on html elements that can contain text like title, div, span, h1, h2 etc.
####Actions
Validations can also include actions. The actions are performed on the html element after it is verfied that the element exists. Example to set a text field's value
```ruby
exists?: [
[{text_field: {id: "username"}}, [set: "admin"]]
]
```
The above example will set the text field's value to the string "admin".
The following is an action
```ruby
[set: "admin"]
```
#####Actions on html elements
Common actions performed on elements are set, select and click.
Set value for a textfield or textarea.
```ruby
[{text_field: {name: "q"}}, [set: "ruby"]]
[{text_area: {name: "longtext"}}, [set: "In a world..."]]
```
Select an option from a drop down menu
```html
<select name="mydropdown">
<option value="Milk">Fresh Milk</option>
<option value="Cheese">Old Cheese</option>
<option value="Bread">Hot Bread</option>
</select>
```
```ruby
[{select_list: {name: "mydropdown"}},[select: "Old Cheese"]]
```
Click a radio button, checkbox, link or button
```ruby
[{radio: {name: "group1", value: "Milk"}}, [:click]]
[{checkbox:{name: "checkbox"}}, [:click]]
[{link: {text: "Click Here"}}, [:click]]
[{button: {id: "submit"}}, [:click]]
```
####Waiting
For webpages that use a lot of AJAX, it's possible to wait until an element exists, by using the wait_until_exists? key. This key takes an element as value. It is a special type of validation, it will wait for 30 seconds for the provided element to exist, if the element doesn't exist in 30 seconds the validation fails.
```ruby
[wait_until_exists?: [div: {id:"open-section"}]]
```
The above example will wait 30 seconds until the div exists, if it doesn't exist after 30 seconds the validation will fail.
####Multiple validations and actions
```ruby
exists?: [
[{text_field: {id: "username"}}, [set: "admin"]],
[{text_field: {id: "password"}}, [set: "pass"]],
[:button, [:click]],
[:title, [includes_text: "Dashboard"]]
]
```
With multiple validations like the example above, the monitor will run the validations, line by line, from top to bottom. When it meets an action it will apply it on the element in the validation. The monitor fails it's test if any of the validation fails. So for the monitor to pass, all validations must pass.
When actions like clicking a link, changes the current page, the following validations will be performed on the new page.
A combination of multiple validations and actions form the basis for performing transactions.
####Performing Transactions
Transactions are achieved by a combination of multiple validations and actions.
Example, to monitor the keyword search feature on my blog, notice the validations in the exists? key's value:
```ruby
monitor = {
monitor: "My Blog: keyword search",
url: "http://obi-akubue.org",
every: "1h",
contact: "[email protected]",
via: "gmail_notifier",
plugin: "uptime_monitor",
exists?: [
[:title,[text: "Obi Akubue"]],
[{text_field: {id: "s"}}, [set: "ruby"]],
[{button:{id: "searchsubmit"}}, [:click]],
[:title, [includes_text: "ruby"], [includes_text: "Search Results"]],
[{h2:{class: "pagetitle"}},[includes_text: "Search results for"]]
],
browser: ["firefox"]
}
ragios.create(monitor)
```
In the above example the monitor will visit "http://obi-akubue.org" every hour, and perform a search for keyword 'ruby', then confirm that the search works by checking that the title tag and h2 tag of the search results page contains the expected text.
Another example, to search my friend's ecommerce site http://akross.net, for a citizen brand wristwatch, add one to cart, and go to the checkout page.
This transaction verifies the the following about the site:
1. Product search is working
2. Add to cart works
3. Checkout page is reachable
4. All three above works together as a sequence
```ruby
monitor = {
monitor: "Akross.net: Add citizen watch to cart and checkout",
url: "http://akross.net",
every: "1h",
contact: "[email protected]",
via: "ses",
plugin: "uptime_monitor",
exists?: [
[:title, [text: "All Watches Shop, Authentic Watches at Akross"]],
[{text_field: {name: "filter_name"}}, [set: "citizen"]],
[{div: {class: "button-search"}}, [:click]],
[:title,[text: "Search"]],
[link: {text: "Search"}],
[{button: {value: "Add to Cart"}}, [:click]],
[{link: {text: "Checkout"}}, [:click]],
[:title, [text: "Checkout"]]
],
browser: ["phantomjs"]
}
ragios.create(monitor)
```
Another example, to monitor the login process of the website http://southmunn.com
```ruby
login_process = [
[:title, [text: "Website Uptime Monitoring | SouthMunn.com"]],
[{link: {text:"Login"}}, [:click]],
[:title, [text: "Sign in - Website Uptime Monitoring | SouthMunn.com"]],
[{text_field: {id: "username"}}, [set: "admin"]],
[{text_field: {id: "password"}}, [set: "pass"]],
[:button, [:click]],
[:title, [text: "Dashboard - Website Uptime Monitoring | SouthMunn.com"]]
]
monitor = {
monitor: "My Website login processs",
url: "https:/southmunn.com",
every: "1h",
contact: "[email protected]",
via: "email_notifier",
plugin: "uptime_monitor",
exists?: login_process,
browser: ["firefox", headless: true]
}
ragios.create(monitor)
```
####Testing the validations outside Ragios
Sometimes it's useful to run validations outside Ragios to verify that the validations are syntactically correct and don't raise any exceptions. This is best done by running the uptime_monitor plugin as a Plain Old Ruby Object.
```ruby
require 'uptime_monitor'
page_element1 = [:title]
page_element2 = [:div]
monitor = {
url: "http://obi-akubue.org",
browser: ["firefox", headless: true],
exists?: [page_element1, page_element2]
}
u = Ragios::Plugin::UptimeMonitor.new
u.init(monitor)
u.test_command?
#=> true
u.test_result
#=> {
# :results =>
# [
# [[:title], "exists_as_expected"],
# [[:div], "exists_as_expected"]
# ]
# }
#test result for a failed test during downtime
page_element = [:title, [text: "dont_exist"]]
monitor = {
url: "http://obi-akubue.org",
browser: ["firefox", headless: true],
exists?: [page_element]
}
u.init(monitor)
u.test_command?
#=> false
u.test_result
#=> {
# :results=>
# [
# [[:title, [{:text=>"dont_exist"}]], "does_not_exist_as_expected"]
# ]
# }
```
In the above example the test_command? method runs the validations and returns true when all validations passes, returns false when any of the validation fails. test_result is a hash that contains the result of the tests ran by test_command?.
####Testing individual validations
It can be very useful to test validations individually before adding them to Ragios. This can be done by running plugin's browser object directly.
```ruby
require 'uptime_monitor'
url= "http://obi-akubue.org"
headless = false
browser_name = "firefox"
browser = Hercules::UptimeMonitor::Browser.new(url, browser_name, headless)
browser.exists? [:title, [includes_text: "ruby"]]
browser.exists? [{h2:{class: "pagetitle"}}]
browser.exists? [{checkbox:{name: "checkbox"}}, [:click]]
browser.close
```
The above example creates a browser object and visits the url. The exists? method takes a single validation as arguement and performs the validation on the url, it returns true if the validation passes and returns false if the validation fails. In the first validation it checks if the title tag on the url includes the text 'ruby'.
##Screenshots
The uptime_monitor can be configured to take a screenshot of the webpage when a test fails. This screenshot is uploaded to Amazon s3 and its url is included in the test_result. So the website admin can see what the site looks like when transaction failed.
This feature is disable by default, to enable it set following environment variable.
```
RAGIOS_HERCULES_ENABLE_SCREENSHOTS=true
```
Also set environment variables for the Amazon s3 account you want to use for storing the screenshots,
```
AWS_ACCESS_KEY_ID=xxxxxxx
AWS_SECRET_ACCESS_KEY=xxxxxx
RAGIOS_HERCULES_S3_DIR=xxxxxx
```
The above env vars are for the Amazon AWS access key, AWS secret key and s3 directory/bucket you want to use for storage. First create this s3 bucket manually.
With the screenshots feature enabled, the results of a failed test will include a screenshot of the webpage when the test failed.
See an example below:
```ruby
require 'uptime_monitor'
page_element = [:title, [text: "dont_exist"]]
monitor = {
url: "http://obi-akubue.org",
browser: ["firefox", headless: true],
exists?: [page_element]
}
u = Ragios::Plugin::UptimeMonitor.new
u.init(monitor)
u.test_command?
#=>false
u.test_result
#=> {
# :results=>
# [
# [[:title, [{:text=>"dont_exist"}]], "does_not_exist_as_expected"]
# ],
# :screenshot=>
# "http://screenshot-ragios.s3.amazonaws.com/uploads/screenshot1428783237.png"
# }
```
Notice that test result includes a url to the screenshot of the webpage when the test failed. This test result is also included in the notifications sent to site admin by by Ragios when a test fails. So this way the admin can see exactly what webpage looked like when the transaction failed.
##Disable screenshots on individual monitors
To disable screenshots on a particular monitor add the key/value pair ```disable_screenshots: true```
example:
```ruby
page_element = [:title]
monitor = {
url: "http://obi-akubue.org",
browser: ["firefox", headless: true],
exists?: [page_element],
disable_screenshots: true
}
ragios.create(monitor)
```
This will diable screenshots only for this monitor, no screenshots will be taken when its test fails.
##Specification:
```ruby
monitor = {
monitor: "My Website",
url: "http://mysite.com",
every: "5m",
contact: "[email protected]",
via: "mail_notifier",
plugin: "uptime_monitor",
exists?: [
[:title, [text: "Welcome to my site"]],
[{div: {id:"test", class: "test-section"}}, [text: "this is a test"]],
[a: {href: "/aboutus" }],
[:h1],
[:h2,[text: "Login"]],
[form: {action: "/signup", method: "get"}],
[{element: {css: "#submit-button"}}, [:click]],
[{text_field: {id: "username"}}, [set: "admin"]],
[{text_field: {id: "password"}}, [set: "pass"]],
[link: {text: "Contact Us"}],
[wait_until_exists?: [div: {id:"open-section"}]]
],
browser: ["firefox", headless: true]
}
ragios.create(monitor)
```
##License:
MIT License.
Copyright (c) 2014 Obi Akubue, obi-akubue.org