1_non-depressive-data-gathering.ipynb

{
 "cells": [
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Collecting (mostly) Non-Depressive data from Multiple Sources\n",
    "\n",
    "Here we try to get some neutral as well as emotional dat from the competition (SemEval-2018 Task 1: Affect in Tweets (AIT-2018))\n",
    "(https://competitions.codalab.org/competitions/17751#learn_the_details)\n",
    "\n",
    "There are various subtasks and datasets. We decided to use the one with annotated Emotional Intensity, which is of Gold standard. This will allow us to be more specific about the type and range of emotions to include in our dataset, and more confident of the depth of its emotional content since it has been professionally annotated.\n",
    "\n",
    "This notebook shows our analytical process in making the decision for inclusion. We try to find distinguishable patterns for each category in order to draw generalisaton based on their intensity score."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## 1. Load Data"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 1,
   "metadata": {},
   "outputs": [],
   "source": [
    "import numpy as np\n",
    "import pandas as pd"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 66,
   "metadata": {},
   "outputs": [],
   "source": [
    "import matplotlib as plt"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 6,
   "metadata": {},
   "outputs": [],
   "source": [
    "df_anger = pd.read_csv(\"2018-EI-reg-En-anger-test-gold.txt\", delimiter=\"\\t\")\n",
    "df_fear = pd.read_csv(\"2018-EI-reg-En-fear-test-gold.txt\", delimiter=\"\\t\")\n",
    "df_joy = pd.read_csv(\"2018-EI-reg-En-joy-test-gold.txt\", delimiter=\"\\t\")\n",
    "df_sadness = pd.read_csv(\"2018-EI-reg-En-sadness-test-gold.txt\", delimiter=\"\\t\")"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 7,
   "metadata": {},
   "outputs": [],
   "source": [
    "pd.set_option('display.max_colwidth', -1)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 62,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>ID</th>\n",
       "      <th>Tweet</th>\n",
       "      <th>Affect Dimension</th>\n",
       "      <th>Intensity Score</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>2018-En-02328</td>\n",
       "      <td>@PageShhh1 I know you mean well but I'm offended. Prick.</td>\n",
       "      <td>anger</td>\n",
       "      <td>0.734</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>2018-En-02617</td>\n",
       "      <td>Let go of resentment, it will hold you back, do not worry about what could of been, what is to come is what matters.</td>\n",
       "      <td>anger</td>\n",
       "      <td>0.422</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>2018-En-01021</td>\n",
       "      <td>No, I'm not 'depressed because of the weather,' I'm depressed because I have #depression #sicknotweak</td>\n",
       "      <td>anger</td>\n",
       "      <td>0.663</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "              ID  \\\n",
       "0  2018-En-02328   \n",
       "1  2018-En-02617   \n",
       "2  2018-En-01021   \n",
       "\n",
       "                                                                                                                  Tweet  \\\n",
       "0  @PageShhh1 I know you mean well but I'm offended. Prick.                                                               \n",
       "1  Let go of resentment, it will hold you back, do not worry about what could of been, what is to come is what matters.   \n",
       "2  No, I'm not 'depressed because of the weather,' I'm depressed because I have #depression #sicknotweak                  \n",
       "\n",
       "  Affect Dimension  Intensity Score  \n",
       "0  anger            0.734            \n",
       "1  anger            0.422            \n",
       "2  anger            0.663            "
      ]
     },
     "execution_count": 62,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df_anger.head(3)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 63,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>ID</th>\n",
       "      <th>Tweet</th>\n",
       "      <th>Affect Dimension</th>\n",
       "      <th>Intensity Score</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>2018-En-02626</td>\n",
       "      <td>@EdmundPAdamus That's the horrific irony; while we 'cleanse' society of moral value, a new religion will rise up &amp;amp; fill the gap - unhindered</td>\n",
       "      <td>fear</td>\n",
       "      <td>0.596</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>2018-En-00320</td>\n",
       "      <td>@TuckerCarlson @krauthammer @FoxNews They always need the drama and a fight to feel adaquate. Sad power is so insecure!!!</td>\n",
       "      <td>fear</td>\n",
       "      <td>0.533</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>2018-En-03973</td>\n",
       "      <td>@executivegoth I tried a free Alpha trial to watch #dread and I'm sold. Worth the subscription alone. You all are incredible!</td>\n",
       "      <td>fear</td>\n",
       "      <td>0.179</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "              ID  \\\n",
       "0  2018-En-02626   \n",
       "1  2018-En-00320   \n",
       "2  2018-En-03973   \n",
       "\n",
       "                                                                                                                                              Tweet  \\\n",
       "0  @EdmundPAdamus That's the horrific irony; while we 'cleanse' society of moral value, a new religion will rise up &amp; fill the gap - unhindered   \n",
       "1  @TuckerCarlson @krauthammer @FoxNews They always need the drama and a fight to feel adaquate. Sad power is so insecure!!!                          \n",
       "2  @executivegoth I tried a free Alpha trial to watch #dread and I'm sold. Worth the subscription alone. You all are incredible!                      \n",
       "\n",
       "  Affect Dimension  Intensity Score  \n",
       "0  fear             0.596            \n",
       "1  fear             0.533            \n",
       "2  fear             0.179            "
      ]
     },
     "execution_count": 63,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df_fear.head(3)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 64,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>ID</th>\n",
       "      <th>Tweet</th>\n",
       "      <th>Affect Dimension</th>\n",
       "      <th>Intensity Score</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>2018-En-00290</td>\n",
       "      <td>People are truly #amazing. #inspiring day</td>\n",
       "      <td>joy</td>\n",
       "      <td>0.712</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>2018-En-03093</td>\n",
       "      <td>What are some good #funny #entertaining #interesting accounts I should follow ? My twitter is dry</td>\n",
       "      <td>joy</td>\n",
       "      <td>0.339</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>2018-En-00588</td>\n",
       "      <td>@NoahWebHouse A review of my book faulted me for spending so much time on Webster's introductory front matter. But I had to, #brilliant!</td>\n",
       "      <td>joy</td>\n",
       "      <td>0.533</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "              ID  \\\n",
       "0  2018-En-00290   \n",
       "1  2018-En-03093   \n",
       "2  2018-En-00588   \n",
       "\n",
       "                                                                                                                                      Tweet  \\\n",
       "0  People are truly #amazing. #inspiring day                                                                                                  \n",
       "1  What are some good #funny #entertaining #interesting accounts I should follow ? My twitter is dry                                          \n",
       "2  @NoahWebHouse A review of my book faulted me for spending so much time on Webster's introductory front matter. But I had to, #brilliant!   \n",
       "\n",
       "  Affect Dimension  Intensity Score  \n",
       "0  joy              0.712            \n",
       "1  joy              0.339            \n",
       "2  joy              0.533            "
      ]
     },
     "execution_count": 64,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df_joy.head(3)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 65,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>ID</th>\n",
       "      <th>Tweet</th>\n",
       "      <th>Affect Dimension</th>\n",
       "      <th>Intensity Score</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>2018-En-03239</td>\n",
       "      <td>@TerraJole is a bully.  plain and simple.</td>\n",
       "      <td>sadness</td>\n",
       "      <td>0.550</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>2018-En-02839</td>\n",
       "      <td>@LondonEconomic Sometimes our judiciary just leaves you breathless and speechless.</td>\n",
       "      <td>sadness</td>\n",
       "      <td>0.521</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>2018-En-01035</td>\n",
       "      <td>#pause You gotta luv March Madness. Mad?? More like #upset</td>\n",
       "      <td>sadness</td>\n",
       "      <td>0.525</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "              ID  \\\n",
       "0  2018-En-03239   \n",
       "1  2018-En-02839   \n",
       "2  2018-En-01035   \n",
       "\n",
       "                                                                                Tweet  \\\n",
       "0  @TerraJole is a bully.  plain and simple.                                            \n",
       "1  @LondonEconomic Sometimes our judiciary just leaves you breathless and speechless.   \n",
       "2  #pause You gotta luv March Madness. Mad?? More like #upset                           \n",
       "\n",
       "  Affect Dimension  Intensity Score  \n",
       "0  sadness          0.550            \n",
       "1  sadness          0.521            \n",
       "2  sadness          0.525            "
      ]
     },
     "execution_count": 65,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df_sadness.head(3)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 13,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "(17939, 17923, 18042, 17912)"
      ]
     },
     "execution_count": 13,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "len(df_anger), len(df_fear), len(df_joy), len(df_sadness)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 18,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "Index(['ID', 'Tweet', 'Affect Dimension', 'Intensity Score'], dtype='object')"
      ]
     },
     "execution_count": 18,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df_anger.columns"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 28,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "Text(0, 0.5, 'frequency')"
      ]
     },
     "execution_count": 28,
     "metadata": {},
     "output_type": "execute_result"
    },
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAA4sAAAGDCAYAAACC34UnAAAABHNCSVQICAgIfAhkiAAAAAlwSFlzAAALEgAACxIB0t1+/AAAADl0RVh0U29mdHdhcmUAbWF0cGxvdGxpYiB2ZXJzaW9uIDMuMC4yLCBodHRwOi8vbWF0cGxvdGxpYi5vcmcvOIA7rQAAIABJREFUeJzt3X3YZnVd7/33RxDSxEBnMORp0AYT3TvCuRGzDLWNQFuh0oRiM7JJPNygtz0dYnZvTLOkvctu9k0a1gRS8qD5MCmKRKBtE2RQQrDYTDjBBMEgD2IYBn7vP9a69GzW9bBgrvPxer+O4zyuc/3W71zn9/xxzfXle67f+q1UFZIkSZIkDXrcuAOQJEmSJE0ei0VJkiRJUofFoiRJkiSpw2JRkiRJktRhsShJkiRJ6rBYlCRJkiR1WCxKkiRJkjosFqUpkeTKJPcm2XXcsUiSNImSbEnyzSTfGHg8fdxxSdPKYlGaAknWAD8GFPCKMbz/zqN+T0mSHqOXV9WTBh63L9eBzYdaaSwWpelwInAVcC6wfq4xyblJzk7yiSQPJLk6yTMH9h+R5KYk9yf5gySfSfILA/v/a5K/a89YXppk/4F9leTUJDcDN4/kU0qSNARJDkvyN0nuS/K3SQ4f2HdSmwsfSHJLktcN7Ds8ydYkb07yz8CfjCN+aVwsFqXpcCLwZ+3jZUmeNrDveOA3gD2AzcA7AZKsAj4EvAV4KnAT8CNzL0pyLPBrwE8Dq4G/Bi7Y7n2PBZ4PHLTsn0iSpBFIsjfwCeA3gacAvwL8eZLVbZe7gP8MPBk4CXh3kkMGDvH97ev2B04ZVdzSJLBYlCZckh+lSVAXV9W1wD8APzfQ5cNV9YWqepimmDy4bT8auLGqPtzuOwv454HXvQ747ar6u3b/bwEHD55dbPffU1XfHM6nkyRp2X20PYN4X5KPAicAl1TVJVX17aq6DNhEkyepqk9U1T9U4zPAp2ku/ZjzbeCMqnrIfKiVxmJRmnzrgU9X1d3t9gcYmIrKvy8AHwSe1D5/OnDb3I6qKmDrQN/9gf93LqEC9wAB9h7ocxuSJE2XY6tq9/ZxLE2+e9VAAXkf8KPAXgBJjkpyVZJ72n1HA6sGjretqv515J9CmgBepCtNsCRPAH4W2Km9VgJgV2D3JD+0xMvvAPYZOFYGt2kKwXdW1Z8tcox69FFLkjRRbgPOr6rXbr+jXWH8z2ku9/hYVf1bezYyA93MhVqxPLMoTbZjgUdorhk8uH08m+b6whOXeO0ngP+Q5Nh29bZTaa67mPNe4C1JngOQ5PuSvGqZ45ckadz+FHh5kpcl2SnJ97QL1+wD7ELzJew24OEkRwFHjDNYaZJYLEqTbT3wJ1V1a1X989wD+P+An2eR2QHttNVXAb8DfI2m4NwEPNTu/whwJnBhkq8DNwBHDfPDSJI0alV1G3AMzaJu22jONP4q8LiqegB4I3AxcC/NmgAbxxSqNHHSXMYkadYleRzNNYs/X1VXjDseSZIkTTbPLEozrJ1ys3t7Tcav0VyDcdWYw5IkSdIUsFiUZtsLaG61cTfwcpoV4lz2W5IkSUtyGqokSZIkqcMzi5IkSZKkDotFSZIkSVLHgsvuz6pVq1bVmjVrxh2GJGnIrr322ruravW445gW5kdJWjn65sgVVyyuWbOGTZs2jTsMSdKQJfnHcccwTcyPkrRy9M2RTkOVJEmSJHVYLEqSJEmSOiwWJUmSJEkdFouSJEmSpA6LRUmSJElSx4pbDXU5rDn9E+MO4Tu2vOsnxx2CJEnfMSk50vwoSTvOM4uSJEmSpA6LRUmSJElSh8WiJEmSJKnDYlGSJEmS1GGxKEmSJEnqsFiUJEmSJHVYLEqSJEmSOiwWJUmSJEkdFouSJEmSpA6LRUmSJElSh8WiJEmSJKljaMVikg1J7kpyw0Db25L8U5Lr2sfRA/vekmRzkpuSvGyg/ci2bXOS0wfaD0hydZKbk1yUZJdhfRZJkpaTOVKSNA2GeWbxXODIedrfXVUHt49LAJIcBBwHPKd9zR8k2SnJTsDZwFHAQcDxbV+AM9tjrQXuBU4e4meRJGk5nYs5UpI04YZWLFbVZ4F7enY/Briwqh6qqq8Cm4FD28fmqrqlqr4FXAgckyTAS4APta8/Dzh2WT+AJElDYo6UJE2DcVyzeFqS69spOHu0bXsDtw302dq2LdT+VOC+qnp4u3ZJkqaZOVKSNDFGXSy+B3gmcDBwB/C7bXvm6VuPoX1eSU5JsinJpm3btj26iCVJGo2R50jzoyRpMSMtFqvqzqp6pKq+DbyPZgoNNN967jvQdR/g9kXa7wZ2T7Lzdu0Lve85VbWuqtatXr16eT6MJEnLaBw50vwoSVrMSIvFJHsNbP4UMLcK3EbguCS7JjkAWAt8AbgGWNuu6rYLzQX+G6uqgCuAV7avXw98bBSfQZKkYTBHSpImzc5Ld3lsklwAHA6sSrIVOAM4PMnBNNNhtgCvA6iqG5NcDHwFeBg4taoeaY9zGnApsBOwoapubN/izcCFSX4T+BLwx8P6LJIkLSdzpCRpGgytWKyq4+dpXjBZVdU7gXfO034JcMk87bfw3Sk6kiRNDXOkJGkajGM1VEmSJEnShLNYlCRJkiR1WCxKkiRJkjosFiVJkiRJHRaLkiRJkqQOi0VJkiRJUofFoiRJkiSpw2JRkiRJktRhsShJkiRJ6rBYlCRJkiR1WCxKkiRJkjosFiVJkiRJHRaLkiRJkqQOi0VJkiRJUofFoiRJkiSpw2JRkiRJktRhsShJkiRJ6rBYlCRJkiR1WCxKkiRJkjosFiVJkiRJHRaLkiRJkqQOi0VJkiRJUofFoiRJkiSpY8liMclTRhGIJEnTxhwpSZplfc4sXp3kg0mOTpKhRyRJ0vQwR0qSZlafYvFA4BzgvwCbk/xWkgOHG5YkSVPBHClJmllLFovVuKyqjgd+AVgPfCHJZ5K8YOgRSpI0ocyRkqRZtvNSHZI8FTiB5lvTO4E3ABuBg4EPAgcMM0BJkiaVOVKSNMuWLBaBzwPnA8dW1daB9k1J3jucsCRJmgrmSEnSzOpTLD6rqmq+HVV15jLHI0nSNDFHSpJmVp8Fbj6dZPe5jSR7JLl0iDFJkjQtzJGSpJnVp1hcXVX3zW1U1b3AnsMLSZKkqWGOlCTNrD7F4iNJ9pvbSLI/MO+UG0mSVhhzpCRpZvUpFt8K/O8k5yc5H/gs8JalXpRkQ5K7ktww0PaUJJclubn9uUfbniRnJdmc5Pokhwy8Zn3b/+Yk6wfan5fky+1rzvJmyJKkMTBHSpJmVp/7LH4KOAS4CLgYeF5V9bke41zgyO3aTgcur6q1wOXtNsBRwNr2cQrwHmgSJ3AG8HzgUOCMueTZ9jll4HXbv5ckSUNljpQkzbI+ZxYBdgXuAe4HDkryoqVeUFWfbV8z6BjgvPb5ecCxA+3vb29ufBWwe5K9gJcBl1XVPe11IJcBR7b7nlxVn29XoXv/wLEkSRolc6QkaSYteeuMJGcCrwZuBL7dNhfNVJtH62lVdQdAVd2RZG4RgL2B2wb6bW3bFmvfOk+7JEkjY46UJM2yPvdZPJbmPlIPDTGO+a6lqMfQPv/Bk1NopuOw3377LdRNkqRHa6pzpPlRkrSYPtNQbwEev0zvd2c7PYb2511t+1Zg34F++wC3L9G+zzzt86qqc6pqXVWtW7169Q5/CEmSWlOdI82PkqTF9CkWHwSuS/KH7YpqZyU56zG+30ZgbrW29cDHBtpPbFd8Owy4v52KcylwRHuT4z2AI4BL230PJDmsXeHtxIFjSZI0KuZISdLM6jMNdWP7eFSSXAAcDqxKspVmxbZ3ARcnORm4FXhV2/0S4GhgM03iPQmgqu5J8g7gmrbf26tqbkGA19OsJvcE4JPtQ5KkUTJHSpJm1pLFYlWdl+QJwH5VdVPfA1fV8Qvseuk8fQs4dYHjbAA2zNO+CXhu33gkSVpu5khJ0ixbchpqkpcD1wGfarcPTvKov0WVJGnWmCMlSbOszzWLb6O52e99AFV1HXDAEGOSJGlavA1zpCRpRvUpFh+uqvu3a1vwNhWSJK0g5khJ0szqs8DNDUl+DtgpyVrgjcDfDDcsSZKmgjlSkjSz+pxZfAPwHOAh4ALg68CbhhmUJElTwhwpSZpZfVZDfRB4a/uQJEktc6QkaZYtWSwmuYJ5rr+oqpcMJSJJkqaEOVKSNMv6XLP4KwPPvwf4GeDh4YQjSdJUMUdKkmZWn2mo127X9LkknxlSPJIkTQ1zpCRplvWZhvqUgc3HAc8Dvn9oEUmSNCXMkZKkWdZnGuq1NNdjhGZqzVeBk4cZlCRJU8IcKUmaWX2moR4wikAkSZo25khJ0izrMw31pxfbX1UfXr5wJEmaHuZISdIs6zMN9WTgR4C/ardfDFwJ3E8z9cZEKElaqcyRkqSZ1adYLOCgqroDIMlewNlVddJQI5MkafKZIyVJM+txPfqsmUuCrTuBA4cUjyRJ08QcKUmaWX3OLF6Z5FLgAppvUI8DrhhqVJIkTQdzpCRpZvVZDfW0JD8FvKhtOqeqPjLcsCRJmnzmSEnSLOtzZhHgi8ADVfWXSZ6YZLeqemCYgUmSNCXMkZKkmbTkNYtJXgt8CPjDtmlv4KPDDEqSpGlgjpQkzbI+C9ycCrwQ+DpAVd0M7DnMoCRJmhLmSEnSzOpTLD5UVd+a20iyM81F/JIkrXTmSEnSzOpTLH4mya8BT0jyn4APAn8x3LAkSZoK5khJ0szqUyyeDmwDvgy8DrgE+PVhBiVJ0pQwR0qSZtaiq6Em2Qk4r6pOAN43mpAkSZp85khJ0qxb9MxiVT0CrE6yy4jikSRpKpgjJUmzrs99FrcAn0uyEfiXucaq+r1hBSVJ0pTYgjlSkjSjFjyzmOT89umrgY+3fXcbeEiStCKZIyVJK8FiZxafl2R/4Fbgf40oHkmSpoE5UpI08xYrFt8LfAo4ANg00B6ae0g9Y4hxSZI0ycyRkqSZt+A01Ko6q6qeDfxJVT1j4HFAVZkEJUkrljlSkrQSLHmfxap6/SgCkSRp2pgjJUmzbMliUZIkSZK08oylWEyyJcmXk1yXZFPb9pQklyW5uf25R9ueJGcl2Zzk+iSHDBxnfdv/5iTrx/FZJElaTuZISdKkGOeZxRdX1cFVta7dPh24vKrWApe32wBHAWvbxynAe6BJnMAZwPOBQ4Ez5pKnJElTzhwpSRq7SZqGegxwXvv8PODYgfb3V+MqYPckewEvAy6rqnuq6l7gMuDIUQctSdIImCMlSSM3rmKxgE8nuTbJKW3b06rqDoD2555t+97AbQOv3dq2LdTekeSUJJuSbNq2bdsyfgxJkpbdyHKk+VGStJjF7rM4TC+sqtuT7AlcluTvF+mbedpqkfZuY9U5wDkA69atm7ePJEkTYmQ50vwoSVrMWM4sVtXt7c+7gI/QXE9xZzt1hvbnXW33rcC+Ay/fB7h9kXZJkqaWOVKSNClGXiwm+d4ku809B44AbgA2AnOrta0HPtY+3wic2K74dhhwfzsF51LgiCR7tBftH9G2SZI0lcyRkqRJMo5pqE8DPpJk7v0/UFWfSnINcHGSk4FbgVe1/S8BjgY2Aw8CJwFU1T1J3gFc0/Z7e1XdM7qPIUnSsjNHSpImxsiLxaq6Bfihedq/Brx0nvYCTl3gWBuADcsdoyRJ42COlCRNkkm6dYYkSZIkaUJYLEqSJEmSOiwWJUmSJEkdFouSJEmSpA6LRUmSJElSh8WiJEmSJKnDYlGSJEmS1GGxKEmSJEnqsFiUJEmSJHVYLEqSJEmSOiwWJUmSJEkdFouSJEmSpA6LRUmSJElSh8WiJEmSJKnDYlGSJEmS1GGxKEmSJEnqsFiUJEmSJHVYLEqSJEmSOiwWJUmSJEkdFouSJEmSpA6LRUmSJElSh8WiJEmSJKnDYlGSJEmS1GGxKEmSJEnqsFiUJEmSJHVYLEqSJEmSOiwWJUmSJEkdFouSJEmSpA6LRUmSJElSh8WiJEmSJKnDYlGSJEmS1GGxKEmSJEnqmPpiMcmRSW5KsjnJ6eOOR5KkSWGOlCTtiKkuFpPsBJwNHAUcBByf5KDxRiVJ0viZIyVJO2rncQewgw4FNlfVLQBJLgSOAb4y1qgkYM3pnxh3CBNpy7t+ctwhSCuFOVITyxzZZX7UJJr2YnFv4LaB7a3A88cUy4rmH3315e/K5PJ/VGaOOXJC+HdPffh7MtlWao6c9mIx87RVp1NyCnBKu/mNJDft4PuuAu7ewWMsi5w57ggWNDFjNKEcn6U5Rotb9vGZ4L8nj9Wzxh3AmC2ZI4eQH2FC/u1O+O/zRIzRhHOM+nGclrYsYzThf1Mei/37dJr2YnErsO/A9j7A7dt3qqpzgHOW602TbKqqdct1vFnkGC3O8VmaY7Q4x2dpSTaNO4YxWzJHLnd+BH83+3CMluYY9eM4Lc0x2jFTvcANcA2wNskBSXYBjgM2jjkmSZImgTlSkrRDpvrMYlU9nOQ04FJgJ2BDVd045rAkSRo7c6QkaUdNdbEIUFWXAJeM+G2XdcrOjHKMFuf4LM0xWpzjs7QVP0bmyInlGC3NMerHcVqaY7QDUtVZD0aSJEmStMJN+zWLkiRJkqQhsFhcRJIjk9yUZHOS0+fZv2uSi9r9VydZM/oox6fH+PxSkq8kuT7J5Ul6LdE7S5Yao4F+r0xSSVbUal19xifJz7a/Rzcm+cCoYxy3Hv/O9ktyRZIvtf/Wjh5HnOOSZEOSu5LcsMD+JDmrHb/rkxwy6hhnkfmxH/Pk0syT/Zgvl2a+HJKq8jHPg2YxgH8AngHsAvwtcNB2ff4b8N72+XHAReOOe8LG58XAE9vnr19J49N3jNp+uwGfBa4C1o077kkaH2At8CVgj3Z7z3HHPYFjdA7w+vb5QcCWccc94jF6EXAIcMMC+48GPklzz8HDgKvHHfO0P8yPyzpO5knz5HL9LpkvzZdDeXhmcWGHApur6paq+hZwIXDMdn2OAc5rn38IeGmS+W6CPIuWHJ+quqKqHmw3r6K5x9dK0ud3COAdwO8A/zrK4CZAn/F5LXB2Vd0LUFV3jTjGceszRgU8uX3+fcxzr9lZVlWfBe5ZpMsxwPurcRWwe5K9RhPdzDI/9mOeXJp5sh/z5dLMl0NisbiwvYHbBra3tm3z9qmqh4H7gaeOJLrx6zM+g06m+XZ/JVlyjJL8MLBvVX18lIFNiD6/QwcCByb5XJKrkhw5sugmQ58xehtwQpKtNKtevmE0oU2NR/u3SkszP/ZjnlyaebIf8+XSzJdDMvW3zhii+b4B3X7p2D59ZlXvz57kBGAd8ONDjWjyLDpGSR4HvBt4zagCmjB9fod2pplaczjNN+5/neS5VXXfkGObFH3G6Hjg3Kr63SQvAM5vx+jbww9vKqzkv9PDYn7sxzy5NPNkP+bLpZkvh8QziwvbCuw7sL0P3dPV3+mTZGeaU9qLTYeaJX3GhyQ/AbwVeEVVPTSi2CbFUmO0G/Bc4MokW2iup9q4gi7e7/tv7GNV9W9V9VXgJppkuFL0GaOTgYsBqurzwPcAq0YS3XTo9bdKj4r5sR/z5NLMk/2YL5dmvhwSi8WFXQOsTXJAkl1oLtDfuF2fjcD69vkrgb+qqpXyzemS49NOHflDmgS40ubOwxJjVFX3V9WqqlpTVWtorld5RVVtGk+4I9fn39hHaRaAIMkqmmk2t4w0yvHqM0a3Ai8FSPJsmuS3baRRTraNwIntqqiHAfdX1R3jDmrKmR/7MU8uzTzZj/lyaebLIXEa6gKq6uEkpwGX0qywtKGqbkzydmBTVW0E/pjmFPZmmm9MjxtfxKPVc3z+B/Ak4IPtuga3VtUrxhb0iPUcoxWr5/hcChyR5CvAI8CvVtXXxhf1aPUco18G3pfkF2mm3LxmJf1PeZILaKZdrWqvQzkDeDxAVb2X5rqUo4HNwIPASeOJdHaYH/sxTy5t1HkyybnA1qr69eU87rCZL5dmvhyeOEbS9EtyJfCnVfVH445FkqTllORHaVZDfQ5NIfR3wJuq6ppHeZxzmcJiURonzyxKkiRpIiV5MvBxmvtQXkxzD70fA1ba9Z3SWHjNojRjkrw2yeYk9yTZmOTpbfvZSX53u75/keRN44lUkqQlHQhQVRdU1SNV9c2q+nRVXZ/kmUn+KsnXktyd5M+S7D73wiQ/nOSLSR5IchHNNWpz+w5PsjXJLye5K8kdSU4a2L9rkv+Z5NYkdyZ5b5IntPtWJfl4kvvaXPvX7cqtJHlzkn9q3/OmJC8d2UhJQ2CxKM2QJC8Bfhv4WWAv4B9pbkwLzQ2yjx9IaKtoLvS+YAyhSpLUx/8BHklyXpKjkuwxsC80Oe/pwLNpVsN8G0C7yMlHgfOBpwAfBH5mu2N/P81KvXvTrJR59sDxz6QpVA8GfqDt89/bfb9Ms/rmauBpwK8BleRZwGnA/1VVuwEvA7bs8AhIY2SxKM2Wn6e5qPuL7RLsbwFekGRNVX2B5sbYc99yHgdcWVV3jilWSZIWVVVfB36UZkGS9wHb2lkzT6uqzVV1WVU9VFXbgN/ju/eqPIxmsavfb28n8SGaFTMH/Rvw9nb/JcA3gGelWW3otcAvVtU9VfUA8Ft8d6Gmf6P5Qnb/9rV/3S6U8giwK3BQksdX1Zaq+ofhjIw0GhaL0mx5Os3ZRACq6hvA12i+EYXm7OIJ7fMTaL5xlSRpYlXV31XVa6pqH5r7Lj4d+P0keya5sJ32+XXgT/nuffOeDvzTdqtd/uO/PzJfq6qHB7YfpFmddjXwRODadqrpfcCn2nZoVrHdDHw6yS1JTm/j3Ay8iebs5l1tbE9flkGQxsRiUZottwP7z20k+V7gqcA/tU1/ChyT5Idopux8dOQRSpL0GFXV3wPn0hSNv01zxvE/VtWTab4ETdv1DmDv9izhnP16vs3dwDeB51TV7u3j+6rqSW0MD1TVL1fVM4CXA780d21iVX2gqn6UJhcXzXRWaWpZLEqz5QPASUkOTrIrzbSZq6tqC0BVbaWZhnM+8OdV9c2xRSpJ0hKS/GC7CM0+7fa+wPHAVcBuNFNH70uyN/CrAy/9PPAw8MYkOyf5aeDQPu9ZVd+mmfL67iR7tu+7d5KXtc//c5IfaAvRr9NMP30kybOSvKTNv/9KU3A+sqNjII2TxaI0O6qqLgf+H+DPab5VfSbdm2GfB/wHnIIqSZp8DwDPB65O8i80ReINNIvM/AZwCM31+J8APjz3oqr6FvDTwGuAe4FXD+7v4c00U02vaqe4/iXwrHbf2nb7GzRF6R9U1ZU01yu+i+bM5D8De9IsfiNNrfz7qdySplGSL9JcpL/ktNIkL6KZjrqm/fZUkiRJ6vDMojTlkjyH5vrDL/Xo+3jg/wb+yEJRkiRJi7FYlKZYkjOBTwNvrqrtV3nbvu+zgftolvv+/RGEJ0mSpCnmNFRJkiRJUodnFiVJkiRJHRaLkiRJkqSOnccdwKitWrWq1qxZM+4wJElDdu21195dVavHHce0MD9K0srRN0euuGJxzZo1bNq0adxhSJKGLMmiiz7p3zM/StLK0TdHOg1VkiRJktRhsShJkiRJ6rBYlCRJkiR1WCxKkiRJkjosFiVJkiRJHStuNdTlsOb0T4w7hO/Y8q6fHHcIkiR9x6TkSPOjJO04zyxKkiRJkjosFiVJkiRJHRaLkiRJkqQOi0VJkiRJUofFoiRJkiSpw2JRkiRJktRhsShJkiRJ6rBYlCRJkiR1WCxKkiRJkjosFiVJkiRJHRaLkiRJkqSOoRWLSTYkuSvJDQNtb0vyT0muax9HD+x7S5LNSW5K8rKB9iPbts1JTh9oPyDJ1UluTnJRkl2G9VkkSVpO5khJ0jQY5pnFc4Ej52l/d1Ud3D4uAUhyEHAc8Jz2NX+QZKckOwFnA0cBBwHHt30BzmyPtRa4Fzh5iJ9FkqTldC7mSEnShBtasVhVnwXu6dn9GODCqnqoqr4KbAYObR+bq+qWqvoWcCFwTJIALwE+1L7+PODYZf0AkiQNiTlSkjQNxnHN4mlJrm+n4OzRtu0N3DbQZ2vbtlD7U4H7qurh7dolSZpm5khJ0sQYdbH4HuCZwMHAHcDvtu2Zp289hvZ5JTklyaYkm7Zt2/boIpYkaTRGniPNj5KkxYy0WKyqO6vqkar6NvA+mik00Hzrue9A132A2xdpvxvYPcnO27Uv9L7nVNW6qlq3evXq5fkwkiQto3HkSPOjJGkxIy0Wk+w1sPlTwNwqcBuB45LsmuQAYC3wBeAaYG27qtsuNBf4b6yqAq4AXtm+fj3wsVF8BkmShsEcKUmaNDsv3eWxSXIBcDiwKslW4Azg8CQH00yH2QK8DqCqbkxyMfAV4GHg1Kp6pD3OacClwE7Ahqq6sX2LNwMXJvlN4EvAHw/rs0iStJzMkZKkaTC0YrGqjp+necFkVVXvBN45T/slwCXztN/Cd6foSJI0NcyRkqRpMI7VUCVJkiRJE85iUZIkSZLUYbEoSZIkSeqwWJQkSZIkdVgsSpIkSZI6LBYlSZIkSR0Wi5IkSZKkDotFSZIkSVKHxaIkSZIkqcNiUZIkSZLUYbEoSZIkSeqwWJQkSZIkdVgsSpIkSZI6LBYlSZIkSR0Wi5IkSZKkDotFSZIkSVKHxaIkSZIkqcNiUZIkSZLUYbEoSZIkSeqwWJQkSZIkdVgsSpIkSZI6LBYlSZIkSR1LFotJnjKKQCRJmjbmSEnSLOtzZvHqJB9McnSSDD0iSZKmhzlSkjSz+hSLBwLnAP8F2Jzkt5IcONywJEmaCuZISdLMWrJYrMZlVXU88AvAeuALST6T5AVDj1CSpAlljpQkzbKdl+qQ5KnACTTfmt4JvAHYCBwMfBA4YJgBSpI0qcyRkqRZtmSxCHweOB84tqq2DrRvSvLe4YQlSdJUMEdKkmZWn2LxWVVV8+2oqjOXOR5JkqaJOVKSNLP6LHDz6SS7z20k2SPJpUOMSZKkaWGOlCTNrD7F4uqqum9uo6ruBfYcXkiSJE0Nc6QkaWb1KRYfSbLf3EaS/YF5p9xIkrTCmCMlSTOrzzWLbwX+d5LPtNsvAk4ZXkiSJE0Nc6QkaWb1uc/ip4BDgIs8ZpFTAAAQw0lEQVSAi4HnVdWS12Mk2ZDkriQ3DLQ9JcllSW5uf+7RtifJWUk2J7k+ySEDr1nf9r85yfqB9ucl+XL7mrOS5NF9dEmSdow5UpI0y/pMQwXYFbgHuB84KMmLerzmXODI7dpOBy6vqrXA5e02wFHA2vZxCvAeaBIncAbwfOBQ4Iy55Nn2OWXgddu/lyRJo2COlCTNpCWnoSY5E3g1cCPw7ba5gM8u9rqq+mySNds1HwMc3j4/D7gSeHPb/v52+fGrkuyeZK+272VVdU8by2XAkUmuBJ5cVZ9v298PHAt8cqnPI0nScjFHSpJmWZ9rFo+luY/UQ8vwfk+rqjsAquqOJHMrxu0N3DbQb2vbtlj71nna55XkFNprSPbbb7+FukmS9GhNdY40P0qSFtNnGuotwOOHHMd811LUY2ifV1WdU1Xrqmrd6tWrH2OIkiR1THWOND9KkhbT58zig8B1SS4HvvPNaVW98TG8351J9mq/Md0LuKtt3wrsO9BvH+D2tv3w7dqvbNv3mae/JEmjZI6UJM2sPmcWNwLvAP4GuHbg8VhsBOZWa1sPfGyg/cR2xbfDgPvbqTiXAkck2aO9aP8I4NJ23wNJDmtXeDtx4FiSJI2KOVKSNLOWPLNYVecleQKwX1Xd1PfASS6g+cZzVZKtNCu2vQu4OMnJwK3Aq9rulwBHA5tpvqU9qX3ve5K8A7im7ff2uQv5gdfTrCb3BJqL9r1wX5I0UuZISdIs67Ma6suB/wnsAhyQ5GCahPSKxV5XVccvsOul8/Qt4NQFjrMB2DBP+ybguYtHL0nS8JgjJUmzrM801LfR3L/pPoCqug44YIgxSZI0Ld6GOVKSNKP6FIsPV9X927UtuPKoJEkriDlSkjSz+qyGekOSnwN2SrIWeCPNhfySJK105khJ0szqc2bxDcBzaJYEvwD4OvCmYQYlSdKUMEdKkmZWn9VQHwTe2j4kSVLLHClJmmV9VkO9gnmuv6iqlwwlIkmSpoQ5UpI0y/pcs/grA8+/B/gZ4OHhhCNJ0lQxR0qSZlafaajXbtf0uSSfGVI8kiRNDXOkJGmW9ZmG+pSBzccBzwO+f2gRSZI0JcyRkqRZ1mca6rU012OEZmrNV4GThxmUJElTwhwpSZpZfaahHjCKQCRJmjbmSEnSLOszDfWnF9tfVR9evnAkSZoe5khJ0izrMw31ZOBHgL9qt18MXAncTzP1xkQoSVqpzJGSpJnVp1gs4KCqugMgyV7A2VV10lAjkyRp8pkjJUkz63E9+qyZS4KtO4EDhxSPJEnTxBwpSZpZfc4sXpnkUuACmm9QjwOuGGpUkiRNB3OkJGlm9VkN9bQkPwW8qG06p6o+MtywJEmafOZISdIs63NmEeCLwANV9ZdJnphkt6p6YJiBSZI0JcyRkqSZtOQ1i0leC3wI+MO2aW/go8MMSpKkaWCOlCTNsj4L3JwKvBD4OkBV3QzsOcygJEmaEuZISdLM6lMsPlRV35rbSLIzzUX8kiStdOZISdLM6lMsfibJrwFPSPKfgA8CfzHcsCRJmgrmSEnSzOpTLJ4ObAO+DLwOuAT49WEGJUnSlDBHSpJm1qKroSbZCTivqk4A3jeakCRJmnzmSEnSrFv0zGJVPQKsTrLLiOKRJGkqmCMlSbOuz30WtwCfS7IR+Je5xqr6vWEFJUnSlNiCOVKSNKMWPLOY5Pz26auBj7d9dxt4SJK0IpkjJUkrwWJnFp+XZH/gVuB/jSgeSZKmgTlSkjTzFisW3wt8CjgA2DTQHpp7SD1jiHFJkjTJzJGSpJm34DTUqjqrqp4N/ElVPWPgcUBVmQQlSSuWOVKStBIseZ/Fqnr9KAKRJGnamCMlSbNsyWJRkiRJkrTyWCxKkiRJkjrGUiwm2ZLky0muS7KpbXtKksuS3Nz+3KNtT5KzkmxOcn2SQwaOs77tf3OS9eP4LJIkLSdzpCRpUozzzOKLq+rgqlrXbp8OXF5Va4HL222Ao4C17eMU4D3QJE7gDOD5wKHAGXPJU5KkKWeOlCSN3SRNQz0GOK99fh5w7ED7+6txFbB7kr2AlwGXVdU9VXUvcBlw5KiDliRpBMyRkqSRG1exWMCnk1yb5JS27WlVdQdA+3PPtn1v4LaB125t2xZq70hySpJNSTZt27ZtGT+GJEnLbmQ50vwoSVrMzmN63xdW1e1J9gQuS/L3i/TNPG21SHu3seoc4ByAdevWzdtHkqQJMbIcaX6UJC1mLGcWq+r29uddwEdorqe4s506Q/vzrrb7VmDfgZfvA9y+SLskSVPLHClJmhQjLxaTfG+S3eaeA0cANwAbgbnV2tYDH2ufbwRObFd8Owy4v52CcylwRJI92ov2j2jbJEmaSuZISdIkGcc01KcBH0ky9/4fqKpPJbkGuDjJycCtwKva/pcARwObgQeBkwCq6p4k7wCuafu9varuGd3HkCRp2ZkjJUkTY+TFYlXdAvzQPO1fA146T3sBpy5wrA3AhuWOUZKkcTBHSpImySTdOkOSJEmSNCEsFiVJkiRJHRaLkiRJkqQOi0VJkiRJUofFoiRJkiSpw2JRkiRJktRhsShJkiRJ6rBYlCRJkiR1WCxKkiRJkjosFiVJkiRJHRaLkiRJkqQOi0VJkiRJUofFoiRJkiSpw2JRkiRJktRhsShJkiRJ6rBYlCRJkiR1WCxKkiRJkjosFiVJkiRJHRaLkiRJkqQOi0VJkiRJUofFoiRJkiSpw2JRkiRJktRhsShJkiRJ6rBYlCRJkiR1WCxKkiRJkjosFiVJkiRJHRaLkiRJkqQOi0VJkiRJUofFoiRJkiSpw2JRkiRJktRhsShJkiRJ6rBYlCRJkiR1TH2xmOTIJDcl2Zzk9HHHI0nSpDBHSpJ2xFQXi0l2As4GjgIOAo5PctB4o5IkafzMkZKkHbXzuAPYQYcCm6vqFoAkFwLHAF8Za1TShFlz+ifGHcLE2fKunxx3CNKwmSM1scxLXeYlTaJpLxb3Bm4b2N4KPH9MsYyFf2ylx8Z/O13+j8rMWfE5clL490Z9+Hsy2VZqjpz2YjHztFWnU3IKcEq7+Y0kN+3g+64C7t7BY8wqx2Zxjs/CHJvFDX18cuYwjz5UC43N/qMOZMIsmSOHkB9hQv4tT+jv80SMzYRybBbm2CxsZGMzoX9TFrPU2PTKkdNeLG4F9h3Y3ge4fftOVXUOcM5yvWmSTVW1brmON0scm8U5PgtzbBbn+CzMsVnQkjlyufMj+N9jMY7NwhybhTk2C3NsFrZcYzPVC9wA1wBrkxyQZBfgOGDjmGOSJGkSmCMlSTtkqs8sVtXDSU4DLgV2AjZU1Y1jDkuSpLEzR0qSdtRUF4sAVXUJcMmI33ZZp+zMGMdmcY7PwhybxTk+C3NsFmCOnDiOzcIcm4U5NgtzbBa2LGOTqs56MJIkSZKkFW7ar1mUJEmSJA2BxeIikhyZ5KYkm5OcPs/+XZNc1O6/Osma0Uc5Hj3G5peSfCXJ9UkuT7KilrBfanwG+r0ySSVZMSt59RmbJD/b/v7cmOQDo45xnHr829ovyRVJvtT++zp6HHGOWpINSe5KcsMC+5PkrHbcrk9yyKhjXEnMjwszPy7M3Lg48+PCzI3zG0lurCof8zxoFgP4B+AZwC7A3wIHbdfnvwHvbZ8fB1w07rgnaGxeDDyxff76lTI2fcen7bcb8FngKmDduOOelLEB1gJfAvZot/ccd9wTNj7nAK9vnx8EbBl33CMamxcBhwA3LLD/aOCTNPcWPAy4etwxz+rD/LjDY7Mi86O5cVl+d1ZkfjQ3Ljo2Q8+Nnllc2KHA5qq6paq+BVwIHLNdn2OA89rnHwJemmS+myDPmiXHpqquqKoH282raO7vtVL0+d0BeAfwO8C/jjK4MeszNq8Fzq6qewGq6q4RxzhOfcangCe3z7+Pee4tO4uq6rPAPYt0OQZ4fzWuAnZPstdooltxzI8LMz8uzNy4OPPjwsyNCxhFbrRYXNjewG0D21vbtnn7VNXDwP3AU0cS3Xj1GZtBJ9N8q7FSLDk+SX4Y2LeqPj7KwCZAn9+dA4EDk3wuyVVJjhxZdOPXZ3zeBpyQZCvNKpdvGE1oE+/R/l3SY2d+XJj5cWHmxsWZHxdmbnzsdjg3Tv2tM4Zovm9At186tk+fWdT7cyc5AVgH/PhQI5osi45PkscB7wZeM6qAJkif352daabaHE7zjftfJ3luVd035NgmQZ/xOR44t6p+N8kLgPPb8fn28MObaCv17/E4mB8XZn5cmLlxcebHhZkbH7sd/lvsmcWFbQX2Hdjeh+4p7e/0SbIzzWnvxU4Fz4o+Y0OSnwDeCryiqh4aUWyTYKnx2Q14LnBlki00c8g3rpAL+fv+u/pYVf1bVX0VuIkmOa4EfcbnZOBigKr6PPA9wKqRRDfZev1d0rIwPy7M/Lgwc+PizI8LMzc+djucGy0WF3YNsDbJAUl2oblAf+N2fTYC69vnrwT+qtqrSWfckmPTTiX5Q5pEuFLm1M9ZdHyq6v6qWlVVa6pqDc01K6+oqk3jCXek+vy7+ijNAhAkWUUz7eaWkUY5Pn3G51bgpQBJnk2TELeNNMrJtBE4sV357TDg/qq6Y9xBzSjz48LMjwszNy7O/Lgwc+Njt8O50WmoC6iqh5OcBlxKswrThqq6McnbgU1VtRH4Y5rT3JtpvjE9bnwRj07PsfkfwJOAD7ZrGtxaVa8YW9Aj1HN8VqSeY3MpcESSrwCPAL9aVV8bX9Sj03N8fhl4X5JfpJlK8pqV8D/hSS6gmXq1qr0m5Qzg8QBV9V6aa1SOBjYDDwInjSfS2Wd+XJj5cWHmxsWZHxdmblzYKHJjVsA4SpIkSZIeJaehSpIkSZI6LBYlSZIkSR0Wi5IkSZKkDotFSZIkSVKHxaIkSZIkqcNiUZowSf6mR583JXniMr/v05N8qH1+cJKjl/P4kiTtKHOkNFreOkOaQkm2AOuq6u4hHf817fFPG8bxJUkaFnOktHw8syhNmCTfaH8enuTKJB9K8vdJ/iyNNwJPB65IckXb94gkn0/yxSQfTPKktn1Lkt9o27+c5Afb9h9Pcl37+FKS3ZKsSXJDkl2AtwOvbve/OsnNSVa3r31cks1JVo1jfCRJK5c5Uhoti0Vpsv0w8CbgIOAZwAur6izgduDFVfXiNiH9OvATVXUIsAn4pYFj3N22vwf4lbbtV4BTq+pg4MeAb851rqpvAf8duKiqDq6qi4A/BX6+7fITwN8O6xtbSZJ6MkdKQ2axKE22L1TV1qr6NnAdsGaePofRJMrPJbkOWA/sP7D/w+3Pawde/zng99pvYHevqoeXiGMDcGL7/L8Cf/IoP4ckScvNHCkN2c7jDkDSoh4aeP4I8/+bDXBZVR2/xDG+8/qqeleSTwBHA1cl+QngXxcKoqpuS3JnkpcAz+e736BKkjQu5khpyDyzKE2nB4Dd2udXAS9M8gMASZ6Y5MDFXpzkmVX15ao6k2ZKzg8ucvw5f0Qz1ebiqnpkRz+AJElDYo6UlonFojSdzgE+meSKqtoGvAa4IMn1NIlx+8S2vTe1F+r/Lc21GJ/cbv8VwEFzF++3bRuBJ+H0GknSZDNHSsvEW2dI6iXJOuDdVfVj445FkqRJYo7UrPKaRUlLSnI68Hq8DkOSpH/HHKlZ5plFSZIkSVKH1yxKkiRJkjosFiVJkiRJHRaLkiRJkqQOi0VJkiRJUofFoiRJkiSpw2JRkiRJktTx/wNz0798uewKqAAAAABJRU5ErkJggg==\n",
      "text/plain": [
       "<Figure size 1080x432 with 4 Axes>"
      ]
     },
     "metadata": {
      "needs_background": "light"
     },
     "output_type": "display_data"
    }
   ],
   "source": [
    "plt.figure(figsize=(15, 6))\n",
    "\n",
    "plt.subplot(2, 2, 1)\n",
    "plt.hist(df_anger[\"Intensity Score\"], bins=10)\n",
    "plt.title('Anger')\n",
    "#plt.xlabel('intensity')\n",
    "plt.ylabel('frequency')\n",
    "\n",
    "plt.subplot(2, 2, 2)\n",
    "plt.hist(df_fear[\"Intensity Score\"], bins=10)\n",
    "plt.title('Fear')\n",
    "#plt.xlabel('intensity')\n",
    "plt.ylabel('frequency')\n",
    "\n",
    "plt.subplot(2, 2, 3)\n",
    "plt.hist(df_joy[\"Intensity Score\"], bins=10)\n",
    "plt.title('Joy')\n",
    "plt.xlabel('intensity')\n",
    "plt.ylabel('frequency')\n",
    "\n",
    "plt.subplot(2, 2, 4)\n",
    "plt.hist(df_sadness[\"Intensity Score\"], bins=10)\n",
    "plt.title('Sadness')\n",
    "plt.xlabel('intensity')\n",
    "plt.ylabel('frequency')"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 68,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "0.000    16937\n",
       "0.516    27   \n",
       "0.500    26   \n",
       "0.547    23   \n",
       "0.469    22   \n",
       "Name: Intensity Score, dtype: int64"
      ]
     },
     "execution_count": 68,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df_anger[\"Intensity Score\"].value_counts().head()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "**It is surprising to see that each dataset has such  high proportion of low intensity values**\n",
    " - Let´s separate the 0 intensities from the remainder values and see what the 0 intensity tweets look like"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## 2. Examine entries with zero-level Intensity Scores"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 35,
   "metadata": {},
   "outputs": [],
   "source": [
    "df_anger0 = df_anger[df_anger[\"Intensity Score\"] == 0]\n",
    "df_fear0 = df_fear[df_fear[\"Intensity Score\"] == 0]\n",
    "df_joy0 = df_joy[df_joy[\"Intensity Score\"] == 0]\n",
    "df_sadness0 = df_sadness[df_sadness[\"Intensity Score\"] == 0]"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 39,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "(16937, 16937, 16937, 16937)"
      ]
     },
     "execution_count": 39,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "len(df_anger0), len(df_fear0), len(df_joy0), len(df_sadness0)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 44,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "(1002    The situation makes Leroy feel annoyed.           \n",
       " 1003    Leroy found himself in a grim situation.          \n",
       " 1004    My girlfriend feels dissapointed.                 \n",
       " 1005    The situation makes Shereen feel discouraged.     \n",
       " 1006    Kristin is a lousy bartender.                     \n",
       " 1007    What is the name of the largest Syrian lake?      \n",
       " 1008    The situation makes Jamel feel scared.            \n",
       " 1009    The conversation with an Argentinian was dreadful.\n",
       " Name: Tweet, dtype: object,\n",
       " 986    The situation makes Leroy feel annoyed.           \n",
       " 987    Leroy found himself in a grim situation.          \n",
       " 988    My girlfriend feels dissapointed.                 \n",
       " 989    The situation makes Shereen feel discouraged.     \n",
       " 990    Kristin is a lousy bartender.                     \n",
       " 991    What is the name of the largest Syrian lake?      \n",
       " 992    The situation makes Jamel feel scared.            \n",
       " 993    The conversation with an Argentinian was dreadful.\n",
       " Name: Tweet, dtype: object,\n",
       " 1105    The situation makes Leroy feel annoyed.           \n",
       " 1106    Leroy found himself in a grim situation.          \n",
       " 1107    My girlfriend feels dissapointed.                 \n",
       " 1108    The situation makes Shereen feel discouraged.     \n",
       " 1109    Kristin is a lousy bartender.                     \n",
       " 1110    What is the name of the largest Syrian lake?      \n",
       " 1111    The situation makes Jamel feel scared.            \n",
       " 1112    The conversation with an Argentinian was dreadful.\n",
       " Name: Tweet, dtype: object,\n",
       " 975    The situation makes Leroy feel annoyed.           \n",
       " 976    Leroy found himself in a grim situation.          \n",
       " 977    My girlfriend feels dissapointed.                 \n",
       " 978    The situation makes Shereen feel discouraged.     \n",
       " 979    Kristin is a lousy bartender.                     \n",
       " 980    What is the name of the largest Syrian lake?      \n",
       " 981    The situation makes Jamel feel scared.            \n",
       " 982    The conversation with an Argentinian was dreadful.\n",
       " Name: Tweet, dtype: object)"
      ]
     },
     "execution_count": 44,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df_anger0.head(8).Tweet, df_fear0.head(8).Tweet, df_joy0.head(8).Tweet, df_sadness0.head(8).Tweet, "
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "**Comment:** The data is quite repetitive and does not really represent the user´s emotions. Perhaps it~s best if we exclude them from our training set"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## 3. Examine entries with non-zero Intensity Scores"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 34,
   "metadata": {},
   "outputs": [],
   "source": [
    "df_anger1 = df_anger[df_anger[\"Intensity Score\"] != 0]\n",
    "df_fear1 = df_fear[df_fear[\"Intensity Score\"] != 0]\n",
    "df_joy1 = df_joy[df_joy[\"Intensity Score\"] != 0]\n",
    "df_sadness1 = df_sadness[df_sadness[\"Intensity Score\"] != 0]"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 36,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "Text(0, 0.5, 'frequency')"
      ]
     },
     "execution_count": 36,
     "metadata": {},
     "output_type": "execute_result"
    },
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAA34AAAGDCAYAAAB0usL6AAAABHNCSVQICAgIfAhkiAAAAAlwSFlzAAALEgAACxIB0t1+/AAAADl0RVh0U29mdHdhcmUAbWF0cGxvdGxpYiB2ZXJzaW9uIDMuMC4yLCBodHRwOi8vbWF0cGxvdGxpYi5vcmcvOIA7rQAAIABJREFUeJzt3X245XVd7//nSxDSpIBmIBhuNtpgouc00hzELEMp5SYdrFQoEjzkeHlAj2VdjtrvSJ5jjZ3Usgwbk0BTbryfhEQikDJBByUEjeOEE2whZpAbMQxjeP/+WN+Ni2Eze82avW6+az0f17Wuvb6f73et9d6fazZv3utz801VIUmSJEmaXI8ZdQCSJEmSpMGy8JMkSZKkCWfhJ0mSJEkTzsJPkiRJkiachZ8kSZIkTTgLP0mSJEmacBZ+kiRJkjThLPykEUlyRZK7kuw+6lgkSRpHSTYl+W6S73Q99h91XFIbWfhJI5BkBvgZoIAXjuDzdx32Z0qS1KcXVNUTuh63LtYbmw81TSz8pNF4GXAVcA5wylxjknOSvDvJRUnuTXJ1kid1nX9ekhuT3JPkz5J8Nsmvd53/70m+1owkXpLk4K5zleT0JF8Hvj6U31KSpAFIcmSSf0xyd5J/SnJU17mXN7nw3iQ3JXll17mjkswmeX2SfwP+chTxS6Ng4SeNxsuADzaP5yfZt+vcScDvAnsBG4G3AiRZAnwEeAPwI8CNwE/NvSjJCcAbgV8ElgJ/D5y3zeeeADwDOGzRfyNJkoYgyTLgIuD/AHsDvwV8NMnS5pLNwC8APwS8HHhnksO73uJHm9cdDKweVtzSqFn4SUOW5KfpJJsLq+oa4F+AX+m65GNV9YWqeoBOYbiiaT8OuKGqPtacexfwb12veyXw+1X1teb87wErukf9mvN3VtV3B/PbSZK06D7RjOzdneQTwMnAxVV1cVU9WFWXAhvo5Emq6qKq+pfq+CzwGTrLK+Y8CLy5qu43H2qaWPhJw3cK8JmquqM5/hBd0z15eDF3H/CE5vn+wC1zJ6qqgNmuaw8G/nguOQJ3AgGWdV1zC5IktcsJVbVn8ziBTr57cVcxeDfw08B+AEmOTXJVkjubc8cBS7reb0tV/cfQfwtpxFzQKg1RkscBLwF2adYWAOwO7JnkJxZ4+W3AAV3vle5jOkXdW6vqg9t5j9rxqCVJGiu3AB+oqldse6LZKfujdJZUfLKq/rMZJUzXZeZCTSVH/KThOgHYSmeN3Yrm8RQ66/FetsBrLwL+S5ITml3ITqezTmHOe4A3JHkqQJIfTvLiRY5fkqRR+yvgBUmen2SXJD/QbNpyALAbnS9UtwAPJDkWeN4og5XGhYWfNFynAH9ZVTdX1b/NPYA/BX6V7YzCN1NDXwz8AfAtOsXjBuD+5vzHgbcB5yf5NnA9cOwgfxlJkoatqm4BVtHZ0GwLnRHA3wYeU1X3Aq8BLgTuorOGfv2IQpXGSjrLhCS1TZLH0Fnj96tVdfmo45EkSdL4csRPapFmWsuezRqGN9JZs3DViMOSJEnSmLPwk9rlmXRu/3AH8AI6O525FbUkSZK2y6mekiRJkjThHPGTJEmSpAln4SdJkiRJE67VN3BfsmRJzczMjDoMSdIQXHPNNXdU1dJRx9EW5khJmg695sdWF34zMzNs2LBh1GFIkoYgyb+OOobFkuRA4P3AjwIPAuuq6o+T7A1cAMwAm4CXVNVdSQL8MXAccB9walV9aXufYY6UpOnQa350qqckScP3APC6qnoKcCRwepLDgDXAZVW1HLisOQY4FljePFYDZw0/ZElSm1n4SZI0ZFV129yIXVXdC3wNWAasAs5tLjsXOKF5vgp4f3VcBeyZZL8hhy1JajELP0mSRijJDPB04Gpg36q6DTrFIbBPc9ky4Jaul802bZIk9cTCT5KkEUnyBOCjwGur6tvbu3SetkfciDfJ6iQbkmzYsmXLYoUpSZoAFn6SJI1AksfSKfo+WFUfa5pvn5vC2fzc3LTPAgd2vfwA4NZt37Oq1lXVyqpauXSpG6BKkr6v1bt6SsM0s+aiUYcAwKa1x486BEk7qdml833A16rqHV2n1gOnAGubn5/saj8jyfnAM4B75qaESvq+ccnVYL7W+LHwkyRp+J4F/BrwlSTXNm1vpFPwXZjkNOBm4MXNuYvp3MphI53bObx8uOFKktrOwk+SpCGrqn9g/nV7AEfPc30Bpw80KEnSRHONnyRJkiRNOAs/SZIkSZpwFn6SJEmSNOEs/CRJkiRpwln4SZIkSdKEs/CTJEmSpAln4SdJkiRJE87CT5IkSZImnIWfJEmSJE04Cz9JkiRJmnAWfpIkSZI04Sz8JEmSJGnC7TrqACTtmJk1F406hIdsWnv8qEOQJElSDxzxkyRJkqQJ54ifxto4jW5JkiRJbeWInyRJkiRNOAs/SZIkSZpwFn6SJEmSNOEGVvglOTvJ5iTXd7WdmeSbSa5tHsd1nXtDko1Jbkzy/EHFJUmSJEnTZpAjfucAx8zT/s6qWtE8LgZIchhwIvDU5jV/lmSXAcYmSZIkSVNjYLt6VtWVSWZ6vHwVcH5V3Q98I8lG4Ajg8wMKT5IkSYvAHbildhjFGr8zklzXTAXdq2lbBtzSdc1s0yZJkiRJ2knDLvzOAp4ErABuA97etGeea2u+N0iyOsmGJBu2bNkymCglSZIkaYIMtfCrqturamtVPQi8l850TuiM8B3YdekBwK2P8h7rqmplVa1cunTpYAOWJEmSpAkw1MIvyX5dhy8C5nb8XA+cmGT3JIcAy4EvDDM2SZIkSZpUA9vcJcl5wFHAkiSzwJuBo5KsoDONcxPwSoCquiHJhcBXgQeA06tq66BikyRJkqRpMshdPU+ap/l927n+rcBbBxWPJEmSJE2rUezqKUnSVGt2tt6c5PqutjOTfDPJtc3juK5zb0iyMcmNSZ4/mqglSW1m4SdJ0vCdAxwzT/s7q2pF87gYIMlhwInAU5vX/FmSXYYWqSRpIlj4SZI0ZFV1JXBnj5evAs6vqvur6hvARr6/K7YkST2x8JMkaXyckeS6ZiroXk3bMuCWrmtmm7ZH8F63kqRHY+EnSdJ4OAt4ErACuA14e9Oeea6t+d7Ae91Kkh6NhZ8kSWOgqm6vqq1V9SDwXr4/nXMWOLDr0gOAW4cdnySp3Sz8JEkaA0n26zp8ETC34+d64MQkuyc5BFgOfGHY8UmS2m1g9/GTJEnzS3IecBSwJMks8GbgqCQr6Ezj3AS8EqCqbkhyIfBV4AHg9KraOoq4JUntZeEnSdKQVdVJ8zS/bzvXvxV46+AikrTYZtZcNOoQANi09vhRh6AxYeEnqW/jktTAxCZJkrQ9rvGTJEmSpAln4SdJkiRJE87CT5IkSZImnIWfJEmSJE24BTd3SbJ3Vd05jGAkSWoTc6RGaZw22JI0/noZ8bs6yYeTHJckA49IkqT2MEdKklqhl8LvUGAd8GvAxiS/l+TQwYYlSVIrmCMlSa2wYOFXHZc2N5v9deAU4AtJPpvkmQOPUJKkMWWOlCS1RS9r/H4EOJnOt5m3A68G1gMrgA8DhwwyQEmSxpU5UpLUFgsWfsDngQ8AJ1TVbFf7hiTvGUxYkiS1gjlSktQKvRR+T66qmu9EVb1tkeORJKlNzJGSpFboZXOXzyTZc+4gyV5JLhlgTJIktYU5UpLUCr0Ufkur6u65g6q6C9hncCFJktQa5khJUiv0UvhtTXLQ3EGSg4F5p7VIkjRlzJGSpFboZY3fm4B/SPLZ5vjZwOrBhSRJUmuYIyVJrbBg4VdVn05yOHAkEOA3quqOgUcmSdKYM0dKktqilxE/gN2BO5vrD0tCVV05uLAkSWoNc6Qkaez1cgP3twEvBW4AHmyaCzCpSRobM2suGnUIAGxae/yoQ9AQmSMlSW3Ry4jfCXTuU3T/oIORJKllzJGSpFboZVfPm4DHDjoQSZJayBwpSWqFXkb87gOuTXIZ8NA3mlX1mu29KMnZwC8Am6vqaU3b3sAFwAywCXhJVd2VJMAfA8c1n3dqVX1ph38bSZKGq68cKUnSsPVS+K1vHjvqHOBPgfd3ta0BLquqtUnWNMevB44FljePZwBnNT8lSRpn/eZISZKGqpfbOZyb5HHAQVV1Y69vXFVXJpnZpnkVcFTz/FzgCjqF3yrg/VVVwFVJ9kyyX1Xd1uvnSZI0bP3mSEmShm3BNX5JXgBcC3y6OV6RpN9vN/edK+aan/s07cuAW7qum23a5otndZINSTZs2bKlzzAkSdp5i5wjJUkamF42dzkTOAK4G6CqrgUOWeQ4Mk9bzXdhVa2rqpVVtXLp0qWLHIYkSTvkTAafIyVJ2mm9FH4PVNU927TNW5T14PYk+wE0Pzc37bPAgV3XHQDc2udnSJI0LIuZIyVJGpheCr/rk/wKsEuS5Un+BPjHPj9vPXBK8/wU4JNd7S9Lx5HAPa7vkyS1QF85MsnZSTYnub6rbe8klyb5evNzr6Y9Sd6VZGOS65IcPrhfR5I0qXop/F4NPJXONtXnAd8GXrvQi5KcB3weeHKS2SSnAWuBn0/ydeDnm2OAi+ncC2kj8F7gf+zg7yFJ0ij0lSPp7Hx9zDZtcztfLwcua47h4Ttfr6az87UkSTukl1097wPe1Dx6VlUnPcqpo+e5toDTd+T9JUkatZ3Ike58LWkoZtZcNOoQHrJp7fGjDmGqLVj4JbmcedYrVNVzBxKRJEktscg58mE7XydZaOfrRxR+SVbTGRXkoIMO6iMESdKk6uUG7r/V9fwHgF8CHhhMOJIktcowcuQO7XwNrANYuXKlm8xIkh7Sy1TPa7Zp+lySzw4oHkmSWmORc+Ttc1M43flakrTYermB+95djyVJng/86BBikyRprC1yjnTna0nSwPQy1fMaOlNKQmf6yjeA0wYZlCRJLdFXjmx2vj4KWJJkFngznZ2uL2x2wb4ZeHFz+cXAcXR2vr4PePni/gqSpGnQy1TPQ4YRiCRJbdNvjnTna0nSsPWyq+cvbu98VX1s8cKRJKk9zJGSpLboZarnacBPAX/XHD+Hzr2F7qEzvcWkJkmaVubIKTNO90STpB3RS+FXwGFzC8mbncbeXVWuMZhgJjZJ6ok5UpLUCgvu6gnMbLN72O3AoQOKR5KkNjFHSpJaoZcRvyuSXAKcR+ebzROBywcalSRJ7WCOlCS1Qi+7ep6R5EXAs5umdVX18cGGJUnS+DNHSpLaopcRP4AvAfdW1d8meXySParq3kEGJklSS5gjJUljb8E1fkleAXwE+POmaRnwiUEGJUlSG5gjJUlt0cuI3+nAEcDVAFX19ST7DDQqSWqpcdoRd9Pa40cdwjQwR0qSWqGXXT3vr6rvzR0k2ZXOAnZJkqadOVKS1Aq9FH6fTfJG4HFJfh74MPDXgw1LkqRWMEdKklqhl8JvDbAF+ArwSuBi4HcGGZQkSS1hjpQktcJ21/gl2QU4t6pOBt47nJAkSRp/5khJUptsd8SvqrYCS5PsNqR4JElqBXOkJKlNetnVcxPwuSTrgX+fa6yqdwwqKEmSWmIT5khJUgs86ohfkg80T18KfKq5do+uhyRJU8kcKUlqm+2N+P1kkoOBm4E/GVI8kiS1gTlSktQq2yv83gN8GjgE2NDVHjr3KHriAOOSJGmcmSMlSa3yqFM9q+pdVfUU4C+r6oldj0OqyoQmSZpa5khJUtsseB+/qnrVMAKRJKltzJGSpLbo5QbukiRJkqQWs/CTJEmSpAnXy338JEmSJGmnzKy5aNQhALBp7fGjDmEkHPGTJEmSpAk3khG/JJuAe4GtwANVtTLJ3sAFwAywCXhJVd01ivhGZVy+BZEkSZI0WUY54vecqlpRVSub4zXAZVW1HLisOZYkSZIk7aRxmuq5Cji3eX4ucMIIY5EkSZKkiTGqwq+AzyS5Jsnqpm3fqroNoPm5z3wvTLI6yYYkG7Zs2TKkcCVJGo4km5J8Jcm1STY0bXsnuTTJ15ufe406TklSu4yq8HtWVR0OHAucnuTZvb6wqtZV1cqqWrl06dLBRShJ0ui4HEKStKhGUvhV1a3Nz83Ax4EjgNuT7AfQ/Nw8itgkSRpDLoeQJO2UoRd+SX4wyR5zz4HnAdcD64FTmstOAT457NgkSRoDLoeQJC26UdzOYV/g40nmPv9DVfXpJF8ELkxyGnAz8OIRxCZJ0qg9q6puTbIPcGmSf+71hVW1DlgHsHLlyhpUgJKk9hl64VdVNwE/MU/7t4Cjhx2PJEnjpHs5RJKHLYeoqttcDiFJ6sc43c5BkqSp5nIISdKgjGKqpyRJmp/LISRJA2HhJ0nSmHA5hCRpUCz8JEnS2JtZc9GoQ5CkVnONnyRJkiRNOEf8JGlCjcsIyaa1x486BEmSpp4jfpIkSZI04Sz8JEmSJGnCWfhJkiRJ0oSz8JMkSZKkCWfhJ0mSJEkTzsJPkiRJkiachZ8kSZIkTTjv4ydJkiRpaozLfW5huPe6dcRPkiRJkiachZ8kSZIkTTinekqSpHmN03QoSdLOccRPkiRJkiachZ8kSZIkTTgLP0mSJEmacBZ+kiRJkjThLPwkSZIkacJZ+EmSJEnShJv62zm4VbUkSZKkSeeInyRJkiRNOAs/SZIkSZpwFn6SJEmSNOEs/CRJkiRpwln4SZIkSdKEG7vCL8kxSW5MsjHJmlHHI0nSODA/SpJ2xlgVfkl2Ad4NHAscBpyU5LDRRiVJ0miZHyVJO2usCj/gCGBjVd1UVd8DzgdWjTgmSZJGzfwoSdop41b4LQNu6TqebdokSZpm5kdJ0k7ZddQBbCPztNXDLkhWA6ubw+8kuXHgUU2GJcAdow6iZeyzHWN/7bip6LO8bdHe6uBFe6f2WTA/gjmyD1PxNzgA9lt/7Lf+THS/LVKO7Ck/jlvhNwsc2HV8AHBr9wVVtQ5YN8ygJkGSDVW1ctRxtIl9tmPsrx1nn2kHLJgfwRy5o/wb7I/91h/7rT/22+IZt6meXwSWJzkkyW7AicD6EcckSdKomR8lSTtlrEb8quqBJGcAlwC7AGdX1Q0jDkuSpJEyP0qSdtZYFX4AVXUxcPGo45hATv3ZcfbZjrG/dpx9pp6ZHwfCv8H+2G/9sd/6Y78tklQ9Ym24JEmSJGmCjNsaP0mSJEnSIrPwmzBJjklyY5KNSdbMc/43k3w1yXVJLksyzdujL9hfXdf9cpJKMvW7SvXSZ0le0vw7uyHJh4Yd47jp4e/yoCSXJ/ly87d53CjilCaRebF/5sj+mCf7Y64cPKd6TpAkuwD/D/h5Olt/fxE4qaq+2nXNc4Crq+q+JK8Cjqqql44k4BHrpb+a6/YALgJ2A86oqg3DjnVc9PhvbDlwIfDcqroryT5VtXkkAY+BHvtsHfDlqjoryWHAxVU1M4p4pUliXuyfObI/5sn+mCuHwxG/yXIEsLGqbqqq7wHnA6u6L6iqy6vqvubwKjr3gppWC/ZX438DfwD8xzCDG1O99NkrgHdX1V0A057M6K3PCvih5vkPM8/92ST1xbzYP3Nkf8yT/TFXDoGF32RZBtzSdTzbtD2a04C/GWhE423B/krydODAqvrUMAMbY738GzsUODTJ55JcleSYoUU3nnrpszOBk5PM0tm18dXDCU2aeObF/pkj+2Oe7I+5cgjG7nYO2imZp23eubxJTgZWAj870IjG23b7K8ljgHcCpw4roBbo5d/YrsBy4Cg635z/fZKnVdXdA45tXPXSZycB51TV25M8E/hA02cPDj48aaKZF/tnjuyPebI/5sohcMRvsswCB3YdH8A8w+BJfg54E/DCqrp/SLGNo4X6aw/gacAVSTYBRwLrp3zxei//xmaBT1bVf1bVN4Ab6SS4adVLn51GZ70HVfV54AeAJUOJTpps5sX+mSP7Y57sj7lyCCz8JssXgeVJDkmyG3AisL77gmZaxp/TSW7TPqd8u/1VVfdU1ZKqmmkWD19Fp9+meeH6gv/GgE8AzwFIsoTOlJabhhrleOmlz24GjgZI8hQ6yWzLUKOUJpN5sX/myP6YJ/tjrhwCC78JUlUPAGcAlwBfAy6sqhuSvCXJC5vL/i/wBODDSa5Nsu0f1dTosb/Upcc+uwT4VpKvApcDv11V3xpNxKPXY5+9DnhFkn8CzgNOLbdclnaaebF/bciRSc5J8n9GHUc382R/zJXD4e0cpDGU5Argr6rqL0YdiyRJiynJT9PZCfSpwFY6/6P/2qr64g6+zznAbFX9zqIHKU0gN3eRJEnSUCT5IeBTwKvorNfaDfgZwLWV0oA51VMac0lekWRjkjuTrE+yf9P+7iRv3+bav07y2tFEKknSgg4FqKrzqmprVX23qj5TVdcleVKSv0vyrSR3JPlgkj3nXpjk6Um+lOTeJBfQWeM1d+6oJLNJXpdkc5Lbkry86/zuSf4wyc1Jbk/yniSPa84tSfKpJHc3ufbvm11LSfL6JN9sPvPGJEcPraekRWbhJ42xJM8Ffh94CbAf8K90bmoKcC5wUldyWkJn0fN5IwhVkqRe/D9ga5JzkxybZK+uc6GT8/YHnkJnl8czAZoNPz4BfADYG/gw8EvbvPeP0rmx9zI6O0C+u+v930an6FwB/Fhzzf9qzr2Ozq6SS4F9gTcCleTJdNad/beq2gN4PrBpp3tAGhELP2m8/SpwdlV9qdli/A3AM5PMVNUXgHtodriiswPWFVV1+4hilSRpu6rq28BP07lH23uBLc1sln2ramNVXVpV91fVFuAdfP++ikcCjwX+qLkNwkfo7ATZ7T+BtzTnLwa+Azw5SYBXAL9RVXdW1b3A79HJm3Ov2w84uHnt3zebhmwFdgcOS/LYqtpUVf8ymJ6RBs/CTxpv+9MZ5QOgqr4DfIvON5XQGfU7uXl+Mp1vQiVJGltV9bWqOrWqDqBzL8D9gT9Ksk+S85upld8G/orv36dtf+Cb2+zi+K8Pf2e+1ewOOec+Oju2LgUeD1zTTOe8G/h00w6dnV03Ap9JclOSNU2cG4HX0hl13NzEtv+idII0AhZ+0ni7FTh47iDJDwI/AnyzaforYFWSn6AzLeYTQ49QkqQ+VdU/A+fQKQB/n85I4H+tqh+i84VmmktvA5Y1o3dzDurxY+4Avgs8tar2bB4/XFVPaGK4t6peV1VPBF4A/ObcWr6q+lBV/TSdXFx0poxKrWThJ423DwEvT7Iiye50pqZcXVWbAKpqls5Ulw8AH62q744sUkmSFpDkx5sNWA5ojg8ETqJzA/g96EzPvDvJMuC3u176eeAB4DVJdk3yi8ARvXxmVT1IZ1rpO5Ps03zusiTPb57/QpIfa4rKb9OZ4rk1yZOTPLfJv/9Bp3jcurN9II2KhZ80vqqqLgP+P+CjdL7tfBLfX5Mw51zgv+A0T0nS+LsXeAZwdZJ/p1PwXU9ng5XfBQ6ns379IuBjcy+qqu8BvwicCtwFvLT7fA9eT2c651XNNNK/BZ7cnFveHH+HToH5Z1V1BZ31fWvpjBj+G7APnY1fpFbyBu7SGEryJToL1Becupnk2XSmfM4032pKkiRJD+OInzRmkjyVznq9L/dw7WOB/wn8hUWfJEmSHo2FnzRGkrwN+Azw+qradreyba99CnA3nS2o/2gI4UmSJKmlnOopSZIkSRPOET9JkiRJmnAWfpIkSZI04XYddQA7Y8mSJTUzMzPqMCRJQ3DNNdfcUVVLRx1HW5gjJWk69JofW134zczMsGHDhlGHIUkagiTb3fBID2eOlKTp0Gt+dKqnJEmSJE04Cz9JkiRJmnAWfpIkSZI04Sz8JEmSJGnCWfhJkiRJ0oRr9a6e0jSaWXPRqEN4yKa1x486BEmaWuOSD8wFUjsMbMQvyYFJLk/ytSQ3JPmfTfveSS5N8vXm515Ne5K8K8nGJNclOXxQsUmSJEnSNBnkVM8HgNdV1VOAI4HTkxwGrAEuq6rlwGXNMcCxwPLmsRo4a4CxSZIkSdLUGFjhV1W3VdWXmuf3Al8DlgGrgHOby84FTmierwLeXx1XAXsm2W9Q8UmSJEnStBjK5i5JZoCnA1cD+1bVbdApDoF9msuWAbd0vWy2adv2vVYn2ZBkw5YtWwYZtiRJkiRNhIEXfkmeAHwUeG1VfXt7l87TVo9oqFpXVSurauXSpUsXK0xJkiRJmlgDLfySPJZO0ffBqvpY03z73BTO5ufmpn0WOLDr5QcAtw4yPkmSJEmaBoPc1TPA+4CvVdU7uk6tB05pnp8CfLKr/WXN7p5HAvfMTQmVJEmSJPVvkPfxexbwa8BXklzbtL0RWAtcmOQ04Gbgxc25i4HjgI3AfcDLBxibJEmSJE2NgRV+VfUPzL9uD+Doea4v4PRBxSNJkiRJ02qQI36SJEnS0MysuWjUITxk09rjRx2C9DBDuZ2DJEmSJGl0LPwkSRqyJGcn2Zzk+q62M5N8M8m1zeO4rnNvSLIxyY1Jnj+aqCVJbeZUT0mShu8c4E+B92/T/s6q+sPuhiSHAScCTwX2B/42yaFVtXUYgUoLGafplZIenSN+kiQNWVVdCdzZ4+WrgPOr6v6q+gad3a+PGFhwkqSJZOEnSdL4OCPJdc1U0L2atmXALV3XzDZtj5BkdZINSTZs2bJl0LFKklrEwk+SpPFwFvAkYAVwG/D2pn2+WyPVfG9QVeuqamVVrVy6dOlgopQktZKFnyRJY6Cqbq+qrVX1IPBevj+dcxY4sOvSA4Bbhx2fJKndLPwkSRoDSfbrOnwRMLfj53rgxCS7JzkEWA58YdjxSZLazV09JfVtnHZy80a5apMk5wFHAUuSzAJvBo5KsoLONM5NwCsBquqGJBcCXwUeAE53R09J0o6y8JMkaciq6qR5mt+3nevfCrx1cBFJkiadUz0lSZIkacJZ+EmSJEnShHOqp9SjcVrPJkmSJO0IR/wkSZIkacI54idJkiQtsnGZKeSu15rjiJ8kSZIkTTgLP0mSJEmacBZ+kiRJkjThLPwkSZIkacJZ+EmSJEnShLPwkyRJkqQJZ+EnSZIkSRPOwk+SJEmSJpyFnyRJkiRNuIEVfknOTrI5yfVdbWcm+WaSa5vHcV3n3pBkY5Ibkzx/UHFJkiRJ0rQZ5IjfOcAx87S/s6pWNI+LAZIcBpwuvXYQAAATLElEQVQIPLV5zZ8l2WWAsUmSJEnS1BhY4VdVVwJ39nj5KuD8qrq/qr4BbASOGFRskiRJkjRNRrHG74wk1zVTQfdq2pYBt3RdM9u0PUKS1Uk2JNmwZcuWQccqSZIkSa037MLvLOBJwArgNuDtTXvmubbme4OqWldVK6tq5dKlSwcTpSRJkiRNkKEWflV1e1VtraoHgffy/emcs8CBXZceANw6zNgkSZIkaVINtfBLsl/X4YuAuR0/1wMnJtk9ySHAcuALw4xNkiRJkibVroN64yTnAUcBS5LMAm8Gjkqygs40zk3AKwGq6oYkFwJfBR4ATq+qrYOKTZIkqR8zay4adQiS1JcFC78ke1dVr7tzPqSqTpqn+X3buf6twFt39HMkSRqVfnOkJEnD1stUz6uTfDjJcUnm24RFkqRpZY6UJLVCL4XfocA64NeAjUl+L8mhgw1LkqRWMEdKklphwcKvOi5tpm7+OnAK8IUkn03yzIFHKEnSmDJHSpLaopc1fj8CnEzn28zbgVfT2YVzBfBh4JBBBqjp5iJ6SePMHClJaotedvX8PPAB4ISqmu1q35DkPYMJS5KkVjBHSpJaoZfC78lVVfOdqKq3LXI8ktSXcRkd3rT2+FGHoOEyR0qSWqGXzV0+k2TPuYMkeyW5ZIAxSZLUFuZISVIr9FL4La2qu+cOquouYJ/BhSRJUmuYIyVJrdBL4bc1yUFzB0kOBuad1iJJ0pQxR0qSWqGXNX5vAv4hyWeb42cDqwcXkiRJrWGOlCS1Qi/38fs0cDhwAXAh8JNV5foFSdLU6zdHJjk7yeYk13e17Z3k0iRfb37u1bQnybuSbExyXZLDB/X7SJImVy9TPQF2B+4E7gEOS/LswYUkSVKr9JMjzwGO2aZtDXBZVS0HLmuOAY4FljeP1cBZixCzJGnK9HID97cBLwVuAB5smgu4coBxSZI09vrNkVV1ZZKZbZpXAUc1z88FrgBe37S/v7ltxFVJ9kyyX1Xdtgi/giRpSvSyxu8EOvcpun/QwUiS1DKLmSP3nSvmquq2JHO7gy4Dbum6brZpe0Thl2Q1zRrDgw46aNvTkqQp1stUz5uAxw46EEmSWmgYOTLztD3aTePXVdXKqlq5dOnSAYclSWqTXkb87gOuTXIZ8NA3mlX1moFFJUlSOyxmjrx9bgpnkv2AzU37LHBg13UHALf2G7AkaTr1Uvitbx6aIjNrLhp1CJLUBouZI9cDpwBrm5+f7Go/I8n5wDOAe1zfJ0naUQsWflV1bpLHAQdV1Y1DiEmSpFboN0cmOY/ORi5LkswCb6ZT8F2Y5DTgZuDFzeUXA8cBG+mMML588X4DSdK06GVXzxcAfwjsBhySZAXwlqp64aCDkyRpnPWbI6vqpEc5dfQ81xZw+s7GKkmabr1s7nImcARwN0BVXQscMsCYJElqizMxR0qSWqCXwu+Bqrpnm7Z5dxOTJGnKmCMlSa3Qy+Yu1yf5FWCXJMuB1wD/ONiwJElqBXOkJKkVehnxezXwVDrbVJ8HfBt47SCDkiSpJcyRkqRW6GVXz/uANzUPSZLUMEdKktqil109L2ee9QpV9dyBRCRJUkuYIyVJbdHLGr/f6nr+A8AvAQ8s9KIkZwO/AGyuqqc1bXsDFwAzwCbgJVV1V5IAf0znPkX3AadW1Zd6/zUkSRqJvnKkJA3LzJqLRh3CQzatPX7UIUy1XqZ6XrNN0+eSfLaH9z4H+FPg/V1ta4DLqmptkjXN8euBY4HlzeMZwFnNT0mSxtZO5EhJkoaql6mee3cdPgb4SeBHF3pdVV2ZZGab5lXAUc3zc4Er6BR+q4D3NzepvSrJnkn2q6rbFvocSZJGpd8cKUnSsPUy1fMaOusXQmf6yjeA0/r8vH3nirmqui3JPk37MuCWrutmmzYLP0nSOFvMHClJ0sD0MtXzkCHEkfk+et4Lk9XAaoCDDjpokDFJkrRdQ8qRkiTttF6mev7i9s5X1cd24PNun5vCmWQ/YHPTPgsc2HXdAcCtj/J564B1ACtXrpy3OJQkaRgWOUdKkjQwvUz1PA34KeDvmuPn0Fmbdw+dUbkdSWrrgVOAtc3PT3a1n5HkfDqbutzj+j5JUgssZo6UJGlgein8CjhsrhBrRureXVUv396LkpxHZyOXJUlmgTfTKfguTHIacDPw4ubyi+ncymEjnds5bPe9JUkaE33lSEmShq2Xwm9mm9G324FDF3pRVZ30KKeOnufaAk7vIRZJksZJXzlSkqRh66XwuyLJJcB5dL7ZPBG4fKBRSZLUDuZISVIr9LKr5xlJXgQ8u2laV1UfH2xYkiSNP3OkJKktehnxA/gScG9V/W2SxyfZo6ruHWRgkiS1hDlSkjT2HrPQBUleAXwE+POmaRnwiUEGJUlSG5gjJUltsWDhR2fTlWcB3waoqq8D+wwyKEmSWsIcKUlqhV4Kv/ur6ntzB0l2pbOAXZKkaWeOlCS1Qi+F32eTvBF4XJKfBz4M/PVgw5IkqRXMkZKkVuil8FsDbAG+ArySzs3Wf2eQQUmS1BLmSElSK2x3V88kuwDnVtXJwHuHE5IkSePPHClJapPtjvhV1VZgaZLdhhSPJEmtYI6UJLVJL/fx2wR8Lsl64N/nGqvqHYMKSpKkltiEOVKS1AKPOuKX5APN05cCn2qu3aPrIUnSVDJHSpLaZnsjfj+Z5GDgZuBPhhSPJEltYI4cspk1F406BElqte0Vfu8BPg0cAmzoag+dexQ9cYBxSZI0zsyRkqRWedSpnlX1rqp6CvCXVfXErschVWVCkyRNLXOkJKltFryPX1W9ahiBSJLUNuZISVJb9HIDd0mSJElSi/VyOwdJUo/GaQOKTWuPH3UIkiRpTFj4SZI0RpJsAu4FtgIPVNXKJHsDFwAzdO4d+JKqumtUMUqS2sepnpIkjZ/nVNWKqlrZHK8BLquq5cBlzbEkST2z8JMkafytAs5tnp8LnDDCWCRJLWThJ0nSeCngM0muSbK6adu3qm4DaH7uM98Lk6xOsiHJhi1btgwpXElSG7jGT5Kk8fKsqro1yT7ApUn+udcXVtU6YB3AypUra1ABSpLax8JPkqQxUlW3Nj83J/k4cARwe5L9quq2JPsBm0capCT1YVx2vp7WXa+d6ilJ0phI8oNJ9ph7DjwPuB5YD5zSXHYK8MnRRChJaquRjPi5VbUkSfPaF/h4Eujk6A9V1aeTfBG4MMlpwM3Ai0cYoySphUY51fM5VXVH1/HcVtVrk6xpjl8/mtAkSRq+qroJ+Il52r8FHD38iCRJk2Kcpnq6VbUkSZIkDcCoCr++t6qWJEmSJO2YUU317Hur6qZQXA1w0EEHDSo+SZIkSZoYIxnx696qGnjYVtUA29uquqrWVdXKqlq5dOnSYYUsSZIkSa019MLPraolSZIkabhGMdXTraolSZIkaYiGXvi5VfWjm1lz0ahDkCRJkjSBxul2DpIkSZKkAbDwkyRJkqQJZ+EnSZIkSRPOwk+SJEmSJtyobuAuSZLGnJuOSdLkcMRPkiRJkiachZ8kSZIkTTgLP0mSJEmacBZ+kiRJkjThLPwkSZIkacJZ+EmSJEnShLPwkyRJkqQJ5338JGlCjcs92DatPX7UIUiSNPUc8ZMkSZKkCTf1I37j8o24JEmSJA2KI36SJEmSNOEs/CRJkiRpwk39VE9JkiRJ02OclnoNcwM0R/wkSZIkacJZ+EmSJEnShLPwkyRJkqQJZ+EnSZIkSRPOwk+SJEmSJpyFnyRJkiRNOAs/SZIkSZpwY1f4JTkmyY1JNiZZM+p4JEkaB+ZHSdLOGKvCL8kuwLuBY4HDgJOSHDbaqCRJGi3zoyRpZ41V4QccAWysqpuq6nvA+cCqEcckSdKomR8lSTtl3Aq/ZcAtXcezTZskSdPM/ChJ2im7jjqAbWSetnrYBclqYHVzeH+S6wce1WRYAtwx6iBawr7qnX3Vu6ntq7xth1/yaH118E4H014L5kd4RI78TpIbBxrV+Jjav69FYN/1x37rn33XZQdz5E7lx3Er/GaBA7uODwBu7b6gqtYB6wCSbKiqlcMLr73sq97ZV72zr3pnX/XOvprXgvkRHp4jp4n/Zvpn3/XHfuuffde/ne27cZvq+UVgeZJDkuwGnAisH3FMkiSNmvlRkrRTxmrEr6oeSHIGcAmwC3B2Vd0w4rAkSRop86MkaWeNVeEHUFUXAxf3ePnUTWfZCfZV7+yr3tlXvbOvemdfzWMH8+O08d9M/+y7/thv/bPv+rdTfZeqR6wNlyRJkiRNkHFb4ydJkiRJWmStKPySHJPkxiQbk6yZ5/zuSS5ozl+dZGb4UY6HHvrqN5N8Ncl1SS5LMrXboy/UV13X/XKSSjK1O1D10ldJXtL827ohyYeGHeO46OFv8KAklyf5cvN3eNwo4hwHSc5OsvnRbsuTjnc1fXldksOHHaPGizmuP+a7/pn/+mc+7M9Ac2NVjfWDziL2fwGeCOwG/BNw2DbX/A/gPc3zE4ELRh33GPfVc4DHN89fZV89el811+0BXAlcBawcddzj2lfAcuDLwF7N8T6jjnuM+2od8Krm+WHAplHHPcL+ejZwOHD9o5w/DvgbOvewOxK4etQx+xjdwxw3uH5rrpv6fNdP35n/dqrvzIfz993AcmMbRvyOADZW1U1V9T3gfGDVNtesAs5tnn8EODrJfDe7nXQL9lVVXV5V9zWHV9G5F9Q06uXfFcD/Bv4A+I9hBjdmeumrVwDvrqq7AKpq85BjHBe99FUBP9Q8/2HmuRfbtKiqK4E7t3PJKuD91XEVsGeS/YYTncaQOa4/5rv+mf/6Zz7s0yBzYxsKv2XALV3Hs03bvNdU1QPAPcCPDCW68dJLX3U7jc43BtNowb5K8nTgwKr61DADG0O9/Ls6FDg0yeeSXJXkmKFFN1566aszgZOTzNLZofHVwwmtlXb0v2mabOa4/pjv+mf+65/5cHD6zo1jdzuHecw3crftVqS9XDMNeu6HJCcDK4GfHWhE42u7fZXkMcA7gVOHFdAY6+Xf1a50prscRecb9r9P8rSqunvAsY2bXvrqJOCcqnp7kmcCH2j66sHBh9c6/rdd3cxx/THf9c/81z/z4eD0nRvbMOI3CxzYdXwAjxwKfuiaJLvSGS7e3hDppOqlr0jyc8CbgBdW1f1Dim3cLNRXewBPA65IsonOHOr1U7rgvde/wU9W1X9W1TeAG+kkwmnTS1+dBlwIUFWfB34AWDKU6Nqnp/+maWqY4/pjvuuf+a9/5sPB6Ts3tqHw+yKwPMkhSXajs3nL+m2uWQ+c0jz/ZeDvqln9OGUW7KtmOsef00mI0zwPfbt9VVX3VNWSqpqpqhk6a0VeWFUbRhPuSPXyN/gJOpsqkGQJnakvNw01yvHQS1/dDBwNkOQpdBLdlqFG2R7rgZc1O5gdCdxTVbeNOiiNjDmuP+a7/pn/+mc+HJy+c+PYT/WsqgeSnAFcQmeHoLOr6oYkbwE2VNV64H10hoc30hnpO3F0EY9Oj331f4EnAB9u9r+5uapeOLKgR6THvhI999UlwPOSfBXYCvx2VX1rdFGPRo999TrgvUl+g87UjFOn9IsqkpxHZ3rUkmaNx5uBxwJU1XvorPk4DtgI3Ae8fDSRahyY4/pjvuuf+a9/5sP+DTI3xv6VJEmSpMnWhqmekiRJkqSdYOEnSZIkSRPOwk+SJEmSJpyFnyRJkiRNOAs/SZIkSZpwFn7SgCX5xx6ueW2Sxy/y5+6f5CPN8xVJjlvM95ckaWeYH6Xh8nYO0hhIsglYWVV3DOj9T23e/4xBvL8kSYNgfpQWjyN+0oAl+U7z86gkVyT5SJJ/TvLBdLwG2B+4PMnlzbXPS/L5JF9K8uEkT2jaNyX53ab9K0l+vGn/2STXNo8vJ9kjyUyS65PsBrwFeGlz/qVJvp5kafPaxyTZmGTJKPpHkjSdzI/ScFn4ScP1dOC1wGHAE4FnVdW7gFuB51TVc5oE8zvAz1XV4cAG4De73uOOpv0s4Leatt8CTq+qFcDPAN+du7iqvgf8L+CCqlpRVRcAfwX8anPJzwH/NKhvUyVJ6oH5URowCz9puL5QVbNV9SBwLTAzzzVH0kl8n0tyLXAKcHDX+Y81P6/pev3ngHc0347uWVUPLBDH2cDLmuf/HfjLHfw9JElaTOZHacB2HXUA0pS5v+v5Vub/GwxwaVWdtMB7PPT6qlqb5CLgOOCqJD8H/MejBVFVtyS5PclzgWfw/W83JUkaBfOjNGCO+Enj4V5gj+b5VcCzkvwYQJLHJzl0ey9O8qSq+kpVvY3O1Jcf3877z/kLOlNaLqyqrTv7C0iSNADmR2mRWPhJ42Ed8DdJLq+qLcCpwHlJrqOT6LZNVNt6bbNQ/Z/orF/4m23OXw4cNrd4vWlbDzwBp7FIksaX+VFaJN7OQZpSSVYC76yqnxl1LJIkjQvzoyaVa/ykKZRkDfAqXLsgSdJDzI+aZI74SZIkSdKEc42fJEmSJE04Cz9JkiRJmnAWfpIkSZI04Sz8JEmSJGnCWfhJkiRJ0oSz8JMkSZKkCff/A2eWJSp3mdV4AAAAAElFTkSuQmCC\n",
      "text/plain": [
       "<Figure size 1080x432 with 4 Axes>"
      ]
     },
     "metadata": {
      "needs_background": "light"
     },
     "output_type": "display_data"
    }
   ],
   "source": [
    "plt.figure(figsize=(15, 6))\n",
    "\n",
    "plt.subplot(2, 2, 1)\n",
    "plt.hist(df_anger1[\"Intensity Score\"], bins=10)\n",
    "plt.title('Anger')\n",
    "#plt.xlabel('intensity')\n",
    "plt.ylabel('frequency')\n",
    "\n",
    "plt.subplot(2, 2, 2)\n",
    "plt.hist(df_fear1[\"Intensity Score\"], bins=10)\n",
    "plt.title('Fear')\n",
    "#plt.xlabel('intensity')\n",
    "plt.ylabel('frequency')\n",
    "\n",
    "plt.subplot(2, 2, 3)\n",
    "plt.hist(df_joy1[\"Intensity Score\"], bins=10)\n",
    "plt.title('Joy')\n",
    "plt.xlabel('intensity')\n",
    "plt.ylabel('frequency')\n",
    "\n",
    "plt.subplot(2, 2, 4)\n",
    "plt.hist(df_sadness1[\"Intensity Score\"], bins=10)\n",
    "plt.title('Sadness')\n",
    "plt.xlabel('intensity')\n",
    "plt.ylabel('frequency')"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 38,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "(1002, 986, 1105, 975)"
      ]
     },
     "execution_count": 38,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "len(df_anger1), len(df_fear1), len(df_joy1), len(df_sadness1)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## 4. Analysis of Individual Datasets"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Let´s Try to look more closely at each category, especially at the lower and upper region, and decide if any data can be included into our training set.\n",
    "We want to find generalisable patterns"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "**_A. Examine Anger_**"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 74,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>ID</th>\n",
       "      <th>Tweet</th>\n",
       "      <th>Affect Dimension</th>\n",
       "      <th>Intensity Score</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>15</th>\n",
       "      <td>2018-En-03228</td>\n",
       "      <td>Dropping son off this morning then shopping with my girls for shoes wedding fun this afternoon.  Your TL won't explode today.  😀</td>\n",
       "      <td>anger</td>\n",
       "      <td>0.266</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>23</th>\n",
       "      <td>2018-En-03865</td>\n",
       "      <td>My heart is so happy I want to explode. ❤️💥</td>\n",
       "      <td>anger</td>\n",
       "      <td>0.061</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>27</th>\n",
       "      <td>2018-En-03447</td>\n",
       "      <td>YOU MIGHT BE TRYING TO FILL THE VOID IN YOUR #HEART WITH ALL SORTS OF THINGS BUT THAT PLACE BELONGS TO JESUS CHRIST #music #worry #love #SMM</td>\n",
       "      <td>anger</td>\n",
       "      <td>0.210</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>33</th>\n",
       "      <td>2018-En-01879</td>\n",
       "      <td>Dont sink to the level of those who insult you. Rather, rise to the level of those who inspire you. Deliver result, not insult</td>\n",
       "      <td>anger</td>\n",
       "      <td>0.258</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>36</th>\n",
       "      <td>2018-En-03548</td>\n",
       "      <td>So I'm pretty sure the @Indians are the MVP of the @AllStarGame  #defense #pitching</td>\n",
       "      <td>anger</td>\n",
       "      <td>0.250</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>37</th>\n",
       "      <td>2018-En-00043</td>\n",
       "      <td>it takes sadness to know happiness\\nabsence to value presence</td>\n",
       "      <td>anger</td>\n",
       "      <td>0.290</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>38</th>\n",
       "      <td>2018-En-01639</td>\n",
       "      <td>To recreate my romantic memories, I'd just put a chip on my shoulder  #masterchefau</td>\n",
       "      <td>anger</td>\n",
       "      <td>0.297</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>51</th>\n",
       "      <td>2018-En-01445</td>\n",
       "      <td>@askGST_GoI without the process of boiling and drying, it cannot be used for coooking.</td>\n",
       "      <td>anger</td>\n",
       "      <td>0.266</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>59</th>\n",
       "      <td>2018-En-03110</td>\n",
       "      <td>#moist people aren't #offended by a little typo.</td>\n",
       "      <td>anger</td>\n",
       "      <td>0.297</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>61</th>\n",
       "      <td>2018-En-04114</td>\n",
       "      <td>Love implies anger. The man who is angered by nothing cares about nothing. ~Edward Abbey #love</td>\n",
       "      <td>anger</td>\n",
       "      <td>0.172</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>62</th>\n",
       "      <td>2018-En-02961</td>\n",
       "      <td>nothing better than going on holiday when the weathers grim at home</td>\n",
       "      <td>anger</td>\n",
       "      <td>0.250</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>63</th>\n",
       "      <td>2018-En-02429</td>\n",
       "      <td>There are parts of you that wants the sadness. Find them out, ask them why</td>\n",
       "      <td>anger</td>\n",
       "      <td>0.274</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>67</th>\n",
       "      <td>2018-En-02973</td>\n",
       "      <td>I want a friendship group like in Friends 😧</td>\n",
       "      <td>anger</td>\n",
       "      <td>0.227</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>71</th>\n",
       "      <td>2018-En-02950</td>\n",
       "      <td>@pattonoswalt @EricaRoman_ Amazing how folks are foaming at the mouth to judge. We're happy for you @pattonoswalt !!!!!!!!!!</td>\n",
       "      <td>anger</td>\n",
       "      <td>0.194</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>78</th>\n",
       "      <td>2018-En-04171</td>\n",
       "      <td>Everyone want to win,but swear they never lost at anything. Victory is only sweet when you taste the bitterness of defeat.</td>\n",
       "      <td>anger</td>\n",
       "      <td>0.250</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>85</th>\n",
       "      <td>2018-En-00525</td>\n",
       "      <td>just watch a revenge movie or write it down in a journal and let it all out</td>\n",
       "      <td>anger</td>\n",
       "      <td>0.266</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>97</th>\n",
       "      <td>2018-En-03179</td>\n",
       "      <td>What can you say about @rogerfederer #awestruck.....</td>\n",
       "      <td>anger</td>\n",
       "      <td>0.290</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>99</th>\n",
       "      <td>2018-En-03927</td>\n",
       "      <td>I keep so many #secrets, my heads gonna #explode!!! \\nOh hey there i didn't notice u were reading this see #good #morning \\n@GoodMorningWord 💖</td>\n",
       "      <td>anger</td>\n",
       "      <td>0.281</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>100</th>\n",
       "      <td>2018-En-03019</td>\n",
       "      <td>If your nail polish has hardened or is gummy, place the bottle in a pan of boiling water. The polish will be like new.</td>\n",
       "      <td>anger</td>\n",
       "      <td>0.212</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>109</th>\n",
       "      <td>2018-En-02598</td>\n",
       "      <td>@soyoprincess @MisfitPhoenix @beastynewall @Gunderthswain 'Racist'is the fashionable insult - ignore it.</td>\n",
       "      <td>anger</td>\n",
       "      <td>0.297</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "                ID  \\\n",
       "15   2018-En-03228   \n",
       "23   2018-En-03865   \n",
       "27   2018-En-03447   \n",
       "33   2018-En-01879   \n",
       "36   2018-En-03548   \n",
       "37   2018-En-00043   \n",
       "38   2018-En-01639   \n",
       "51   2018-En-01445   \n",
       "59   2018-En-03110   \n",
       "61   2018-En-04114   \n",
       "62   2018-En-02961   \n",
       "63   2018-En-02429   \n",
       "67   2018-En-02973   \n",
       "71   2018-En-02950   \n",
       "78   2018-En-04171   \n",
       "85   2018-En-00525   \n",
       "97   2018-En-03179   \n",
       "99   2018-En-03927   \n",
       "100  2018-En-03019   \n",
       "109  2018-En-02598   \n",
       "\n",
       "                                                                                                                                              Tweet  \\\n",
       "15   Dropping son off this morning then shopping with my girls for shoes wedding fun this afternoon.  Your TL won't explode today.  😀                 \n",
       "23   My heart is so happy I want to explode. ❤️💥                                                                                                      \n",
       "27   YOU MIGHT BE TRYING TO FILL THE VOID IN YOUR #HEART WITH ALL SORTS OF THINGS BUT THAT PLACE BELONGS TO JESUS CHRIST #music #worry #love #SMM     \n",
       "33   Dont sink to the level of those who insult you. Rather, rise to the level of those who inspire you. Deliver result, not insult                   \n",
       "36   So I'm pretty sure the @Indians are the MVP of the @AllStarGame  #defense #pitching                                                              \n",
       "37   it takes sadness to know happiness\\nabsence to value presence                                                                                    \n",
       "38   To recreate my romantic memories, I'd just put a chip on my shoulder  #masterchefau                                                              \n",
       "51   @askGST_GoI without the process of boiling and drying, it cannot be used for coooking.                                                           \n",
       "59   #moist people aren't #offended by a little typo.                                                                                                 \n",
       "61   Love implies anger. The man who is angered by nothing cares about nothing. ~Edward Abbey #love                                                   \n",
       "62   nothing better than going on holiday when the weathers grim at home                                                                              \n",
       "63   There are parts of you that wants the sadness. Find them out, ask them why                                                                       \n",
       "67   I want a friendship group like in Friends 😧                                                                                                      \n",
       "71   @pattonoswalt @EricaRoman_ Amazing how folks are foaming at the mouth to judge. We're happy for you @pattonoswalt !!!!!!!!!!                     \n",
       "78   Everyone want to win,but swear they never lost at anything. Victory is only sweet when you taste the bitterness of defeat.                       \n",
       "85   just watch a revenge movie or write it down in a journal and let it all out                                                                      \n",
       "97   What can you say about @rogerfederer #awestruck.....                                                                                             \n",
       "99   I keep so many #secrets, my heads gonna #explode!!! \\nOh hey there i didn't notice u were reading this see #good #morning \\n@GoodMorningWord 💖   \n",
       "100  If your nail polish has hardened or is gummy, place the bottle in a pan of boiling water. The polish will be like new.                           \n",
       "109  @soyoprincess @MisfitPhoenix @beastynewall @Gunderthswain 'Racist'is the fashionable insult - ignore it.                                         \n",
       "\n",
       "    Affect Dimension  Intensity Score  \n",
       "15   anger            0.266            \n",
       "23   anger            0.061            \n",
       "27   anger            0.210            \n",
       "33   anger            0.258            \n",
       "36   anger            0.250            \n",
       "37   anger            0.290            \n",
       "38   anger            0.297            \n",
       "51   anger            0.266            \n",
       "59   anger            0.297            \n",
       "61   anger            0.172            \n",
       "62   anger            0.250            \n",
       "63   anger            0.274            \n",
       "67   anger            0.227            \n",
       "71   anger            0.194            \n",
       "78   anger            0.250            \n",
       "85   anger            0.266            \n",
       "97   anger            0.290            \n",
       "99   anger            0.281            \n",
       "100  anger            0.212            \n",
       "109  anger            0.297            "
      ]
     },
     "execution_count": 74,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df_anger1[df_anger1[\"Intensity Score\"] < 0.3].head(20)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 75,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "131"
      ]
     },
     "execution_count": 75,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "len(df_anger1[df_anger1[\"Intensity Score\"] < 0.3])"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 69,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>ID</th>\n",
       "      <th>Tweet</th>\n",
       "      <th>Affect Dimension</th>\n",
       "      <th>Intensity Score</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>6</th>\n",
       "      <td>2018-En-04119</td>\n",
       "      <td>Just know USA, all Canadians don't agree with what Khadr's settlement and his unwillingness to take responsibility for his actions. #outrage</td>\n",
       "      <td>anger</td>\n",
       "      <td>0.844</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>7</th>\n",
       "      <td>2018-En-01392</td>\n",
       "      <td>I hate getting woken up out my sleep 😡</td>\n",
       "      <td>anger</td>\n",
       "      <td>0.823</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>9</th>\n",
       "      <td>2018-En-01244</td>\n",
       "      <td>#UKVI why are you so difficult to access? And why on earth am I being charged exorbitant amounts to understand about my visa status?!  #crap</td>\n",
       "      <td>anger</td>\n",
       "      <td>0.803</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>12</th>\n",
       "      <td>2018-En-02200</td>\n",
       "      <td>@CP_UK_Longleat money grabbing and RUBBISH customer service!!! Rapids shut but no reply to emails! #diabolical #CustomerService #crap</td>\n",
       "      <td>anger</td>\n",
       "      <td>0.914</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>13</th>\n",
       "      <td>2018-En-01391</td>\n",
       "      <td>I am so freaking annoyed that he constantly feels the need to be a time in my life where I'd be happy with just one monitor on my PC</td>\n",
       "      <td>anger</td>\n",
       "      <td>0.848</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>79</th>\n",
       "      <td>2018-En-00819</td>\n",
       "      <td>@AmazonHelp Why are you making it so hard to return a faulty item. It's not my fault that you sent out an item that doesn't work #fuming</td>\n",
       "      <td>anger</td>\n",
       "      <td>0.828</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>110</th>\n",
       "      <td>2018-En-00702</td>\n",
       "      <td>Remember when Julia thought she was pregnant with Michael's baby and I was so happy about it and then the storyline got dropped. #pissed</td>\n",
       "      <td>anger</td>\n",
       "      <td>0.889</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>112</th>\n",
       "      <td>2018-En-04293</td>\n",
       "      <td>See people now selling their #MayMac presss conference tickets at Wembley for £100 now when they were free. Scum cunts!!! 😡</td>\n",
       "      <td>anger</td>\n",
       "      <td>0.924</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>113</th>\n",
       "      <td>2018-En-00985</td>\n",
       "      <td>@mumsnet_madness I am furious that these passive smokers are huffing all my cig smoke without contributing to the cost of a packet #outrage</td>\n",
       "      <td>anger</td>\n",
       "      <td>0.833</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>148</th>\n",
       "      <td>2018-En-00919</td>\n",
       "      <td>If I see one more Lakshmi EX enrage, I'm kill someone.</td>\n",
       "      <td>anger</td>\n",
       "      <td>0.922</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>150</th>\n",
       "      <td>2018-En-01041</td>\n",
       "      <td>all this anger is making me tored and there's literally no reason to stay up for this shitshow</td>\n",
       "      <td>anger</td>\n",
       "      <td>0.937</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>177</th>\n",
       "      <td>2018-En-00139</td>\n",
       "      <td>Sam all she fuckin said was about you meeting her rents on Friday which WAS GOING TO HAPPEN ANYWAY YOU DICK #cbb #cbbfinal #arsehole</td>\n",
       "      <td>anger</td>\n",
       "      <td>0.875</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>183</th>\n",
       "      <td>2018-En-02699</td>\n",
       "      <td>Anybody else getting furious about all the ads / articles filled with #WalkingDead &amp;amp; #GoT spoilers? #mad #furious #sad #SpoilerAlert</td>\n",
       "      <td>anger</td>\n",
       "      <td>0.871</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>185</th>\n",
       "      <td>2018-En-01082</td>\n",
       "      <td>Request MRI 2 years ago, Neuro only requested last year, I'm still waiting on appointment  #mssucks #healthcareFail</td>\n",
       "      <td>anger</td>\n",
       "      <td>0.819</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>220</th>\n",
       "      <td>2018-En-00545</td>\n",
       "      <td>#furious as fuck!!</td>\n",
       "      <td>anger</td>\n",
       "      <td>0.953</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>222</th>\n",
       "      <td>2018-En-00831</td>\n",
       "      <td>@altontowers Loves the rich!!! Fuck us 'working class folk' and our kids! #fuming #joke #scandalous #disgusting #altontowers  😡😡</td>\n",
       "      <td>anger</td>\n",
       "      <td>0.891</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>239</th>\n",
       "      <td>2018-En-03988</td>\n",
       "      <td>Cannot express my #hatred for @ATT they even screw me at work! 😠 this is 2nd time they cut our lines #idiots #worthless #needtobefined</td>\n",
       "      <td>anger</td>\n",
       "      <td>0.875</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>240</th>\n",
       "      <td>2018-En-00339</td>\n",
       "      <td>fuck shit fuck fuck shit  #suicideISanoption</td>\n",
       "      <td>anger</td>\n",
       "      <td>0.828</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>241</th>\n",
       "      <td>2018-En-02307</td>\n",
       "      <td>Nothing fuels my daily anger and hatred like a bus driver who stops at a yellow light</td>\n",
       "      <td>anger</td>\n",
       "      <td>0.813</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>249</th>\n",
       "      <td>2018-En-00712</td>\n",
       "      <td>#Vocabulary #1: Crap : extremely poor in quality.\\n\\nEx3: That movie was terrible. I can't believe I just wasted $10 on such #crap !\\n\\n#English</td>\n",
       "      <td>anger</td>\n",
       "      <td>0.803</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "                ID  \\\n",
       "6    2018-En-04119   \n",
       "7    2018-En-01392   \n",
       "9    2018-En-01244   \n",
       "12   2018-En-02200   \n",
       "13   2018-En-01391   \n",
       "79   2018-En-00819   \n",
       "110  2018-En-00702   \n",
       "112  2018-En-04293   \n",
       "113  2018-En-00985   \n",
       "148  2018-En-00919   \n",
       "150  2018-En-01041   \n",
       "177  2018-En-00139   \n",
       "183  2018-En-02699   \n",
       "185  2018-En-01082   \n",
       "220  2018-En-00545   \n",
       "222  2018-En-00831   \n",
       "239  2018-En-03988   \n",
       "240  2018-En-00339   \n",
       "241  2018-En-02307   \n",
       "249  2018-En-00712   \n",
       "\n",
       "                                                                                                                                                Tweet  \\\n",
       "6    Just know USA, all Canadians don't agree with what Khadr's settlement and his unwillingness to take responsibility for his actions. #outrage       \n",
       "7    I hate getting woken up out my sleep 😡                                                                                                             \n",
       "9    #UKVI why are you so difficult to access? And why on earth am I being charged exorbitant amounts to understand about my visa status?!  #crap       \n",
       "12   @CP_UK_Longleat money grabbing and RUBBISH customer service!!! Rapids shut but no reply to emails! #diabolical #CustomerService #crap              \n",
       "13   I am so freaking annoyed that he constantly feels the need to be a time in my life where I'd be happy with just one monitor on my PC               \n",
       "79   @AmazonHelp Why are you making it so hard to return a faulty item. It's not my fault that you sent out an item that doesn't work #fuming           \n",
       "110  Remember when Julia thought she was pregnant with Michael's baby and I was so happy about it and then the storyline got dropped. #pissed           \n",
       "112  See people now selling their #MayMac presss conference tickets at Wembley for £100 now when they were free. Scum cunts!!! 😡                        \n",
       "113  @mumsnet_madness I am furious that these passive smokers are huffing all my cig smoke without contributing to the cost of a packet #outrage        \n",
       "148  If I see one more Lakshmi EX enrage, I'm kill someone.                                                                                             \n",
       "150  all this anger is making me tored and there's literally no reason to stay up for this shitshow                                                     \n",
       "177  Sam all she fuckin said was about you meeting her rents on Friday which WAS GOING TO HAPPEN ANYWAY YOU DICK #cbb #cbbfinal #arsehole               \n",
       "183  Anybody else getting furious about all the ads / articles filled with #WalkingDead &amp; #GoT spoilers? #mad #furious #sad #SpoilerAlert           \n",
       "185  Request MRI 2 years ago, Neuro only requested last year, I'm still waiting on appointment  #mssucks #healthcareFail                                \n",
       "220  #furious as fuck!!                                                                                                                                 \n",
       "222  @altontowers Loves the rich!!! Fuck us 'working class folk' and our kids! #fuming #joke #scandalous #disgusting #altontowers  😡😡                   \n",
       "239  Cannot express my #hatred for @ATT they even screw me at work! 😠 this is 2nd time they cut our lines #idiots #worthless #needtobefined             \n",
       "240  fuck shit fuck fuck shit  #suicideISanoption                                                                                                       \n",
       "241  Nothing fuels my daily anger and hatred like a bus driver who stops at a yellow light                                                              \n",
       "249  #Vocabulary #1: Crap : extremely poor in quality.\\n\\nEx3: That movie was terrible. I can't believe I just wasted $10 on such #crap !\\n\\n#English   \n",
       "\n",
       "    Affect Dimension  Intensity Score  \n",
       "6    anger            0.844            \n",
       "7    anger            0.823            \n",
       "9    anger            0.803            \n",
       "12   anger            0.914            \n",
       "13   anger            0.848            \n",
       "79   anger            0.828            \n",
       "110  anger            0.889            \n",
       "112  anger            0.924            \n",
       "113  anger            0.833            \n",
       "148  anger            0.922            \n",
       "150  anger            0.937            \n",
       "177  anger            0.875            \n",
       "183  anger            0.871            \n",
       "185  anger            0.819            \n",
       "220  anger            0.953            \n",
       "222  anger            0.891            \n",
       "239  anger            0.875            \n",
       "240  anger            0.828            \n",
       "241  anger            0.813            \n",
       "249  anger            0.803            "
      ]
     },
     "execution_count": 69,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df_anger1[df_anger1[\"Intensity Score\"] > 0.8].head(20)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "**Conclusion** - A low value of anger can be included as non-depressive, judging by our random sample of text. A high level of anger is a little more tricky, so we will not include them for now"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "**_B. Examine Fear_**"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 71,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>ID</th>\n",
       "      <th>Tweet</th>\n",
       "      <th>Affect Dimension</th>\n",
       "      <th>Intensity Score</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>2018-En-03973</td>\n",
       "      <td>@executivegoth I tried a free Alpha trial to watch #dread and I'm sold. Worth the subscription alone. You all are incredible!</td>\n",
       "      <td>fear</td>\n",
       "      <td>0.179</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>5</th>\n",
       "      <td>2018-En-02333</td>\n",
       "      <td>@cnn please get Sebstian Gorka off of my tv.  The whole trump admin. needs to stop deflecting by talking about Hillary.</td>\n",
       "      <td>fear</td>\n",
       "      <td>0.328</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>11</th>\n",
       "      <td>2018-En-01344</td>\n",
       "      <td>My morning protein shake. Delicious way to assure I start my day the right way with 21 gms of whey protein. #protein #shake #morning</td>\n",
       "      <td>fear</td>\n",
       "      <td>0.210</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>12</th>\n",
       "      <td>2018-En-02726</td>\n",
       "      <td>#AI #revolation, soon is possible!\\n #fearless  #good #goodness</td>\n",
       "      <td>fear</td>\n",
       "      <td>0.194</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>18</th>\n",
       "      <td>2018-En-02179</td>\n",
       "      <td>'You dare threaten me, Thor, with so puny a weapon?'</td>\n",
       "      <td>fear</td>\n",
       "      <td>0.304</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>20</th>\n",
       "      <td>2018-En-01028</td>\n",
       "      <td>Why is an alarm clock going 'off' when it actually turns on? #alarm #alarmclock #ThursdayThoughts</td>\n",
       "      <td>fear</td>\n",
       "      <td>0.346</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>25</th>\n",
       "      <td>2018-En-01771</td>\n",
       "      <td>@shahidafridi37 at his best.... Great to watch u go big sir. #tremendous hits \\nDts boom boom Afridi 😍</td>\n",
       "      <td>fear</td>\n",
       "      <td>0.133</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>27</th>\n",
       "      <td>2018-En-03019</td>\n",
       "      <td>If your nail polish has hardened or is gummy, place the bottle in a pan of boiling water. The polish will be like new.</td>\n",
       "      <td>fear</td>\n",
       "      <td>0.222</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>29</th>\n",
       "      <td>2018-En-01166</td>\n",
       "      <td>no offense to those who love k culture, u can love it all you want bbs!! 💖 but i just personally want to get to know my own country's-</td>\n",
       "      <td>fear</td>\n",
       "      <td>0.281</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>33</th>\n",
       "      <td>2018-En-03035</td>\n",
       "      <td>It bugs me that people concern themselves so much with what other people CHOOSE to do with their money 😂🙈</td>\n",
       "      <td>fear</td>\n",
       "      <td>0.250</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>37</th>\n",
       "      <td>2018-En-03594</td>\n",
       "      <td>I'm not picky, guys are just intimidated by me... and I don't let dudes run over me or run my life and finances. If u can't respect that bye</td>\n",
       "      <td>fear</td>\n",
       "      <td>0.296</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>40</th>\n",
       "      <td>2018-En-00210</td>\n",
       "      <td>Don't be discouraged.</td>\n",
       "      <td>fear</td>\n",
       "      <td>0.321</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>42</th>\n",
       "      <td>2018-En-02270</td>\n",
       "      <td>#fans #gamers what you think @EAMaddenNFL 18 is going to rate the #Dolphins #offense #defense special teams rating &amp;amp; rank out of 32 teams</td>\n",
       "      <td>fear</td>\n",
       "      <td>0.321</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>47</th>\n",
       "      <td>2018-En-04376</td>\n",
       "      <td>Up early. Kicking ass and taking names. #offense.</td>\n",
       "      <td>fear</td>\n",
       "      <td>0.290</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>49</th>\n",
       "      <td>2018-En-03673</td>\n",
       "      <td>Olivia is a prime example how you can be gorgeous on the outside &amp;amp; have a really shitty personality! #looksainteverything #loveisland</td>\n",
       "      <td>fear</td>\n",
       "      <td>0.219</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>51</th>\n",
       "      <td>2018-En-00484</td>\n",
       "      <td>Time to get my dreads back I miss them 😩😩 #dread head #girlswithdreads</td>\n",
       "      <td>fear</td>\n",
       "      <td>0.350</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>53</th>\n",
       "      <td>2018-En-01173</td>\n",
       "      <td>Dear Emma its my honor to communicate with you directly kindly give me this tremendous opportunity to chat via Whats App 00966504634031 thx</td>\n",
       "      <td>fear</td>\n",
       "      <td>0.232</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>55</th>\n",
       "      <td>2018-En-01808</td>\n",
       "      <td>Sometimes you have to smile to hide your fears and to laugh to hide your tears</td>\n",
       "      <td>fear</td>\n",
       "      <td>0.310</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>58</th>\n",
       "      <td>2018-En-02325</td>\n",
       "      <td>And plz don't hesitate to come in. We have a translation\\nservices either. We all are waiting you to come!</td>\n",
       "      <td>fear</td>\n",
       "      <td>0.194</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>61</th>\n",
       "      <td>2018-En-02457</td>\n",
       "      <td>@Ritsakuru awe sorry na</td>\n",
       "      <td>fear</td>\n",
       "      <td>0.359</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "               ID  \\\n",
       "2   2018-En-03973   \n",
       "5   2018-En-02333   \n",
       "11  2018-En-01344   \n",
       "12  2018-En-02726   \n",
       "18  2018-En-02179   \n",
       "20  2018-En-01028   \n",
       "25  2018-En-01771   \n",
       "27  2018-En-03019   \n",
       "29  2018-En-01166   \n",
       "33  2018-En-03035   \n",
       "37  2018-En-03594   \n",
       "40  2018-En-00210   \n",
       "42  2018-En-02270   \n",
       "47  2018-En-04376   \n",
       "49  2018-En-03673   \n",
       "51  2018-En-00484   \n",
       "53  2018-En-01173   \n",
       "55  2018-En-01808   \n",
       "58  2018-En-02325   \n",
       "61  2018-En-02457   \n",
       "\n",
       "                                                                                                                                            Tweet  \\\n",
       "2   @executivegoth I tried a free Alpha trial to watch #dread and I'm sold. Worth the subscription alone. You all are incredible!                   \n",
       "5   @cnn please get Sebstian Gorka off of my tv.  The whole trump admin. needs to stop deflecting by talking about Hillary.                         \n",
       "11  My morning protein shake. Delicious way to assure I start my day the right way with 21 gms of whey protein. #protein #shake #morning            \n",
       "12  #AI #revolation, soon is possible!\\n #fearless  #good #goodness                                                                                 \n",
       "18  'You dare threaten me, Thor, with so puny a weapon?'                                                                                            \n",
       "20  Why is an alarm clock going 'off' when it actually turns on? #alarm #alarmclock #ThursdayThoughts                                               \n",
       "25  @shahidafridi37 at his best.... Great to watch u go big sir. #tremendous hits \\nDts boom boom Afridi 😍                                          \n",
       "27  If your nail polish has hardened or is gummy, place the bottle in a pan of boiling water. The polish will be like new.                          \n",
       "29  no offense to those who love k culture, u can love it all you want bbs!! 💖 but i just personally want to get to know my own country's-          \n",
       "33  It bugs me that people concern themselves so much with what other people CHOOSE to do with their money 😂🙈                                       \n",
       "37  I'm not picky, guys are just intimidated by me... and I don't let dudes run over me or run my life and finances. If u can't respect that bye    \n",
       "40  Don't be discouraged.                                                                                                                           \n",
       "42  #fans #gamers what you think @EAMaddenNFL 18 is going to rate the #Dolphins #offense #defense special teams rating &amp; rank out of 32 teams   \n",
       "47  Up early. Kicking ass and taking names. #offense.                                                                                               \n",
       "49  Olivia is a prime example how you can be gorgeous on the outside &amp; have a really shitty personality! #looksainteverything #loveisland       \n",
       "51  Time to get my dreads back I miss them 😩😩 #dread head #girlswithdreads                                                                          \n",
       "53  Dear Emma its my honor to communicate with you directly kindly give me this tremendous opportunity to chat via Whats App 00966504634031 thx     \n",
       "55  Sometimes you have to smile to hide your fears and to laugh to hide your tears                                                                  \n",
       "58  And plz don't hesitate to come in. We have a translation\\nservices either. We all are waiting you to come!                                      \n",
       "61  @Ritsakuru awe sorry na                                                                                                                         \n",
       "\n",
       "   Affect Dimension  Intensity Score  \n",
       "2   fear             0.179            \n",
       "5   fear             0.328            \n",
       "11  fear             0.210            \n",
       "12  fear             0.194            \n",
       "18  fear             0.304            \n",
       "20  fear             0.346            \n",
       "25  fear             0.133            \n",
       "27  fear             0.222            \n",
       "29  fear             0.281            \n",
       "33  fear             0.250            \n",
       "37  fear             0.296            \n",
       "40  fear             0.321            \n",
       "42  fear             0.321            \n",
       "47  fear             0.290            \n",
       "49  fear             0.219            \n",
       "51  fear             0.350            \n",
       "53  fear             0.232            \n",
       "55  fear             0.310            \n",
       "58  fear             0.194            \n",
       "61  fear             0.359            "
      ]
     },
     "execution_count": 71,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df_fear1[df_fear1[\"Intensity Score\"] < 0.4].head(20)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 72,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "265"
      ]
     },
     "execution_count": 72,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "len(df_fear1[df_fear1[\"Intensity Score\"] < 0.4])"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 59,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>ID</th>\n",
       "      <th>Tweet</th>\n",
       "      <th>Affect Dimension</th>\n",
       "      <th>Intensity Score</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>28</th>\n",
       "      <td>2018-En-03125</td>\n",
       "      <td>#TrumpRally : divisive, rude, incoherent. This man is truly insane. #terrifying #ridiculous I am an Arizonan Against Trump.</td>\n",
       "      <td>fear</td>\n",
       "      <td>0.839</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>39</th>\n",
       "      <td>2018-En-01914</td>\n",
       "      <td>things that terrify me: remembering my bf follows me on twitter</td>\n",
       "      <td>fear</td>\n",
       "      <td>0.817</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>43</th>\n",
       "      <td>2018-En-02003</td>\n",
       "      <td>3 hours of hell again. #anxiety. At this point I'm convinced I'll never get an on site job again or play keyboards live.</td>\n",
       "      <td>fear</td>\n",
       "      <td>0.895</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>56</th>\n",
       "      <td>2018-En-00526</td>\n",
       "      <td>One of those days. #Mentalhealth #Anxiety #agoraphobia #panic #depression #OCD</td>\n",
       "      <td>fear</td>\n",
       "      <td>0.907</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>97</th>\n",
       "      <td>2018-En-02972</td>\n",
       "      <td>@idktaehyng the possibilities terrify me</td>\n",
       "      <td>fear</td>\n",
       "      <td>0.911</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>101</th>\n",
       "      <td>2018-En-00694</td>\n",
       "      <td>I finally got my drivers permit #yes #readytodrive #nervous #scared</td>\n",
       "      <td>fear</td>\n",
       "      <td>0.857</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>135</th>\n",
       "      <td>2018-En-03209</td>\n",
       "      <td>Potentially going on holiday in 7 days.. can you get fit in that time? #panic 🤔</td>\n",
       "      <td>fear</td>\n",
       "      <td>0.911</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>144</th>\n",
       "      <td>2018-En-00105</td>\n",
       "      <td>On 1 side is the concern &amp;amp; fear 4 our teens' safety &amp;amp; happiness #thathorriblesuicidegame #terrifying #sosick (contd)</td>\n",
       "      <td>fear</td>\n",
       "      <td>0.806</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>147</th>\n",
       "      <td>2018-En-03585</td>\n",
       "      <td>I panic when someone says: 'I need to talk to you'.</td>\n",
       "      <td>fear</td>\n",
       "      <td>0.847</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>149</th>\n",
       "      <td>2018-En-03244</td>\n",
       "      <td>Ashamed. How #EU citizens treated and made #insecure in #UK @AmberRuddHR @theresa_may It's on yr watch #fear#anger #distrust is flourishing</td>\n",
       "      <td>fear</td>\n",
       "      <td>0.850</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>180</th>\n",
       "      <td>2018-En-02709</td>\n",
       "      <td>Tmr is the most important day to determine my future.....I am really nervous xxx</td>\n",
       "      <td>fear</td>\n",
       "      <td>0.854</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>200</th>\n",
       "      <td>2018-En-01348</td>\n",
       "      <td>Yeah im more afraid</td>\n",
       "      <td>fear</td>\n",
       "      <td>0.913</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>208</th>\n",
       "      <td>2018-En-00762</td>\n",
       "      <td>@ElfinKate @CulturalWatch @aldaily @BullDeborah @SelinaNThompson @CSSDLondon @CSSDLondon Tedx 1st Sept #scared!</td>\n",
       "      <td>fear</td>\n",
       "      <td>0.808</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>220</th>\n",
       "      <td>2018-En-04285</td>\n",
       "      <td>also, been kind of silent on s11 of the x-files because i am terrified that CC is going to screw it up! actually i know he will... #dreading</td>\n",
       "      <td>fear</td>\n",
       "      <td>0.845</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>221</th>\n",
       "      <td>2018-En-00083</td>\n",
       "      <td>@insurextech   Do you have complete control over your website and twitter account again.  We're nervous and uneasy on ico day.</td>\n",
       "      <td>fear</td>\n",
       "      <td>0.806</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>229</th>\n",
       "      <td>2018-En-03866</td>\n",
       "      <td>Model Town massacre represented the height of terrorism, savagery and oppression committed by the rulers\\n#ArrestModelTownKillers</td>\n",
       "      <td>fear</td>\n",
       "      <td>0.813</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>238</th>\n",
       "      <td>2018-En-03213</td>\n",
       "      <td>and you start to think that your new found home will be yours forever, with no threat in sight, until something or someone comes along...</td>\n",
       "      <td>fear</td>\n",
       "      <td>0.808</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>250</th>\n",
       "      <td>2018-En-02876</td>\n",
       "      <td>Suicide Blast killed 11 people in Cameroon. #bomb #attack   #security #explosion</td>\n",
       "      <td>fear</td>\n",
       "      <td>0.804</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>293</th>\n",
       "      <td>2018-En-03654</td>\n",
       "      <td>Before... I fear of not having you in my life... Now... I fear of letting you back into my life. #fears</td>\n",
       "      <td>fear</td>\n",
       "      <td>0.897</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>297</th>\n",
       "      <td>2018-En-01752</td>\n",
       "      <td>@lc_bradley @MarvMach @OxfordPlayhouse I know *that* - I *mean* Emma Rice's Wise Children!!! #angelacarter #panic</td>\n",
       "      <td>fear</td>\n",
       "      <td>0.804</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "                ID  \\\n",
       "28   2018-En-03125   \n",
       "39   2018-En-01914   \n",
       "43   2018-En-02003   \n",
       "56   2018-En-00526   \n",
       "97   2018-En-02972   \n",
       "101  2018-En-00694   \n",
       "135  2018-En-03209   \n",
       "144  2018-En-00105   \n",
       "147  2018-En-03585   \n",
       "149  2018-En-03244   \n",
       "180  2018-En-02709   \n",
       "200  2018-En-01348   \n",
       "208  2018-En-00762   \n",
       "220  2018-En-04285   \n",
       "221  2018-En-00083   \n",
       "229  2018-En-03866   \n",
       "238  2018-En-03213   \n",
       "250  2018-En-02876   \n",
       "293  2018-En-03654   \n",
       "297  2018-En-01752   \n",
       "\n",
       "                                                                                                                                            Tweet  \\\n",
       "28   #TrumpRally : divisive, rude, incoherent. This man is truly insane. #terrifying #ridiculous I am an Arizonan Against Trump.                    \n",
       "39   things that terrify me: remembering my bf follows me on twitter                                                                                \n",
       "43   3 hours of hell again. #anxiety. At this point I'm convinced I'll never get an on site job again or play keyboards live.                       \n",
       "56   One of those days. #Mentalhealth #Anxiety #agoraphobia #panic #depression #OCD                                                                 \n",
       "97   @idktaehyng the possibilities terrify me                                                                                                       \n",
       "101  I finally got my drivers permit #yes #readytodrive #nervous #scared                                                                            \n",
       "135  Potentially going on holiday in 7 days.. can you get fit in that time? #panic 🤔                                                                \n",
       "144  On 1 side is the concern &amp; fear 4 our teens' safety &amp; happiness #thathorriblesuicidegame #terrifying #sosick (contd)                   \n",
       "147  I panic when someone says: 'I need to talk to you'.                                                                                            \n",
       "149  Ashamed. How #EU citizens treated and made #insecure in #UK @AmberRuddHR @theresa_may It's on yr watch #fear#anger #distrust is flourishing    \n",
       "180  Tmr is the most important day to determine my future.....I am really nervous xxx                                                               \n",
       "200  Yeah im more afraid                                                                                                                            \n",
       "208  @ElfinKate @CulturalWatch @aldaily @BullDeborah @SelinaNThompson @CSSDLondon @CSSDLondon Tedx 1st Sept #scared!                                \n",
       "220  also, been kind of silent on s11 of the x-files because i am terrified that CC is going to screw it up! actually i know he will... #dreading   \n",
       "221  @insurextech   Do you have complete control over your website and twitter account again.  We're nervous and uneasy on ico day.                 \n",
       "229  Model Town massacre represented the height of terrorism, savagery and oppression committed by the rulers\\n#ArrestModelTownKillers              \n",
       "238  and you start to think that your new found home will be yours forever, with no threat in sight, until something or someone comes along...      \n",
       "250  Suicide Blast killed 11 people in Cameroon. #bomb #attack   #security #explosion                                                               \n",
       "293  Before... I fear of not having you in my life... Now... I fear of letting you back into my life. #fears                                        \n",
       "297  @lc_bradley @MarvMach @OxfordPlayhouse I know *that* - I *mean* Emma Rice's Wise Children!!! #angelacarter #panic                              \n",
       "\n",
       "    Affect Dimension  Intensity Score  \n",
       "28   fear             0.839            \n",
       "39   fear             0.817            \n",
       "43   fear             0.895            \n",
       "56   fear             0.907            \n",
       "97   fear             0.911            \n",
       "101  fear             0.857            \n",
       "135  fear             0.911            \n",
       "144  fear             0.806            \n",
       "147  fear             0.847            \n",
       "149  fear             0.850            \n",
       "180  fear             0.854            \n",
       "200  fear             0.913            \n",
       "208  fear             0.808            \n",
       "220  fear             0.845            \n",
       "221  fear             0.806            \n",
       "229  fear             0.813            \n",
       "238  fear             0.808            \n",
       "250  fear             0.804            \n",
       "293  fear             0.897            \n",
       "297  fear             0.804            "
      ]
     },
     "execution_count": 59,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df_fear1[df_fear1[\"Intensity Score\"] > 0.8].head(20)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "**Conclusion** - A low-mod value of fear does not appear to be depressive. However, a higher level of fear is harder to judge, so will not be included this time"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "**_C. Examine Joy_**"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 78,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>ID</th>\n",
       "      <th>Tweet</th>\n",
       "      <th>Affect Dimension</th>\n",
       "      <th>Intensity Score</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>2018-En-01532</td>\n",
       "      <td>#good to learning #wisdom &amp;lt;&amp;lt; reform (v): make in order to improve something &amp;gt;&amp;gt;</td>\n",
       "      <td>joy</td>\n",
       "      <td>0.281</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>9</th>\n",
       "      <td>2018-En-00053</td>\n",
       "      <td>@thedramble Tried it once. Poured into the sink. Didn't bother to make tasting notes :-) Looks like cheap sake, tasted like it too...</td>\n",
       "      <td>joy</td>\n",
       "      <td>0.281</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>17</th>\n",
       "      <td>2018-En-04294</td>\n",
       "      <td>@SkyNewsAust Oh for four years these  panelists were the lnp cheer squad hypocrites</td>\n",
       "      <td>joy</td>\n",
       "      <td>0.250</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>18</th>\n",
       "      <td>2018-En-00063</td>\n",
       "      <td>someone cheer me up</td>\n",
       "      <td>joy</td>\n",
       "      <td>0.219</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>32</th>\n",
       "      <td>2018-En-00663</td>\n",
       "      <td>persuade me into taking you out by using lively puns</td>\n",
       "      <td>joy</td>\n",
       "      <td>0.250</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>45</th>\n",
       "      <td>2018-En-01203</td>\n",
       "      <td>Bitter afternoon,no sweetness at all #Lenovo</td>\n",
       "      <td>joy</td>\n",
       "      <td>0.141</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>47</th>\n",
       "      <td>2018-En-02499</td>\n",
       "      <td>@England_Netball @NetballSW Please vote for the South West nominees to give us a chance #humbled  #southwestnetballfamily</td>\n",
       "      <td>joy</td>\n",
       "      <td>0.234</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>69</th>\n",
       "      <td>2018-En-00784</td>\n",
       "      <td>TY @PhilDieke: 'To drown out the God of #blessing is a powerful #political act. But the silencing cannot go on forever.' - @FCSCreationSpir</td>\n",
       "      <td>joy</td>\n",
       "      <td>0.242</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>70</th>\n",
       "      <td>2018-En-00586</td>\n",
       "      <td>“When I get sad, I stop being sad and be awesome instead.” \\n― Barney Stinson</td>\n",
       "      <td>joy</td>\n",
       "      <td>0.281</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>77</th>\n",
       "      <td>2018-En-00505</td>\n",
       "      <td>@marcrileydj Looks like City fans are already blaming the ref for a shock defeat at Bournemouth, #amusing</td>\n",
       "      <td>joy</td>\n",
       "      <td>0.182</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>78</th>\n",
       "      <td>2018-En-02156</td>\n",
       "      <td>@SnoopDogg is the man</td>\n",
       "      <td>joy</td>\n",
       "      <td>0.258</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>85</th>\n",
       "      <td>2018-En-00840</td>\n",
       "      <td>@xxBambsxx @OriginalFunko @AshWillBradley @Elliewhitt123 I've retweeted and followed #good luck @AshWillBradley @OriginalFunko</td>\n",
       "      <td>joy</td>\n",
       "      <td>0.250</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>88</th>\n",
       "      <td>2018-En-02966</td>\n",
       "      <td>@Rinoa11 lel I already know the whole plot dont worry I would have warned you :D man... Cid tho... That bitch slapped Gabranths hand away</td>\n",
       "      <td>joy</td>\n",
       "      <td>0.266</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>95</th>\n",
       "      <td>2018-En-02840</td>\n",
       "      <td>Fuck @mariannethyssen  Let us go for #splendid isolation !</td>\n",
       "      <td>joy</td>\n",
       "      <td>0.212</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>107</th>\n",
       "      <td>2018-En-02622</td>\n",
       "      <td>@DannyMcguire6 sad day Danny 😓you have been and still are a true Leeds rhino you have been brilliant at the club I will miss you</td>\n",
       "      <td>joy</td>\n",
       "      <td>0.156</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>117</th>\n",
       "      <td>2018-En-01655</td>\n",
       "      <td>I just tore my 2nd meniscus in 2 months what the fuck have you accomplished. But seriously, reaching maniacal laughter pain/WTF, self?-ness</td>\n",
       "      <td>joy</td>\n",
       "      <td>0.156</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>124</th>\n",
       "      <td>2018-En-01737</td>\n",
       "      <td>@LouiseLinton just because you married money doesn't mean you have class it just means you are a high prices prostitute.  #adorable</td>\n",
       "      <td>joy</td>\n",
       "      <td>0.141</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>127</th>\n",
       "      <td>2018-En-00377</td>\n",
       "      <td>#Gambling Horse racing is animated roulette. ~ Roger Kahn #quotes #followme</td>\n",
       "      <td>joy</td>\n",
       "      <td>0.197</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>129</th>\n",
       "      <td>2018-En-01492</td>\n",
       "      <td>There is a rollicking kindness that looks like malice.  Friedrich Nietzsche #friedrichnietzsche</td>\n",
       "      <td>joy</td>\n",
       "      <td>0.297</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>134</th>\n",
       "      <td>2018-En-03753</td>\n",
       "      <td>@kaylynreynolds @katycpstrong Ha brilliant 😂. Its really not ok is it 🙁 xx</td>\n",
       "      <td>joy</td>\n",
       "      <td>0.273</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "                ID  \\\n",
       "3    2018-En-01532   \n",
       "9    2018-En-00053   \n",
       "17   2018-En-04294   \n",
       "18   2018-En-00063   \n",
       "32   2018-En-00663   \n",
       "45   2018-En-01203   \n",
       "47   2018-En-02499   \n",
       "69   2018-En-00784   \n",
       "70   2018-En-00586   \n",
       "77   2018-En-00505   \n",
       "78   2018-En-02156   \n",
       "85   2018-En-00840   \n",
       "88   2018-En-02966   \n",
       "95   2018-En-02840   \n",
       "107  2018-En-02622   \n",
       "117  2018-En-01655   \n",
       "124  2018-En-01737   \n",
       "127  2018-En-00377   \n",
       "129  2018-En-01492   \n",
       "134  2018-En-03753   \n",
       "\n",
       "                                                                                                                                           Tweet  \\\n",
       "3    #good to learning #wisdom &lt;&lt; reform (v): make in order to improve something &gt;&gt;                                                    \n",
       "9    @thedramble Tried it once. Poured into the sink. Didn't bother to make tasting notes :-) Looks like cheap sake, tasted like it too...         \n",
       "17   @SkyNewsAust Oh for four years these  panelists were the lnp cheer squad hypocrites                                                           \n",
       "18   someone cheer me up                                                                                                                           \n",
       "32   persuade me into taking you out by using lively puns                                                                                          \n",
       "45   Bitter afternoon,no sweetness at all #Lenovo                                                                                                  \n",
       "47   @England_Netball @NetballSW Please vote for the South West nominees to give us a chance #humbled  #southwestnetballfamily                     \n",
       "69   TY @PhilDieke: 'To drown out the God of #blessing is a powerful #political act. But the silencing cannot go on forever.' - @FCSCreationSpir   \n",
       "70   “When I get sad, I stop being sad and be awesome instead.” \\n― Barney Stinson                                                                 \n",
       "77   @marcrileydj Looks like City fans are already blaming the ref for a shock defeat at Bournemouth, #amusing                                     \n",
       "78   @SnoopDogg is the man                                                                                                                         \n",
       "85   @xxBambsxx @OriginalFunko @AshWillBradley @Elliewhitt123 I've retweeted and followed #good luck @AshWillBradley @OriginalFunko                \n",
       "88   @Rinoa11 lel I already know the whole plot dont worry I would have warned you :D man... Cid tho... That bitch slapped Gabranths hand away     \n",
       "95   Fuck @mariannethyssen  Let us go for #splendid isolation !                                                                                    \n",
       "107  @DannyMcguire6 sad day Danny 😓you have been and still are a true Leeds rhino you have been brilliant at the club I will miss you              \n",
       "117  I just tore my 2nd meniscus in 2 months what the fuck have you accomplished. But seriously, reaching maniacal laughter pain/WTF, self?-ness   \n",
       "124  @LouiseLinton just because you married money doesn't mean you have class it just means you are a high prices prostitute.  #adorable           \n",
       "127  #Gambling Horse racing is animated roulette. ~ Roger Kahn #quotes #followme                                                                   \n",
       "129  There is a rollicking kindness that looks like malice.  Friedrich Nietzsche #friedrichnietzsche                                               \n",
       "134  @kaylynreynolds @katycpstrong Ha brilliant 😂. Its really not ok is it 🙁 xx                                                                    \n",
       "\n",
       "    Affect Dimension  Intensity Score  \n",
       "3    joy              0.281            \n",
       "9    joy              0.281            \n",
       "17   joy              0.250            \n",
       "18   joy              0.219            \n",
       "32   joy              0.250            \n",
       "45   joy              0.141            \n",
       "47   joy              0.234            \n",
       "69   joy              0.242            \n",
       "70   joy              0.281            \n",
       "77   joy              0.182            \n",
       "78   joy              0.258            \n",
       "85   joy              0.250            \n",
       "88   joy              0.266            \n",
       "95   joy              0.212            \n",
       "107  joy              0.156            \n",
       "117  joy              0.156            \n",
       "124  joy              0.141            \n",
       "127  joy              0.197            \n",
       "129  joy              0.297            \n",
       "134  joy              0.273            "
      ]
     },
     "execution_count": 78,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df_joy1[df_joy1[\"Intensity Score\"] < 0.3].head(20)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 82,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>ID</th>\n",
       "      <th>Tweet</th>\n",
       "      <th>Affect Dimension</th>\n",
       "      <th>Intensity Score</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>2018-En-00290</td>\n",
       "      <td>People are truly #amazing. #inspiring day</td>\n",
       "      <td>joy</td>\n",
       "      <td>0.712</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>2018-En-00588</td>\n",
       "      <td>@NoahWebHouse A review of my book faulted me for spending so much time on Webster's introductory front matter. But I had to, #brilliant!</td>\n",
       "      <td>joy</td>\n",
       "      <td>0.533</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>2018-En-03258</td>\n",
       "      <td>Really excited to see our team this year, and especially moving in the next 2-3 years when his guys start playing significant minutes.</td>\n",
       "      <td>joy</td>\n",
       "      <td>0.797</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>5</th>\n",
       "      <td>2018-En-03332</td>\n",
       "      <td>Be happy. Be confident. Be kind.\\n\\n #KissablesLoveSMShopmag\\nAllOutDenimFor KISSMARC</td>\n",
       "      <td>joy</td>\n",
       "      <td>0.661</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>7</th>\n",
       "      <td>2018-En-04146</td>\n",
       "      <td>You don't need money to have a great life, be eccentric, be creative, be joyful, be entertaining and all you want will come!</td>\n",
       "      <td>joy</td>\n",
       "      <td>0.578</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>8</th>\n",
       "      <td>2018-En-00231</td>\n",
       "      <td>@SatisfyingTaste @TheAnimalVines I used to make the peanut butter energy balls all the time. My famjam loved them! #recipes #yummy</td>\n",
       "      <td>joy</td>\n",
       "      <td>0.703</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>10</th>\n",
       "      <td>2018-En-03178</td>\n",
       "      <td>@RuthieeL &amp;amp; @EamonnHolmes are total entertainment on @thismorning #brilliant #sofunny #myfaves</td>\n",
       "      <td>joy</td>\n",
       "      <td>0.586</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>11</th>\n",
       "      <td>2018-En-04149</td>\n",
       "      <td>being an entrepreneur at 18 is a real blessing 🙏🏼 the flexibility, doing what you love, and being the one in charge is #great #blessed</td>\n",
       "      <td>joy</td>\n",
       "      <td>0.750</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>12</th>\n",
       "      <td>2018-En-01943</td>\n",
       "      <td>Vin Diesel is pretty cool. I have seen him in that movie Riddick and Pitch Black too. He must work out or something. #smiles</td>\n",
       "      <td>joy</td>\n",
       "      <td>0.532</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>13</th>\n",
       "      <td>2018-En-02634</td>\n",
       "      <td>@TeenMomOG2 @Javimarroquin9 @KailLowry He is so cute! Your #minime for sure! #blessing</td>\n",
       "      <td>joy</td>\n",
       "      <td>0.594</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>16</th>\n",
       "      <td>2018-En-01783</td>\n",
       "      <td>@071304Nathan Happy #blissful birthday</td>\n",
       "      <td>joy</td>\n",
       "      <td>0.712</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>21</th>\n",
       "      <td>2018-En-01609</td>\n",
       "      <td>Beautiful morning at the beach on Anna Maria Island with my wife. #vacation #blessed #happy</td>\n",
       "      <td>joy</td>\n",
       "      <td>0.818</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>23</th>\n",
       "      <td>2018-En-01111</td>\n",
       "      <td>Happy birthday @primo_can_dance have a blessed one my G 🎂🍾</td>\n",
       "      <td>joy</td>\n",
       "      <td>0.719</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>25</th>\n",
       "      <td>2018-En-04311</td>\n",
       "      <td>One of my clients just said that my look reminded her of Kim Kardashian! Oh shoot hey now! Watch out...\\nNot bad.. okay #flattered</td>\n",
       "      <td>joy</td>\n",
       "      <td>0.514</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>26</th>\n",
       "      <td>2018-En-03074</td>\n",
       "      <td>@dwarsrivier_SA Welcome to the industry fellow #guides! Expect a future of #excitement, #hairraising tales and just allround #fun! :D</td>\n",
       "      <td>joy</td>\n",
       "      <td>0.561</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>27</th>\n",
       "      <td>2018-En-02384</td>\n",
       "      <td>and now I got tickets to Hamlet #yay #happy #londontheatre</td>\n",
       "      <td>joy</td>\n",
       "      <td>0.721</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>29</th>\n",
       "      <td>2018-En-04178</td>\n",
       "      <td>Some people make your laugh a little louder. Your smile a little brighter. and your life a little better</td>\n",
       "      <td>joy</td>\n",
       "      <td>0.656</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>31</th>\n",
       "      <td>2018-En-01180</td>\n",
       "      <td>Granny Smiths with Flapjack Crumble, died and in heaven #yummy @stac28 @Kimtins  #NadiyasBritishFoodAdventure</td>\n",
       "      <td>joy</td>\n",
       "      <td>0.516</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>36</th>\n",
       "      <td>2018-En-02563</td>\n",
       "      <td>Just seen recent pics of Liz Hurley in swimming costume , she looks amazing 😍 #beauty</td>\n",
       "      <td>joy</td>\n",
       "      <td>0.719</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>38</th>\n",
       "      <td>2018-En-03523</td>\n",
       "      <td>Goodevening 😆</td>\n",
       "      <td>joy</td>\n",
       "      <td>0.531</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "               ID  \\\n",
       "0   2018-En-00290   \n",
       "2   2018-En-00588   \n",
       "4   2018-En-03258   \n",
       "5   2018-En-03332   \n",
       "7   2018-En-04146   \n",
       "8   2018-En-00231   \n",
       "10  2018-En-03178   \n",
       "11  2018-En-04149   \n",
       "12  2018-En-01943   \n",
       "13  2018-En-02634   \n",
       "16  2018-En-01783   \n",
       "21  2018-En-01609   \n",
       "23  2018-En-01111   \n",
       "25  2018-En-04311   \n",
       "26  2018-En-03074   \n",
       "27  2018-En-02384   \n",
       "29  2018-En-04178   \n",
       "31  2018-En-01180   \n",
       "36  2018-En-02563   \n",
       "38  2018-En-03523   \n",
       "\n",
       "                                                                                                                                       Tweet  \\\n",
       "0   People are truly #amazing. #inspiring day                                                                                                  \n",
       "2   @NoahWebHouse A review of my book faulted me for spending so much time on Webster's introductory front matter. But I had to, #brilliant!   \n",
       "4   Really excited to see our team this year, and especially moving in the next 2-3 years when his guys start playing significant minutes.     \n",
       "5   Be happy. Be confident. Be kind.\\n\\n #KissablesLoveSMShopmag\\nAllOutDenimFor KISSMARC                                                      \n",
       "7   You don't need money to have a great life, be eccentric, be creative, be joyful, be entertaining and all you want will come!               \n",
       "8   @SatisfyingTaste @TheAnimalVines I used to make the peanut butter energy balls all the time. My famjam loved them! #recipes #yummy         \n",
       "10  @RuthieeL &amp; @EamonnHolmes are total entertainment on @thismorning #brilliant #sofunny #myfaves                                         \n",
       "11  being an entrepreneur at 18 is a real blessing 🙏🏼 the flexibility, doing what you love, and being the one in charge is #great #blessed     \n",
       "12  Vin Diesel is pretty cool. I have seen him in that movie Riddick and Pitch Black too. He must work out or something. #smiles               \n",
       "13  @TeenMomOG2 @Javimarroquin9 @KailLowry He is so cute! Your #minime for sure! #blessing                                                     \n",
       "16  @071304Nathan Happy #blissful birthday                                                                                                     \n",
       "21  Beautiful morning at the beach on Anna Maria Island with my wife. #vacation #blessed #happy                                                \n",
       "23  Happy birthday @primo_can_dance have a blessed one my G 🎂🍾                                                                                 \n",
       "25  One of my clients just said that my look reminded her of Kim Kardashian! Oh shoot hey now! Watch out...\\nNot bad.. okay #flattered         \n",
       "26  @dwarsrivier_SA Welcome to the industry fellow #guides! Expect a future of #excitement, #hairraising tales and just allround #fun! :D      \n",
       "27  and now I got tickets to Hamlet #yay #happy #londontheatre                                                                                 \n",
       "29  Some people make your laugh a little louder. Your smile a little brighter. and your life a little better                                   \n",
       "31  Granny Smiths with Flapjack Crumble, died and in heaven #yummy @stac28 @Kimtins  #NadiyasBritishFoodAdventure                              \n",
       "36  Just seen recent pics of Liz Hurley in swimming costume , she looks amazing 😍 #beauty                                                      \n",
       "38  Goodevening 😆                                                                                                                              \n",
       "\n",
       "   Affect Dimension  Intensity Score  \n",
       "0   joy              0.712            \n",
       "2   joy              0.533            \n",
       "4   joy              0.797            \n",
       "5   joy              0.661            \n",
       "7   joy              0.578            \n",
       "8   joy              0.703            \n",
       "10  joy              0.586            \n",
       "11  joy              0.750            \n",
       "12  joy              0.532            \n",
       "13  joy              0.594            \n",
       "16  joy              0.712            \n",
       "21  joy              0.818            \n",
       "23  joy              0.719            \n",
       "25  joy              0.514            \n",
       "26  joy              0.561            \n",
       "27  joy              0.721            \n",
       "29  joy              0.656            \n",
       "31  joy              0.516            \n",
       "36  joy              0.719            \n",
       "38  joy              0.531            "
      ]
     },
     "execution_count": 82,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df_joy1[df_joy1[\"Intensity Score\"] > 0.5].head(20)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 84,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "614"
      ]
     },
     "execution_count": 84,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "len(df_joy1[df_joy1[\"Intensity Score\"] > 0.5])"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "**Conclusion** - A low level of joy is inconclusive, but a mid-high level of joy is definitely non-depressive, so can be included in our dataset"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "**_D. Examine Sadness_**"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 87,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>ID</th>\n",
       "      <th>Tweet</th>\n",
       "      <th>Affect Dimension</th>\n",
       "      <th>Intensity Score</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>6</th>\n",
       "      <td>2018-En-01054</td>\n",
       "      <td>@VanBluesat @infrared_rock Among them, is Hawrelak Park and the stage they have there. A great venue. #livemusic #blues</td>\n",
       "      <td>sadness</td>\n",
       "      <td>0.180</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>7</th>\n",
       "      <td>2018-En-00210</td>\n",
       "      <td>Don't be discouraged.</td>\n",
       "      <td>sadness</td>\n",
       "      <td>0.283</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>8</th>\n",
       "      <td>2018-En-01771</td>\n",
       "      <td>@shahidafridi37 at his best.... Great to watch u go big sir. #tremendous hits \\nDts boom boom Afridi 😍</td>\n",
       "      <td>sadness</td>\n",
       "      <td>0.200</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>11</th>\n",
       "      <td>2018-En-00294</td>\n",
       "      <td>“We just have to hold on a bit longer, then we can sink this monster into the ocean.” #foodparty</td>\n",
       "      <td>sadness</td>\n",
       "      <td>0.269</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>16</th>\n",
       "      <td>2018-En-03502</td>\n",
       "      <td>Here is the message Cnbc is sending they Don't care that Melissa Lee has a horrible smile or a that Joe Kernan needs braces</td>\n",
       "      <td>sadness</td>\n",
       "      <td>0.283</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>18</th>\n",
       "      <td>2018-En-01775</td>\n",
       "      <td>Do #you #said, people never cross the 10! #serious</td>\n",
       "      <td>sadness</td>\n",
       "      <td>0.220</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>28</th>\n",
       "      <td>2018-En-03813</td>\n",
       "      <td>Don't ever frown upon someone chasing a dream. Remember you were once chasing one too. HUMILITY ......</td>\n",
       "      <td>sadness</td>\n",
       "      <td>0.288</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>30</th>\n",
       "      <td>2018-En-00713</td>\n",
       "      <td>@SpnTentation Thank you! My first solo run!  #excited #andnervous</td>\n",
       "      <td>sadness</td>\n",
       "      <td>0.289</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>31</th>\n",
       "      <td>2018-En-03307</td>\n",
       "      <td>@GutoAberconwy Your majority is 635 members of the public- believe me you have offended rather more than 635 voters!</td>\n",
       "      <td>sadness</td>\n",
       "      <td>0.276</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>32</th>\n",
       "      <td>2018-En-02823</td>\n",
       "      <td>A joyless faith is not one for which Jesus died. #thegospel #joy #Jesus #happiness</td>\n",
       "      <td>sadness</td>\n",
       "      <td>0.152</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>33</th>\n",
       "      <td>2018-En-00127</td>\n",
       "      <td>Hello twitter! My next few tweets are going to be a bit gushy.... Look away if you're feeling bilious!!!</td>\n",
       "      <td>sadness</td>\n",
       "      <td>0.222</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>40</th>\n",
       "      <td>2018-En-02856</td>\n",
       "      <td>NEW MUSIC FRIDAY: FIRST SINGLE OFF THE NEXT PROJECT. #untitled #mattrod #hiphop #boston #hartford #animosity #thesemycities</td>\n",
       "      <td>sadness</td>\n",
       "      <td>0.265</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>44</th>\n",
       "      <td>2018-En-03600</td>\n",
       "      <td>Come on blues #StateOfOrigin #Origin  #NSWBlues #nsw</td>\n",
       "      <td>sadness</td>\n",
       "      <td>0.190</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>45</th>\n",
       "      <td>2018-En-02791</td>\n",
       "      <td>Beware of little expenses. A small leak will sink a great ship. -Benjamin Franklin</td>\n",
       "      <td>sadness</td>\n",
       "      <td>0.261</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>46</th>\n",
       "      <td>2018-En-03280</td>\n",
       "      <td>Playing at July 11, 2017 at 09:30PM: Special '20</td>\n",
       "      <td>sadness</td>\n",
       "      <td>0.185</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>51</th>\n",
       "      <td>2018-En-03491</td>\n",
       "      <td>feeling like a grim reaper all day hehehe\\n9 days pa 🎩✉️</td>\n",
       "      <td>sadness</td>\n",
       "      <td>0.286</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>67</th>\n",
       "      <td>2018-En-00483</td>\n",
       "      <td>@blackvoices Keep it up @gucci1017 #sober clear minded I see you over in Europe on tour killing the game right now!</td>\n",
       "      <td>sadness</td>\n",
       "      <td>0.273</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>86</th>\n",
       "      <td>2018-En-00243</td>\n",
       "      <td>You are MINE, my baby, my headache, my love, my smile, my frown, my wrong, my right, my pain, my happiness, my everything.</td>\n",
       "      <td>sadness</td>\n",
       "      <td>0.140</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>97</th>\n",
       "      <td>2018-En-02953</td>\n",
       "      <td>It's now raining and I can hear thunder growl somewhere. Good day to read some more.</td>\n",
       "      <td>sadness</td>\n",
       "      <td>0.196</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>103</th>\n",
       "      <td>2018-En-01275</td>\n",
       "      <td>if jk realize what taehyung did can he do that to taehyung as a revenge? i would love to</td>\n",
       "      <td>sadness</td>\n",
       "      <td>0.283</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "                ID  \\\n",
       "6    2018-En-01054   \n",
       "7    2018-En-00210   \n",
       "8    2018-En-01771   \n",
       "11   2018-En-00294   \n",
       "16   2018-En-03502   \n",
       "18   2018-En-01775   \n",
       "28   2018-En-03813   \n",
       "30   2018-En-00713   \n",
       "31   2018-En-03307   \n",
       "32   2018-En-02823   \n",
       "33   2018-En-00127   \n",
       "40   2018-En-02856   \n",
       "44   2018-En-03600   \n",
       "45   2018-En-02791   \n",
       "46   2018-En-03280   \n",
       "51   2018-En-03491   \n",
       "67   2018-En-00483   \n",
       "86   2018-En-00243   \n",
       "97   2018-En-02953   \n",
       "103  2018-En-01275   \n",
       "\n",
       "                                                                                                                           Tweet  \\\n",
       "6    @VanBluesat @infrared_rock Among them, is Hawrelak Park and the stage they have there. A great venue. #livemusic #blues       \n",
       "7    Don't be discouraged.                                                                                                         \n",
       "8    @shahidafridi37 at his best.... Great to watch u go big sir. #tremendous hits \\nDts boom boom Afridi 😍                        \n",
       "11   “We just have to hold on a bit longer, then we can sink this monster into the ocean.” #foodparty                              \n",
       "16   Here is the message Cnbc is sending they Don't care that Melissa Lee has a horrible smile or a that Joe Kernan needs braces   \n",
       "18   Do #you #said, people never cross the 10! #serious                                                                            \n",
       "28   Don't ever frown upon someone chasing a dream. Remember you were once chasing one too. HUMILITY ......                        \n",
       "30   @SpnTentation Thank you! My first solo run!  #excited #andnervous                                                             \n",
       "31   @GutoAberconwy Your majority is 635 members of the public- believe me you have offended rather more than 635 voters!          \n",
       "32   A joyless faith is not one for which Jesus died. #thegospel #joy #Jesus #happiness                                            \n",
       "33   Hello twitter! My next few tweets are going to be a bit gushy.... Look away if you're feeling bilious!!!                      \n",
       "40   NEW MUSIC FRIDAY: FIRST SINGLE OFF THE NEXT PROJECT. #untitled #mattrod #hiphop #boston #hartford #animosity #thesemycities   \n",
       "44   Come on blues #StateOfOrigin #Origin  #NSWBlues #nsw                                                                          \n",
       "45   Beware of little expenses. A small leak will sink a great ship. -Benjamin Franklin                                            \n",
       "46   Playing at July 11, 2017 at 09:30PM: Special '20                                                                              \n",
       "51   feeling like a grim reaper all day hehehe\\n9 days pa 🎩✉️                                                                      \n",
       "67   @blackvoices Keep it up @gucci1017 #sober clear minded I see you over in Europe on tour killing the game right now!           \n",
       "86   You are MINE, my baby, my headache, my love, my smile, my frown, my wrong, my right, my pain, my happiness, my everything.    \n",
       "97   It's now raining and I can hear thunder growl somewhere. Good day to read some more.                                          \n",
       "103  if jk realize what taehyung did can he do that to taehyung as a revenge? i would love to                                      \n",
       "\n",
       "    Affect Dimension  Intensity Score  \n",
       "6    sadness          0.180            \n",
       "7    sadness          0.283            \n",
       "8    sadness          0.200            \n",
       "11   sadness          0.269            \n",
       "16   sadness          0.283            \n",
       "18   sadness          0.220            \n",
       "28   sadness          0.288            \n",
       "30   sadness          0.289            \n",
       "31   sadness          0.276            \n",
       "32   sadness          0.152            \n",
       "33   sadness          0.222            \n",
       "40   sadness          0.265            \n",
       "44   sadness          0.190            \n",
       "45   sadness          0.261            \n",
       "46   sadness          0.185            \n",
       "51   sadness          0.286            \n",
       "67   sadness          0.273            \n",
       "86   sadness          0.140            \n",
       "97   sadness          0.196            \n",
       "103  sadness          0.283            "
      ]
     },
     "execution_count": 87,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df_sadness1[df_sadness1[\"Intensity Score\"] < 0.3].head(20)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 90,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "121"
      ]
     },
     "execution_count": 90,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "len(df_sadness1[df_sadness1[\"Intensity Score\"] < 0.3])"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 93,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>ID</th>\n",
       "      <th>Tweet</th>\n",
       "      <th>Affect Dimension</th>\n",
       "      <th>Intensity Score</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>9</th>\n",
       "      <td>2018-En-00276</td>\n",
       "      <td>we mourn the death of our hopes today #james</td>\n",
       "      <td>sadness</td>\n",
       "      <td>0.870</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>22</th>\n",
       "      <td>2018-En-02064</td>\n",
       "      <td>@narendramodi Really it was very sad and shame!!!</td>\n",
       "      <td>sadness</td>\n",
       "      <td>0.862</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>42</th>\n",
       "      <td>2018-En-02565</td>\n",
       "      <td>My head is been hurting so much and I lost my appetite</td>\n",
       "      <td>sadness</td>\n",
       "      <td>0.860</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>43</th>\n",
       "      <td>2018-En-01021</td>\n",
       "      <td>No, I'm not 'depressed because of the weather,' I'm depressed because I have #depression #sicknotweak</td>\n",
       "      <td>sadness</td>\n",
       "      <td>0.973</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>64</th>\n",
       "      <td>2018-En-03308</td>\n",
       "      <td>Would love to stop crying sometime today, on my tenth cry 🙄 deep sadness on top of food poisoning do not mix. #miserable</td>\n",
       "      <td>sadness</td>\n",
       "      <td>0.857</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>95</th>\n",
       "      <td>2018-En-03669</td>\n",
       "      <td>#sadness #cry 💔 dad will never understand his 3rd child</td>\n",
       "      <td>sadness</td>\n",
       "      <td>0.833</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>125</th>\n",
       "      <td>2018-En-02545</td>\n",
       "      <td>lonely is not being alone, it's the feeling that no one cares. #alone #depressed #anxiety</td>\n",
       "      <td>sadness</td>\n",
       "      <td>0.841</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>139</th>\n",
       "      <td>2018-En-01456</td>\n",
       "      <td>this year keeps getting more depressing and disappointing</td>\n",
       "      <td>sadness</td>\n",
       "      <td>0.909</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>143</th>\n",
       "      <td>2018-En-03844</td>\n",
       "      <td>no matter how many sad ghost man tears he's crying now! you are not entitled to forgiveness just because you're really sad now!!</td>\n",
       "      <td>sadness</td>\n",
       "      <td>0.804</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>166</th>\n",
       "      <td>2018-En-04017</td>\n",
       "      <td>Bout to cry 😭 I just wanna sleep I hate this job 😩</td>\n",
       "      <td>sadness</td>\n",
       "      <td>0.852</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>171</th>\n",
       "      <td>2018-En-00418</td>\n",
       "      <td>Once she said you are my world, now she is saying not only you exist in the earth. #pain  #heartbreaking</td>\n",
       "      <td>sadness</td>\n",
       "      <td>0.846</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>173</th>\n",
       "      <td>2018-En-04153</td>\n",
       "      <td>I don't know how much longer I can play stupid 😒😔 #heartbroken #stupid #sadness</td>\n",
       "      <td>sadness</td>\n",
       "      <td>0.923</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>182</th>\n",
       "      <td>2018-En-03113</td>\n",
       "      <td>I miss my friends so badly 😢</td>\n",
       "      <td>sadness</td>\n",
       "      <td>0.820</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>193</th>\n",
       "      <td>2018-En-03944</td>\n",
       "      <td>watching that video and realizing that I've gotten uglier #depressed</td>\n",
       "      <td>sadness</td>\n",
       "      <td>0.944</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>194</th>\n",
       "      <td>2018-En-01182</td>\n",
       "      <td>Looking for good news today...not finding any on Twitter. Bummer. 😢 #depressing #badnews</td>\n",
       "      <td>sadness</td>\n",
       "      <td>0.820</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>200</th>\n",
       "      <td>2018-En-00725</td>\n",
       "      <td>Bro it deadass suck when you try your best to make one person happy and end up letting everyone down #disappointment</td>\n",
       "      <td>sadness</td>\n",
       "      <td>0.826</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>219</th>\n",
       "      <td>2018-En-00928</td>\n",
       "      <td>ha 🙃 ha 🙃 i just realised that i've never actually been to therapy and i still don't know if i'm depressed or just sad all the time</td>\n",
       "      <td>sadness</td>\n",
       "      <td>0.828</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>222</th>\n",
       "      <td>2018-En-02340</td>\n",
       "      <td>@CPC_HQ Immature...and Trumpy. Sad one guys😕 Does this represent the intelligence and moral depth of CPC ? #bully #notinmycanada</td>\n",
       "      <td>sadness</td>\n",
       "      <td>0.833</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>262</th>\n",
       "      <td>2018-En-02347</td>\n",
       "      <td>Hate seein stories on animal cruelty, why would any1 wanna hurt poor defenceless animals 😩😭 #StopAnimalCruelty #heartbreaking #worldsgoneMad</td>\n",
       "      <td>sadness</td>\n",
       "      <td>0.841</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>270</th>\n",
       "      <td>2018-En-00920</td>\n",
       "      <td>Unrealistic expectations attract disappointment. And that's what you were #disappointment #sad</td>\n",
       "      <td>sadness</td>\n",
       "      <td>0.860</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "                ID  \\\n",
       "9    2018-En-00276   \n",
       "22   2018-En-02064   \n",
       "42   2018-En-02565   \n",
       "43   2018-En-01021   \n",
       "64   2018-En-03308   \n",
       "95   2018-En-03669   \n",
       "125  2018-En-02545   \n",
       "139  2018-En-01456   \n",
       "143  2018-En-03844   \n",
       "166  2018-En-04017   \n",
       "171  2018-En-00418   \n",
       "173  2018-En-04153   \n",
       "182  2018-En-03113   \n",
       "193  2018-En-03944   \n",
       "194  2018-En-01182   \n",
       "200  2018-En-00725   \n",
       "219  2018-En-00928   \n",
       "222  2018-En-02340   \n",
       "262  2018-En-02347   \n",
       "270  2018-En-00920   \n",
       "\n",
       "                                                                                                                                            Tweet  \\\n",
       "9    we mourn the death of our hopes today #james                                                                                                   \n",
       "22   @narendramodi Really it was very sad and shame!!!                                                                                              \n",
       "42   My head is been hurting so much and I lost my appetite                                                                                         \n",
       "43   No, I'm not 'depressed because of the weather,' I'm depressed because I have #depression #sicknotweak                                          \n",
       "64   Would love to stop crying sometime today, on my tenth cry 🙄 deep sadness on top of food poisoning do not mix. #miserable                       \n",
       "95   #sadness #cry 💔 dad will never understand his 3rd child                                                                                        \n",
       "125  lonely is not being alone, it's the feeling that no one cares. #alone #depressed #anxiety                                                      \n",
       "139  this year keeps getting more depressing and disappointing                                                                                      \n",
       "143  no matter how many sad ghost man tears he's crying now! you are not entitled to forgiveness just because you're really sad now!!               \n",
       "166  Bout to cry 😭 I just wanna sleep I hate this job 😩                                                                                             \n",
       "171  Once she said you are my world, now she is saying not only you exist in the earth. #pain  #heartbreaking                                       \n",
       "173  I don't know how much longer I can play stupid 😒😔 #heartbroken #stupid #sadness                                                                \n",
       "182  I miss my friends so badly 😢                                                                                                                   \n",
       "193  watching that video and realizing that I've gotten uglier #depressed                                                                           \n",
       "194  Looking for good news today...not finding any on Twitter. Bummer. 😢 #depressing #badnews                                                       \n",
       "200  Bro it deadass suck when you try your best to make one person happy and end up letting everyone down #disappointment                           \n",
       "219  ha 🙃 ha 🙃 i just realised that i've never actually been to therapy and i still don't know if i'm depressed or just sad all the time            \n",
       "222  @CPC_HQ Immature...and Trumpy. Sad one guys😕 Does this represent the intelligence and moral depth of CPC ? #bully #notinmycanada               \n",
       "262  Hate seein stories on animal cruelty, why would any1 wanna hurt poor defenceless animals 😩😭 #StopAnimalCruelty #heartbreaking #worldsgoneMad   \n",
       "270  Unrealistic expectations attract disappointment. And that's what you were #disappointment #sad                                                 \n",
       "\n",
       "    Affect Dimension  Intensity Score  \n",
       "9    sadness          0.870            \n",
       "22   sadness          0.862            \n",
       "42   sadness          0.860            \n",
       "43   sadness          0.973            \n",
       "64   sadness          0.857            \n",
       "95   sadness          0.833            \n",
       "125  sadness          0.841            \n",
       "139  sadness          0.909            \n",
       "143  sadness          0.804            \n",
       "166  sadness          0.852            \n",
       "171  sadness          0.846            \n",
       "173  sadness          0.923            \n",
       "182  sadness          0.820            \n",
       "193  sadness          0.944            \n",
       "194  sadness          0.820            \n",
       "200  sadness          0.826            \n",
       "219  sadness          0.828            \n",
       "222  sadness          0.833            \n",
       "262  sadness          0.841            \n",
       "270  sadness          0.860            "
      ]
     },
     "execution_count": 93,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df_sadness1[df_sadness1[\"Intensity Score\"] > 0.8].head(20)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 91,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "60"
      ]
     },
     "execution_count": 91,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "len(df_sadness1[df_sadness1[\"Intensity Score\"] > 0.8])"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "**Conclusion** - A low value of sadness can be considered as non-depressive, while a high level of sadnes can be marked as depressive"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## 5. Compile the Final Dataset"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Here are the criteria we will use to select the non-depreesive, and depressive tweets:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 96,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "(131, 265, 614, 121)"
      ]
     },
     "execution_count": 96,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# Non-depressive tweets\n",
    "len(df_anger1[df_anger1[\"Intensity Score\"] < 0.3]), len(df_fear1[df_fear1[\"Intensity Score\"] < 0.4]), len(df_joy1[df_joy1[\"Intensity Score\"] > 0.5]), len(df_sadness1[df_sadness1[\"Intensity Score\"] < 0.3])"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 97,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "60"
      ]
     },
     "execution_count": 97,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# depressive tweets\n",
    "len(df_sadness1[df_sadness1[\"Intensity Score\"] > 0.8])"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 99,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "1131"
      ]
     },
     "execution_count": 99,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df_non_depress = pd.concat([df_anger1[df_anger1[\"Intensity Score\"] < 0.3], df_fear1[df_fear1[\"Intensity Score\"] < 0.4], df_joy1[df_joy1[\"Intensity Score\"] > 0.5], df_sadness1[df_sadness1[\"Intensity Score\"] < 0.3]])\n",
    "len(df_non_depress)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 100,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "60"
      ]
     },
     "execution_count": 100,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df_depress = df_sadness1[df_sadness1[\"Intensity Score\"] > 0.8]\n",
    "len(df_depress)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 101,
   "metadata": {},
   "outputs": [
    {
     "name": "stderr",
     "output_type": "stream",
     "text": [
      "C:\\Users\\Susan\\Anaconda3\\lib\\site-packages\\ipykernel_launcher.py:2: SettingWithCopyWarning: \n",
      "A value is trying to be set on a copy of a slice from a DataFrame.\n",
      "Try using .loc[row_indexer,col_indexer] = value instead\n",
      "\n",
      "See the caveats in the documentation: http://pandas.pydata.org/pandas-docs/stable/indexing.html#indexing-view-versus-copy\n",
      "  \n"
     ]
    }
   ],
   "source": [
    "df_non_depress[\"target\"] = 0\n",
    "df_depress[\"target\"] = 1"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 102,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>ID</th>\n",
       "      <th>Tweet</th>\n",
       "      <th>Affect Dimension</th>\n",
       "      <th>Intensity Score</th>\n",
       "      <th>target</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>15</th>\n",
       "      <td>2018-En-03228</td>\n",
       "      <td>Dropping son off this morning then shopping with my girls for shoes wedding fun this afternoon.  Your TL won't explode today.  😀</td>\n",
       "      <td>anger</td>\n",
       "      <td>0.266</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>23</th>\n",
       "      <td>2018-En-03865</td>\n",
       "      <td>My heart is so happy I want to explode. ❤️💥</td>\n",
       "      <td>anger</td>\n",
       "      <td>0.061</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>27</th>\n",
       "      <td>2018-En-03447</td>\n",
       "      <td>YOU MIGHT BE TRYING TO FILL THE VOID IN YOUR #HEART WITH ALL SORTS OF THINGS BUT THAT PLACE BELONGS TO JESUS CHRIST #music #worry #love #SMM</td>\n",
       "      <td>anger</td>\n",
       "      <td>0.210</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>33</th>\n",
       "      <td>2018-En-01879</td>\n",
       "      <td>Dont sink to the level of those who insult you. Rather, rise to the level of those who inspire you. Deliver result, not insult</td>\n",
       "      <td>anger</td>\n",
       "      <td>0.258</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>36</th>\n",
       "      <td>2018-En-03548</td>\n",
       "      <td>So I'm pretty sure the @Indians are the MVP of the @AllStarGame  #defense #pitching</td>\n",
       "      <td>anger</td>\n",
       "      <td>0.250</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "               ID  \\\n",
       "15  2018-En-03228   \n",
       "23  2018-En-03865   \n",
       "27  2018-En-03447   \n",
       "33  2018-En-01879   \n",
       "36  2018-En-03548   \n",
       "\n",
       "                                                                                                                                           Tweet  \\\n",
       "15  Dropping son off this morning then shopping with my girls for shoes wedding fun this afternoon.  Your TL won't explode today.  😀               \n",
       "23  My heart is so happy I want to explode. ❤️💥                                                                                                    \n",
       "27  YOU MIGHT BE TRYING TO FILL THE VOID IN YOUR #HEART WITH ALL SORTS OF THINGS BUT THAT PLACE BELONGS TO JESUS CHRIST #music #worry #love #SMM   \n",
       "33  Dont sink to the level of those who insult you. Rather, rise to the level of those who inspire you. Deliver result, not insult                 \n",
       "36  So I'm pretty sure the @Indians are the MVP of the @AllStarGame  #defense #pitching                                                            \n",
       "\n",
       "   Affect Dimension  Intensity Score  target  \n",
       "15  anger            0.266            0       \n",
       "23  anger            0.061            0       \n",
       "27  anger            0.210            0       \n",
       "33  anger            0.258            0       \n",
       "36  anger            0.250            0       "
      ]
     },
     "execution_count": 102,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df_non_depress.head()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 103,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>ID</th>\n",
       "      <th>Tweet</th>\n",
       "      <th>Affect Dimension</th>\n",
       "      <th>Intensity Score</th>\n",
       "      <th>target</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>9</th>\n",
       "      <td>2018-En-00276</td>\n",
       "      <td>we mourn the death of our hopes today #james</td>\n",
       "      <td>sadness</td>\n",
       "      <td>0.870</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>22</th>\n",
       "      <td>2018-En-02064</td>\n",
       "      <td>@narendramodi Really it was very sad and shame!!!</td>\n",
       "      <td>sadness</td>\n",
       "      <td>0.862</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>42</th>\n",
       "      <td>2018-En-02565</td>\n",
       "      <td>My head is been hurting so much and I lost my appetite</td>\n",
       "      <td>sadness</td>\n",
       "      <td>0.860</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>43</th>\n",
       "      <td>2018-En-01021</td>\n",
       "      <td>No, I'm not 'depressed because of the weather,' I'm depressed because I have #depression #sicknotweak</td>\n",
       "      <td>sadness</td>\n",
       "      <td>0.973</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>64</th>\n",
       "      <td>2018-En-03308</td>\n",
       "      <td>Would love to stop crying sometime today, on my tenth cry 🙄 deep sadness on top of food poisoning do not mix. #miserable</td>\n",
       "      <td>sadness</td>\n",
       "      <td>0.857</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "               ID  \\\n",
       "9   2018-En-00276   \n",
       "22  2018-En-02064   \n",
       "42  2018-En-02565   \n",
       "43  2018-En-01021   \n",
       "64  2018-En-03308   \n",
       "\n",
       "                                                                                                                       Tweet  \\\n",
       "9   we mourn the death of our hopes today #james                                                                               \n",
       "22  @narendramodi Really it was very sad and shame!!!                                                                          \n",
       "42  My head is been hurting so much and I lost my appetite                                                                     \n",
       "43  No, I'm not 'depressed because of the weather,' I'm depressed because I have #depression #sicknotweak                      \n",
       "64  Would love to stop crying sometime today, on my tenth cry 🙄 deep sadness on top of food poisoning do not mix. #miserable   \n",
       "\n",
       "   Affect Dimension  Intensity Score  target  \n",
       "9   sadness          0.870            1       \n",
       "22  sadness          0.862            1       \n",
       "42  sadness          0.860            1       \n",
       "43  sadness          0.973            1       \n",
       "64  sadness          0.857            1       "
      ]
     },
     "execution_count": 103,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df_depress.head()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 104,
   "metadata": {},
   "outputs": [],
   "source": [
    "df_final = pd.concat([df_non_depress, df_depress])"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 105,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>ID</th>\n",
       "      <th>Tweet</th>\n",
       "      <th>Affect Dimension</th>\n",
       "      <th>Intensity Score</th>\n",
       "      <th>target</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>2018-En-03332</td>\n",
       "      <td>Be happy. Be confident. Be kind.\\n\\n #KissablesLoveSMShopmag\\nAllOutDenimFor KISSMARC</td>\n",
       "      <td>joy</td>\n",
       "      <td>0.661</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>2018-En-01146</td>\n",
       "      <td>@queenjlouise @mamaw_gereck awe thanks 😊</td>\n",
       "      <td>fear</td>\n",
       "      <td>0.089</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>2018-En-02249</td>\n",
       "      <td>@Ithika Loving it! 😂</td>\n",
       "      <td>joy</td>\n",
       "      <td>0.813</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>2018-En-00192</td>\n",
       "      <td>@mir_btc Eherium should make everybody happy</td>\n",
       "      <td>joy</td>\n",
       "      <td>0.515</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>2018-En-03117</td>\n",
       "      <td>Shitty is the worst feeling ever #depressed #anxiety</td>\n",
       "      <td>sadness</td>\n",
       "      <td>0.895</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>5</th>\n",
       "      <td>2018-En-03461</td>\n",
       "      <td>I didn't know, that there existed such sheer and utter joy and contentment, as that which I am now experiencing. #grateful 🙏🏽</td>\n",
       "      <td>joy</td>\n",
       "      <td>0.839</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>6</th>\n",
       "      <td>2018-En-01466</td>\n",
       "      <td>Chiropractor time  #crackle #pop #chiropractor</td>\n",
       "      <td>anger</td>\n",
       "      <td>0.172</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>7</th>\n",
       "      <td>2018-En-03854</td>\n",
       "      <td>Every time I see the #GBBO advert..... #sugacravings #yummy #dietgonetohell     😋😋😋</td>\n",
       "      <td>joy</td>\n",
       "      <td>0.625</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>8</th>\n",
       "      <td>2018-En-01470</td>\n",
       "      <td>oh how i just love love love glee doing billy joel's numbers!!!!</td>\n",
       "      <td>joy</td>\n",
       "      <td>0.742</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>9</th>\n",
       "      <td>2018-En-01290</td>\n",
       "      <td>Listening to @danauerbach and watching the #eclipse at the dog park #bliss</td>\n",
       "      <td>joy</td>\n",
       "      <td>0.547</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>10</th>\n",
       "      <td>2018-En-01693</td>\n",
       "      <td>Any #GOP senator who refuses to #RepealAndReplace needs to bear the #wrath of their constituents @ polls home state!  #healthcare #price2pay</td>\n",
       "      <td>sadness</td>\n",
       "      <td>0.289</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>11</th>\n",
       "      <td>2018-En-01064</td>\n",
       "      <td>@Liz_Hanbury Oh no, jumper on again, has it turned colder? 😟 Have a terrific day🙋🏼🌸🌼🌻💕💕</td>\n",
       "      <td>fear</td>\n",
       "      <td>0.250</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>12</th>\n",
       "      <td>2018-En-00682</td>\n",
       "      <td>I have uploaded my first article for @TheProteinWorks! Keep your eyes open for more 😉💪👌#recipes #nutrition #gainz #delicious #biggestfan</td>\n",
       "      <td>joy</td>\n",
       "      <td>0.714</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>13</th>\n",
       "      <td>2018-En-01630</td>\n",
       "      <td>@Kawells00 So bright that kill my heart😂</td>\n",
       "      <td>joy</td>\n",
       "      <td>0.576</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>14</th>\n",
       "      <td>2018-En-01615</td>\n",
       "      <td>Excellent customer service from @ao this morning. Thank you Kharis for your help! #CustomerService</td>\n",
       "      <td>joy</td>\n",
       "      <td>0.750</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>15</th>\n",
       "      <td>2018-En-00943</td>\n",
       "      <td>I was taught, there's nothing out there to #fear; just go out there turn #dreams into #reality, use other people fears to your advantage.</td>\n",
       "      <td>fear</td>\n",
       "      <td>0.350</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>16</th>\n",
       "      <td>2018-En-00766</td>\n",
       "      <td>@bbcbristolsport so proud of City...2 Bristol boys scoring and a great performance...where's the cider  #OTIB</td>\n",
       "      <td>joy</td>\n",
       "      <td>0.594</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>17</th>\n",
       "      <td>2018-En-04031</td>\n",
       "      <td>Seriously, why do people punish children for 'sass'? Wit should be rewarded, not discouraged!</td>\n",
       "      <td>fear</td>\n",
       "      <td>0.355</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>18</th>\n",
       "      <td>2018-En-03103</td>\n",
       "      <td>@ActuallyNPH @RealJamesWoods I didn't realize you weren't acting... You actually are that guy. #smh  #Hercules #ghostsofmississippi</td>\n",
       "      <td>fear</td>\n",
       "      <td>0.350</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>19</th>\n",
       "      <td>2018-En-03832</td>\n",
       "      <td>Spread the love means no matter how hard life is, never stop smilling :) and be happy. Always.</td>\n",
       "      <td>joy</td>\n",
       "      <td>0.688</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "               ID  \\\n",
       "0   2018-En-03332   \n",
       "1   2018-En-01146   \n",
       "2   2018-En-02249   \n",
       "3   2018-En-00192   \n",
       "4   2018-En-03117   \n",
       "5   2018-En-03461   \n",
       "6   2018-En-01466   \n",
       "7   2018-En-03854   \n",
       "8   2018-En-01470   \n",
       "9   2018-En-01290   \n",
       "10  2018-En-01693   \n",
       "11  2018-En-01064   \n",
       "12  2018-En-00682   \n",
       "13  2018-En-01630   \n",
       "14  2018-En-01615   \n",
       "15  2018-En-00943   \n",
       "16  2018-En-00766   \n",
       "17  2018-En-04031   \n",
       "18  2018-En-03103   \n",
       "19  2018-En-03832   \n",
       "\n",
       "                                                                                                                                           Tweet  \\\n",
       "0   Be happy. Be confident. Be kind.\\n\\n #KissablesLoveSMShopmag\\nAllOutDenimFor KISSMARC                                                          \n",
       "1   @queenjlouise @mamaw_gereck awe thanks 😊                                                                                                       \n",
       "2   @Ithika Loving it! 😂                                                                                                                           \n",
       "3   @mir_btc Eherium should make everybody happy                                                                                                   \n",
       "4   Shitty is the worst feeling ever #depressed #anxiety                                                                                           \n",
       "5   I didn't know, that there existed such sheer and utter joy and contentment, as that which I am now experiencing. #grateful 🙏🏽                  \n",
       "6   Chiropractor time  #crackle #pop #chiropractor                                                                                                 \n",
       "7   Every time I see the #GBBO advert..... #sugacravings #yummy #dietgonetohell     😋😋😋                                                            \n",
       "8   oh how i just love love love glee doing billy joel's numbers!!!!                                                                               \n",
       "9   Listening to @danauerbach and watching the #eclipse at the dog park #bliss                                                                     \n",
       "10  Any #GOP senator who refuses to #RepealAndReplace needs to bear the #wrath of their constituents @ polls home state!  #healthcare #price2pay   \n",
       "11  @Liz_Hanbury Oh no, jumper on again, has it turned colder? 😟 Have a terrific day🙋🏼🌸🌼🌻💕💕                                                        \n",
       "12  I have uploaded my first article for @TheProteinWorks! Keep your eyes open for more 😉💪👌#recipes #nutrition #gainz #delicious #biggestfan       \n",
       "13  @Kawells00 So bright that kill my heart😂                                                                                                       \n",
       "14  Excellent customer service from @ao this morning. Thank you Kharis for your help! #CustomerService                                             \n",
       "15  I was taught, there's nothing out there to #fear; just go out there turn #dreams into #reality, use other people fears to your advantage.      \n",
       "16  @bbcbristolsport so proud of City...2 Bristol boys scoring and a great performance...where's the cider  #OTIB                                  \n",
       "17  Seriously, why do people punish children for 'sass'? Wit should be rewarded, not discouraged!                                                  \n",
       "18  @ActuallyNPH @RealJamesWoods I didn't realize you weren't acting... You actually are that guy. #smh  #Hercules #ghostsofmississippi            \n",
       "19  Spread the love means no matter how hard life is, never stop smilling :) and be happy. Always.                                                 \n",
       "\n",
       "   Affect Dimension  Intensity Score  target  \n",
       "0   joy              0.661            0       \n",
       "1   fear             0.089            0       \n",
       "2   joy              0.813            0       \n",
       "3   joy              0.515            0       \n",
       "4   sadness          0.895            1       \n",
       "5   joy              0.839            0       \n",
       "6   anger            0.172            0       \n",
       "7   joy              0.625            0       \n",
       "8   joy              0.742            0       \n",
       "9   joy              0.547            0       \n",
       "10  sadness          0.289            0       \n",
       "11  fear             0.250            0       \n",
       "12  joy              0.714            0       \n",
       "13  joy              0.576            0       \n",
       "14  joy              0.750            0       \n",
       "15  fear             0.350            0       \n",
       "16  joy              0.594            0       \n",
       "17  fear             0.355            0       \n",
       "18  fear             0.350            0       \n",
       "19  joy              0.688            0       "
      ]
     },
     "execution_count": 105,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df_final = df_final.sample(frac=1).reset_index(drop=True)\n",
    "df_final.head(20)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 106,
   "metadata": {},
   "outputs": [],
   "source": [
    "df_final.to_csv(\"general_tweets.csv\")"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Conclusion"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "**The resulting dataset will be combined with the depressive dataset we have compiled, to be used in training and testing our model for depression**"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": []
  }
 ],
 "metadata": {
  "kernelspec": {
   "display_name": "Python 3",
   "language": "python",
   "name": "python3"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.6.8"
  }
 },
 "nbformat": 4,
 "nbformat_minor": 2
}