recommendationSystem.ipynb

{
  "nbformat": 4,
  "nbformat_minor": 0,
  "metadata": {
    "colab": {
      "provenance": []
    },
    "kernelspec": {
      "name": "python3",
      "display_name": "Python 3"
    },
    "language_info": {
      "name": "python"
    }
  },
  "cells": [
    {
      "cell_type": "markdown",
      "source": [
        "\n",
        "#Implementation of a movie recommendation system\n",
        "\n",
        "The recommendation system is built using Python and uses content based filtering techniques to provide personalized movie recommendations to users.\n",
        "\n",
        "- Content Based Filtering - Content based filtering is a recommendation technique that uses the characteristics or attributes of items to make personalized recommendations. In the context of movie recommendation systems, content-based filtering analyzes the characteristics or content of movies, such as genre, actors, director, and plot, to identify similar movies and suggest them to users."
      ],
      "metadata": {
        "id": "tzQB1ZsP82ce"
      }
    },
    {
      "cell_type": "markdown",
      "source": [
        "## Libraries"
      ],
      "metadata": {
        "id": "NWsm4k12xqzf"
      }
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "id": "zfTcDCo8yf0G"
      },
      "outputs": [],
      "source": [
        "import sys\n",
        "import numpy as np\n",
        "np.set_printoptions(threshold=sys.maxsize)\n",
        "import pandas as pd\n",
        "import ast\n",
        "from nltk.stem.porter import PorterStemmer\n",
        "from sklearn.feature_extraction.text import CountVectorizer\n",
        "from sklearn.metrics.pairwise import cosine_similarity\n",
        "import pickle"
      ]
    },
    {
      "cell_type": "markdown",
      "source": [
        "## Loading the dataset"
      ],
      "metadata": {
        "id": "staPS4MKxsdu"
      }
    },
    {
      "cell_type": "code",
      "source": [
        "movies = pd.read_csv(\"/content/tmdb_5000_movies.csv\")\n",
        "credits = pd.read_csv(\"/content/tmdb_5000_credits.csv\")"
      ],
      "metadata": {
        "id": "02YKWv-xy7i_"
      },
      "execution_count": null,
      "outputs": []
    },
    {
      "cell_type": "markdown",
      "source": [
        "The Credits dataset contains the following features:-\n",
        "\n",
        "- movie_id - A unique identifier for each movie.\n",
        "- title - Title of the movie.\n",
        "- cast - The name of lead and supporting actors.\n",
        "- crew - The name of Director, Editor, Composer, Writer etc.\n",
        "\n",
        "The Movies dataset has the following features:-\n",
        "\n",
        "- budget - The budget in which the movie was made.\n",
        "- genre - The genre of the movie, Action, Comedy ,Thriller etc.\n",
        "- homepage - A link to the homepage of the movie.\n",
        "- id - This is infact the movie_id as in the first dataset.\n",
        "- keywords - The keywords or tags related to the movie.\n",
        "- original_language - The language in which the movie was made.\n",
        "- original_title - The title of the movie before translation or adaptation.\n",
        "- overview - A brief description of the movie.\n",
        "- popularity - A numeric quantity specifying the movie popularity.\n",
        "- production_companies - The production house of the movie.\n",
        "- production_countries - The country in which it was produced.\n",
        "- release_date - The date on which it was released.\n",
        "- revenue - The worldwide revenue generated by the movie.\n",
        "- runtime - The running time of the movie in minutes.\n",
        "- status - \"Released\" or \"Rumored\".\n",
        "- tagline - Movie's tagline.\n",
        "- title - Title of the movie.\n",
        "- vote_average - average ratings the movie recieved.\n",
        "- vote_count - the count of votes recieved"
      ],
      "metadata": {
        "id": "Zbp0dFiu5llb"
      }
    },
    {
      "cell_type": "code",
      "source": [
        "movies.head()"
      ],
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 774
        },
        "id": "JheUIc-E3Bno",
        "outputId": "ab69bc49-0e4a-44d7-95eb-b1578751e7fd"
      },
      "execution_count": null,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/plain": [
              "      budget                                             genres  \\\n",
              "0  237000000  [{\"id\": 28, \"name\": \"Action\"}, {\"id\": 12, \"nam...   \n",
              "1  300000000  [{\"id\": 12, \"name\": \"Adventure\"}, {\"id\": 14, \"...   \n",
              "2  245000000  [{\"id\": 28, \"name\": \"Action\"}, {\"id\": 12, \"nam...   \n",
              "3  250000000  [{\"id\": 28, \"name\": \"Action\"}, {\"id\": 80, \"nam...   \n",
              "4  260000000  [{\"id\": 28, \"name\": \"Action\"}, {\"id\": 12, \"nam...   \n",
              "\n",
              "                                       homepage      id  \\\n",
              "0                   http://www.avatarmovie.com/   19995   \n",
              "1  http://disney.go.com/disneypictures/pirates/     285   \n",
              "2   http://www.sonypictures.com/movies/spectre/  206647   \n",
              "3            http://www.thedarkknightrises.com/   49026   \n",
              "4          http://movies.disney.com/john-carter   49529   \n",
              "\n",
              "                                            keywords original_language  \\\n",
              "0  [{\"id\": 1463, \"name\": \"culture clash\"}, {\"id\":...                en   \n",
              "1  [{\"id\": 270, \"name\": \"ocean\"}, {\"id\": 726, \"na...                en   \n",
              "2  [{\"id\": 470, \"name\": \"spy\"}, {\"id\": 818, \"name...                en   \n",
              "3  [{\"id\": 849, \"name\": \"dc comics\"}, {\"id\": 853,...                en   \n",
              "4  [{\"id\": 818, \"name\": \"based on novel\"}, {\"id\":...                en   \n",
              "\n",
              "                             original_title  \\\n",
              "0                                    Avatar   \n",
              "1  Pirates of the Caribbean: At World's End   \n",
              "2                                   Spectre   \n",
              "3                     The Dark Knight Rises   \n",
              "4                               John Carter   \n",
              "\n",
              "                                            overview  popularity  \\\n",
              "0  In the 22nd century, a paraplegic Marine is di...  150.437577   \n",
              "1  Captain Barbossa, long believed to be dead, ha...  139.082615   \n",
              "2  A cryptic message from Bond’s past sends him o...  107.376788   \n",
              "3  Following the death of District Attorney Harve...  112.312950   \n",
              "4  John Carter is a war-weary, former military ca...   43.926995   \n",
              "\n",
              "                                production_companies  \\\n",
              "0  [{\"name\": \"Ingenious Film Partners\", \"id\": 289...   \n",
              "1  [{\"name\": \"Walt Disney Pictures\", \"id\": 2}, {\"...   \n",
              "2  [{\"name\": \"Columbia Pictures\", \"id\": 5}, {\"nam...   \n",
              "3  [{\"name\": \"Legendary Pictures\", \"id\": 923}, {\"...   \n",
              "4        [{\"name\": \"Walt Disney Pictures\", \"id\": 2}]   \n",
              "\n",
              "                                production_countries release_date     revenue  \\\n",
              "0  [{\"iso_3166_1\": \"US\", \"name\": \"United States o...   2009-12-10  2787965087   \n",
              "1  [{\"iso_3166_1\": \"US\", \"name\": \"United States o...   2007-05-19   961000000   \n",
              "2  [{\"iso_3166_1\": \"GB\", \"name\": \"United Kingdom\"...   2015-10-26   880674609   \n",
              "3  [{\"iso_3166_1\": \"US\", \"name\": \"United States o...   2012-07-16  1084939099   \n",
              "4  [{\"iso_3166_1\": \"US\", \"name\": \"United States o...   2012-03-07   284139100   \n",
              "\n",
              "   runtime                                   spoken_languages    status  \\\n",
              "0    162.0  [{\"iso_639_1\": \"en\", \"name\": \"English\"}, {\"iso...  Released   \n",
              "1    169.0           [{\"iso_639_1\": \"en\", \"name\": \"English\"}]  Released   \n",
              "2    148.0  [{\"iso_639_1\": \"fr\", \"name\": \"Fran\\u00e7ais\"},...  Released   \n",
              "3    165.0           [{\"iso_639_1\": \"en\", \"name\": \"English\"}]  Released   \n",
              "4    132.0           [{\"iso_639_1\": \"en\", \"name\": \"English\"}]  Released   \n",
              "\n",
              "                                          tagline  \\\n",
              "0                     Enter the World of Pandora.   \n",
              "1  At the end of the world, the adventure begins.   \n",
              "2                           A Plan No One Escapes   \n",
              "3                                 The Legend Ends   \n",
              "4            Lost in our world, found in another.   \n",
              "\n",
              "                                      title  vote_average  vote_count  \n",
              "0                                    Avatar           7.2       11800  \n",
              "1  Pirates of the Caribbean: At World's End           6.9        4500  \n",
              "2                                   Spectre           6.3        4466  \n",
              "3                     The Dark Knight Rises           7.6        9106  \n",
              "4                               John Carter           6.1        2124  "
            ],
            "text/html": [
              "\n",
              "  <div id=\"df-d0456cbc-78e9-4c94-9470-4fe0c1a883b9\">\n",
              "    <div class=\"colab-df-container\">\n",
              "      <div>\n",
              "<style scoped>\n",
              "    .dataframe tbody tr th:only-of-type {\n",
              "        vertical-align: middle;\n",
              "    }\n",
              "\n",
              "    .dataframe tbody tr th {\n",
              "        vertical-align: top;\n",
              "    }\n",
              "\n",
              "    .dataframe thead th {\n",
              "        text-align: right;\n",
              "    }\n",
              "</style>\n",
              "<table border=\"1\" class=\"dataframe\">\n",
              "  <thead>\n",
              "    <tr style=\"text-align: right;\">\n",
              "      <th></th>\n",
              "      <th>budget</th>\n",
              "      <th>genres</th>\n",
              "      <th>homepage</th>\n",
              "      <th>id</th>\n",
              "      <th>keywords</th>\n",
              "      <th>original_language</th>\n",
              "      <th>original_title</th>\n",
              "      <th>overview</th>\n",
              "      <th>popularity</th>\n",
              "      <th>production_companies</th>\n",
              "      <th>production_countries</th>\n",
              "      <th>release_date</th>\n",
              "      <th>revenue</th>\n",
              "      <th>runtime</th>\n",
              "      <th>spoken_languages</th>\n",
              "      <th>status</th>\n",
              "      <th>tagline</th>\n",
              "      <th>title</th>\n",
              "      <th>vote_average</th>\n",
              "      <th>vote_count</th>\n",
              "    </tr>\n",
              "  </thead>\n",
              "  <tbody>\n",
              "    <tr>\n",
              "      <th>0</th>\n",
              "      <td>237000000</td>\n",
              "      <td>[{\"id\": 28, \"name\": \"Action\"}, {\"id\": 12, \"nam...</td>\n",
              "      <td>http://www.avatarmovie.com/</td>\n",
              "      <td>19995</td>\n",
              "      <td>[{\"id\": 1463, \"name\": \"culture clash\"}, {\"id\":...</td>\n",
              "      <td>en</td>\n",
              "      <td>Avatar</td>\n",
              "      <td>In the 22nd century, a paraplegic Marine is di...</td>\n",
              "      <td>150.437577</td>\n",
              "      <td>[{\"name\": \"Ingenious Film Partners\", \"id\": 289...</td>\n",
              "      <td>[{\"iso_3166_1\": \"US\", \"name\": \"United States o...</td>\n",
              "      <td>2009-12-10</td>\n",
              "      <td>2787965087</td>\n",
              "      <td>162.0</td>\n",
              "      <td>[{\"iso_639_1\": \"en\", \"name\": \"English\"}, {\"iso...</td>\n",
              "      <td>Released</td>\n",
              "      <td>Enter the World of Pandora.</td>\n",
              "      <td>Avatar</td>\n",
              "      <td>7.2</td>\n",
              "      <td>11800</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>1</th>\n",
              "      <td>300000000</td>\n",
              "      <td>[{\"id\": 12, \"name\": \"Adventure\"}, {\"id\": 14, \"...</td>\n",
              "      <td>http://disney.go.com/disneypictures/pirates/</td>\n",
              "      <td>285</td>\n",
              "      <td>[{\"id\": 270, \"name\": \"ocean\"}, {\"id\": 726, \"na...</td>\n",
              "      <td>en</td>\n",
              "      <td>Pirates of the Caribbean: At World's End</td>\n",
              "      <td>Captain Barbossa, long believed to be dead, ha...</td>\n",
              "      <td>139.082615</td>\n",
              "      <td>[{\"name\": \"Walt Disney Pictures\", \"id\": 2}, {\"...</td>\n",
              "      <td>[{\"iso_3166_1\": \"US\", \"name\": \"United States o...</td>\n",
              "      <td>2007-05-19</td>\n",
              "      <td>961000000</td>\n",
              "      <td>169.0</td>\n",
              "      <td>[{\"iso_639_1\": \"en\", \"name\": \"English\"}]</td>\n",
              "      <td>Released</td>\n",
              "      <td>At the end of the world, the adventure begins.</td>\n",
              "      <td>Pirates of the Caribbean: At World's End</td>\n",
              "      <td>6.9</td>\n",
              "      <td>4500</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>2</th>\n",
              "      <td>245000000</td>\n",
              "      <td>[{\"id\": 28, \"name\": \"Action\"}, {\"id\": 12, \"nam...</td>\n",
              "      <td>http://www.sonypictures.com/movies/spectre/</td>\n",
              "      <td>206647</td>\n",
              "      <td>[{\"id\": 470, \"name\": \"spy\"}, {\"id\": 818, \"name...</td>\n",
              "      <td>en</td>\n",
              "      <td>Spectre</td>\n",
              "      <td>A cryptic message from Bond’s past sends him o...</td>\n",
              "      <td>107.376788</td>\n",
              "      <td>[{\"name\": \"Columbia Pictures\", \"id\": 5}, {\"nam...</td>\n",
              "      <td>[{\"iso_3166_1\": \"GB\", \"name\": \"United Kingdom\"...</td>\n",
              "      <td>2015-10-26</td>\n",
              "      <td>880674609</td>\n",
              "      <td>148.0</td>\n",
              "      <td>[{\"iso_639_1\": \"fr\", \"name\": \"Fran\\u00e7ais\"},...</td>\n",
              "      <td>Released</td>\n",
              "      <td>A Plan No One Escapes</td>\n",
              "      <td>Spectre</td>\n",
              "      <td>6.3</td>\n",
              "      <td>4466</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>3</th>\n",
              "      <td>250000000</td>\n",
              "      <td>[{\"id\": 28, \"name\": \"Action\"}, {\"id\": 80, \"nam...</td>\n",
              "      <td>http://www.thedarkknightrises.com/</td>\n",
              "      <td>49026</td>\n",
              "      <td>[{\"id\": 849, \"name\": \"dc comics\"}, {\"id\": 853,...</td>\n",
              "      <td>en</td>\n",
              "      <td>The Dark Knight Rises</td>\n",
              "      <td>Following the death of District Attorney Harve...</td>\n",
              "      <td>112.312950</td>\n",
              "      <td>[{\"name\": \"Legendary Pictures\", \"id\": 923}, {\"...</td>\n",
              "      <td>[{\"iso_3166_1\": \"US\", \"name\": \"United States o...</td>\n",
              "      <td>2012-07-16</td>\n",
              "      <td>1084939099</td>\n",
              "      <td>165.0</td>\n",
              "      <td>[{\"iso_639_1\": \"en\", \"name\": \"English\"}]</td>\n",
              "      <td>Released</td>\n",
              "      <td>The Legend Ends</td>\n",
              "      <td>The Dark Knight Rises</td>\n",
              "      <td>7.6</td>\n",
              "      <td>9106</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>4</th>\n",
              "      <td>260000000</td>\n",
              "      <td>[{\"id\": 28, \"name\": \"Action\"}, {\"id\": 12, \"nam...</td>\n",
              "      <td>http://movies.disney.com/john-carter</td>\n",
              "      <td>49529</td>\n",
              "      <td>[{\"id\": 818, \"name\": \"based on novel\"}, {\"id\":...</td>\n",
              "      <td>en</td>\n",
              "      <td>John Carter</td>\n",
              "      <td>John Carter is a war-weary, former military ca...</td>\n",
              "      <td>43.926995</td>\n",
              "      <td>[{\"name\": \"Walt Disney Pictures\", \"id\": 2}]</td>\n",
              "      <td>[{\"iso_3166_1\": \"US\", \"name\": \"United States o...</td>\n",
              "      <td>2012-03-07</td>\n",
              "      <td>284139100</td>\n",
              "      <td>132.0</td>\n",
              "      <td>[{\"iso_639_1\": \"en\", \"name\": \"English\"}]</td>\n",
              "      <td>Released</td>\n",
              "      <td>Lost in our world, found in another.</td>\n",
              "      <td>John Carter</td>\n",
              "      <td>6.1</td>\n",
              "      <td>2124</td>\n",
              "    </tr>\n",
              "  </tbody>\n",
              "</table>\n",
              "</div>\n",
              "      <button class=\"colab-df-convert\" onclick=\"convertToInteractive('df-d0456cbc-78e9-4c94-9470-4fe0c1a883b9')\"\n",
              "              title=\"Convert this dataframe to an interactive table.\"\n",
              "              style=\"display:none;\">\n",
              "        \n",
              "  <svg xmlns=\"http://www.w3.org/2000/svg\" height=\"24px\"viewBox=\"0 0 24 24\"\n",
              "       width=\"24px\">\n",
              "    <path d=\"M0 0h24v24H0V0z\" fill=\"none\"/>\n",
              "    <path d=\"M18.56 5.44l.94 2.06.94-2.06 2.06-.94-2.06-.94-.94-2.06-.94 2.06-2.06.94zm-11 1L8.5 8.5l.94-2.06 2.06-.94-2.06-.94L8.5 2.5l-.94 2.06-2.06.94zm10 10l.94 2.06.94-2.06 2.06-.94-2.06-.94-.94-2.06-.94 2.06-2.06.94z\"/><path d=\"M17.41 7.96l-1.37-1.37c-.4-.4-.92-.59-1.43-.59-.52 0-1.04.2-1.43.59L10.3 9.45l-7.72 7.72c-.78.78-.78 2.05 0 2.83L4 21.41c.39.39.9.59 1.41.59.51 0 1.02-.2 1.41-.59l7.78-7.78 2.81-2.81c.8-.78.8-2.07 0-2.86zM5.41 20L4 18.59l7.72-7.72 1.47 1.35L5.41 20z\"/>\n",
              "  </svg>\n",
              "      </button>\n",
              "      \n",
              "  <style>\n",
              "    .colab-df-container {\n",
              "      display:flex;\n",
              "      flex-wrap:wrap;\n",
              "      gap: 12px;\n",
              "    }\n",
              "\n",
              "    .colab-df-convert {\n",
              "      background-color: #E8F0FE;\n",
              "      border: none;\n",
              "      border-radius: 50%;\n",
              "      cursor: pointer;\n",
              "      display: none;\n",
              "      fill: #1967D2;\n",
              "      height: 32px;\n",
              "      padding: 0 0 0 0;\n",
              "      width: 32px;\n",
              "    }\n",
              "\n",
              "    .colab-df-convert:hover {\n",
              "      background-color: #E2EBFA;\n",
              "      box-shadow: 0px 1px 2px rgba(60, 64, 67, 0.3), 0px 1px 3px 1px rgba(60, 64, 67, 0.15);\n",
              "      fill: #174EA6;\n",
              "    }\n",
              "\n",
              "    [theme=dark] .colab-df-convert {\n",
              "      background-color: #3B4455;\n",
              "      fill: #D2E3FC;\n",
              "    }\n",
              "\n",
              "    [theme=dark] .colab-df-convert:hover {\n",
              "      background-color: #434B5C;\n",
              "      box-shadow: 0px 1px 3px 1px rgba(0, 0, 0, 0.15);\n",
              "      filter: drop-shadow(0px 1px 2px rgba(0, 0, 0, 0.3));\n",
              "      fill: #FFFFFF;\n",
              "    }\n",
              "  </style>\n",
              "\n",
              "      <script>\n",
              "        const buttonEl =\n",
              "          document.querySelector('#df-d0456cbc-78e9-4c94-9470-4fe0c1a883b9 button.colab-df-convert');\n",
              "        buttonEl.style.display =\n",
              "          google.colab.kernel.accessAllowed ? 'block' : 'none';\n",
              "\n",
              "        async function convertToInteractive(key) {\n",
              "          const element = document.querySelector('#df-d0456cbc-78e9-4c94-9470-4fe0c1a883b9');\n",
              "          const dataTable =\n",
              "            await google.colab.kernel.invokeFunction('convertToInteractive',\n",
              "                                                     [key], {});\n",
              "          if (!dataTable) return;\n",
              "\n",
              "          const docLinkHtml = 'Like what you see? Visit the ' +\n",
              "            '<a target=\"_blank\" href=https://colab.research.google.com/notebooks/data_table.ipynb>data table notebook</a>'\n",
              "            + ' to learn more about interactive tables.';\n",
              "          element.innerHTML = '';\n",
              "          dataTable['output_type'] = 'display_data';\n",
              "          await google.colab.output.renderOutput(dataTable, element);\n",
              "          const docLink = document.createElement('div');\n",
              "          docLink.innerHTML = docLinkHtml;\n",
              "          element.appendChild(docLink);\n",
              "        }\n",
              "      </script>\n",
              "    </div>\n",
              "  </div>\n",
              "  "
            ]
          },
          "metadata": {},
          "execution_count": 4
        }
      ]
    },
    {
      "cell_type": "code",
      "source": [
        "movies.shape"
      ],
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "V0e1z08m4PtA",
        "outputId": "e6f7d693-2359-448f-8f07-b36b5ddf9e08"
      },
      "execution_count": null,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/plain": [
              "(4803, 20)"
            ]
          },
          "metadata": {},
          "execution_count": 5
        }
      ]
    },
    {
      "cell_type": "code",
      "source": [
        "movies.info()"
      ],
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "ZBmmq1U94Srv",
        "outputId": "1506e96e-aba4-4534-caef-4f5cec71ca0b"
      },
      "execution_count": null,
      "outputs": [
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "<class 'pandas.core.frame.DataFrame'>\n",
            "RangeIndex: 4803 entries, 0 to 4802\n",
            "Data columns (total 20 columns):\n",
            " #   Column                Non-Null Count  Dtype  \n",
            "---  ------                --------------  -----  \n",
            " 0   budget                4803 non-null   int64  \n",
            " 1   genres                4803 non-null   object \n",
            " 2   homepage              1712 non-null   object \n",
            " 3   id                    4803 non-null   int64  \n",
            " 4   keywords              4803 non-null   object \n",
            " 5   original_language     4803 non-null   object \n",
            " 6   original_title        4803 non-null   object \n",
            " 7   overview              4800 non-null   object \n",
            " 8   popularity            4803 non-null   float64\n",
            " 9   production_companies  4803 non-null   object \n",
            " 10  production_countries  4803 non-null   object \n",
            " 11  release_date          4802 non-null   object \n",
            " 12  revenue               4803 non-null   int64  \n",
            " 13  runtime               4801 non-null   float64\n",
            " 14  spoken_languages      4803 non-null   object \n",
            " 15  status                4803 non-null   object \n",
            " 16  tagline               3959 non-null   object \n",
            " 17  title                 4803 non-null   object \n",
            " 18  vote_average          4803 non-null   float64\n",
            " 19  vote_count            4803 non-null   int64  \n",
            "dtypes: float64(3), int64(4), object(13)\n",
            "memory usage: 750.6+ KB\n"
          ]
        }
      ]
    },
    {
      "cell_type": "code",
      "source": [
        "credits.head()"
      ],
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 337
        },
        "id": "9QvvtfEW3HC3",
        "outputId": "3a23fa3c-39fe-4bf9-e598-22694df302aa"
      },
      "execution_count": null,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/plain": [
              "   movie_id                                     title  \\\n",
              "0     19995                                    Avatar   \n",
              "1       285  Pirates of the Caribbean: At World's End   \n",
              "2    206647                                   Spectre   \n",
              "3     49026                     The Dark Knight Rises   \n",
              "4     49529                               John Carter   \n",
              "\n",
              "                                                cast  \\\n",
              "0  [{\"cast_id\": 242, \"character\": \"Jake Sully\", \"...   \n",
              "1  [{\"cast_id\": 4, \"character\": \"Captain Jack Spa...   \n",
              "2  [{\"cast_id\": 1, \"character\": \"James Bond\", \"cr...   \n",
              "3  [{\"cast_id\": 2, \"character\": \"Bruce Wayne / Ba...   \n",
              "4  [{\"cast_id\": 5, \"character\": \"John Carter\", \"c...   \n",
              "\n",
              "                                                crew  \n",
              "0  [{\"credit_id\": \"52fe48009251416c750aca23\", \"de...  \n",
              "1  [{\"credit_id\": \"52fe4232c3a36847f800b579\", \"de...  \n",
              "2  [{\"credit_id\": \"54805967c3a36829b5002c41\", \"de...  \n",
              "3  [{\"credit_id\": \"52fe4781c3a36847f81398c3\", \"de...  \n",
              "4  [{\"credit_id\": \"52fe479ac3a36847f813eaa3\", \"de...  "
            ],
            "text/html": [
              "\n",
              "  <div id=\"df-054cda4b-93ea-4a38-a159-8b3a2158751f\">\n",
              "    <div class=\"colab-df-container\">\n",
              "      <div>\n",
              "<style scoped>\n",
              "    .dataframe tbody tr th:only-of-type {\n",
              "        vertical-align: middle;\n",
              "    }\n",
              "\n",
              "    .dataframe tbody tr th {\n",
              "        vertical-align: top;\n",
              "    }\n",
              "\n",
              "    .dataframe thead th {\n",
              "        text-align: right;\n",
              "    }\n",
              "</style>\n",
              "<table border=\"1\" class=\"dataframe\">\n",
              "  <thead>\n",
              "    <tr style=\"text-align: right;\">\n",
              "      <th></th>\n",
              "      <th>movie_id</th>\n",
              "      <th>title</th>\n",
              "      <th>cast</th>\n",
              "      <th>crew</th>\n",
              "    </tr>\n",
              "  </thead>\n",
              "  <tbody>\n",
              "    <tr>\n",
              "      <th>0</th>\n",
              "      <td>19995</td>\n",
              "      <td>Avatar</td>\n",
              "      <td>[{\"cast_id\": 242, \"character\": \"Jake Sully\", \"...</td>\n",
              "      <td>[{\"credit_id\": \"52fe48009251416c750aca23\", \"de...</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>1</th>\n",
              "      <td>285</td>\n",
              "      <td>Pirates of the Caribbean: At World's End</td>\n",
              "      <td>[{\"cast_id\": 4, \"character\": \"Captain Jack Spa...</td>\n",
              "      <td>[{\"credit_id\": \"52fe4232c3a36847f800b579\", \"de...</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>2</th>\n",
              "      <td>206647</td>\n",
              "      <td>Spectre</td>\n",
              "      <td>[{\"cast_id\": 1, \"character\": \"James Bond\", \"cr...</td>\n",
              "      <td>[{\"credit_id\": \"54805967c3a36829b5002c41\", \"de...</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>3</th>\n",
              "      <td>49026</td>\n",
              "      <td>The Dark Knight Rises</td>\n",
              "      <td>[{\"cast_id\": 2, \"character\": \"Bruce Wayne / Ba...</td>\n",
              "      <td>[{\"credit_id\": \"52fe4781c3a36847f81398c3\", \"de...</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>4</th>\n",
              "      <td>49529</td>\n",
              "      <td>John Carter</td>\n",
              "      <td>[{\"cast_id\": 5, \"character\": \"John Carter\", \"c...</td>\n",
              "      <td>[{\"credit_id\": \"52fe479ac3a36847f813eaa3\", \"de...</td>\n",
              "    </tr>\n",
              "  </tbody>\n",
              "</table>\n",
              "</div>\n",
              "      <button class=\"colab-df-convert\" onclick=\"convertToInteractive('df-054cda4b-93ea-4a38-a159-8b3a2158751f')\"\n",
              "              title=\"Convert this dataframe to an interactive table.\"\n",
              "              style=\"display:none;\">\n",
              "        \n",
              "  <svg xmlns=\"http://www.w3.org/2000/svg\" height=\"24px\"viewBox=\"0 0 24 24\"\n",
              "       width=\"24px\">\n",
              "    <path d=\"M0 0h24v24H0V0z\" fill=\"none\"/>\n",
              "    <path d=\"M18.56 5.44l.94 2.06.94-2.06 2.06-.94-2.06-.94-.94-2.06-.94 2.06-2.06.94zm-11 1L8.5 8.5l.94-2.06 2.06-.94-2.06-.94L8.5 2.5l-.94 2.06-2.06.94zm10 10l.94 2.06.94-2.06 2.06-.94-2.06-.94-.94-2.06-.94 2.06-2.06.94z\"/><path d=\"M17.41 7.96l-1.37-1.37c-.4-.4-.92-.59-1.43-.59-.52 0-1.04.2-1.43.59L10.3 9.45l-7.72 7.72c-.78.78-.78 2.05 0 2.83L4 21.41c.39.39.9.59 1.41.59.51 0 1.02-.2 1.41-.59l7.78-7.78 2.81-2.81c.8-.78.8-2.07 0-2.86zM5.41 20L4 18.59l7.72-7.72 1.47 1.35L5.41 20z\"/>\n",
              "  </svg>\n",
              "      </button>\n",
              "      \n",
              "  <style>\n",
              "    .colab-df-container {\n",
              "      display:flex;\n",
              "      flex-wrap:wrap;\n",
              "      gap: 12px;\n",
              "    }\n",
              "\n",
              "    .colab-df-convert {\n",
              "      background-color: #E8F0FE;\n",
              "      border: none;\n",
              "      border-radius: 50%;\n",
              "      cursor: pointer;\n",
              "      display: none;\n",
              "      fill: #1967D2;\n",
              "      height: 32px;\n",
              "      padding: 0 0 0 0;\n",
              "      width: 32px;\n",
              "    }\n",
              "\n",
              "    .colab-df-convert:hover {\n",
              "      background-color: #E2EBFA;\n",
              "      box-shadow: 0px 1px 2px rgba(60, 64, 67, 0.3), 0px 1px 3px 1px rgba(60, 64, 67, 0.15);\n",
              "      fill: #174EA6;\n",
              "    }\n",
              "\n",
              "    [theme=dark] .colab-df-convert {\n",
              "      background-color: #3B4455;\n",
              "      fill: #D2E3FC;\n",
              "    }\n",
              "\n",
              "    [theme=dark] .colab-df-convert:hover {\n",
              "      background-color: #434B5C;\n",
              "      box-shadow: 0px 1px 3px 1px rgba(0, 0, 0, 0.15);\n",
              "      filter: drop-shadow(0px 1px 2px rgba(0, 0, 0, 0.3));\n",
              "      fill: #FFFFFF;\n",
              "    }\n",
              "  </style>\n",
              "\n",
              "      <script>\n",
              "        const buttonEl =\n",
              "          document.querySelector('#df-054cda4b-93ea-4a38-a159-8b3a2158751f button.colab-df-convert');\n",
              "        buttonEl.style.display =\n",
              "          google.colab.kernel.accessAllowed ? 'block' : 'none';\n",
              "\n",
              "        async function convertToInteractive(key) {\n",
              "          const element = document.querySelector('#df-054cda4b-93ea-4a38-a159-8b3a2158751f');\n",
              "          const dataTable =\n",
              "            await google.colab.kernel.invokeFunction('convertToInteractive',\n",
              "                                                     [key], {});\n",
              "          if (!dataTable) return;\n",
              "\n",
              "          const docLinkHtml = 'Like what you see? Visit the ' +\n",
              "            '<a target=\"_blank\" href=https://colab.research.google.com/notebooks/data_table.ipynb>data table notebook</a>'\n",
              "            + ' to learn more about interactive tables.';\n",
              "          element.innerHTML = '';\n",
              "          dataTable['output_type'] = 'display_data';\n",
              "          await google.colab.output.renderOutput(dataTable, element);\n",
              "          const docLink = document.createElement('div');\n",
              "          docLink.innerHTML = docLinkHtml;\n",
              "          element.appendChild(docLink);\n",
              "        }\n",
              "      </script>\n",
              "    </div>\n",
              "  </div>\n",
              "  "
            ]
          },
          "metadata": {},
          "execution_count": 7
        }
      ]
    },
    {
      "cell_type": "code",
      "source": [
        "credits.shape"
      ],
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "yWRuU0ty4W54",
        "outputId": "0f3174ef-646d-46a5-f590-01d022546707"
      },
      "execution_count": null,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/plain": [
              "(4803, 4)"
            ]
          },
          "metadata": {},
          "execution_count": 8
        }
      ]
    },
    {
      "cell_type": "code",
      "source": [
        "credits.info()"
      ],
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "ZlcyrysP4aK2",
        "outputId": "16d6be8f-83a8-4de6-9ced-38a94d41e5a1"
      },
      "execution_count": null,
      "outputs": [
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "<class 'pandas.core.frame.DataFrame'>\n",
            "RangeIndex: 4803 entries, 0 to 4802\n",
            "Data columns (total 4 columns):\n",
            " #   Column    Non-Null Count  Dtype \n",
            "---  ------    --------------  ----- \n",
            " 0   movie_id  4803 non-null   int64 \n",
            " 1   title     4803 non-null   object\n",
            " 2   cast      4803 non-null   object\n",
            " 3   crew      4803 non-null   object\n",
            "dtypes: int64(1), object(3)\n",
            "memory usage: 150.2+ KB\n"
          ]
        }
      ]
    },
    {
      "cell_type": "markdown",
      "source": [
        "## Data Preprocessing"
      ],
      "metadata": {
        "id": "puOKz1yRyIJg"
      }
    },
    {
      "cell_type": "markdown",
      "source": [
        "### Merging two datasets together"
      ],
      "metadata": {
        "id": "Ga1FX42X688w"
      }
    },
    {
      "cell_type": "code",
      "source": [
        "movies = movies.merge(credits, \n",
        "                      on= 'title')"
      ],
      "metadata": {
        "id": "9GJgZYrF4xuI"
      },
      "execution_count": null,
      "outputs": []
    },
    {
      "cell_type": "code",
      "source": [
        "movies.shape"
      ],
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "3qqGezie7kUO",
        "outputId": "a7643369-a799-4fdb-d245-aa345097d8a5"
      },
      "execution_count": null,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/plain": [
              "(4809, 23)"
            ]
          },
          "metadata": {},
          "execution_count": 11
        }
      ]
    },
    {
      "cell_type": "code",
      "source": [
        "movies.head(2)"
      ],
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 396
        },
        "id": "43JJVdf_7r1b",
        "outputId": "c679b220-3126-451d-af5b-5fc1a8a08a2e"
      },
      "execution_count": null,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/plain": [
              "      budget                                             genres  \\\n",
              "0  237000000  [{\"id\": 28, \"name\": \"Action\"}, {\"id\": 12, \"nam...   \n",
              "1  300000000  [{\"id\": 12, \"name\": \"Adventure\"}, {\"id\": 14, \"...   \n",
              "\n",
              "                                       homepage     id  \\\n",
              "0                   http://www.avatarmovie.com/  19995   \n",
              "1  http://disney.go.com/disneypictures/pirates/    285   \n",
              "\n",
              "                                            keywords original_language  \\\n",
              "0  [{\"id\": 1463, \"name\": \"culture clash\"}, {\"id\":...                en   \n",
              "1  [{\"id\": 270, \"name\": \"ocean\"}, {\"id\": 726, \"na...                en   \n",
              "\n",
              "                             original_title  \\\n",
              "0                                    Avatar   \n",
              "1  Pirates of the Caribbean: At World's End   \n",
              "\n",
              "                                            overview  popularity  \\\n",
              "0  In the 22nd century, a paraplegic Marine is di...  150.437577   \n",
              "1  Captain Barbossa, long believed to be dead, ha...  139.082615   \n",
              "\n",
              "                                production_companies  ... runtime  \\\n",
              "0  [{\"name\": \"Ingenious Film Partners\", \"id\": 289...  ...   162.0   \n",
              "1  [{\"name\": \"Walt Disney Pictures\", \"id\": 2}, {\"...  ...   169.0   \n",
              "\n",
              "                                    spoken_languages    status  \\\n",
              "0  [{\"iso_639_1\": \"en\", \"name\": \"English\"}, {\"iso...  Released   \n",
              "1           [{\"iso_639_1\": \"en\", \"name\": \"English\"}]  Released   \n",
              "\n",
              "                                          tagline  \\\n",
              "0                     Enter the World of Pandora.   \n",
              "1  At the end of the world, the adventure begins.   \n",
              "\n",
              "                                      title vote_average vote_count movie_id  \\\n",
              "0                                    Avatar          7.2      11800    19995   \n",
              "1  Pirates of the Caribbean: At World's End          6.9       4500      285   \n",
              "\n",
              "                                                cast  \\\n",
              "0  [{\"cast_id\": 242, \"character\": \"Jake Sully\", \"...   \n",
              "1  [{\"cast_id\": 4, \"character\": \"Captain Jack Spa...   \n",
              "\n",
              "                                                crew  \n",
              "0  [{\"credit_id\": \"52fe48009251416c750aca23\", \"de...  \n",
              "1  [{\"credit_id\": \"52fe4232c3a36847f800b579\", \"de...  \n",
              "\n",
              "[2 rows x 23 columns]"
            ],
            "text/html": [
              "\n",
              "  <div id=\"df-8dcc1376-23b0-4648-a6fc-c91cf488f1f2\">\n",
              "    <div class=\"colab-df-container\">\n",
              "      <div>\n",
              "<style scoped>\n",
              "    .dataframe tbody tr th:only-of-type {\n",
              "        vertical-align: middle;\n",
              "    }\n",
              "\n",
              "    .dataframe tbody tr th {\n",
              "        vertical-align: top;\n",
              "    }\n",
              "\n",
              "    .dataframe thead th {\n",
              "        text-align: right;\n",
              "    }\n",
              "</style>\n",
              "<table border=\"1\" class=\"dataframe\">\n",
              "  <thead>\n",
              "    <tr style=\"text-align: right;\">\n",
              "      <th></th>\n",
              "      <th>budget</th>\n",
              "      <th>genres</th>\n",
              "      <th>homepage</th>\n",
              "      <th>id</th>\n",
              "      <th>keywords</th>\n",
              "      <th>original_language</th>\n",
              "      <th>original_title</th>\n",
              "      <th>overview</th>\n",
              "      <th>popularity</th>\n",
              "      <th>production_companies</th>\n",
              "      <th>...</th>\n",
              "      <th>runtime</th>\n",
              "      <th>spoken_languages</th>\n",
              "      <th>status</th>\n",
              "      <th>tagline</th>\n",
              "      <th>title</th>\n",
              "      <th>vote_average</th>\n",
              "      <th>vote_count</th>\n",
              "      <th>movie_id</th>\n",
              "      <th>cast</th>\n",
              "      <th>crew</th>\n",
              "    </tr>\n",
              "  </thead>\n",
              "  <tbody>\n",
              "    <tr>\n",
              "      <th>0</th>\n",
              "      <td>237000000</td>\n",
              "      <td>[{\"id\": 28, \"name\": \"Action\"}, {\"id\": 12, \"nam...</td>\n",
              "      <td>http://www.avatarmovie.com/</td>\n",
              "      <td>19995</td>\n",
              "      <td>[{\"id\": 1463, \"name\": \"culture clash\"}, {\"id\":...</td>\n",
              "      <td>en</td>\n",
              "      <td>Avatar</td>\n",
              "      <td>In the 22nd century, a paraplegic Marine is di...</td>\n",
              "      <td>150.437577</td>\n",
              "      <td>[{\"name\": \"Ingenious Film Partners\", \"id\": 289...</td>\n",
              "      <td>...</td>\n",
              "      <td>162.0</td>\n",
              "      <td>[{\"iso_639_1\": \"en\", \"name\": \"English\"}, {\"iso...</td>\n",
              "      <td>Released</td>\n",
              "      <td>Enter the World of Pandora.</td>\n",
              "      <td>Avatar</td>\n",
              "      <td>7.2</td>\n",
              "      <td>11800</td>\n",
              "      <td>19995</td>\n",
              "      <td>[{\"cast_id\": 242, \"character\": \"Jake Sully\", \"...</td>\n",
              "      <td>[{\"credit_id\": \"52fe48009251416c750aca23\", \"de...</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>1</th>\n",
              "      <td>300000000</td>\n",
              "      <td>[{\"id\": 12, \"name\": \"Adventure\"}, {\"id\": 14, \"...</td>\n",
              "      <td>http://disney.go.com/disneypictures/pirates/</td>\n",
              "      <td>285</td>\n",
              "      <td>[{\"id\": 270, \"name\": \"ocean\"}, {\"id\": 726, \"na...</td>\n",
              "      <td>en</td>\n",
              "      <td>Pirates of the Caribbean: At World's End</td>\n",
              "      <td>Captain Barbossa, long believed to be dead, ha...</td>\n",
              "      <td>139.082615</td>\n",
              "      <td>[{\"name\": \"Walt Disney Pictures\", \"id\": 2}, {\"...</td>\n",
              "      <td>...</td>\n",
              "      <td>169.0</td>\n",
              "      <td>[{\"iso_639_1\": \"en\", \"name\": \"English\"}]</td>\n",
              "      <td>Released</td>\n",
              "      <td>At the end of the world, the adventure begins.</td>\n",
              "      <td>Pirates of the Caribbean: At World's End</td>\n",
              "      <td>6.9</td>\n",
              "      <td>4500</td>\n",
              "      <td>285</td>\n",
              "      <td>[{\"cast_id\": 4, \"character\": \"Captain Jack Spa...</td>\n",
              "      <td>[{\"credit_id\": \"52fe4232c3a36847f800b579\", \"de...</td>\n",
              "    </tr>\n",
              "  </tbody>\n",
              "</table>\n",
              "<p>2 rows × 23 columns</p>\n",
              "</div>\n",
              "      <button class=\"colab-df-convert\" onclick=\"convertToInteractive('df-8dcc1376-23b0-4648-a6fc-c91cf488f1f2')\"\n",
              "              title=\"Convert this dataframe to an interactive table.\"\n",
              "              style=\"display:none;\">\n",
              "        \n",
              "  <svg xmlns=\"http://www.w3.org/2000/svg\" height=\"24px\"viewBox=\"0 0 24 24\"\n",
              "       width=\"24px\">\n",
              "    <path d=\"M0 0h24v24H0V0z\" fill=\"none\"/>\n",
              "    <path d=\"M18.56 5.44l.94 2.06.94-2.06 2.06-.94-2.06-.94-.94-2.06-.94 2.06-2.06.94zm-11 1L8.5 8.5l.94-2.06 2.06-.94-2.06-.94L8.5 2.5l-.94 2.06-2.06.94zm10 10l.94 2.06.94-2.06 2.06-.94-2.06-.94-.94-2.06-.94 2.06-2.06.94z\"/><path d=\"M17.41 7.96l-1.37-1.37c-.4-.4-.92-.59-1.43-.59-.52 0-1.04.2-1.43.59L10.3 9.45l-7.72 7.72c-.78.78-.78 2.05 0 2.83L4 21.41c.39.39.9.59 1.41.59.51 0 1.02-.2 1.41-.59l7.78-7.78 2.81-2.81c.8-.78.8-2.07 0-2.86zM5.41 20L4 18.59l7.72-7.72 1.47 1.35L5.41 20z\"/>\n",
              "  </svg>\n",
              "      </button>\n",
              "      \n",
              "  <style>\n",
              "    .colab-df-container {\n",
              "      display:flex;\n",
              "      flex-wrap:wrap;\n",
              "      gap: 12px;\n",
              "    }\n",
              "\n",
              "    .colab-df-convert {\n",
              "      background-color: #E8F0FE;\n",
              "      border: none;\n",
              "      border-radius: 50%;\n",
              "      cursor: pointer;\n",
              "      display: none;\n",
              "      fill: #1967D2;\n",
              "      height: 32px;\n",
              "      padding: 0 0 0 0;\n",
              "      width: 32px;\n",
              "    }\n",
              "\n",
              "    .colab-df-convert:hover {\n",
              "      background-color: #E2EBFA;\n",
              "      box-shadow: 0px 1px 2px rgba(60, 64, 67, 0.3), 0px 1px 3px 1px rgba(60, 64, 67, 0.15);\n",
              "      fill: #174EA6;\n",
              "    }\n",
              "\n",
              "    [theme=dark] .colab-df-convert {\n",
              "      background-color: #3B4455;\n",
              "      fill: #D2E3FC;\n",
              "    }\n",
              "\n",
              "    [theme=dark] .colab-df-convert:hover {\n",
              "      background-color: #434B5C;\n",
              "      box-shadow: 0px 1px 3px 1px rgba(0, 0, 0, 0.15);\n",
              "      filter: drop-shadow(0px 1px 2px rgba(0, 0, 0, 0.3));\n",
              "      fill: #FFFFFF;\n",
              "    }\n",
              "  </style>\n",
              "\n",
              "      <script>\n",
              "        const buttonEl =\n",
              "          document.querySelector('#df-8dcc1376-23b0-4648-a6fc-c91cf488f1f2 button.colab-df-convert');\n",
              "        buttonEl.style.display =\n",
              "          google.colab.kernel.accessAllowed ? 'block' : 'none';\n",
              "\n",
              "        async function convertToInteractive(key) {\n",
              "          const element = document.querySelector('#df-8dcc1376-23b0-4648-a6fc-c91cf488f1f2');\n",
              "          const dataTable =\n",
              "            await google.colab.kernel.invokeFunction('convertToInteractive',\n",
              "                                                     [key], {});\n",
              "          if (!dataTable) return;\n",
              "\n",
              "          const docLinkHtml = 'Like what you see? Visit the ' +\n",
              "            '<a target=\"_blank\" href=https://colab.research.google.com/notebooks/data_table.ipynb>data table notebook</a>'\n",
              "            + ' to learn more about interactive tables.';\n",
              "          element.innerHTML = '';\n",
              "          dataTable['output_type'] = 'display_data';\n",
              "          await google.colab.output.renderOutput(dataTable, element);\n",
              "          const docLink = document.createElement('div');\n",
              "          docLink.innerHTML = docLinkHtml;\n",
              "          element.appendChild(docLink);\n",
              "        }\n",
              "      </script>\n",
              "    </div>\n",
              "  </div>\n",
              "  "
            ]
          },
          "metadata": {},
          "execution_count": 12
        }
      ]
    },
    {
      "cell_type": "code",
      "source": [
        "movies.info()"
      ],
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "d6kQpfUK8rga",
        "outputId": "41068139-0554-4b82-dc21-2aa6c08c2d4e"
      },
      "execution_count": null,
      "outputs": [
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "<class 'pandas.core.frame.DataFrame'>\n",
            "Int64Index: 4809 entries, 0 to 4808\n",
            "Data columns (total 23 columns):\n",
            " #   Column                Non-Null Count  Dtype  \n",
            "---  ------                --------------  -----  \n",
            " 0   budget                4809 non-null   int64  \n",
            " 1   genres                4809 non-null   object \n",
            " 2   homepage              1713 non-null   object \n",
            " 3   id                    4809 non-null   int64  \n",
            " 4   keywords              4809 non-null   object \n",
            " 5   original_language     4809 non-null   object \n",
            " 6   original_title        4809 non-null   object \n",
            " 7   overview              4806 non-null   object \n",
            " 8   popularity            4809 non-null   float64\n",
            " 9   production_companies  4809 non-null   object \n",
            " 10  production_countries  4809 non-null   object \n",
            " 11  release_date          4808 non-null   object \n",
            " 12  revenue               4809 non-null   int64  \n",
            " 13  runtime               4807 non-null   float64\n",
            " 14  spoken_languages      4809 non-null   object \n",
            " 15  status                4809 non-null   object \n",
            " 16  tagline               3965 non-null   object \n",
            " 17  title                 4809 non-null   object \n",
            " 18  vote_average          4809 non-null   float64\n",
            " 19  vote_count            4809 non-null   int64  \n",
            " 20  movie_id              4809 non-null   int64  \n",
            " 21  cast                  4809 non-null   object \n",
            " 22  crew                  4809 non-null   object \n",
            "dtypes: float64(3), int64(5), object(15)\n",
            "memory usage: 901.7+ KB\n"
          ]
        }
      ]
    },
    {
      "cell_type": "code",
      "source": [
        "movies['original_language'].value_counts()"
      ],
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "aPrsqmJi9B7u",
        "outputId": "fd27d464-24e9-4b38-c587-ece9e71286c0"
      },
      "execution_count": null,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/plain": [
              "en    4510\n",
              "fr      70\n",
              "es      32\n",
              "zh      27\n",
              "de      27\n",
              "hi      19\n",
              "ja      16\n",
              "it      14\n",
              "ko      12\n",
              "cn      12\n",
              "ru      11\n",
              "pt       9\n",
              "da       7\n",
              "sv       5\n",
              "nl       4\n",
              "fa       4\n",
              "th       3\n",
              "he       3\n",
              "ta       2\n",
              "cs       2\n",
              "ro       2\n",
              "id       2\n",
              "ar       2\n",
              "vi       1\n",
              "sl       1\n",
              "ps       1\n",
              "no       1\n",
              "ky       1\n",
              "hu       1\n",
              "pl       1\n",
              "af       1\n",
              "nb       1\n",
              "tr       1\n",
              "is       1\n",
              "xx       1\n",
              "te       1\n",
              "el       1\n",
              "Name: original_language, dtype: int64"
            ]
          },
          "metadata": {},
          "execution_count": 14
        }
      ]
    },
    {
      "cell_type": "markdown",
      "source": [
        "Potential important features for building recommendation system\n",
        "- genres\n",
        "- id\n",
        "- keywords\n",
        "- title\n",
        "- overview\n",
        "- release_date (Could be important)\n",
        "- cast\n",
        "- crew     "
      ],
      "metadata": {
        "id": "mQvBf8iE_i1g"
      }
    },
    {
      "cell_type": "code",
      "source": [
        "movies = movies.copy()"
      ],
      "metadata": {
        "id": "t5wA8fbV_fvK"
      },
      "execution_count": null,
      "outputs": []
    },
    {
      "cell_type": "code",
      "source": [
        "movie = movies[['movie_id','title','overview','genres','keywords','cast','crew']]"
      ],
      "metadata": {
        "id": "kTqopQg-_tR1"
      },
      "execution_count": null,
      "outputs": []
    },
    {
      "cell_type": "code",
      "source": [
        "movie.head(3)"
      ],
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 344
        },
        "id": "YIN8Cxu9_zH2",
        "outputId": "53e79395-247a-4930-d5c6-7ef6d55b0eb2"
      },
      "execution_count": null,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/plain": [
              "   movie_id                                     title  \\\n",
              "0     19995                                    Avatar   \n",
              "1       285  Pirates of the Caribbean: At World's End   \n",
              "2    206647                                   Spectre   \n",
              "\n",
              "                                            overview  \\\n",
              "0  In the 22nd century, a paraplegic Marine is di...   \n",
              "1  Captain Barbossa, long believed to be dead, ha...   \n",
              "2  A cryptic message from Bond’s past sends him o...   \n",
              "\n",
              "                                              genres  \\\n",
              "0  [{\"id\": 28, \"name\": \"Action\"}, {\"id\": 12, \"nam...   \n",
              "1  [{\"id\": 12, \"name\": \"Adventure\"}, {\"id\": 14, \"...   \n",
              "2  [{\"id\": 28, \"name\": \"Action\"}, {\"id\": 12, \"nam...   \n",
              "\n",
              "                                            keywords  \\\n",
              "0  [{\"id\": 1463, \"name\": \"culture clash\"}, {\"id\":...   \n",
              "1  [{\"id\": 270, \"name\": \"ocean\"}, {\"id\": 726, \"na...   \n",
              "2  [{\"id\": 470, \"name\": \"spy\"}, {\"id\": 818, \"name...   \n",
              "\n",
              "                                                cast  \\\n",
              "0  [{\"cast_id\": 242, \"character\": \"Jake Sully\", \"...   \n",
              "1  [{\"cast_id\": 4, \"character\": \"Captain Jack Spa...   \n",
              "2  [{\"cast_id\": 1, \"character\": \"James Bond\", \"cr...   \n",
              "\n",
              "                                                crew  \n",
              "0  [{\"credit_id\": \"52fe48009251416c750aca23\", \"de...  \n",
              "1  [{\"credit_id\": \"52fe4232c3a36847f800b579\", \"de...  \n",
              "2  [{\"credit_id\": \"54805967c3a36829b5002c41\", \"de...  "
            ],
            "text/html": [
              "\n",
              "  <div id=\"df-acf944ac-e429-4f52-9d83-6c37cc7cdc6f\">\n",
              "    <div class=\"colab-df-container\">\n",
              "      <div>\n",
              "<style scoped>\n",
              "    .dataframe tbody tr th:only-of-type {\n",
              "        vertical-align: middle;\n",
              "    }\n",
              "\n",
              "    .dataframe tbody tr th {\n",
              "        vertical-align: top;\n",
              "    }\n",
              "\n",
              "    .dataframe thead th {\n",
              "        text-align: right;\n",
              "    }\n",
              "</style>\n",
              "<table border=\"1\" class=\"dataframe\">\n",
              "  <thead>\n",
              "    <tr style=\"text-align: right;\">\n",
              "      <th></th>\n",
              "      <th>movie_id</th>\n",
              "      <th>title</th>\n",
              "      <th>overview</th>\n",
              "      <th>genres</th>\n",
              "      <th>keywords</th>\n",
              "      <th>cast</th>\n",
              "      <th>crew</th>\n",
              "    </tr>\n",
              "  </thead>\n",
              "  <tbody>\n",
              "    <tr>\n",
              "      <th>0</th>\n",
              "      <td>19995</td>\n",
              "      <td>Avatar</td>\n",
              "      <td>In the 22nd century, a paraplegic Marine is di...</td>\n",
              "      <td>[{\"id\": 28, \"name\": \"Action\"}, {\"id\": 12, \"nam...</td>\n",
              "      <td>[{\"id\": 1463, \"name\": \"culture clash\"}, {\"id\":...</td>\n",
              "      <td>[{\"cast_id\": 242, \"character\": \"Jake Sully\", \"...</td>\n",
              "      <td>[{\"credit_id\": \"52fe48009251416c750aca23\", \"de...</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>1</th>\n",
              "      <td>285</td>\n",
              "      <td>Pirates of the Caribbean: At World's End</td>\n",
              "      <td>Captain Barbossa, long believed to be dead, ha...</td>\n",
              "      <td>[{\"id\": 12, \"name\": \"Adventure\"}, {\"id\": 14, \"...</td>\n",
              "      <td>[{\"id\": 270, \"name\": \"ocean\"}, {\"id\": 726, \"na...</td>\n",
              "      <td>[{\"cast_id\": 4, \"character\": \"Captain Jack Spa...</td>\n",
              "      <td>[{\"credit_id\": \"52fe4232c3a36847f800b579\", \"de...</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>2</th>\n",
              "      <td>206647</td>\n",
              "      <td>Spectre</td>\n",
              "      <td>A cryptic message from Bond’s past sends him o...</td>\n",
              "      <td>[{\"id\": 28, \"name\": \"Action\"}, {\"id\": 12, \"nam...</td>\n",
              "      <td>[{\"id\": 470, \"name\": \"spy\"}, {\"id\": 818, \"name...</td>\n",
              "      <td>[{\"cast_id\": 1, \"character\": \"James Bond\", \"cr...</td>\n",
              "      <td>[{\"credit_id\": \"54805967c3a36829b5002c41\", \"de...</td>\n",
              "    </tr>\n",
              "  </tbody>\n",
              "</table>\n",
              "</div>\n",
              "      <button class=\"colab-df-convert\" onclick=\"convertToInteractive('df-acf944ac-e429-4f52-9d83-6c37cc7cdc6f')\"\n",
              "              title=\"Convert this dataframe to an interactive table.\"\n",
              "              style=\"display:none;\">\n",
              "        \n",
              "  <svg xmlns=\"http://www.w3.org/2000/svg\" height=\"24px\"viewBox=\"0 0 24 24\"\n",
              "       width=\"24px\">\n",
              "    <path d=\"M0 0h24v24H0V0z\" fill=\"none\"/>\n",
              "    <path d=\"M18.56 5.44l.94 2.06.94-2.06 2.06-.94-2.06-.94-.94-2.06-.94 2.06-2.06.94zm-11 1L8.5 8.5l.94-2.06 2.06-.94-2.06-.94L8.5 2.5l-.94 2.06-2.06.94zm10 10l.94 2.06.94-2.06 2.06-.94-2.06-.94-.94-2.06-.94 2.06-2.06.94z\"/><path d=\"M17.41 7.96l-1.37-1.37c-.4-.4-.92-.59-1.43-.59-.52 0-1.04.2-1.43.59L10.3 9.45l-7.72 7.72c-.78.78-.78 2.05 0 2.83L4 21.41c.39.39.9.59 1.41.59.51 0 1.02-.2 1.41-.59l7.78-7.78 2.81-2.81c.8-.78.8-2.07 0-2.86zM5.41 20L4 18.59l7.72-7.72 1.47 1.35L5.41 20z\"/>\n",
              "  </svg>\n",
              "      </button>\n",
              "      \n",
              "  <style>\n",
              "    .colab-df-container {\n",
              "      display:flex;\n",
              "      flex-wrap:wrap;\n",
              "      gap: 12px;\n",
              "    }\n",
              "\n",
              "    .colab-df-convert {\n",
              "      background-color: #E8F0FE;\n",
              "      border: none;\n",
              "      border-radius: 50%;\n",
              "      cursor: pointer;\n",
              "      display: none;\n",
              "      fill: #1967D2;\n",
              "      height: 32px;\n",
              "      padding: 0 0 0 0;\n",
              "      width: 32px;\n",
              "    }\n",
              "\n",
              "    .colab-df-convert:hover {\n",
              "      background-color: #E2EBFA;\n",
              "      box-shadow: 0px 1px 2px rgba(60, 64, 67, 0.3), 0px 1px 3px 1px rgba(60, 64, 67, 0.15);\n",
              "      fill: #174EA6;\n",
              "    }\n",
              "\n",
              "    [theme=dark] .colab-df-convert {\n",
              "      background-color: #3B4455;\n",
              "      fill: #D2E3FC;\n",
              "    }\n",
              "\n",
              "    [theme=dark] .colab-df-convert:hover {\n",
              "      background-color: #434B5C;\n",
              "      box-shadow: 0px 1px 3px 1px rgba(0, 0, 0, 0.15);\n",
              "      filter: drop-shadow(0px 1px 2px rgba(0, 0, 0, 0.3));\n",
              "      fill: #FFFFFF;\n",
              "    }\n",
              "  </style>\n",
              "\n",
              "      <script>\n",
              "        const buttonEl =\n",
              "          document.querySelector('#df-acf944ac-e429-4f52-9d83-6c37cc7cdc6f button.colab-df-convert');\n",
              "        buttonEl.style.display =\n",
              "          google.colab.kernel.accessAllowed ? 'block' : 'none';\n",
              "\n",
              "        async function convertToInteractive(key) {\n",
              "          const element = document.querySelector('#df-acf944ac-e429-4f52-9d83-6c37cc7cdc6f');\n",
              "          const dataTable =\n",
              "            await google.colab.kernel.invokeFunction('convertToInteractive',\n",
              "                                                     [key], {});\n",
              "          if (!dataTable) return;\n",
              "\n",
              "          const docLinkHtml = 'Like what you see? Visit the ' +\n",
              "            '<a target=\"_blank\" href=https://colab.research.google.com/notebooks/data_table.ipynb>data table notebook</a>'\n",
              "            + ' to learn more about interactive tables.';\n",
              "          element.innerHTML = '';\n",
              "          dataTable['output_type'] = 'display_data';\n",
              "          await google.colab.output.renderOutput(dataTable, element);\n",
              "          const docLink = document.createElement('div');\n",
              "          docLink.innerHTML = docLinkHtml;\n",
              "          element.appendChild(docLink);\n",
              "        }\n",
              "      </script>\n",
              "    </div>\n",
              "  </div>\n",
              "  "
            ]
          },
          "metadata": {},
          "execution_count": 17
        }
      ]
    },
    {
      "cell_type": "markdown",
      "source": [
        "### Checking for missing value"
      ],
      "metadata": {
        "id": "lYjJ7765x-D-"
      }
    },
    {
      "cell_type": "code",
      "source": [
        "movie.isnull().sum()"
      ],
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "-T-_7bWUAgk9",
        "outputId": "a91c6c70-40ec-47e6-bfc8-05711b477b25"
      },
      "execution_count": null,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/plain": [
              "movie_id    0\n",
              "title       0\n",
              "overview    3\n",
              "genres      0\n",
              "keywords    0\n",
              "cast        0\n",
              "crew        0\n",
              "dtype: int64"
            ]
          },
          "metadata": {},
          "execution_count": 18
        }
      ]
    },
    {
      "cell_type": "code",
      "source": [
        "movie.dropna(inplace=True)"
      ],
      "metadata": {
        "id": "psEnivGUAn3Z"
      },
      "execution_count": null,
      "outputs": []
    },
    {
      "cell_type": "code",
      "source": [
        "movie.isnull().sum()"
      ],
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "2eR5WVjIA8TG",
        "outputId": "ddf20247-7144-463f-be25-32cb4fd521ef"
      },
      "execution_count": null,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/plain": [
              "movie_id    0\n",
              "title       0\n",
              "overview    0\n",
              "genres      0\n",
              "keywords    0\n",
              "cast        0\n",
              "crew        0\n",
              "dtype: int64"
            ]
          },
          "metadata": {},
          "execution_count": 20
        }
      ]
    },
    {
      "cell_type": "markdown",
      "source": [
        "### Checking duplicate value"
      ],
      "metadata": {
        "id": "Bv3mlaA5yC6o"
      }
    },
    {
      "cell_type": "code",
      "source": [
        "movie.duplicated().sum()"
      ],
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "qNALK4IzA9_O",
        "outputId": "d30e8281-6476-4d60-9bd3-5a16d5299f06"
      },
      "execution_count": null,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/plain": [
              "0"
            ]
          },
          "metadata": {},
          "execution_count": 21
        }
      ]
    },
    {
      "cell_type": "code",
      "source": [
        "movies.iloc[0].genres"
      ],
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 53
        },
        "id": "mTWk0DilBFAZ",
        "outputId": "801db3c5-fa8c-423d-c403-e3e5e11a1004"
      },
      "execution_count": null,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/plain": [
              "'[{\"id\": 28, \"name\": \"Action\"}, {\"id\": 12, \"name\": \"Adventure\"}, {\"id\": 14, \"name\": \"Fantasy\"}, {\"id\": 878, \"name\": \"Science Fiction\"}]'"
            ],
            "application/vnd.google.colaboratory.intrinsic+json": {
              "type": "string"
            }
          },
          "metadata": {},
          "execution_count": 22
        }
      ]
    },
    {
      "cell_type": "markdown",
      "source": [
        "The movie dataset contains a \"genres\" column where each value is a dictionary stored as a string. To extract only the names of the genres from this column, we need to convert the string representation into a list.\n",
        "\n",
        "The process involves the following steps:\n",
        "\n",
        "1. Convert the string representation of the dictionary into an actual dictionary using the `ast` library. This allows us to work with the genres as a dictionary object.\n",
        "\n",
        "2. Extract the names of the genres from the dictionary. We are interested in only the genre names, so we discard any other information present in the dictionary.\n",
        "\n",
        "3. Convert the extracted genre names into a list. This ensures that we have a structured representation of the genres for each movie, which can be used for further analysis and computations.\n",
        "\n",
        "By converting the genres column from a string representation to a list of genre names, we can easily analyze and work with the genre information in the movie recommendation system."
      ],
      "metadata": {
        "id": "4PMriY8OySdH"
      }
    },
    {
      "cell_type": "code",
      "source": [
        "def convert(obj):\n",
        "  L=[]\n",
        "  for i in ast.literal_eval(obj):\n",
        "    L.append(i['name'])\n",
        "  return L"
      ],
      "metadata": {
        "id": "4BxTO85cCJ_g"
      },
      "execution_count": null,
      "outputs": []
    },
    {
      "cell_type": "code",
      "source": [
        "convert('[{\"id\": 28, \"name\": \"Action\"}, {\"id\": 12, \"name\": \"Adventure\"}, {\"id\": 14, \"name\": \"Fantasy\"}, {\"id\": 878, \"name\": \"Science Fiction\"}]')"
      ],
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "mA5jfDPmm7gl",
        "outputId": "e9cdb0e5-48c9-44fa-a5b6-8f6108d15e90"
      },
      "execution_count": null,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/plain": [
              "['Action', 'Adventure', 'Fantasy', 'Science Fiction']"
            ]
          },
          "metadata": {},
          "execution_count": 26
        }
      ]
    },
    {
      "cell_type": "code",
      "source": [
        "movie['genres'] = movie['genres'].apply(convert)"
      ],
      "metadata": {
        "id": "lSTPJmNxnGzd"
      },
      "execution_count": null,
      "outputs": []
    },
    {
      "cell_type": "code",
      "source": [
        "movie.iloc[0].keywords"
      ],
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 140
        },
        "id": "YjrweqKcnc6K",
        "outputId": "4805023a-9215-44ae-d781-19b053cfc6cf"
      },
      "execution_count": null,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/plain": [
              "'[{\"id\": 1463, \"name\": \"culture clash\"}, {\"id\": 2964, \"name\": \"future\"}, {\"id\": 3386, \"name\": \"space war\"}, {\"id\": 3388, \"name\": \"space colony\"}, {\"id\": 3679, \"name\": \"society\"}, {\"id\": 3801, \"name\": \"space travel\"}, {\"id\": 9685, \"name\": \"futuristic\"}, {\"id\": 9840, \"name\": \"romance\"}, {\"id\": 9882, \"name\": \"space\"}, {\"id\": 9951, \"name\": \"alien\"}, {\"id\": 10148, \"name\": \"tribe\"}, {\"id\": 10158, \"name\": \"alien planet\"}, {\"id\": 10987, \"name\": \"cgi\"}, {\"id\": 11399, \"name\": \"marine\"}, {\"id\": 13065, \"name\": \"soldier\"}, {\"id\": 14643, \"name\": \"battle\"}, {\"id\": 14720, \"name\": \"love affair\"}, {\"id\": 165431, \"name\": \"anti war\"}, {\"id\": 193554, \"name\": \"power relations\"}, {\"id\": 206690, \"name\": \"mind and soul\"}, {\"id\": 209714, \"name\": \"3d\"}]'"
            ],
            "application/vnd.google.colaboratory.intrinsic+json": {
              "type": "string"
            }
          },
          "metadata": {},
          "execution_count": 30
        }
      ]
    },
    {
      "cell_type": "code",
      "source": [
        "movie['keywords'] = movie['keywords'].apply(convert)"
      ],
      "metadata": {
        "id": "0TEh3pWnnmNI"
      },
      "execution_count": null,
      "outputs": []
    },
    {
      "cell_type": "code",
      "source": [
        "movie.head(3)"
      ],
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 344
        },
        "id": "UZatjA8AnzSv",
        "outputId": "b3d243fd-c1cc-4217-b69b-49bc1c2d508c"
      },
      "execution_count": null,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/plain": [
              "   movie_id                                     title  \\\n",
              "0     19995                                    Avatar   \n",
              "1       285  Pirates of the Caribbean: At World's End   \n",
              "2    206647                                   Spectre   \n",
              "\n",
              "                                            overview  \\\n",
              "0  In the 22nd century, a paraplegic Marine is di...   \n",
              "1  Captain Barbossa, long believed to be dead, ha...   \n",
              "2  A cryptic message from Bond’s past sends him o...   \n",
              "\n",
              "                                          genres  \\\n",
              "0  [Action, Adventure, Fantasy, Science Fiction]   \n",
              "1                   [Adventure, Fantasy, Action]   \n",
              "2                     [Action, Adventure, Crime]   \n",
              "\n",
              "                                            keywords  \\\n",
              "0  [culture clash, future, space war, space colon...   \n",
              "1  [ocean, drug abuse, exotic island, east india ...   \n",
              "2  [spy, based on novel, secret agent, sequel, mi...   \n",
              "\n",
              "                                                cast  \\\n",
              "0  [{\"cast_id\": 242, \"character\": \"Jake Sully\", \"...   \n",
              "1  [{\"cast_id\": 4, \"character\": \"Captain Jack Spa...   \n",
              "2  [{\"cast_id\": 1, \"character\": \"James Bond\", \"cr...   \n",
              "\n",
              "                                                crew  \n",
              "0  [{\"credit_id\": \"52fe48009251416c750aca23\", \"de...  \n",
              "1  [{\"credit_id\": \"52fe4232c3a36847f800b579\", \"de...  \n",
              "2  [{\"credit_id\": \"54805967c3a36829b5002c41\", \"de...  "
            ],
            "text/html": [
              "\n",
              "  <div id=\"df-4711d966-c8ad-429c-becb-eef9cb39c8e6\">\n",
              "    <div class=\"colab-df-container\">\n",
              "      <div>\n",
              "<style scoped>\n",
              "    .dataframe tbody tr th:only-of-type {\n",
              "        vertical-align: middle;\n",
              "    }\n",
              "\n",
              "    .dataframe tbody tr th {\n",
              "        vertical-align: top;\n",
              "    }\n",
              "\n",
              "    .dataframe thead th {\n",
              "        text-align: right;\n",
              "    }\n",
              "</style>\n",
              "<table border=\"1\" class=\"dataframe\">\n",
              "  <thead>\n",
              "    <tr style=\"text-align: right;\">\n",
              "      <th></th>\n",
              "      <th>movie_id</th>\n",
              "      <th>title</th>\n",
              "      <th>overview</th>\n",
              "      <th>genres</th>\n",
              "      <th>keywords</th>\n",
              "      <th>cast</th>\n",
              "      <th>crew</th>\n",
              "    </tr>\n",
              "  </thead>\n",
              "  <tbody>\n",
              "    <tr>\n",
              "      <th>0</th>\n",
              "      <td>19995</td>\n",
              "      <td>Avatar</td>\n",
              "      <td>In the 22nd century, a paraplegic Marine is di...</td>\n",
              "      <td>[Action, Adventure, Fantasy, Science Fiction]</td>\n",
              "      <td>[culture clash, future, space war, space colon...</td>\n",
              "      <td>[{\"cast_id\": 242, \"character\": \"Jake Sully\", \"...</td>\n",
              "      <td>[{\"credit_id\": \"52fe48009251416c750aca23\", \"de...</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>1</th>\n",
              "      <td>285</td>\n",
              "      <td>Pirates of the Caribbean: At World's End</td>\n",
              "      <td>Captain Barbossa, long believed to be dead, ha...</td>\n",
              "      <td>[Adventure, Fantasy, Action]</td>\n",
              "      <td>[ocean, drug abuse, exotic island, east india ...</td>\n",
              "      <td>[{\"cast_id\": 4, \"character\": \"Captain Jack Spa...</td>\n",
              "      <td>[{\"credit_id\": \"52fe4232c3a36847f800b579\", \"de...</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>2</th>\n",
              "      <td>206647</td>\n",
              "      <td>Spectre</td>\n",
              "      <td>A cryptic message from Bond’s past sends him o...</td>\n",
              "      <td>[Action, Adventure, Crime]</td>\n",
              "      <td>[spy, based on novel, secret agent, sequel, mi...</td>\n",
              "      <td>[{\"cast_id\": 1, \"character\": \"James Bond\", \"cr...</td>\n",
              "      <td>[{\"credit_id\": \"54805967c3a36829b5002c41\", \"de...</td>\n",
              "    </tr>\n",
              "  </tbody>\n",
              "</table>\n",
              "</div>\n",
              "      <button class=\"colab-df-convert\" onclick=\"convertToInteractive('df-4711d966-c8ad-429c-becb-eef9cb39c8e6')\"\n",
              "              title=\"Convert this dataframe to an interactive table.\"\n",
              "              style=\"display:none;\">\n",
              "        \n",
              "  <svg xmlns=\"http://www.w3.org/2000/svg\" height=\"24px\"viewBox=\"0 0 24 24\"\n",
              "       width=\"24px\">\n",
              "    <path d=\"M0 0h24v24H0V0z\" fill=\"none\"/>\n",
              "    <path d=\"M18.56 5.44l.94 2.06.94-2.06 2.06-.94-2.06-.94-.94-2.06-.94 2.06-2.06.94zm-11 1L8.5 8.5l.94-2.06 2.06-.94-2.06-.94L8.5 2.5l-.94 2.06-2.06.94zm10 10l.94 2.06.94-2.06 2.06-.94-2.06-.94-.94-2.06-.94 2.06-2.06.94z\"/><path d=\"M17.41 7.96l-1.37-1.37c-.4-.4-.92-.59-1.43-.59-.52 0-1.04.2-1.43.59L10.3 9.45l-7.72 7.72c-.78.78-.78 2.05 0 2.83L4 21.41c.39.39.9.59 1.41.59.51 0 1.02-.2 1.41-.59l7.78-7.78 2.81-2.81c.8-.78.8-2.07 0-2.86zM5.41 20L4 18.59l7.72-7.72 1.47 1.35L5.41 20z\"/>\n",
              "  </svg>\n",
              "      </button>\n",
              "      \n",
              "  <style>\n",
              "    .colab-df-container {\n",
              "      display:flex;\n",
              "      flex-wrap:wrap;\n",
              "      gap: 12px;\n",
              "    }\n",
              "\n",
              "    .colab-df-convert {\n",
              "      background-color: #E8F0FE;\n",
              "      border: none;\n",
              "      border-radius: 50%;\n",
              "      cursor: pointer;\n",
              "      display: none;\n",
              "      fill: #1967D2;\n",
              "      height: 32px;\n",
              "      padding: 0 0 0 0;\n",
              "      width: 32px;\n",
              "    }\n",
              "\n",
              "    .colab-df-convert:hover {\n",
              "      background-color: #E2EBFA;\n",
              "      box-shadow: 0px 1px 2px rgba(60, 64, 67, 0.3), 0px 1px 3px 1px rgba(60, 64, 67, 0.15);\n",
              "      fill: #174EA6;\n",
              "    }\n",
              "\n",
              "    [theme=dark] .colab-df-convert {\n",
              "      background-color: #3B4455;\n",
              "      fill: #D2E3FC;\n",
              "    }\n",
              "\n",
              "    [theme=dark] .colab-df-convert:hover {\n",
              "      background-color: #434B5C;\n",
              "      box-shadow: 0px 1px 3px 1px rgba(0, 0, 0, 0.15);\n",
              "      filter: drop-shadow(0px 1px 2px rgba(0, 0, 0, 0.3));\n",
              "      fill: #FFFFFF;\n",
              "    }\n",
              "  </style>\n",
              "\n",
              "      <script>\n",
              "        const buttonEl =\n",
              "          document.querySelector('#df-4711d966-c8ad-429c-becb-eef9cb39c8e6 button.colab-df-convert');\n",
              "        buttonEl.style.display =\n",
              "          google.colab.kernel.accessAllowed ? 'block' : 'none';\n",
              "\n",
              "        async function convertToInteractive(key) {\n",
              "          const element = document.querySelector('#df-4711d966-c8ad-429c-becb-eef9cb39c8e6');\n",
              "          const dataTable =\n",
              "            await google.colab.kernel.invokeFunction('convertToInteractive',\n",
              "                                                     [key], {});\n",
              "          if (!dataTable) return;\n",
              "\n",
              "          const docLinkHtml = 'Like what you see? Visit the ' +\n",
              "            '<a target=\"_blank\" href=https://colab.research.google.com/notebooks/data_table.ipynb>data table notebook</a>'\n",
              "            + ' to learn more about interactive tables.';\n",
              "          element.innerHTML = '';\n",
              "          dataTable['output_type'] = 'display_data';\n",
              "          await google.colab.output.renderOutput(dataTable, element);\n",
              "          const docLink = document.createElement('div');\n",
              "          docLink.innerHTML = docLinkHtml;\n",
              "          element.appendChild(docLink);\n",
              "        }\n",
              "      </script>\n",
              "    </div>\n",
              "  </div>\n",
              "  "
            ]
          },
          "metadata": {},
          "execution_count": 33
        }
      ]
    },
    {
      "cell_type": "code",
      "source": [
        "movie.iloc[0].cast"
      ],
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 174
        },
        "id": "QD52YM7pn4HF",
        "outputId": "d77e3497-7c78-4c56-b395-82764b01a332"
      },
      "execution_count": null,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/plain": [
              "'[{\"cast_id\": 242, \"character\": \"Jake Sully\", \"credit_id\": \"5602a8a7c3a3685532001c9a\", \"gender\": 2, \"id\": 65731, \"name\": \"Sam Worthington\", \"order\": 0}, {\"cast_id\": 3, \"character\": \"Neytiri\", \"credit_id\": \"52fe48009251416c750ac9cb\", \"gender\": 1, \"id\": 8691, \"name\": \"Zoe Saldana\", \"order\": 1}, {\"cast_id\": 25, \"character\": \"Dr. Grace Augustine\", \"credit_id\": \"52fe48009251416c750aca39\", \"gender\": 1, \"id\": 10205, \"name\": \"Sigourney Weaver\", \"order\": 2}, {\"cast_id\": 4, \"character\": \"Col. Quaritch\", \"credit_id\": \"52fe48009251416c750ac9cf\", \"gender\": 2, \"id\": 32747, \"name\": \"Stephen Lang\", \"order\": 3}, {\"cast_id\": 5, \"character\": \"Trudy Chacon\", \"credit_id\": \"52fe48009251416c750ac9d3\", \"gender\": 1, \"id\": 17647, \"name\": \"Michelle Rodriguez\", \"order\": 4}, {\"cast_id\": 8, \"character\": \"Selfridge\", \"credit_id\": \"52fe48009251416c750ac9e1\", \"gender\": 2, \"id\": 1771, \"name\": \"Giovanni Ribisi\", \"order\": 5}, {\"cast_id\": 7, \"character\": \"Norm Spellman\", \"credit_id\": \"52fe48009251416c750ac9dd\", \"gender\": 2, \"id\": 59231, \"name\": \"Joel David Moore\", \"order\": 6}, {\"cast_id\": 9, \"character\": \"Moat\", \"credit_id\": \"52fe48009251416c750ac9e5\", \"gender\": 1, \"id\": 30485, \"name\": \"CCH Pounder\", \"order\": 7}, {\"cast_id\": 11, \"character\": \"Eytukan\", \"credit_id\": \"52fe48009251416c750ac9ed\", \"gender\": 2, \"id\": 15853, \"name\": \"Wes Studi\", \"order\": 8}, {\"cast_id\": 10, \"character\": \"Tsu\\'Tey\", \"credit_id\": \"52fe48009251416c750ac9e9\", \"gender\": 2, \"id\": 10964, \"name\": \"Laz Alonso\", \"order\": 9}, {\"cast_id\": 12, \"character\": \"Dr. Max Patel\", \"credit_id\": \"52fe48009251416c750ac9f1\", \"gender\": 2, \"id\": 95697, \"name\": \"Dileep Rao\", \"order\": 10}, {\"cast_id\": 13, \"character\": \"Lyle Wainfleet\", \"credit_id\": \"52fe48009251416c750ac9f5\", \"gender\": 2, \"id\": 98215, \"name\": \"Matt Gerald\", \"order\": 11}, {\"cast_id\": 32, \"character\": \"Private Fike\", \"credit_id\": \"52fe48009251416c750aca5b\", \"gender\": 2, \"id\": 154153, \"name\": \"Sean Anthony Moran\", \"order\": 12}, {\"cast_id\": 33, \"character\": \"Cryo Vault Med Tech\", \"credit_id\": \"52fe48009251416c750aca5f\", \"gender\": 2, \"id\": 397312, \"name\": \"Jason Whyte\", \"order\": 13}, {\"cast_id\": 34, \"character\": \"Venture Star Crew Chief\", \"credit_id\": \"52fe48009251416c750aca63\", \"gender\": 2, \"id\": 42317, \"name\": \"Scott Lawrence\", \"order\": 14}, {\"cast_id\": 35, \"character\": \"Lock Up Trooper\", \"credit_id\": \"52fe48009251416c750aca67\", \"gender\": 2, \"id\": 986734, \"name\": \"Kelly Kilgour\", \"order\": 15}, {\"cast_id\": 36, \"character\": \"Shuttle Pilot\", \"credit_id\": \"52fe48009251416c750aca6b\", \"gender\": 0, \"id\": 1207227, \"name\": \"James Patrick Pitt\", \"order\": 16}, {\"cast_id\": 37, \"character\": \"Shuttle Co-Pilot\", \"credit_id\": \"52fe48009251416c750aca6f\", \"gender\": 0, \"id\": 1180936, \"name\": \"Sean Patrick Murphy\", \"order\": 17}, {\"cast_id\": 38, \"character\": \"Shuttle Crew Chief\", \"credit_id\": \"52fe48009251416c750aca73\", \"gender\": 2, \"id\": 1019578, \"name\": \"Peter Dillon\", \"order\": 18}, {\"cast_id\": 39, \"character\": \"Tractor Operator / Troupe\", \"credit_id\": \"52fe48009251416c750aca77\", \"gender\": 0, \"id\": 91443, \"name\": \"Kevin Dorman\", \"order\": 19}, {\"cast_id\": 40, \"character\": \"Dragon Gunship Pilot\", \"credit_id\": \"52fe48009251416c750aca7b\", \"gender\": 2, \"id\": 173391, \"name\": \"Kelson Henderson\", \"order\": 20}, {\"cast_id\": 41, \"character\": \"Dragon Gunship Gunner\", \"credit_id\": \"52fe48009251416c750aca7f\", \"gender\": 0, \"id\": 1207236, \"name\": \"David Van Horn\", \"order\": 21}, {\"cast_id\": 42, \"character\": \"Dragon Gunship Navigator\", \"credit_id\": \"52fe48009251416c750aca83\", \"gender\": 0, \"id\": 215913, \"name\": \"Jacob Tomuri\", \"order\": 22}, {\"cast_id\": 43, \"character\": \"Suit #1\", \"credit_id\": \"52fe48009251416c750aca87\", \"gender\": 0, \"id\": 143206, \"name\": \"Michael Blain-Rozgay\", \"order\": 23}, {\"cast_id\": 44, \"character\": \"Suit #2\", \"credit_id\": \"52fe48009251416c750aca8b\", \"gender\": 2, \"id\": 169676, \"name\": \"Jon Curry\", \"order\": 24}, {\"cast_id\": 46, \"character\": \"Ambient Room Tech\", \"credit_id\": \"52fe48009251416c750aca8f\", \"gender\": 0, \"id\": 1048610, \"name\": \"Luke Hawker\", \"order\": 25}, {\"cast_id\": 47, \"character\": \"Ambient Room Tech / Troupe\", \"credit_id\": \"52fe48009251416c750aca93\", \"gender\": 0, \"id\": 42288, \"name\": \"Woody Schultz\", \"order\": 26}, {\"cast_id\": 48, \"character\": \"Horse Clan Leader\", \"credit_id\": \"52fe48009251416c750aca97\", \"gender\": 2, \"id\": 68278, \"name\": \"Peter Mensah\", \"order\": 27}, {\"cast_id\": 49, \"character\": \"Link Room Tech\", \"credit_id\": \"52fe48009251416c750aca9b\", \"gender\": 0, \"id\": 1207247, \"name\": \"Sonia Yee\", \"order\": 28}, {\"cast_id\": 50, \"character\": \"Basketball Avatar / Troupe\", \"credit_id\": \"52fe48009251416c750aca9f\", \"gender\": 1, \"id\": 1207248, \"name\": \"Jahnel Curfman\", \"order\": 29}, {\"cast_id\": 51, \"character\": \"Basketball Avatar\", \"credit_id\": \"52fe48009251416c750acaa3\", \"gender\": 0, \"id\": 89714, \"name\": \"Ilram Choi\", \"order\": 30}, {\"cast_id\": 52, \"character\": \"Na\\'vi Child\", \"credit_id\": \"52fe48009251416c750acaa7\", \"gender\": 0, \"id\": 1207249, \"name\": \"Kyla Warren\", \"order\": 31}, {\"cast_id\": 53, \"character\": \"Troupe\", \"credit_id\": \"52fe48009251416c750acaab\", \"gender\": 0, \"id\": 1207250, \"name\": \"Lisa Roumain\", \"order\": 32}, {\"cast_id\": 54, \"character\": \"Troupe\", \"credit_id\": \"52fe48009251416c750acaaf\", \"gender\": 1, \"id\": 83105, \"name\": \"Debra Wilson\", \"order\": 33}, {\"cast_id\": 57, \"character\": \"Troupe\", \"credit_id\": \"52fe48009251416c750acabb\", \"gender\": 0, \"id\": 1207253, \"name\": \"Chris Mala\", \"order\": 34}, {\"cast_id\": 55, \"character\": \"Troupe\", \"credit_id\": \"52fe48009251416c750acab3\", \"gender\": 0, \"id\": 1207251, \"name\": \"Taylor Kibby\", \"order\": 35}, {\"cast_id\": 56, \"character\": \"Troupe\", \"credit_id\": \"52fe48009251416c750acab7\", \"gender\": 0, \"id\": 1207252, \"name\": \"Jodie Landau\", \"order\": 36}, {\"cast_id\": 58, \"character\": \"Troupe\", \"credit_id\": \"52fe48009251416c750acabf\", \"gender\": 0, \"id\": 1207254, \"name\": \"Julie Lamm\", \"order\": 37}, {\"cast_id\": 59, \"character\": \"Troupe\", \"credit_id\": \"52fe48009251416c750acac3\", \"gender\": 0, \"id\": 1207257, \"name\": \"Cullen B. Madden\", \"order\": 38}, {\"cast_id\": 60, \"character\": \"Troupe\", \"credit_id\": \"52fe48009251416c750acac7\", \"gender\": 0, \"id\": 1207259, \"name\": \"Joseph Brady Madden\", \"order\": 39}, {\"cast_id\": 61, \"character\": \"Troupe\", \"credit_id\": \"52fe48009251416c750acacb\", \"gender\": 0, \"id\": 1207262, \"name\": \"Frankie Torres\", \"order\": 40}, {\"cast_id\": 62, \"character\": \"Troupe\", \"credit_id\": \"52fe48009251416c750acacf\", \"gender\": 1, \"id\": 1158600, \"name\": \"Austin Wilson\", \"order\": 41}, {\"cast_id\": 63, \"character\": \"Troupe\", \"credit_id\": \"52fe48019251416c750acad3\", \"gender\": 1, \"id\": 983705, \"name\": \"Sara Wilson\", \"order\": 42}, {\"cast_id\": 64, \"character\": \"Troupe\", \"credit_id\": \"52fe48019251416c750acad7\", \"gender\": 0, \"id\": 1207263, \"name\": \"Tamica Washington-Miller\", \"order\": 43}, {\"cast_id\": 65, \"character\": \"Op Center Staff\", \"credit_id\": \"52fe48019251416c750acadb\", \"gender\": 1, \"id\": 1145098, \"name\": \"Lucy Briant\", \"order\": 44}, {\"cast_id\": 66, \"character\": \"Op Center Staff\", \"credit_id\": \"52fe48019251416c750acadf\", \"gender\": 2, \"id\": 33305, \"name\": \"Nathan Meister\", \"order\": 45}, {\"cast_id\": 67, \"character\": \"Op Center Staff\", \"credit_id\": \"52fe48019251416c750acae3\", \"gender\": 0, \"id\": 1207264, \"name\": \"Gerry Blair\", \"order\": 46}, {\"cast_id\": 68, \"character\": \"Op Center Staff\", \"credit_id\": \"52fe48019251416c750acae7\", \"gender\": 2, \"id\": 33311, \"name\": \"Matthew Chamberlain\", \"order\": 47}, {\"cast_id\": 69, \"character\": \"Op Center Staff\", \"credit_id\": \"52fe48019251416c750acaeb\", \"gender\": 0, \"id\": 1207265, \"name\": \"Paul Yates\", \"order\": 48}, {\"cast_id\": 70, \"character\": \"Op Center Duty Officer\", \"credit_id\": \"52fe48019251416c750acaef\", \"gender\": 0, \"id\": 1207266, \"name\": \"Wray Wilson\", \"order\": 49}, {\"cast_id\": 71, \"character\": \"Op Center Staff\", \"credit_id\": \"52fe48019251416c750acaf3\", \"gender\": 2, \"id\": 54492, \"name\": \"James Gaylyn\", \"order\": 50}, {\"cast_id\": 72, \"character\": \"Dancer\", \"credit_id\": \"52fe48019251416c750acaf7\", \"gender\": 0, \"id\": 1207267, \"name\": \"Melvin Leno Clark III\", \"order\": 51}, {\"cast_id\": 73, \"character\": \"Dancer\", \"credit_id\": \"52fe48019251416c750acafb\", \"gender\": 0, \"id\": 1207268, \"name\": \"Carvon Futrell\", \"order\": 52}, {\"cast_id\": 74, \"character\": \"Dancer\", \"credit_id\": \"52fe48019251416c750acaff\", \"gender\": 0, \"id\": 1207269, \"name\": \"Brandon Jelkes\", \"order\": 53}, {\"cast_id\": 75, \"character\": \"Dancer\", \"credit_id\": \"52fe48019251416c750acb03\", \"gender\": 0, \"id\": 1207270, \"name\": \"Micah Moch\", \"order\": 54}, {\"cast_id\": 76, \"character\": \"Dancer\", \"credit_id\": \"52fe48019251416c750acb07\", \"gender\": 0, \"id\": 1207271, \"name\": \"Hanniyah Muhammad\", \"order\": 55}, {\"cast_id\": 77, \"character\": \"Dancer\", \"credit_id\": \"52fe48019251416c750acb0b\", \"gender\": 0, \"id\": 1207272, \"name\": \"Christopher Nolen\", \"order\": 56}, {\"cast_id\": 78, \"character\": \"Dancer\", \"credit_id\": \"52fe48019251416c750acb0f\", \"gender\": 0, \"id\": 1207273, \"name\": \"Christa Oliver\", \"order\": 57}, {\"cast_id\": 79, \"character\": \"Dancer\", \"credit_id\": \"52fe48019251416c750acb13\", \"gender\": 0, \"id\": 1207274, \"name\": \"April Marie Thomas\", \"order\": 58}, {\"cast_id\": 80, \"character\": \"Dancer\", \"credit_id\": \"52fe48019251416c750acb17\", \"gender\": 0, \"id\": 1207275, \"name\": \"Bravita A. Threatt\", \"order\": 59}, {\"cast_id\": 81, \"character\": \"Mining Chief (uncredited)\", \"credit_id\": \"52fe48019251416c750acb1b\", \"gender\": 0, \"id\": 1207276, \"name\": \"Colin Bleasdale\", \"order\": 60}, {\"cast_id\": 82, \"character\": \"Veteran Miner (uncredited)\", \"credit_id\": \"52fe48019251416c750acb1f\", \"gender\": 0, \"id\": 107969, \"name\": \"Mike Bodnar\", \"order\": 61}, {\"cast_id\": 83, \"character\": \"Richard (uncredited)\", \"credit_id\": \"52fe48019251416c750acb23\", \"gender\": 0, \"id\": 1207278, \"name\": \"Matt Clayton\", \"order\": 62}, {\"cast_id\": 84, \"character\": \"Nav\\'i (uncredited)\", \"credit_id\": \"52fe48019251416c750acb27\", \"gender\": 1, \"id\": 147898, \"name\": \"Nicole Dionne\", \"order\": 63}, {\"cast_id\": 85, \"character\": \"Trooper (uncredited)\", \"credit_id\": \"52fe48019251416c750acb2b\", \"gender\": 0, \"id\": 1207280, \"name\": \"Jamie Harrison\", \"order\": 64}, {\"cast_id\": 86, \"character\": \"Trooper (uncredited)\", \"credit_id\": \"52fe48019251416c750acb2f\", \"gender\": 0, \"id\": 1207281, \"name\": \"Allan Henry\", \"order\": 65}, {\"cast_id\": 87, \"character\": \"Ground Technician (uncredited)\", \"credit_id\": \"52fe48019251416c750acb33\", \"gender\": 2, \"id\": 1207282, \"name\": \"Anthony Ingruber\", \"order\": 66}, {\"cast_id\": 88, \"character\": \"Flight Crew Mechanic (uncredited)\", \"credit_id\": \"52fe48019251416c750acb37\", \"gender\": 0, \"id\": 1207283, \"name\": \"Ashley Jeffery\", \"order\": 67}, {\"cast_id\": 14, \"character\": \"Samson Pilot\", \"credit_id\": \"52fe48009251416c750ac9f9\", \"gender\": 0, \"id\": 98216, \"name\": \"Dean Knowsley\", \"order\": 68}, {\"cast_id\": 89, \"character\": \"Trooper (uncredited)\", \"credit_id\": \"52fe48019251416c750acb3b\", \"gender\": 0, \"id\": 1201399, \"name\": \"Joseph Mika-Hunt\", \"order\": 69}, {\"cast_id\": 90, \"character\": \"Banshee (uncredited)\", \"credit_id\": \"52fe48019251416c750acb3f\", \"gender\": 0, \"id\": 236696, \"name\": \"Terry Notary\", \"order\": 70}, {\"cast_id\": 91, \"character\": \"Soldier (uncredited)\", \"credit_id\": \"52fe48019251416c750acb43\", \"gender\": 0, \"id\": 1207287, \"name\": \"Kai Pantano\", \"order\": 71}, {\"cast_id\": 92, \"character\": \"Blast Technician (uncredited)\", \"credit_id\": \"52fe48019251416c750acb47\", \"gender\": 0, \"id\": 1207288, \"name\": \"Logan Pithyou\", \"order\": 72}, {\"cast_id\": 93, \"character\": \"Vindum Raah (uncredited)\", \"credit_id\": \"52fe48019251416c750acb4b\", \"gender\": 0, \"id\": 1207289, \"name\": \"Stuart Pollock\", \"order\": 73}, {\"cast_id\": 94, \"character\": \"Hero (uncredited)\", \"credit_id\": \"52fe48019251416c750acb4f\", \"gender\": 0, \"id\": 584868, \"name\": \"Raja\", \"order\": 74}, {\"cast_id\": 95, \"character\": \"Ops Centreworker (uncredited)\", \"credit_id\": \"52fe48019251416c750acb53\", \"gender\": 0, \"id\": 1207290, \"name\": \"Gareth Ruck\", \"order\": 75}, {\"cast_id\": 96, \"character\": \"Engineer (uncredited)\", \"credit_id\": \"52fe48019251416c750acb57\", \"gender\": 0, \"id\": 1062463, \"name\": \"Rhian Sheehan\", \"order\": 76}, {\"cast_id\": 97, \"character\": \"Col. Quaritch\\'s Mech Suit (uncredited)\", \"credit_id\": \"52fe48019251416c750acb5b\", \"gender\": 0, \"id\": 60656, \"name\": \"T. J. Storm\", \"order\": 77}, {\"cast_id\": 98, \"character\": \"Female Marine (uncredited)\", \"credit_id\": \"52fe48019251416c750acb5f\", \"gender\": 0, \"id\": 1207291, \"name\": \"Jodie Taylor\", \"order\": 78}, {\"cast_id\": 99, \"character\": \"Ikran Clan Leader (uncredited)\", \"credit_id\": \"52fe48019251416c750acb63\", \"gender\": 1, \"id\": 1186027, \"name\": \"Alicia Vela-Bailey\", \"order\": 79}, {\"cast_id\": 100, \"character\": \"Geologist (uncredited)\", \"credit_id\": \"52fe48019251416c750acb67\", \"gender\": 0, \"id\": 1207292, \"name\": \"Richard Whiteside\", \"order\": 80}, {\"cast_id\": 101, \"character\": \"Na\\'vi (uncredited)\", \"credit_id\": \"52fe48019251416c750acb6b\", \"gender\": 0, \"id\": 103259, \"name\": \"Nikie Zambo\", \"order\": 81}, {\"cast_id\": 102, \"character\": \"Ambient Room Tech / Troupe\", \"credit_id\": \"52fe48019251416c750acb6f\", \"gender\": 1, \"id\": 42286, \"name\": \"Julene Renee\", \"order\": 82}]'"
            ],
            "application/vnd.google.colaboratory.intrinsic+json": {
              "type": "string"
            }
          },
          "metadata": {},
          "execution_count": 34
        }
      ]
    },
    {
      "cell_type": "markdown",
      "source": [
        "Preprocessing of the cast column is the same as genres column. But in this particular case, we are interested in only the names of the first three cast members. To achieve this, we iterate over the list of cast member dictionaries, appending the names to a list until we have extracted the first three names. This limitation ensures that we consider only the top three cast members.  "
      ],
      "metadata": {
        "id": "yUNuxwWLzyqG"
      }
    },
    {
      "cell_type": "code",
      "source": [
        "def convert_cast(obj):\n",
        "  L=[]\n",
        "  counter = 0\n",
        "  for i in ast.literal_eval(obj):\n",
        "    if counter != 3:\n",
        "      L.append(i['name'])\n",
        "      counter +=1\n",
        "    else:\n",
        "      break\n",
        "  return L"
      ],
      "metadata": {
        "id": "ydLsyzi0oLn9"
      },
      "execution_count": null,
      "outputs": []
    },
    {
      "cell_type": "code",
      "source": [
        "convert_cast(movie.iloc[0].cast)"
      ],
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "PhQ-KK94pkV9",
        "outputId": "47e56888-0a37-411d-d94e-2c79624d8ff1"
      },
      "execution_count": null,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/plain": [
              "['Sam Worthington', 'Zoe Saldana', 'Sigourney Weaver']"
            ]
          },
          "metadata": {},
          "execution_count": 38
        }
      ]
    },
    {
      "cell_type": "code",
      "source": [
        "movie['cast'] = movie['cast'].apply(convert_cast)"
      ],
      "metadata": {
        "id": "MmIE-uiQpzrc"
      },
      "execution_count": null,
      "outputs": []
    },
    {
      "cell_type": "code",
      "source": [
        "movie.head(3)"
      ],
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 344
        },
        "id": "AgHruB2YqEFc",
        "outputId": "4539d88c-b5f5-4996-91f7-de70496fa184"
      },
      "execution_count": null,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/plain": [
              "   movie_id                                     title  \\\n",
              "0     19995                                    Avatar   \n",
              "1       285  Pirates of the Caribbean: At World's End   \n",
              "2    206647                                   Spectre   \n",
              "\n",
              "                                            overview  \\\n",
              "0  In the 22nd century, a paraplegic Marine is di...   \n",
              "1  Captain Barbossa, long believed to be dead, ha...   \n",
              "2  A cryptic message from Bond’s past sends him o...   \n",
              "\n",
              "                                          genres  \\\n",
              "0  [Action, Adventure, Fantasy, Science Fiction]   \n",
              "1                   [Adventure, Fantasy, Action]   \n",
              "2                     [Action, Adventure, Crime]   \n",
              "\n",
              "                                            keywords  \\\n",
              "0  [culture clash, future, space war, space colon...   \n",
              "1  [ocean, drug abuse, exotic island, east india ...   \n",
              "2  [spy, based on novel, secret agent, sequel, mi...   \n",
              "\n",
              "                                               cast  \\\n",
              "0  [Sam Worthington, Zoe Saldana, Sigourney Weaver]   \n",
              "1     [Johnny Depp, Orlando Bloom, Keira Knightley]   \n",
              "2      [Daniel Craig, Christoph Waltz, Léa Seydoux]   \n",
              "\n",
              "                                                crew  \n",
              "0  [{\"credit_id\": \"52fe48009251416c750aca23\", \"de...  \n",
              "1  [{\"credit_id\": \"52fe4232c3a36847f800b579\", \"de...  \n",
              "2  [{\"credit_id\": \"54805967c3a36829b5002c41\", \"de...  "
            ],
            "text/html": [
              "\n",
              "  <div id=\"df-7491b9ff-86bb-464c-bc41-abd41b1c55b8\">\n",
              "    <div class=\"colab-df-container\">\n",
              "      <div>\n",
              "<style scoped>\n",
              "    .dataframe tbody tr th:only-of-type {\n",
              "        vertical-align: middle;\n",
              "    }\n",
              "\n",
              "    .dataframe tbody tr th {\n",
              "        vertical-align: top;\n",
              "    }\n",
              "\n",
              "    .dataframe thead th {\n",
              "        text-align: right;\n",
              "    }\n",
              "</style>\n",
              "<table border=\"1\" class=\"dataframe\">\n",
              "  <thead>\n",
              "    <tr style=\"text-align: right;\">\n",
              "      <th></th>\n",
              "      <th>movie_id</th>\n",
              "      <th>title</th>\n",
              "      <th>overview</th>\n",
              "      <th>genres</th>\n",
              "      <th>keywords</th>\n",
              "      <th>cast</th>\n",
              "      <th>crew</th>\n",
              "    </tr>\n",
              "  </thead>\n",
              "  <tbody>\n",
              "    <tr>\n",
              "      <th>0</th>\n",
              "      <td>19995</td>\n",
              "      <td>Avatar</td>\n",
              "      <td>In the 22nd century, a paraplegic Marine is di...</td>\n",
              "      <td>[Action, Adventure, Fantasy, Science Fiction]</td>\n",
              "      <td>[culture clash, future, space war, space colon...</td>\n",
              "      <td>[Sam Worthington, Zoe Saldana, Sigourney Weaver]</td>\n",
              "      <td>[{\"credit_id\": \"52fe48009251416c750aca23\", \"de...</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>1</th>\n",
              "      <td>285</td>\n",
              "      <td>Pirates of the Caribbean: At World's End</td>\n",
              "      <td>Captain Barbossa, long believed to be dead, ha...</td>\n",
              "      <td>[Adventure, Fantasy, Action]</td>\n",
              "      <td>[ocean, drug abuse, exotic island, east india ...</td>\n",
              "      <td>[Johnny Depp, Orlando Bloom, Keira Knightley]</td>\n",
              "      <td>[{\"credit_id\": \"52fe4232c3a36847f800b579\", \"de...</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>2</th>\n",
              "      <td>206647</td>\n",
              "      <td>Spectre</td>\n",
              "      <td>A cryptic message from Bond’s past sends him o...</td>\n",
              "      <td>[Action, Adventure, Crime]</td>\n",
              "      <td>[spy, based on novel, secret agent, sequel, mi...</td>\n",
              "      <td>[Daniel Craig, Christoph Waltz, Léa Seydoux]</td>\n",
              "      <td>[{\"credit_id\": \"54805967c3a36829b5002c41\", \"de...</td>\n",
              "    </tr>\n",
              "  </tbody>\n",
              "</table>\n",
              "</div>\n",
              "      <button class=\"colab-df-convert\" onclick=\"convertToInteractive('df-7491b9ff-86bb-464c-bc41-abd41b1c55b8')\"\n",
              "              title=\"Convert this dataframe to an interactive table.\"\n",
              "              style=\"display:none;\">\n",
              "        \n",
              "  <svg xmlns=\"http://www.w3.org/2000/svg\" height=\"24px\"viewBox=\"0 0 24 24\"\n",
              "       width=\"24px\">\n",
              "    <path d=\"M0 0h24v24H0V0z\" fill=\"none\"/>\n",
              "    <path d=\"M18.56 5.44l.94 2.06.94-2.06 2.06-.94-2.06-.94-.94-2.06-.94 2.06-2.06.94zm-11 1L8.5 8.5l.94-2.06 2.06-.94-2.06-.94L8.5 2.5l-.94 2.06-2.06.94zm10 10l.94 2.06.94-2.06 2.06-.94-2.06-.94-.94-2.06-.94 2.06-2.06.94z\"/><path d=\"M17.41 7.96l-1.37-1.37c-.4-.4-.92-.59-1.43-.59-.52 0-1.04.2-1.43.59L10.3 9.45l-7.72 7.72c-.78.78-.78 2.05 0 2.83L4 21.41c.39.39.9.59 1.41.59.51 0 1.02-.2 1.41-.59l7.78-7.78 2.81-2.81c.8-.78.8-2.07 0-2.86zM5.41 20L4 18.59l7.72-7.72 1.47 1.35L5.41 20z\"/>\n",
              "  </svg>\n",
              "      </button>\n",
              "      \n",
              "  <style>\n",
              "    .colab-df-container {\n",
              "      display:flex;\n",
              "      flex-wrap:wrap;\n",
              "      gap: 12px;\n",
              "    }\n",
              "\n",
              "    .colab-df-convert {\n",
              "      background-color: #E8F0FE;\n",
              "      border: none;\n",
              "      border-radius: 50%;\n",
              "      cursor: pointer;\n",
              "      display: none;\n",
              "      fill: #1967D2;\n",
              "      height: 32px;\n",
              "      padding: 0 0 0 0;\n",
              "      width: 32px;\n",
              "    }\n",
              "\n",
              "    .colab-df-convert:hover {\n",
              "      background-color: #E2EBFA;\n",
              "      box-shadow: 0px 1px 2px rgba(60, 64, 67, 0.3), 0px 1px 3px 1px rgba(60, 64, 67, 0.15);\n",
              "      fill: #174EA6;\n",
              "    }\n",
              "\n",
              "    [theme=dark] .colab-df-convert {\n",
              "      background-color: #3B4455;\n",
              "      fill: #D2E3FC;\n",
              "    }\n",
              "\n",
              "    [theme=dark] .colab-df-convert:hover {\n",
              "      background-color: #434B5C;\n",
              "      box-shadow: 0px 1px 3px 1px rgba(0, 0, 0, 0.15);\n",
              "      filter: drop-shadow(0px 1px 2px rgba(0, 0, 0, 0.3));\n",
              "      fill: #FFFFFF;\n",
              "    }\n",
              "  </style>\n",
              "\n",
              "      <script>\n",
              "        const buttonEl =\n",
              "          document.querySelector('#df-7491b9ff-86bb-464c-bc41-abd41b1c55b8 button.colab-df-convert');\n",
              "        buttonEl.style.display =\n",
              "          google.colab.kernel.accessAllowed ? 'block' : 'none';\n",
              "\n",
              "        async function convertToInteractive(key) {\n",
              "          const element = document.querySelector('#df-7491b9ff-86bb-464c-bc41-abd41b1c55b8');\n",
              "          const dataTable =\n",
              "            await google.colab.kernel.invokeFunction('convertToInteractive',\n",
              "                                                     [key], {});\n",
              "          if (!dataTable) return;\n",
              "\n",
              "          const docLinkHtml = 'Like what you see? Visit the ' +\n",
              "            '<a target=\"_blank\" href=https://colab.research.google.com/notebooks/data_table.ipynb>data table notebook</a>'\n",
              "            + ' to learn more about interactive tables.';\n",
              "          element.innerHTML = '';\n",
              "          dataTable['output_type'] = 'display_data';\n",
              "          await google.colab.output.renderOutput(dataTable, element);\n",
              "          const docLink = document.createElement('div');\n",
              "          docLink.innerHTML = docLinkHtml;\n",
              "          element.appendChild(docLink);\n",
              "        }\n",
              "      </script>\n",
              "    </div>\n",
              "  </div>\n",
              "  "
            ]
          },
          "metadata": {},
          "execution_count": 41
        }
      ]
    },
    {
      "cell_type": "code",
      "source": [
        "movie['crew'][0]"
      ],
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 174
        },
        "id": "wL-HfrWoqIR8",
        "outputId": "5583f140-388c-4728-bab4-3f61a1d6546b"
      },
      "execution_count": null,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/plain": [
              "'[{\"credit_id\": \"52fe48009251416c750aca23\", \"department\": \"Editing\", \"gender\": 0, \"id\": 1721, \"job\": \"Editor\", \"name\": \"Stephen E. Rivkin\"}, {\"credit_id\": \"539c47ecc3a36810e3001f87\", \"department\": \"Art\", \"gender\": 2, \"id\": 496, \"job\": \"Production Design\", \"name\": \"Rick Carter\"}, {\"credit_id\": \"54491c89c3a3680fb4001cf7\", \"department\": \"Sound\", \"gender\": 0, \"id\": 900, \"job\": \"Sound Designer\", \"name\": \"Christopher Boyes\"}, {\"credit_id\": \"54491cb70e0a267480001bd0\", \"department\": \"Sound\", \"gender\": 0, \"id\": 900, \"job\": \"Supervising Sound Editor\", \"name\": \"Christopher Boyes\"}, {\"credit_id\": \"539c4a4cc3a36810c9002101\", \"department\": \"Production\", \"gender\": 1, \"id\": 1262, \"job\": \"Casting\", \"name\": \"Mali Finn\"}, {\"credit_id\": \"5544ee3b925141499f0008fc\", \"department\": \"Sound\", \"gender\": 2, \"id\": 1729, \"job\": \"Original Music Composer\", \"name\": \"James Horner\"}, {\"credit_id\": \"52fe48009251416c750ac9c3\", \"department\": \"Directing\", \"gender\": 2, \"id\": 2710, \"job\": \"Director\", \"name\": \"James Cameron\"}, {\"credit_id\": \"52fe48009251416c750ac9d9\", \"department\": \"Writing\", \"gender\": 2, \"id\": 2710, \"job\": \"Writer\", \"name\": \"James Cameron\"}, {\"credit_id\": \"52fe48009251416c750aca17\", \"department\": \"Editing\", \"gender\": 2, \"id\": 2710, \"job\": \"Editor\", \"name\": \"James Cameron\"}, {\"credit_id\": \"52fe48009251416c750aca29\", \"department\": \"Production\", \"gender\": 2, \"id\": 2710, \"job\": \"Producer\", \"name\": \"James Cameron\"}, {\"credit_id\": \"52fe48009251416c750aca3f\", \"department\": \"Writing\", \"gender\": 2, \"id\": 2710, \"job\": \"Screenplay\", \"name\": \"James Cameron\"}, {\"credit_id\": \"539c4987c3a36810ba0021a4\", \"department\": \"Art\", \"gender\": 2, \"id\": 7236, \"job\": \"Art Direction\", \"name\": \"Andrew Menzies\"}, {\"credit_id\": \"549598c3c3a3686ae9004383\", \"department\": \"Visual Effects\", \"gender\": 0, \"id\": 6690, \"job\": \"Visual Effects Producer\", \"name\": \"Jill Brooks\"}, {\"credit_id\": \"52fe48009251416c750aca4b\", \"department\": \"Production\", \"gender\": 1, \"id\": 6347, \"job\": \"Casting\", \"name\": \"Margery Simkin\"}, {\"credit_id\": \"570b6f419251417da70032fe\", \"department\": \"Art\", \"gender\": 2, \"id\": 6878, \"job\": \"Supervising Art Director\", \"name\": \"Kevin Ishioka\"}, {\"credit_id\": \"5495a0fac3a3686ae9004468\", \"department\": \"Sound\", \"gender\": 0, \"id\": 6883, \"job\": \"Music Editor\", \"name\": \"Dick Bernstein\"}, {\"credit_id\": \"54959706c3a3686af3003e81\", \"department\": \"Sound\", \"gender\": 0, \"id\": 8159, \"job\": \"Sound Effects Editor\", \"name\": \"Shannon Mills\"}, {\"credit_id\": \"54491d58c3a3680fb1001ccb\", \"department\": \"Sound\", \"gender\": 0, \"id\": 8160, \"job\": \"Foley\", \"name\": \"Dennie Thorpe\"}, {\"credit_id\": \"54491d6cc3a3680fa5001b2c\", \"department\": \"Sound\", \"gender\": 0, \"id\": 8163, \"job\": \"Foley\", \"name\": \"Jana Vance\"}, {\"credit_id\": \"52fe48009251416c750aca57\", \"department\": \"Costume & Make-Up\", \"gender\": 1, \"id\": 8527, \"job\": \"Costume Design\", \"name\": \"Deborah Lynn Scott\"}, {\"credit_id\": \"52fe48009251416c750aca2f\", \"department\": \"Production\", \"gender\": 2, \"id\": 8529, \"job\": \"Producer\", \"name\": \"Jon Landau\"}, {\"credit_id\": \"539c4937c3a36810ba002194\", \"department\": \"Art\", \"gender\": 0, \"id\": 9618, \"job\": \"Art Direction\", \"name\": \"Sean Haworth\"}, {\"credit_id\": \"539c49b6c3a36810c10020e6\", \"department\": \"Art\", \"gender\": 1, \"id\": 12653, \"job\": \"Set Decoration\", \"name\": \"Kim Sinclair\"}, {\"credit_id\": \"570b6f2f9251413a0e00020d\", \"department\": \"Art\", \"gender\": 1, \"id\": 12653, \"job\": \"Supervising Art Director\", \"name\": \"Kim Sinclair\"}, {\"credit_id\": \"54491a6c0e0a26748c001b19\", \"department\": \"Art\", \"gender\": 2, \"id\": 14350, \"job\": \"Set Designer\", \"name\": \"Richard F. Mays\"}, {\"credit_id\": \"56928cf4c3a3684cff0025c4\", \"department\": \"Production\", \"gender\": 1, \"id\": 20294, \"job\": \"Executive Producer\", \"name\": \"Laeta Kalogridis\"}, {\"credit_id\": \"52fe48009251416c750aca51\", \"department\": \"Costume & Make-Up\", \"gender\": 0, \"id\": 17675, \"job\": \"Costume Design\", \"name\": \"Mayes C. Rubeo\"}, {\"credit_id\": \"52fe48009251416c750aca11\", \"department\": \"Camera\", \"gender\": 2, \"id\": 18265, \"job\": \"Director of Photography\", \"name\": \"Mauro Fiore\"}, {\"credit_id\": \"5449194d0e0a26748f001b39\", \"department\": \"Art\", \"gender\": 0, \"id\": 42281, \"job\": \"Set Designer\", \"name\": \"Scott Herbertson\"}, {\"credit_id\": \"52fe48009251416c750aca05\", \"department\": \"Crew\", \"gender\": 0, \"id\": 42288, \"job\": \"Stunts\", \"name\": \"Woody Schultz\"}, {\"credit_id\": \"5592aefb92514152de0010f5\", \"department\": \"Costume & Make-Up\", \"gender\": 0, \"id\": 29067, \"job\": \"Makeup Artist\", \"name\": \"Linda DeVetta\"}, {\"credit_id\": \"5592afa492514152de00112c\", \"department\": \"Costume & Make-Up\", \"gender\": 0, \"id\": 29067, \"job\": \"Hairstylist\", \"name\": \"Linda DeVetta\"}, {\"credit_id\": \"54959ed592514130fc002e5d\", \"department\": \"Camera\", \"gender\": 2, \"id\": 33302, \"job\": \"Camera Operator\", \"name\": \"Richard Bluck\"}, {\"credit_id\": \"539c4891c3a36810ba002147\", \"department\": \"Art\", \"gender\": 2, \"id\": 33303, \"job\": \"Art Direction\", \"name\": \"Simon Bright\"}, {\"credit_id\": \"54959c069251417a81001f3a\", \"department\": \"Visual Effects\", \"gender\": 0, \"id\": 113145, \"job\": \"Visual Effects Supervisor\", \"name\": \"Richard Martin\"}, {\"credit_id\": \"54959a0dc3a3680ff5002c8d\", \"department\": \"Crew\", \"gender\": 2, \"id\": 58188, \"job\": \"Visual Effects Editor\", \"name\": \"Steve R. Moore\"}, {\"credit_id\": \"52fe48009251416c750aca1d\", \"department\": \"Editing\", \"gender\": 2, \"id\": 58871, \"job\": \"Editor\", \"name\": \"John Refoua\"}, {\"credit_id\": \"54491a4dc3a3680fc30018ca\", \"department\": \"Art\", \"gender\": 0, \"id\": 92359, \"job\": \"Set Designer\", \"name\": \"Karl J. Martin\"}, {\"credit_id\": \"52fe48009251416c750aca35\", \"department\": \"Camera\", \"gender\": 1, \"id\": 72201, \"job\": \"Director of Photography\", \"name\": \"Chiling Lin\"}, {\"credit_id\": \"52fe48009251416c750ac9ff\", \"department\": \"Crew\", \"gender\": 0, \"id\": 89714, \"job\": \"Stunts\", \"name\": \"Ilram Choi\"}, {\"credit_id\": \"54959c529251416e2b004394\", \"department\": \"Visual Effects\", \"gender\": 2, \"id\": 93214, \"job\": \"Visual Effects Supervisor\", \"name\": \"Steven Quale\"}, {\"credit_id\": \"54491edf0e0a267489001c37\", \"department\": \"Crew\", \"gender\": 1, \"id\": 122607, \"job\": \"Dialect Coach\", \"name\": \"Carla Meyer\"}, {\"credit_id\": \"539c485bc3a368653d001a3a\", \"department\": \"Art\", \"gender\": 2, \"id\": 132585, \"job\": \"Art Direction\", \"name\": \"Nick Bassett\"}, {\"credit_id\": \"539c4903c3a368653d001a74\", \"department\": \"Art\", \"gender\": 0, \"id\": 132596, \"job\": \"Art Direction\", \"name\": \"Jill Cormack\"}, {\"credit_id\": \"539c4967c3a368653d001a94\", \"department\": \"Art\", \"gender\": 0, \"id\": 132604, \"job\": \"Art Direction\", \"name\": \"Andy McLaren\"}, {\"credit_id\": \"52fe48009251416c750aca45\", \"department\": \"Crew\", \"gender\": 0, \"id\": 236696, \"job\": \"Motion Capture Artist\", \"name\": \"Terry Notary\"}, {\"credit_id\": \"54959e02c3a3680fc60027d2\", \"department\": \"Crew\", \"gender\": 2, \"id\": 956198, \"job\": \"Stunt Coordinator\", \"name\": \"Garrett Warren\"}, {\"credit_id\": \"54959ca3c3a3686ae300438c\", \"department\": \"Visual Effects\", \"gender\": 2, \"id\": 957874, \"job\": \"Visual Effects Supervisor\", \"name\": \"Jonathan Rothbart\"}, {\"credit_id\": \"570b6f519251412c74001b2f\", \"department\": \"Art\", \"gender\": 0, \"id\": 957889, \"job\": \"Supervising Art Director\", \"name\": \"Stefan Dechant\"}, {\"credit_id\": \"570b6f62c3a3680b77007460\", \"department\": \"Art\", \"gender\": 2, \"id\": 959555, \"job\": \"Supervising Art Director\", \"name\": \"Todd Cherniawsky\"}, {\"credit_id\": \"539c4a3ac3a36810da0021cc\", \"department\": \"Production\", \"gender\": 0, \"id\": 1016177, \"job\": \"Casting\", \"name\": \"Miranda Rivers\"}, {\"credit_id\": \"539c482cc3a36810c1002062\", \"department\": \"Art\", \"gender\": 0, \"id\": 1032536, \"job\": \"Production Design\", \"name\": \"Robert Stromberg\"}, {\"credit_id\": \"539c4b65c3a36810c9002125\", \"department\": \"Costume & Make-Up\", \"gender\": 2, \"id\": 1071680, \"job\": \"Costume Design\", \"name\": \"John Harding\"}, {\"credit_id\": \"54959e6692514130fc002e4e\", \"department\": \"Camera\", \"gender\": 0, \"id\": 1177364, \"job\": \"Steadicam Operator\", \"name\": \"Roberto De Angelis\"}, {\"credit_id\": \"539c49f1c3a368653d001aac\", \"department\": \"Costume & Make-Up\", \"gender\": 2, \"id\": 1202850, \"job\": \"Makeup Department Head\", \"name\": \"Mike Smithson\"}, {\"credit_id\": \"5495999ec3a3686ae100460c\", \"department\": \"Visual Effects\", \"gender\": 0, \"id\": 1204668, \"job\": \"Visual Effects Producer\", \"name\": \"Alain Lalanne\"}, {\"credit_id\": \"54959cdfc3a3681153002729\", \"department\": \"Visual Effects\", \"gender\": 0, \"id\": 1206410, \"job\": \"Visual Effects Supervisor\", \"name\": \"Lucas Salton\"}, {\"credit_id\": \"549596239251417a81001eae\", \"department\": \"Crew\", \"gender\": 0, \"id\": 1234266, \"job\": \"Post Production Supervisor\", \"name\": \"Janace Tashjian\"}, {\"credit_id\": \"54959c859251416e1e003efe\", \"department\": \"Visual Effects\", \"gender\": 0, \"id\": 1271932, \"job\": \"Visual Effects Supervisor\", \"name\": \"Stephen Rosenbaum\"}, {\"credit_id\": \"5592af28c3a368775a00105f\", \"department\": \"Costume & Make-Up\", \"gender\": 0, \"id\": 1310064, \"job\": \"Makeup Artist\", \"name\": \"Frankie Karena\"}, {\"credit_id\": \"539c4adfc3a36810e300203b\", \"department\": \"Costume & Make-Up\", \"gender\": 1, \"id\": 1319844, \"job\": \"Costume Supervisor\", \"name\": \"Lisa Lovaas\"}, {\"credit_id\": \"54959b579251416e2b004371\", \"department\": \"Visual Effects\", \"gender\": 0, \"id\": 1327028, \"job\": \"Visual Effects Supervisor\", \"name\": \"Jonathan Fawkner\"}, {\"credit_id\": \"539c48a7c3a36810b5001fa7\", \"department\": \"Art\", \"gender\": 0, \"id\": 1330561, \"job\": \"Art Direction\", \"name\": \"Robert Bavin\"}, {\"credit_id\": \"539c4a71c3a36810da0021e0\", \"department\": \"Costume & Make-Up\", \"gender\": 0, \"id\": 1330567, \"job\": \"Costume Supervisor\", \"name\": \"Anthony Almaraz\"}, {\"credit_id\": \"539c4a8ac3a36810ba0021e4\", \"department\": \"Costume & Make-Up\", \"gender\": 0, \"id\": 1330570, \"job\": \"Costume Supervisor\", \"name\": \"Carolyn M. Fenton\"}, {\"credit_id\": \"539c4ab6c3a36810da0021f0\", \"department\": \"Costume & Make-Up\", \"gender\": 0, \"id\": 1330574, \"job\": \"Costume Supervisor\", \"name\": \"Beth Koenigsberg\"}, {\"credit_id\": \"54491ab70e0a267480001ba2\", \"department\": \"Art\", \"gender\": 0, \"id\": 1336191, \"job\": \"Set Designer\", \"name\": \"Sam Page\"}, {\"credit_id\": \"544919d9c3a3680fc30018bd\", \"department\": \"Art\", \"gender\": 0, \"id\": 1339441, \"job\": \"Set Designer\", \"name\": \"Tex Kadonaga\"}, {\"credit_id\": \"54491cf50e0a267483001b0c\", \"department\": \"Editing\", \"gender\": 0, \"id\": 1352422, \"job\": \"Dialogue Editor\", \"name\": \"Kim Foscato\"}, {\"credit_id\": \"544919f40e0a26748c001b09\", \"department\": \"Art\", \"gender\": 0, \"id\": 1352962, \"job\": \"Set Designer\", \"name\": \"Tammy S. Lee\"}, {\"credit_id\": \"5495a115c3a3680ff5002d71\", \"department\": \"Crew\", \"gender\": 0, \"id\": 1357070, \"job\": \"Transportation Coordinator\", \"name\": \"Denny Caira\"}, {\"credit_id\": \"5495a12f92514130fc002e94\", \"department\": \"Crew\", \"gender\": 0, \"id\": 1357071, \"job\": \"Transportation Coordinator\", \"name\": \"James Waitkus\"}, {\"credit_id\": \"5495976fc3a36811530026b0\", \"department\": \"Sound\", \"gender\": 0, \"id\": 1360103, \"job\": \"Supervising Sound Editor\", \"name\": \"Addison Teague\"}, {\"credit_id\": \"54491837c3a3680fb1001c5a\", \"department\": \"Art\", \"gender\": 2, \"id\": 1376887, \"job\": \"Set Designer\", \"name\": \"C. Scott Baker\"}, {\"credit_id\": \"54491878c3a3680fb4001c9d\", \"department\": \"Art\", \"gender\": 0, \"id\": 1376888, \"job\": \"Set Designer\", \"name\": \"Luke Caska\"}, {\"credit_id\": \"544918dac3a3680fa5001ae0\", \"department\": \"Art\", \"gender\": 0, \"id\": 1376889, \"job\": \"Set Designer\", \"name\": \"David Chow\"}, {\"credit_id\": \"544919110e0a267486001b68\", \"department\": \"Art\", \"gender\": 0, \"id\": 1376890, \"job\": \"Set Designer\", \"name\": \"Jonathan Dyer\"}, {\"credit_id\": \"54491967c3a3680faa001b5e\", \"department\": \"Art\", \"gender\": 0, \"id\": 1376891, \"job\": \"Set Designer\", \"name\": \"Joseph Hiura\"}, {\"credit_id\": \"54491997c3a3680fb1001c8a\", \"department\": \"Art\", \"gender\": 0, \"id\": 1376892, \"job\": \"Art Department Coordinator\", \"name\": \"Rebecca Jellie\"}, {\"credit_id\": \"544919ba0e0a26748f001b42\", \"department\": \"Art\", \"gender\": 0, \"id\": 1376893, \"job\": \"Set Designer\", \"name\": \"Robert Andrew Johnson\"}, {\"credit_id\": \"54491b1dc3a3680faa001b8c\", \"department\": \"Art\", \"gender\": 0, \"id\": 1376895, \"job\": \"Assistant Art Director\", \"name\": \"Mike Stassi\"}, {\"credit_id\": \"54491b79c3a3680fbb001826\", \"department\": \"Art\", \"gender\": 0, \"id\": 1376897, \"job\": \"Construction Coordinator\", \"name\": \"John Villarino\"}, {\"credit_id\": \"54491baec3a3680fb4001ce6\", \"department\": \"Art\", \"gender\": 2, \"id\": 1376898, \"job\": \"Assistant Art Director\", \"name\": \"Jeffrey Wisniewski\"}, {\"credit_id\": \"54491d2fc3a3680fb4001d07\", \"department\": \"Editing\", \"gender\": 0, \"id\": 1376899, \"job\": \"Dialogue Editor\", \"name\": \"Cheryl Nardi\"}, {\"credit_id\": \"54491d86c3a3680fa5001b2f\", \"department\": \"Editing\", \"gender\": 0, \"id\": 1376901, \"job\": \"Dialogue Editor\", \"name\": \"Marshall Winn\"}, {\"credit_id\": \"54491d9dc3a3680faa001bb0\", \"department\": \"Sound\", \"gender\": 0, \"id\": 1376902, \"job\": \"Supervising Sound Editor\", \"name\": \"Gwendolyn Yates Whittle\"}, {\"credit_id\": \"54491dc10e0a267486001bce\", \"department\": \"Sound\", \"gender\": 0, \"id\": 1376903, \"job\": \"Sound Re-Recording Mixer\", \"name\": \"William Stein\"}, {\"credit_id\": \"54491f500e0a26747c001c07\", \"department\": \"Crew\", \"gender\": 0, \"id\": 1376909, \"job\": \"Choreographer\", \"name\": \"Lula Washington\"}, {\"credit_id\": \"549599239251412c4e002a2e\", \"department\": \"Visual Effects\", \"gender\": 0, \"id\": 1391692, \"job\": \"Visual Effects Producer\", \"name\": \"Chris Del Conte\"}, {\"credit_id\": \"54959d54c3a36831b8001d9a\", \"department\": \"Visual Effects\", \"gender\": 2, \"id\": 1391695, \"job\": \"Visual Effects Supervisor\", \"name\": \"R. Christopher White\"}, {\"credit_id\": \"54959bdf9251412c4e002a66\", \"department\": \"Visual Effects\", \"gender\": 0, \"id\": 1394070, \"job\": \"Visual Effects Supervisor\", \"name\": \"Dan Lemmon\"}, {\"credit_id\": \"5495971d92514132ed002922\", \"department\": \"Sound\", \"gender\": 0, \"id\": 1394129, \"job\": \"Sound Effects Editor\", \"name\": \"Tim Nielsen\"}, {\"credit_id\": \"5592b25792514152cc0011aa\", \"department\": \"Crew\", \"gender\": 0, \"id\": 1394286, \"job\": \"CG Supervisor\", \"name\": \"Michael Mulholland\"}, {\"credit_id\": \"54959a329251416e2b004355\", \"department\": \"Crew\", \"gender\": 0, \"id\": 1394750, \"job\": \"Visual Effects Editor\", \"name\": \"Thomas Nittmann\"}, {\"credit_id\": \"54959d6dc3a3686ae9004401\", \"department\": \"Visual Effects\", \"gender\": 0, \"id\": 1394755, \"job\": \"Visual Effects Supervisor\", \"name\": \"Edson Williams\"}, {\"credit_id\": \"5495a08fc3a3686ae300441c\", \"department\": \"Editing\", \"gender\": 0, \"id\": 1394953, \"job\": \"Digital Intermediate\", \"name\": \"Christine Carr\"}, {\"credit_id\": \"55402d659251413d6d000249\", \"department\": \"Visual Effects\", \"gender\": 0, \"id\": 1395269, \"job\": \"Visual Effects Supervisor\", \"name\": \"John Bruno\"}, {\"credit_id\": \"54959e7b9251416e1e003f3e\", \"department\": \"Camera\", \"gender\": 0, \"id\": 1398970, \"job\": \"Steadicam Operator\", \"name\": \"David Emmerichs\"}, {\"credit_id\": \"54959734c3a3686ae10045e0\", \"department\": \"Sound\", \"gender\": 0, \"id\": 1400906, \"job\": \"Sound Effects Editor\", \"name\": \"Christopher Scarabosio\"}, {\"credit_id\": \"549595dd92514130fc002d79\", \"department\": \"Production\", \"gender\": 0, \"id\": 1401784, \"job\": \"Production Supervisor\", \"name\": \"Jennifer Teves\"}, {\"credit_id\": \"549596009251413af70028cc\", \"department\": \"Production\", \"gender\": 0, \"id\": 1401785, \"job\": \"Production Manager\", \"name\": \"Brigitte Yorke\"}, {\"credit_id\": \"549596e892514130fc002d99\", \"department\": \"Sound\", \"gender\": 0, \"id\": 1401786, \"job\": \"Sound Effects Editor\", \"name\": \"Ken Fischer\"}, {\"credit_id\": \"549598229251412c4e002a1c\", \"department\": \"Crew\", \"gender\": 0, \"id\": 1401787, \"job\": \"Special Effects Coordinator\", \"name\": \"Iain Hutton\"}, {\"credit_id\": \"549598349251416e2b00432b\", \"department\": \"Crew\", \"gender\": 0, \"id\": 1401788, \"job\": \"Special Effects Coordinator\", \"name\": \"Steve Ingram\"}, {\"credit_id\": \"54959905c3a3686ae3004324\", \"department\": \"Visual Effects\", \"gender\": 0, \"id\": 1401789, \"job\": \"Visual Effects Producer\", \"name\": \"Joyce Cox\"}, {\"credit_id\": \"5495994b92514132ed002951\", \"department\": \"Visual Effects\", \"gender\": 0, \"id\": 1401790, \"job\": \"Visual Effects Producer\", \"name\": \"Jenny Foster\"}, {\"credit_id\": \"549599cbc3a3686ae1004613\", \"department\": \"Crew\", \"gender\": 0, \"id\": 1401791, \"job\": \"Visual Effects Editor\", \"name\": \"Christopher Marino\"}, {\"credit_id\": \"549599f2c3a3686ae100461e\", \"department\": \"Crew\", \"gender\": 0, \"id\": 1401792, \"job\": \"Visual Effects Editor\", \"name\": \"Jim Milton\"}, {\"credit_id\": \"54959a51c3a3686af3003eb5\", \"department\": \"Visual Effects\", \"gender\": 0, \"id\": 1401793, \"job\": \"Visual Effects Producer\", \"name\": \"Cyndi Ochs\"}, {\"credit_id\": \"54959a7cc3a36811530026f4\", \"department\": \"Crew\", \"gender\": 0, \"id\": 1401794, \"job\": \"Visual Effects Editor\", \"name\": \"Lucas Putnam\"}, {\"credit_id\": \"54959b91c3a3680ff5002cb4\", \"department\": \"Visual Effects\", \"gender\": 0, \"id\": 1401795, \"job\": \"Visual Effects Supervisor\", \"name\": \"Anthony \\'Max\\' Ivins\"}, {\"credit_id\": \"54959bb69251412c4e002a5f\", \"department\": \"Visual Effects\", \"gender\": 0, \"id\": 1401796, \"job\": \"Visual Effects Supervisor\", \"name\": \"John Knoll\"}, {\"credit_id\": \"54959cbbc3a3686ae3004391\", \"department\": \"Visual Effects\", \"gender\": 2, \"id\": 1401799, \"job\": \"Visual Effects Supervisor\", \"name\": \"Eric Saindon\"}, {\"credit_id\": \"54959d06c3a3686ae90043f6\", \"department\": \"Visual Effects\", \"gender\": 0, \"id\": 1401800, \"job\": \"Visual Effects Supervisor\", \"name\": \"Wayne Stables\"}, {\"credit_id\": \"54959d259251416e1e003f11\", \"department\": \"Visual Effects\", \"gender\": 0, \"id\": 1401801, \"job\": \"Visual Effects Supervisor\", \"name\": \"David Stinnett\"}, {\"credit_id\": \"54959db49251413af7002975\", \"department\": \"Visual Effects\", \"gender\": 0, \"id\": 1401803, \"job\": \"Visual Effects Supervisor\", \"name\": \"Guy Williams\"}, {\"credit_id\": \"54959de4c3a3681153002750\", \"department\": \"Crew\", \"gender\": 0, \"id\": 1401804, \"job\": \"Stunt Coordinator\", \"name\": \"Stuart Thorp\"}, {\"credit_id\": \"54959ef2c3a3680fc60027f2\", \"department\": \"Lighting\", \"gender\": 0, \"id\": 1401805, \"job\": \"Best Boy Electric\", \"name\": \"Giles Coburn\"}, {\"credit_id\": \"54959f07c3a3680fc60027f9\", \"department\": \"Camera\", \"gender\": 2, \"id\": 1401806, \"job\": \"Still Photographer\", \"name\": \"Mark Fellman\"}, {\"credit_id\": \"54959f47c3a3681153002774\", \"department\": \"Lighting\", \"gender\": 0, \"id\": 1401807, \"job\": \"Lighting Technician\", \"name\": \"Scott Sprague\"}, {\"credit_id\": \"54959f8cc3a36831b8001df2\", \"department\": \"Visual Effects\", \"gender\": 0, \"id\": 1401808, \"job\": \"Animation Director\", \"name\": \"Jeremy Hollobon\"}, {\"credit_id\": \"54959fa0c3a36831b8001dfb\", \"department\": \"Visual Effects\", \"gender\": 0, \"id\": 1401809, \"job\": \"Animation Director\", \"name\": \"Orlando Meunier\"}, {\"credit_id\": \"54959fb6c3a3686af3003f54\", \"department\": \"Visual Effects\", \"gender\": 0, \"id\": 1401810, \"job\": \"Animation Director\", \"name\": \"Taisuke Tanimura\"}, {\"credit_id\": \"54959fd2c3a36831b8001e02\", \"department\": \"Costume & Make-Up\", \"gender\": 0, \"id\": 1401812, \"job\": \"Set Costumer\", \"name\": \"Lilia Mishel Acevedo\"}, {\"credit_id\": \"54959ff9c3a3686ae300440c\", \"department\": \"Costume & Make-Up\", \"gender\": 0, \"id\": 1401814, \"job\": \"Set Costumer\", \"name\": \"Alejandro M. Hernandez\"}, {\"credit_id\": \"5495a0ddc3a3686ae10046fe\", \"department\": \"Editing\", \"gender\": 0, \"id\": 1401815, \"job\": \"Digital Intermediate\", \"name\": \"Marvin Hall\"}, {\"credit_id\": \"5495a1f7c3a3686ae3004443\", \"department\": \"Production\", \"gender\": 0, \"id\": 1401816, \"job\": \"Publicist\", \"name\": \"Judy Alley\"}, {\"credit_id\": \"5592b29fc3a36869d100002f\", \"department\": \"Crew\", \"gender\": 0, \"id\": 1418381, \"job\": \"CG Supervisor\", \"name\": \"Mike Perry\"}, {\"credit_id\": \"5592b23a9251415df8001081\", \"department\": \"Crew\", \"gender\": 0, \"id\": 1426854, \"job\": \"CG Supervisor\", \"name\": \"Andrew Morley\"}, {\"credit_id\": \"55491e1192514104c40002d8\", \"department\": \"Art\", \"gender\": 0, \"id\": 1438901, \"job\": \"Conceptual Design\", \"name\": \"Seth Engstrom\"}, {\"credit_id\": \"5525d5809251417276002b06\", \"department\": \"Crew\", \"gender\": 0, \"id\": 1447362, \"job\": \"Visual Effects Art Director\", \"name\": \"Eric Oliver\"}, {\"credit_id\": \"554427ca925141586500312a\", \"department\": \"Visual Effects\", \"gender\": 0, \"id\": 1447503, \"job\": \"Modeling\", \"name\": \"Matsune Suzuki\"}, {\"credit_id\": \"551906889251415aab001c88\", \"department\": \"Art\", \"gender\": 0, \"id\": 1447524, \"job\": \"Art Department Manager\", \"name\": \"Paul Tobin\"}, {\"credit_id\": \"5592af8492514152cc0010de\", \"department\": \"Costume & Make-Up\", \"gender\": 0, \"id\": 1452643, \"job\": \"Hairstylist\", \"name\": \"Roxane Griffin\"}, {\"credit_id\": \"553d3c109251415852001318\", \"department\": \"Lighting\", \"gender\": 0, \"id\": 1453938, \"job\": \"Lighting Artist\", \"name\": \"Arun Ram-Mohan\"}, {\"credit_id\": \"5592af4692514152d5001355\", \"department\": \"Costume & Make-Up\", \"gender\": 0, \"id\": 1457305, \"job\": \"Makeup Artist\", \"name\": \"Georgia Lockhart-Adams\"}, {\"credit_id\": \"5592b2eac3a36877470012a5\", \"department\": \"Crew\", \"gender\": 0, \"id\": 1466035, \"job\": \"CG Supervisor\", \"name\": \"Thrain Shadbolt\"}, {\"credit_id\": \"5592b032c3a36877450015f1\", \"department\": \"Crew\", \"gender\": 0, \"id\": 1483220, \"job\": \"CG Supervisor\", \"name\": \"Brad Alexander\"}, {\"credit_id\": \"5592b05592514152d80012f6\", \"department\": \"Crew\", \"gender\": 0, \"id\": 1483221, \"job\": \"CG Supervisor\", \"name\": \"Shadi Almassizadeh\"}, {\"credit_id\": \"5592b090c3a36877570010b5\", \"department\": \"Crew\", \"gender\": 0, \"id\": 1483222, \"job\": \"CG Supervisor\", \"name\": \"Simon Clutterbuck\"}, {\"credit_id\": \"5592b0dbc3a368774b00112c\", \"department\": \"Crew\", \"gender\": 0, \"id\": 1483223, \"job\": \"CG Supervisor\", \"name\": \"Graeme Demmocks\"}, {\"credit_id\": \"5592b0fe92514152db0010c1\", \"department\": \"Crew\", \"gender\": 0, \"id\": 1483224, \"job\": \"CG Supervisor\", \"name\": \"Adrian Fernandes\"}, {\"credit_id\": \"5592b11f9251415df8001059\", \"department\": \"Crew\", \"gender\": 0, \"id\": 1483225, \"job\": \"CG Supervisor\", \"name\": \"Mitch Gates\"}, {\"credit_id\": \"5592b15dc3a3687745001645\", \"department\": \"Crew\", \"gender\": 0, \"id\": 1483226, \"job\": \"CG Supervisor\", \"name\": \"Jerry Kung\"}, {\"credit_id\": \"5592b18e925141645a0004ae\", \"department\": \"Crew\", \"gender\": 0, \"id\": 1483227, \"job\": \"CG Supervisor\", \"name\": \"Andy Lomas\"}, {\"credit_id\": \"5592b1bfc3a368775d0010e7\", \"department\": \"Crew\", \"gender\": 0, \"id\": 1483228, \"job\": \"CG Supervisor\", \"name\": \"Sebastian Marino\"}, {\"credit_id\": \"5592b2049251415df8001078\", \"department\": \"Crew\", \"gender\": 0, \"id\": 1483229, \"job\": \"CG Supervisor\", \"name\": \"Matthias Menz\"}, {\"credit_id\": \"5592b27b92514152d800136a\", \"department\": \"Crew\", \"gender\": 0, \"id\": 1483230, \"job\": \"CG Supervisor\", \"name\": \"Sergei Nevshupov\"}, {\"credit_id\": \"5592b2c3c3a36869e800003c\", \"department\": \"Crew\", \"gender\": 0, \"id\": 1483231, \"job\": \"CG Supervisor\", \"name\": \"Philippe Rebours\"}, {\"credit_id\": \"5592b317c3a36877470012af\", \"department\": \"Crew\", \"gender\": 0, \"id\": 1483232, \"job\": \"CG Supervisor\", \"name\": \"Michael Takarangi\"}, {\"credit_id\": \"5592b345c3a36877470012bb\", \"department\": \"Crew\", \"gender\": 0, \"id\": 1483233, \"job\": \"CG Supervisor\", \"name\": \"David Weitzberg\"}, {\"credit_id\": \"5592b37cc3a368775100113b\", \"department\": \"Crew\", \"gender\": 0, \"id\": 1483234, \"job\": \"CG Supervisor\", \"name\": \"Ben White\"}, {\"credit_id\": \"573c8e2f9251413f5d000094\", \"department\": \"Crew\", \"gender\": 1, \"id\": 1621932, \"job\": \"Stunts\", \"name\": \"Min Windle\"}]'"
            ],
            "application/vnd.google.colaboratory.intrinsic+json": {
              "type": "string"
            }
          },
          "metadata": {},
          "execution_count": 42
        }
      ]
    },
    {
      "cell_type": "markdown",
      "source": [
        "We only extracted the director name from the crew column."
      ],
      "metadata": {
        "id": "FLEtAjiG0laL"
      }
    },
    {
      "cell_type": "code",
      "source": [
        "def convert_crew(obj):\n",
        "  L=[]\n",
        "  for i in ast.literal_eval(obj):\n",
        "    if i['job'] == 'Director':\n",
        "      L.append(i['name'])\n",
        "      break\n",
        "  return L"
      ],
      "metadata": {
        "id": "6Klsp-_BwM8r"
      },
      "execution_count": null,
      "outputs": []
    },
    {
      "cell_type": "code",
      "source": [
        "convert_crew(movie['crew'][0])"
      ],
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "H3FzNfEuwm9-",
        "outputId": "02ac2bf4-7fab-4f52-e3a9-fd95cd7c3f55"
      },
      "execution_count": null,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/plain": [
              "['James Cameron']"
            ]
          },
          "metadata": {},
          "execution_count": 45
        }
      ]
    },
    {
      "cell_type": "code",
      "source": [
        "movie['crew'] = movie['crew'].apply(convert_crew)"
      ],
      "metadata": {
        "id": "qXedND-4wsq1"
      },
      "execution_count": null,
      "outputs": []
    },
    {
      "cell_type": "code",
      "source": [
        "movie.head(3)"
      ],
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 292
        },
        "id": "IpJT-qDew7z2",
        "outputId": "af7c973a-d6ab-4e91-93e2-eb89f973d9c9"
      },
      "execution_count": null,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/plain": [
              "   movie_id                                     title  \\\n",
              "0     19995                                    Avatar   \n",
              "1       285  Pirates of the Caribbean: At World's End   \n",
              "2    206647                                   Spectre   \n",
              "\n",
              "                                            overview  \\\n",
              "0  In the 22nd century, a paraplegic Marine is di...   \n",
              "1  Captain Barbossa, long believed to be dead, ha...   \n",
              "2  A cryptic message from Bond’s past sends him o...   \n",
              "\n",
              "                                          genres  \\\n",
              "0  [Action, Adventure, Fantasy, Science Fiction]   \n",
              "1                   [Adventure, Fantasy, Action]   \n",
              "2                     [Action, Adventure, Crime]   \n",
              "\n",
              "                                            keywords  \\\n",
              "0  [culture clash, future, space war, space colon...   \n",
              "1  [ocean, drug abuse, exotic island, east india ...   \n",
              "2  [spy, based on novel, secret agent, sequel, mi...   \n",
              "\n",
              "                                               cast              crew  \n",
              "0  [Sam Worthington, Zoe Saldana, Sigourney Weaver]   [James Cameron]  \n",
              "1     [Johnny Depp, Orlando Bloom, Keira Knightley]  [Gore Verbinski]  \n",
              "2      [Daniel Craig, Christoph Waltz, Léa Seydoux]      [Sam Mendes]  "
            ],
            "text/html": [
              "\n",
              "  <div id=\"df-af72edbf-909b-4a30-8636-92ce48670d39\">\n",
              "    <div class=\"colab-df-container\">\n",
              "      <div>\n",
              "<style scoped>\n",
              "    .dataframe tbody tr th:only-of-type {\n",
              "        vertical-align: middle;\n",
              "    }\n",
              "\n",
              "    .dataframe tbody tr th {\n",
              "        vertical-align: top;\n",
              "    }\n",
              "\n",
              "    .dataframe thead th {\n",
              "        text-align: right;\n",
              "    }\n",
              "</style>\n",
              "<table border=\"1\" class=\"dataframe\">\n",
              "  <thead>\n",
              "    <tr style=\"text-align: right;\">\n",
              "      <th></th>\n",
              "      <th>movie_id</th>\n",
              "      <th>title</th>\n",
              "      <th>overview</th>\n",
              "      <th>genres</th>\n",
              "      <th>keywords</th>\n",
              "      <th>cast</th>\n",
              "      <th>crew</th>\n",
              "    </tr>\n",
              "  </thead>\n",
              "  <tbody>\n",
              "    <tr>\n",
              "      <th>0</th>\n",
              "      <td>19995</td>\n",
              "      <td>Avatar</td>\n",
              "      <td>In the 22nd century, a paraplegic Marine is di...</td>\n",
              "      <td>[Action, Adventure, Fantasy, Science Fiction]</td>\n",
              "      <td>[culture clash, future, space war, space colon...</td>\n",
              "      <td>[Sam Worthington, Zoe Saldana, Sigourney Weaver]</td>\n",
              "      <td>[James Cameron]</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>1</th>\n",
              "      <td>285</td>\n",
              "      <td>Pirates of the Caribbean: At World's End</td>\n",
              "      <td>Captain Barbossa, long believed to be dead, ha...</td>\n",
              "      <td>[Adventure, Fantasy, Action]</td>\n",
              "      <td>[ocean, drug abuse, exotic island, east india ...</td>\n",
              "      <td>[Johnny Depp, Orlando Bloom, Keira Knightley]</td>\n",
              "      <td>[Gore Verbinski]</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>2</th>\n",
              "      <td>206647</td>\n",
              "      <td>Spectre</td>\n",
              "      <td>A cryptic message from Bond’s past sends him o...</td>\n",
              "      <td>[Action, Adventure, Crime]</td>\n",
              "      <td>[spy, based on novel, secret agent, sequel, mi...</td>\n",
              "      <td>[Daniel Craig, Christoph Waltz, Léa Seydoux]</td>\n",
              "      <td>[Sam Mendes]</td>\n",
              "    </tr>\n",
              "  </tbody>\n",
              "</table>\n",
              "</div>\n",
              "      <button class=\"colab-df-convert\" onclick=\"convertToInteractive('df-af72edbf-909b-4a30-8636-92ce48670d39')\"\n",
              "              title=\"Convert this dataframe to an interactive table.\"\n",
              "              style=\"display:none;\">\n",
              "        \n",
              "  <svg xmlns=\"http://www.w3.org/2000/svg\" height=\"24px\"viewBox=\"0 0 24 24\"\n",
              "       width=\"24px\">\n",
              "    <path d=\"M0 0h24v24H0V0z\" fill=\"none\"/>\n",
              "    <path d=\"M18.56 5.44l.94 2.06.94-2.06 2.06-.94-2.06-.94-.94-2.06-.94 2.06-2.06.94zm-11 1L8.5 8.5l.94-2.06 2.06-.94-2.06-.94L8.5 2.5l-.94 2.06-2.06.94zm10 10l.94 2.06.94-2.06 2.06-.94-2.06-.94-.94-2.06-.94 2.06-2.06.94z\"/><path d=\"M17.41 7.96l-1.37-1.37c-.4-.4-.92-.59-1.43-.59-.52 0-1.04.2-1.43.59L10.3 9.45l-7.72 7.72c-.78.78-.78 2.05 0 2.83L4 21.41c.39.39.9.59 1.41.59.51 0 1.02-.2 1.41-.59l7.78-7.78 2.81-2.81c.8-.78.8-2.07 0-2.86zM5.41 20L4 18.59l7.72-7.72 1.47 1.35L5.41 20z\"/>\n",
              "  </svg>\n",
              "      </button>\n",
              "      \n",
              "  <style>\n",
              "    .colab-df-container {\n",
              "      display:flex;\n",
              "      flex-wrap:wrap;\n",
              "      gap: 12px;\n",
              "    }\n",
              "\n",
              "    .colab-df-convert {\n",
              "      background-color: #E8F0FE;\n",
              "      border: none;\n",
              "      border-radius: 50%;\n",
              "      cursor: pointer;\n",
              "      display: none;\n",
              "      fill: #1967D2;\n",
              "      height: 32px;\n",
              "      padding: 0 0 0 0;\n",
              "      width: 32px;\n",
              "    }\n",
              "\n",
              "    .colab-df-convert:hover {\n",
              "      background-color: #E2EBFA;\n",
              "      box-shadow: 0px 1px 2px rgba(60, 64, 67, 0.3), 0px 1px 3px 1px rgba(60, 64, 67, 0.15);\n",
              "      fill: #174EA6;\n",
              "    }\n",
              "\n",
              "    [theme=dark] .colab-df-convert {\n",
              "      background-color: #3B4455;\n",
              "      fill: #D2E3FC;\n",
              "    }\n",
              "\n",
              "    [theme=dark] .colab-df-convert:hover {\n",
              "      background-color: #434B5C;\n",
              "      box-shadow: 0px 1px 3px 1px rgba(0, 0, 0, 0.15);\n",
              "      filter: drop-shadow(0px 1px 2px rgba(0, 0, 0, 0.3));\n",
              "      fill: #FFFFFF;\n",
              "    }\n",
              "  </style>\n",
              "\n",
              "      <script>\n",
              "        const buttonEl =\n",
              "          document.querySelector('#df-af72edbf-909b-4a30-8636-92ce48670d39 button.colab-df-convert');\n",
              "        buttonEl.style.display =\n",
              "          google.colab.kernel.accessAllowed ? 'block' : 'none';\n",
              "\n",
              "        async function convertToInteractive(key) {\n",
              "          const element = document.querySelector('#df-af72edbf-909b-4a30-8636-92ce48670d39');\n",
              "          const dataTable =\n",
              "            await google.colab.kernel.invokeFunction('convertToInteractive',\n",
              "                                                     [key], {});\n",
              "          if (!dataTable) return;\n",
              "\n",
              "          const docLinkHtml = 'Like what you see? Visit the ' +\n",
              "            '<a target=\"_blank\" href=https://colab.research.google.com/notebooks/data_table.ipynb>data table notebook</a>'\n",
              "            + ' to learn more about interactive tables.';\n",
              "          element.innerHTML = '';\n",
              "          dataTable['output_type'] = 'display_data';\n",
              "          await google.colab.output.renderOutput(dataTable, element);\n",
              "          const docLink = document.createElement('div');\n",
              "          docLink.innerHTML = docLinkHtml;\n",
              "          element.appendChild(docLink);\n",
              "        }\n",
              "      </script>\n",
              "    </div>\n",
              "  </div>\n",
              "  "
            ]
          },
          "metadata": {},
          "execution_count": 48
        }
      ]
    },
    {
      "cell_type": "markdown",
      "source": [
        "Tokenize the text data in 'overview' column by splitting it into individual words. The result is stored back in the 'overview' column, replacing the original text with a list of words."
      ],
      "metadata": {
        "id": "8NkEpQMq7SVx"
      }
    },
    {
      "cell_type": "code",
      "source": [
        "movie['overview'][0]"
      ],
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 53
        },
        "id": "Xjkq0pWWyJ6X",
        "outputId": "a0672bd9-0305-48b4-c671-6db761a1a246"
      },
      "execution_count": null,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/plain": [
              "'In the 22nd century, a paraplegic Marine is dispatched to the moon Pandora on a unique mission, but becomes torn between following orders and protecting an alien civilization.'"
            ],
            "application/vnd.google.colaboratory.intrinsic+json": {
              "type": "string"
            }
          },
          "metadata": {},
          "execution_count": 50
        }
      ]
    },
    {
      "cell_type": "code",
      "source": [
        "movie['overview'] = movie['overview'].apply(lambda x:x.split())"
      ],
      "metadata": {
        "id": "i9SjcHwryQUl"
      },
      "execution_count": null,
      "outputs": []
    },
    {
      "cell_type": "markdown",
      "source": [
        "- Removing spaces from the elements within each list from the the `genres`, `cast`, `crew` and `keywords` columns.\n",
        "\n",
        "- The reason for removing spaces from the elements within the lists in the column is to standardize the format and facilitate further analysis. This modification ensures that there are no spaces within the genre /cast /crew  names or in keywors, allowing for consistency and easier comparison."
      ],
      "metadata": {
        "id": "F7kc70Mj8GbA"
      }
    },
    {
      "cell_type": "code",
      "source": [
        "def remove_spaces_in_list(column):\n",
        "    return column.apply(lambda x: [i.replace(\" \", \"\") for i in x])"
      ],
      "metadata": {
        "id": "eLlOwhd30fBY"
      },
      "execution_count": null,
      "outputs": []
    },
    {
      "cell_type": "code",
      "source": [
        "movie['genres'] = remove_spaces_in_list(movie['genres'])"
      ],
      "metadata": {
        "id": "FK0AGLdy0zTO"
      },
      "execution_count": null,
      "outputs": []
    },
    {
      "cell_type": "code",
      "source": [
        "movie['cast'] = remove_spaces_in_list(movie['cast'])\n",
        "movie['crew'] = remove_spaces_in_list(movie['crew'])\n",
        "movie['keywords'] = remove_spaces_in_list(movie['keywords'])"
      ],
      "metadata": {
        "id": "kTIyD9Pq1Z9J"
      },
      "execution_count": null,
      "outputs": []
    },
    {
      "cell_type": "code",
      "source": [
        "movie.head(3)"
      ],
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 344
        },
        "id": "NKL-r0OZ1qrP",
        "outputId": "978aba3d-aec9-4ebd-e8f3-54095af3ee41"
      },
      "execution_count": null,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/plain": [
              "   movie_id                                     title  \\\n",
              "0     19995                                    Avatar   \n",
              "1       285  Pirates of the Caribbean: At World's End   \n",
              "2    206647                                   Spectre   \n",
              "\n",
              "                                            overview  \\\n",
              "0  [In, the, 22nd, century,, a, paraplegic, Marin...   \n",
              "1  [Captain, Barbossa,, long, believed, to, be, d...   \n",
              "2  [A, cryptic, message, from, Bond’s, past, send...   \n",
              "\n",
              "                                         genres  \\\n",
              "0  [Action, Adventure, Fantasy, ScienceFiction]   \n",
              "1                  [Adventure, Fantasy, Action]   \n",
              "2                    [Action, Adventure, Crime]   \n",
              "\n",
              "                                            keywords  \\\n",
              "0  [cultureclash, future, spacewar, spacecolony, ...   \n",
              "1  [ocean, drugabuse, exoticisland, eastindiatrad...   \n",
              "2  [spy, basedonnovel, secretagent, sequel, mi6, ...   \n",
              "\n",
              "                                            cast             crew  \n",
              "0  [SamWorthington, ZoeSaldana, SigourneyWeaver]   [JamesCameron]  \n",
              "1     [JohnnyDepp, OrlandoBloom, KeiraKnightley]  [GoreVerbinski]  \n",
              "2      [DanielCraig, ChristophWaltz, LéaSeydoux]      [SamMendes]  "
            ],
            "text/html": [
              "\n",
              "  <div id=\"df-5c226648-774a-4f15-ad68-7ffc0990a84a\">\n",
              "    <div class=\"colab-df-container\">\n",
              "      <div>\n",
              "<style scoped>\n",
              "    .dataframe tbody tr th:only-of-type {\n",
              "        vertical-align: middle;\n",
              "    }\n",
              "\n",
              "    .dataframe tbody tr th {\n",
              "        vertical-align: top;\n",
              "    }\n",
              "\n",
              "    .dataframe thead th {\n",
              "        text-align: right;\n",
              "    }\n",
              "</style>\n",
              "<table border=\"1\" class=\"dataframe\">\n",
              "  <thead>\n",
              "    <tr style=\"text-align: right;\">\n",
              "      <th></th>\n",
              "      <th>movie_id</th>\n",
              "      <th>title</th>\n",
              "      <th>overview</th>\n",
              "      <th>genres</th>\n",
              "      <th>keywords</th>\n",
              "      <th>cast</th>\n",
              "      <th>crew</th>\n",
              "    </tr>\n",
              "  </thead>\n",
              "  <tbody>\n",
              "    <tr>\n",
              "      <th>0</th>\n",
              "      <td>19995</td>\n",
              "      <td>Avatar</td>\n",
              "      <td>[In, the, 22nd, century,, a, paraplegic, Marin...</td>\n",
              "      <td>[Action, Adventure, Fantasy, ScienceFiction]</td>\n",
              "      <td>[cultureclash, future, spacewar, spacecolony, ...</td>\n",
              "      <td>[SamWorthington, ZoeSaldana, SigourneyWeaver]</td>\n",
              "      <td>[JamesCameron]</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>1</th>\n",
              "      <td>285</td>\n",
              "      <td>Pirates of the Caribbean: At World's End</td>\n",
              "      <td>[Captain, Barbossa,, long, believed, to, be, d...</td>\n",
              "      <td>[Adventure, Fantasy, Action]</td>\n",
              "      <td>[ocean, drugabuse, exoticisland, eastindiatrad...</td>\n",
              "      <td>[JohnnyDepp, OrlandoBloom, KeiraKnightley]</td>\n",
              "      <td>[GoreVerbinski]</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>2</th>\n",
              "      <td>206647</td>\n",
              "      <td>Spectre</td>\n",
              "      <td>[A, cryptic, message, from, Bond’s, past, send...</td>\n",
              "      <td>[Action, Adventure, Crime]</td>\n",
              "      <td>[spy, basedonnovel, secretagent, sequel, mi6, ...</td>\n",
              "      <td>[DanielCraig, ChristophWaltz, LéaSeydoux]</td>\n",
              "      <td>[SamMendes]</td>\n",
              "    </tr>\n",
              "  </tbody>\n",
              "</table>\n",
              "</div>\n",
              "      <button class=\"colab-df-convert\" onclick=\"convertToInteractive('df-5c226648-774a-4f15-ad68-7ffc0990a84a')\"\n",
              "              title=\"Convert this dataframe to an interactive table.\"\n",
              "              style=\"display:none;\">\n",
              "        \n",
              "  <svg xmlns=\"http://www.w3.org/2000/svg\" height=\"24px\"viewBox=\"0 0 24 24\"\n",
              "       width=\"24px\">\n",
              "    <path d=\"M0 0h24v24H0V0z\" fill=\"none\"/>\n",
              "    <path d=\"M18.56 5.44l.94 2.06.94-2.06 2.06-.94-2.06-.94-.94-2.06-.94 2.06-2.06.94zm-11 1L8.5 8.5l.94-2.06 2.06-.94-2.06-.94L8.5 2.5l-.94 2.06-2.06.94zm10 10l.94 2.06.94-2.06 2.06-.94-2.06-.94-.94-2.06-.94 2.06-2.06.94z\"/><path d=\"M17.41 7.96l-1.37-1.37c-.4-.4-.92-.59-1.43-.59-.52 0-1.04.2-1.43.59L10.3 9.45l-7.72 7.72c-.78.78-.78 2.05 0 2.83L4 21.41c.39.39.9.59 1.41.59.51 0 1.02-.2 1.41-.59l7.78-7.78 2.81-2.81c.8-.78.8-2.07 0-2.86zM5.41 20L4 18.59l7.72-7.72 1.47 1.35L5.41 20z\"/>\n",
              "  </svg>\n",
              "      </button>\n",
              "      \n",
              "  <style>\n",
              "    .colab-df-container {\n",
              "      display:flex;\n",
              "      flex-wrap:wrap;\n",
              "      gap: 12px;\n",
              "    }\n",
              "\n",
              "    .colab-df-convert {\n",
              "      background-color: #E8F0FE;\n",
              "      border: none;\n",
              "      border-radius: 50%;\n",
              "      cursor: pointer;\n",
              "      display: none;\n",
              "      fill: #1967D2;\n",
              "      height: 32px;\n",
              "      padding: 0 0 0 0;\n",
              "      width: 32px;\n",
              "    }\n",
              "\n",
              "    .colab-df-convert:hover {\n",
              "      background-color: #E2EBFA;\n",
              "      box-shadow: 0px 1px 2px rgba(60, 64, 67, 0.3), 0px 1px 3px 1px rgba(60, 64, 67, 0.15);\n",
              "      fill: #174EA6;\n",
              "    }\n",
              "\n",
              "    [theme=dark] .colab-df-convert {\n",
              "      background-color: #3B4455;\n",
              "      fill: #D2E3FC;\n",
              "    }\n",
              "\n",
              "    [theme=dark] .colab-df-convert:hover {\n",
              "      background-color: #434B5C;\n",
              "      box-shadow: 0px 1px 3px 1px rgba(0, 0, 0, 0.15);\n",
              "      filter: drop-shadow(0px 1px 2px rgba(0, 0, 0, 0.3));\n",
              "      fill: #FFFFFF;\n",
              "    }\n",
              "  </style>\n",
              "\n",
              "      <script>\n",
              "        const buttonEl =\n",
              "          document.querySelector('#df-5c226648-774a-4f15-ad68-7ffc0990a84a button.colab-df-convert');\n",
              "        buttonEl.style.display =\n",
              "          google.colab.kernel.accessAllowed ? 'block' : 'none';\n",
              "\n",
              "        async function convertToInteractive(key) {\n",
              "          const element = document.querySelector('#df-5c226648-774a-4f15-ad68-7ffc0990a84a');\n",
              "          const dataTable =\n",
              "            await google.colab.kernel.invokeFunction('convertToInteractive',\n",
              "                                                     [key], {});\n",
              "          if (!dataTable) return;\n",
              "\n",
              "          const docLinkHtml = 'Like what you see? Visit the ' +\n",
              "            '<a target=\"_blank\" href=https://colab.research.google.com/notebooks/data_table.ipynb>data table notebook</a>'\n",
              "            + ' to learn more about interactive tables.';\n",
              "          element.innerHTML = '';\n",
              "          dataTable['output_type'] = 'display_data';\n",
              "          await google.colab.output.renderOutput(dataTable, element);\n",
              "          const docLink = document.createElement('div');\n",
              "          docLink.innerHTML = docLinkHtml;\n",
              "          element.appendChild(docLink);\n",
              "        }\n",
              "      </script>\n",
              "    </div>\n",
              "  </div>\n",
              "  "
            ]
          },
          "metadata": {},
          "execution_count": 65
        }
      ]
    },
    {
      "cell_type": "markdown",
      "source": [
        "Creating a new column, `tags`, that combines information from multiple existing columns. By concatenating the values from the specified columns, the 'tags' column is intended to capture a comprehensive representation of movie characteristics, including the movie `overview`, `genres`, `keywords`, `cast`, and `crew`."
      ],
      "metadata": {
        "id": "9XY26Tal9Aq_"
      }
    },
    {
      "cell_type": "code",
      "source": [
        "movie['tags'] = movie['overview'] + movie['genres'] + movie['keywords'] + movie['cast'] + movie['crew']"
      ],
      "metadata": {
        "id": "K7o1l0971wZM"
      },
      "execution_count": null,
      "outputs": []
    },
    {
      "cell_type": "code",
      "source": [
        "movie.head(3)"
      ],
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 344
        },
        "id": "RC9Ti2zT2SO8",
        "outputId": "2b34e903-d3ef-4c1e-ed63-0378aebc635a"
      },
      "execution_count": null,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/plain": [
              "   movie_id                                     title  \\\n",
              "0     19995                                    Avatar   \n",
              "1       285  Pirates of the Caribbean: At World's End   \n",
              "2    206647                                   Spectre   \n",
              "\n",
              "                                            overview  \\\n",
              "0  [In, the, 22nd, century,, a, paraplegic, Marin...   \n",
              "1  [Captain, Barbossa,, long, believed, to, be, d...   \n",
              "2  [A, cryptic, message, from, Bond’s, past, send...   \n",
              "\n",
              "                                         genres  \\\n",
              "0  [Action, Adventure, Fantasy, ScienceFiction]   \n",
              "1                  [Adventure, Fantasy, Action]   \n",
              "2                    [Action, Adventure, Crime]   \n",
              "\n",
              "                                            keywords  \\\n",
              "0  [cultureclash, future, spacewar, spacecolony, ...   \n",
              "1  [ocean, drugabuse, exoticisland, eastindiatrad...   \n",
              "2  [spy, basedonnovel, secretagent, sequel, mi6, ...   \n",
              "\n",
              "                                            cast             crew  \\\n",
              "0  [SamWorthington, ZoeSaldana, SigourneyWeaver]   [JamesCameron]   \n",
              "1     [JohnnyDepp, OrlandoBloom, KeiraKnightley]  [GoreVerbinski]   \n",
              "2      [DanielCraig, ChristophWaltz, LéaSeydoux]      [SamMendes]   \n",
              "\n",
              "                                                tags  \n",
              "0  [In, the, 22nd, century,, a, paraplegic, Marin...  \n",
              "1  [Captain, Barbossa,, long, believed, to, be, d...  \n",
              "2  [A, cryptic, message, from, Bond’s, past, send...  "
            ],
            "text/html": [
              "\n",
              "  <div id=\"df-f2b545ae-6ee7-4606-b39d-8e96290944b1\">\n",
              "    <div class=\"colab-df-container\">\n",
              "      <div>\n",
              "<style scoped>\n",
              "    .dataframe tbody tr th:only-of-type {\n",
              "        vertical-align: middle;\n",
              "    }\n",
              "\n",
              "    .dataframe tbody tr th {\n",
              "        vertical-align: top;\n",
              "    }\n",
              "\n",
              "    .dataframe thead th {\n",
              "        text-align: right;\n",
              "    }\n",
              "</style>\n",
              "<table border=\"1\" class=\"dataframe\">\n",
              "  <thead>\n",
              "    <tr style=\"text-align: right;\">\n",
              "      <th></th>\n",
              "      <th>movie_id</th>\n",
              "      <th>title</th>\n",
              "      <th>overview</th>\n",
              "      <th>genres</th>\n",
              "      <th>keywords</th>\n",
              "      <th>cast</th>\n",
              "      <th>crew</th>\n",
              "      <th>tags</th>\n",
              "    </tr>\n",
              "  </thead>\n",
              "  <tbody>\n",
              "    <tr>\n",
              "      <th>0</th>\n",
              "      <td>19995</td>\n",
              "      <td>Avatar</td>\n",
              "      <td>[In, the, 22nd, century,, a, paraplegic, Marin...</td>\n",
              "      <td>[Action, Adventure, Fantasy, ScienceFiction]</td>\n",
              "      <td>[cultureclash, future, spacewar, spacecolony, ...</td>\n",
              "      <td>[SamWorthington, ZoeSaldana, SigourneyWeaver]</td>\n",
              "      <td>[JamesCameron]</td>\n",
              "      <td>[In, the, 22nd, century,, a, paraplegic, Marin...</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>1</th>\n",
              "      <td>285</td>\n",
              "      <td>Pirates of the Caribbean: At World's End</td>\n",
              "      <td>[Captain, Barbossa,, long, believed, to, be, d...</td>\n",
              "      <td>[Adventure, Fantasy, Action]</td>\n",
              "      <td>[ocean, drugabuse, exoticisland, eastindiatrad...</td>\n",
              "      <td>[JohnnyDepp, OrlandoBloom, KeiraKnightley]</td>\n",
              "      <td>[GoreVerbinski]</td>\n",
              "      <td>[Captain, Barbossa,, long, believed, to, be, d...</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>2</th>\n",
              "      <td>206647</td>\n",
              "      <td>Spectre</td>\n",
              "      <td>[A, cryptic, message, from, Bond’s, past, send...</td>\n",
              "      <td>[Action, Adventure, Crime]</td>\n",
              "      <td>[spy, basedonnovel, secretagent, sequel, mi6, ...</td>\n",
              "      <td>[DanielCraig, ChristophWaltz, LéaSeydoux]</td>\n",
              "      <td>[SamMendes]</td>\n",
              "      <td>[A, cryptic, message, from, Bond’s, past, send...</td>\n",
              "    </tr>\n",
              "  </tbody>\n",
              "</table>\n",
              "</div>\n",
              "      <button class=\"colab-df-convert\" onclick=\"convertToInteractive('df-f2b545ae-6ee7-4606-b39d-8e96290944b1')\"\n",
              "              title=\"Convert this dataframe to an interactive table.\"\n",
              "              style=\"display:none;\">\n",
              "        \n",
              "  <svg xmlns=\"http://www.w3.org/2000/svg\" height=\"24px\"viewBox=\"0 0 24 24\"\n",
              "       width=\"24px\">\n",
              "    <path d=\"M0 0h24v24H0V0z\" fill=\"none\"/>\n",
              "    <path d=\"M18.56 5.44l.94 2.06.94-2.06 2.06-.94-2.06-.94-.94-2.06-.94 2.06-2.06.94zm-11 1L8.5 8.5l.94-2.06 2.06-.94-2.06-.94L8.5 2.5l-.94 2.06-2.06.94zm10 10l.94 2.06.94-2.06 2.06-.94-2.06-.94-.94-2.06-.94 2.06-2.06.94z\"/><path d=\"M17.41 7.96l-1.37-1.37c-.4-.4-.92-.59-1.43-.59-.52 0-1.04.2-1.43.59L10.3 9.45l-7.72 7.72c-.78.78-.78 2.05 0 2.83L4 21.41c.39.39.9.59 1.41.59.51 0 1.02-.2 1.41-.59l7.78-7.78 2.81-2.81c.8-.78.8-2.07 0-2.86zM5.41 20L4 18.59l7.72-7.72 1.47 1.35L5.41 20z\"/>\n",
              "  </svg>\n",
              "      </button>\n",
              "      \n",
              "  <style>\n",
              "    .colab-df-container {\n",
              "      display:flex;\n",
              "      flex-wrap:wrap;\n",
              "      gap: 12px;\n",
              "    }\n",
              "\n",
              "    .colab-df-convert {\n",
              "      background-color: #E8F0FE;\n",
              "      border: none;\n",
              "      border-radius: 50%;\n",
              "      cursor: pointer;\n",
              "      display: none;\n",
              "      fill: #1967D2;\n",
              "      height: 32px;\n",
              "      padding: 0 0 0 0;\n",
              "      width: 32px;\n",
              "    }\n",
              "\n",
              "    .colab-df-convert:hover {\n",
              "      background-color: #E2EBFA;\n",
              "      box-shadow: 0px 1px 2px rgba(60, 64, 67, 0.3), 0px 1px 3px 1px rgba(60, 64, 67, 0.15);\n",
              "      fill: #174EA6;\n",
              "    }\n",
              "\n",
              "    [theme=dark] .colab-df-convert {\n",
              "      background-color: #3B4455;\n",
              "      fill: #D2E3FC;\n",
              "    }\n",
              "\n",
              "    [theme=dark] .colab-df-convert:hover {\n",
              "      background-color: #434B5C;\n",
              "      box-shadow: 0px 1px 3px 1px rgba(0, 0, 0, 0.15);\n",
              "      filter: drop-shadow(0px 1px 2px rgba(0, 0, 0, 0.3));\n",
              "      fill: #FFFFFF;\n",
              "    }\n",
              "  </style>\n",
              "\n",
              "      <script>\n",
              "        const buttonEl =\n",
              "          document.querySelector('#df-f2b545ae-6ee7-4606-b39d-8e96290944b1 button.colab-df-convert');\n",
              "        buttonEl.style.display =\n",
              "          google.colab.kernel.accessAllowed ? 'block' : 'none';\n",
              "\n",
              "        async function convertToInteractive(key) {\n",
              "          const element = document.querySelector('#df-f2b545ae-6ee7-4606-b39d-8e96290944b1');\n",
              "          const dataTable =\n",
              "            await google.colab.kernel.invokeFunction('convertToInteractive',\n",
              "                                                     [key], {});\n",
              "          if (!dataTable) return;\n",
              "\n",
              "          const docLinkHtml = 'Like what you see? Visit the ' +\n",
              "            '<a target=\"_blank\" href=https://colab.research.google.com/notebooks/data_table.ipynb>data table notebook</a>'\n",
              "            + ' to learn more about interactive tables.';\n",
              "          element.innerHTML = '';\n",
              "          dataTable['output_type'] = 'display_data';\n",
              "          await google.colab.output.renderOutput(dataTable, element);\n",
              "          const docLink = document.createElement('div');\n",
              "          docLink.innerHTML = docLinkHtml;\n",
              "          element.appendChild(docLink);\n",
              "        }\n",
              "      </script>\n",
              "    </div>\n",
              "  </div>\n",
              "  "
            ]
          },
          "metadata": {},
          "execution_count": 67
        }
      ]
    },
    {
      "cell_type": "code",
      "source": [
        "newMovie = movie[['movie_id', 'title', 'tags']]"
      ],
      "metadata": {
        "id": "gR7hal_H2bCW"
      },
      "execution_count": null,
      "outputs": []
    },
    {
      "cell_type": "code",
      "source": [
        "newMovie.head()"
      ],
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 206
        },
        "id": "tehRcAId2jOJ",
        "outputId": "7bf6f545-a2e0-4175-fb70-f0c8432c402d"
      },
      "execution_count": null,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/plain": [
              "   movie_id                                     title  \\\n",
              "0     19995                                    Avatar   \n",
              "1       285  Pirates of the Caribbean: At World's End   \n",
              "2    206647                                   Spectre   \n",
              "3     49026                     The Dark Knight Rises   \n",
              "4     49529                               John Carter   \n",
              "\n",
              "                                                tags  \n",
              "0  [In, the, 22nd, century,, a, paraplegic, Marin...  \n",
              "1  [Captain, Barbossa,, long, believed, to, be, d...  \n",
              "2  [A, cryptic, message, from, Bond’s, past, send...  \n",
              "3  [Following, the, death, of, District, Attorney...  \n",
              "4  [John, Carter, is, a, war-weary,, former, mili...  "
            ],
            "text/html": [
              "\n",
              "  <div id=\"df-9a1a72f0-eee3-40d3-aafd-c05a4fe60157\">\n",
              "    <div class=\"colab-df-container\">\n",
              "      <div>\n",
              "<style scoped>\n",
              "    .dataframe tbody tr th:only-of-type {\n",
              "        vertical-align: middle;\n",
              "    }\n",
              "\n",
              "    .dataframe tbody tr th {\n",
              "        vertical-align: top;\n",
              "    }\n",
              "\n",
              "    .dataframe thead th {\n",
              "        text-align: right;\n",
              "    }\n",
              "</style>\n",
              "<table border=\"1\" class=\"dataframe\">\n",
              "  <thead>\n",
              "    <tr style=\"text-align: right;\">\n",
              "      <th></th>\n",
              "      <th>movie_id</th>\n",
              "      <th>title</th>\n",
              "      <th>tags</th>\n",
              "    </tr>\n",
              "  </thead>\n",
              "  <tbody>\n",
              "    <tr>\n",
              "      <th>0</th>\n",
              "      <td>19995</td>\n",
              "      <td>Avatar</td>\n",
              "      <td>[In, the, 22nd, century,, a, paraplegic, Marin...</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>1</th>\n",
              "      <td>285</td>\n",
              "      <td>Pirates of the Caribbean: At World's End</td>\n",
              "      <td>[Captain, Barbossa,, long, believed, to, be, d...</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>2</th>\n",
              "      <td>206647</td>\n",
              "      <td>Spectre</td>\n",
              "      <td>[A, cryptic, message, from, Bond’s, past, send...</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>3</th>\n",
              "      <td>49026</td>\n",
              "      <td>The Dark Knight Rises</td>\n",
              "      <td>[Following, the, death, of, District, Attorney...</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>4</th>\n",
              "      <td>49529</td>\n",
              "      <td>John Carter</td>\n",
              "      <td>[John, Carter, is, a, war-weary,, former, mili...</td>\n",
              "    </tr>\n",
              "  </tbody>\n",
              "</table>\n",
              "</div>\n",
              "      <button class=\"colab-df-convert\" onclick=\"convertToInteractive('df-9a1a72f0-eee3-40d3-aafd-c05a4fe60157')\"\n",
              "              title=\"Convert this dataframe to an interactive table.\"\n",
              "              style=\"display:none;\">\n",
              "        \n",
              "  <svg xmlns=\"http://www.w3.org/2000/svg\" height=\"24px\"viewBox=\"0 0 24 24\"\n",
              "       width=\"24px\">\n",
              "    <path d=\"M0 0h24v24H0V0z\" fill=\"none\"/>\n",
              "    <path d=\"M18.56 5.44l.94 2.06.94-2.06 2.06-.94-2.06-.94-.94-2.06-.94 2.06-2.06.94zm-11 1L8.5 8.5l.94-2.06 2.06-.94-2.06-.94L8.5 2.5l-.94 2.06-2.06.94zm10 10l.94 2.06.94-2.06 2.06-.94-2.06-.94-.94-2.06-.94 2.06-2.06.94z\"/><path d=\"M17.41 7.96l-1.37-1.37c-.4-.4-.92-.59-1.43-.59-.52 0-1.04.2-1.43.59L10.3 9.45l-7.72 7.72c-.78.78-.78 2.05 0 2.83L4 21.41c.39.39.9.59 1.41.59.51 0 1.02-.2 1.41-.59l7.78-7.78 2.81-2.81c.8-.78.8-2.07 0-2.86zM5.41 20L4 18.59l7.72-7.72 1.47 1.35L5.41 20z\"/>\n",
              "  </svg>\n",
              "      </button>\n",
              "      \n",
              "  <style>\n",
              "    .colab-df-container {\n",
              "      display:flex;\n",
              "      flex-wrap:wrap;\n",
              "      gap: 12px;\n",
              "    }\n",
              "\n",
              "    .colab-df-convert {\n",
              "      background-color: #E8F0FE;\n",
              "      border: none;\n",
              "      border-radius: 50%;\n",
              "      cursor: pointer;\n",
              "      display: none;\n",
              "      fill: #1967D2;\n",
              "      height: 32px;\n",
              "      padding: 0 0 0 0;\n",
              "      width: 32px;\n",
              "    }\n",
              "\n",
              "    .colab-df-convert:hover {\n",
              "      background-color: #E2EBFA;\n",
              "      box-shadow: 0px 1px 2px rgba(60, 64, 67, 0.3), 0px 1px 3px 1px rgba(60, 64, 67, 0.15);\n",
              "      fill: #174EA6;\n",
              "    }\n",
              "\n",
              "    [theme=dark] .colab-df-convert {\n",
              "      background-color: #3B4455;\n",
              "      fill: #D2E3FC;\n",
              "    }\n",
              "\n",
              "    [theme=dark] .colab-df-convert:hover {\n",
              "      background-color: #434B5C;\n",
              "      box-shadow: 0px 1px 3px 1px rgba(0, 0, 0, 0.15);\n",
              "      filter: drop-shadow(0px 1px 2px rgba(0, 0, 0, 0.3));\n",
              "      fill: #FFFFFF;\n",
              "    }\n",
              "  </style>\n",
              "\n",
              "      <script>\n",
              "        const buttonEl =\n",
              "          document.querySelector('#df-9a1a72f0-eee3-40d3-aafd-c05a4fe60157 button.colab-df-convert');\n",
              "        buttonEl.style.display =\n",
              "          google.colab.kernel.accessAllowed ? 'block' : 'none';\n",
              "\n",
              "        async function convertToInteractive(key) {\n",
              "          const element = document.querySelector('#df-9a1a72f0-eee3-40d3-aafd-c05a4fe60157');\n",
              "          const dataTable =\n",
              "            await google.colab.kernel.invokeFunction('convertToInteractive',\n",
              "                                                     [key], {});\n",
              "          if (!dataTable) return;\n",
              "\n",
              "          const docLinkHtml = 'Like what you see? Visit the ' +\n",
              "            '<a target=\"_blank\" href=https://colab.research.google.com/notebooks/data_table.ipynb>data table notebook</a>'\n",
              "            + ' to learn more about interactive tables.';\n",
              "          element.innerHTML = '';\n",
              "          dataTable['output_type'] = 'display_data';\n",
              "          await google.colab.output.renderOutput(dataTable, element);\n",
              "          const docLink = document.createElement('div');\n",
              "          docLink.innerHTML = docLinkHtml;\n",
              "          element.appendChild(docLink);\n",
              "        }\n",
              "      </script>\n",
              "    </div>\n",
              "  </div>\n",
              "  "
            ]
          },
          "metadata": {},
          "execution_count": 69
        }
      ]
    },
    {
      "cell_type": "markdown",
      "source": [
        "Joining the elements of tag list into a single string, separated by a space."
      ],
      "metadata": {
        "id": "1GOy8xnF93b4"
      }
    },
    {
      "cell_type": "code",
      "source": [
        "newMovie['tags'] = newMovie['tags'].apply(lambda x: \" \".join(x))"
      ],
      "metadata": {
        "id": "rVtxT9gs2pqp"
      },
      "execution_count": null,
      "outputs": []
    },
    {
      "cell_type": "code",
      "source": [
        "newMovie.head(3)"
      ],
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 143
        },
        "id": "EUVQYKgs3J7l",
        "outputId": "d056f8d8-9864-4522-e86a-036def61d01a"
      },
      "execution_count": null,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/plain": [
              "   movie_id                                     title  \\\n",
              "0     19995                                    Avatar   \n",
              "1       285  Pirates of the Caribbean: At World's End   \n",
              "2    206647                                   Spectre   \n",
              "\n",
              "                                                tags  \n",
              "0  In the 22nd century, a paraplegic Marine is di...  \n",
              "1  Captain Barbossa, long believed to be dead, ha...  \n",
              "2  A cryptic message from Bond’s past sends him o...  "
            ],
            "text/html": [
              "\n",
              "  <div id=\"df-80c1258b-7e28-4f82-9d98-e66a55cc88ba\">\n",
              "    <div class=\"colab-df-container\">\n",
              "      <div>\n",
              "<style scoped>\n",
              "    .dataframe tbody tr th:only-of-type {\n",
              "        vertical-align: middle;\n",
              "    }\n",
              "\n",
              "    .dataframe tbody tr th {\n",
              "        vertical-align: top;\n",
              "    }\n",
              "\n",
              "    .dataframe thead th {\n",
              "        text-align: right;\n",
              "    }\n",
              "</style>\n",
              "<table border=\"1\" class=\"dataframe\">\n",
              "  <thead>\n",
              "    <tr style=\"text-align: right;\">\n",
              "      <th></th>\n",
              "      <th>movie_id</th>\n",
              "      <th>title</th>\n",
              "      <th>tags</th>\n",
              "    </tr>\n",
              "  </thead>\n",
              "  <tbody>\n",
              "    <tr>\n",
              "      <th>0</th>\n",
              "      <td>19995</td>\n",
              "      <td>Avatar</td>\n",
              "      <td>In the 22nd century, a paraplegic Marine is di...</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>1</th>\n",
              "      <td>285</td>\n",
              "      <td>Pirates of the Caribbean: At World's End</td>\n",
              "      <td>Captain Barbossa, long believed to be dead, ha...</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>2</th>\n",
              "      <td>206647</td>\n",
              "      <td>Spectre</td>\n",
              "      <td>A cryptic message from Bond’s past sends him o...</td>\n",
              "    </tr>\n",
              "  </tbody>\n",
              "</table>\n",
              "</div>\n",
              "      <button class=\"colab-df-convert\" onclick=\"convertToInteractive('df-80c1258b-7e28-4f82-9d98-e66a55cc88ba')\"\n",
              "              title=\"Convert this dataframe to an interactive table.\"\n",
              "              style=\"display:none;\">\n",
              "        \n",
              "  <svg xmlns=\"http://www.w3.org/2000/svg\" height=\"24px\"viewBox=\"0 0 24 24\"\n",
              "       width=\"24px\">\n",
              "    <path d=\"M0 0h24v24H0V0z\" fill=\"none\"/>\n",
              "    <path d=\"M18.56 5.44l.94 2.06.94-2.06 2.06-.94-2.06-.94-.94-2.06-.94 2.06-2.06.94zm-11 1L8.5 8.5l.94-2.06 2.06-.94-2.06-.94L8.5 2.5l-.94 2.06-2.06.94zm10 10l.94 2.06.94-2.06 2.06-.94-2.06-.94-.94-2.06-.94 2.06-2.06.94z\"/><path d=\"M17.41 7.96l-1.37-1.37c-.4-.4-.92-.59-1.43-.59-.52 0-1.04.2-1.43.59L10.3 9.45l-7.72 7.72c-.78.78-.78 2.05 0 2.83L4 21.41c.39.39.9.59 1.41.59.51 0 1.02-.2 1.41-.59l7.78-7.78 2.81-2.81c.8-.78.8-2.07 0-2.86zM5.41 20L4 18.59l7.72-7.72 1.47 1.35L5.41 20z\"/>\n",
              "  </svg>\n",
              "      </button>\n",
              "      \n",
              "  <style>\n",
              "    .colab-df-container {\n",
              "      display:flex;\n",
              "      flex-wrap:wrap;\n",
              "      gap: 12px;\n",
              "    }\n",
              "\n",
              "    .colab-df-convert {\n",
              "      background-color: #E8F0FE;\n",
              "      border: none;\n",
              "      border-radius: 50%;\n",
              "      cursor: pointer;\n",
              "      display: none;\n",
              "      fill: #1967D2;\n",
              "      height: 32px;\n",
              "      padding: 0 0 0 0;\n",
              "      width: 32px;\n",
              "    }\n",
              "\n",
              "    .colab-df-convert:hover {\n",
              "      background-color: #E2EBFA;\n",
              "      box-shadow: 0px 1px 2px rgba(60, 64, 67, 0.3), 0px 1px 3px 1px rgba(60, 64, 67, 0.15);\n",
              "      fill: #174EA6;\n",
              "    }\n",
              "\n",
              "    [theme=dark] .colab-df-convert {\n",
              "      background-color: #3B4455;\n",
              "      fill: #D2E3FC;\n",
              "    }\n",
              "\n",
              "    [theme=dark] .colab-df-convert:hover {\n",
              "      background-color: #434B5C;\n",
              "      box-shadow: 0px 1px 3px 1px rgba(0, 0, 0, 0.15);\n",
              "      filter: drop-shadow(0px 1px 2px rgba(0, 0, 0, 0.3));\n",
              "      fill: #FFFFFF;\n",
              "    }\n",
              "  </style>\n",
              "\n",
              "      <script>\n",
              "        const buttonEl =\n",
              "          document.querySelector('#df-80c1258b-7e28-4f82-9d98-e66a55cc88ba button.colab-df-convert');\n",
              "        buttonEl.style.display =\n",
              "          google.colab.kernel.accessAllowed ? 'block' : 'none';\n",
              "\n",
              "        async function convertToInteractive(key) {\n",
              "          const element = document.querySelector('#df-80c1258b-7e28-4f82-9d98-e66a55cc88ba');\n",
              "          const dataTable =\n",
              "            await google.colab.kernel.invokeFunction('convertToInteractive',\n",
              "                                                     [key], {});\n",
              "          if (!dataTable) return;\n",
              "\n",
              "          const docLinkHtml = 'Like what you see? Visit the ' +\n",
              "            '<a target=\"_blank\" href=https://colab.research.google.com/notebooks/data_table.ipynb>data table notebook</a>'\n",
              "            + ' to learn more about interactive tables.';\n",
              "          element.innerHTML = '';\n",
              "          dataTable['output_type'] = 'display_data';\n",
              "          await google.colab.output.renderOutput(dataTable, element);\n",
              "          const docLink = document.createElement('div');\n",
              "          docLink.innerHTML = docLinkHtml;\n",
              "          element.appendChild(docLink);\n",
              "        }\n",
              "      </script>\n",
              "    </div>\n",
              "  </div>\n",
              "  "
            ]
          },
          "metadata": {},
          "execution_count": 72
        }
      ]
    },
    {
      "cell_type": "markdown",
      "source": [
        "Converting all the value in the tags column in lower case"
      ],
      "metadata": {
        "id": "abTMonrH-DgW"
      }
    },
    {
      "cell_type": "code",
      "source": [
        "newMovie['tags'] = newMovie['tags'].apply(lambda x:x.lower())"
      ],
      "metadata": {
        "id": "5-Y2d9w73jMR"
      },
      "execution_count": null,
      "outputs": []
    },
    {
      "cell_type": "code",
      "source": [
        "newMovie.head()"
      ],
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 206
        },
        "id": "5-u1Lz9u3zxg",
        "outputId": "a3faa338-126d-4147-b1ab-1fcb821ef9bd"
      },
      "execution_count": null,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/plain": [
              "   movie_id                                     title  \\\n",
              "0     19995                                    Avatar   \n",
              "1       285  Pirates of the Caribbean: At World's End   \n",
              "2    206647                                   Spectre   \n",
              "3     49026                     The Dark Knight Rises   \n",
              "4     49529                               John Carter   \n",
              "\n",
              "                                                tags  \n",
              "0  in the 22nd century, a paraplegic marine is di...  \n",
              "1  captain barbossa, long believed to be dead, ha...  \n",
              "2  a cryptic message from bond’s past sends him o...  \n",
              "3  following the death of district attorney harve...  \n",
              "4  john carter is a war-weary, former military ca...  "
            ],
            "text/html": [
              "\n",
              "  <div id=\"df-1e023eab-7601-4a38-a797-7273876b6dc3\">\n",
              "    <div class=\"colab-df-container\">\n",
              "      <div>\n",
              "<style scoped>\n",
              "    .dataframe tbody tr th:only-of-type {\n",
              "        vertical-align: middle;\n",
              "    }\n",
              "\n",
              "    .dataframe tbody tr th {\n",
              "        vertical-align: top;\n",
              "    }\n",
              "\n",
              "    .dataframe thead th {\n",
              "        text-align: right;\n",
              "    }\n",
              "</style>\n",
              "<table border=\"1\" class=\"dataframe\">\n",
              "  <thead>\n",
              "    <tr style=\"text-align: right;\">\n",
              "      <th></th>\n",
              "      <th>movie_id</th>\n",
              "      <th>title</th>\n",
              "      <th>tags</th>\n",
              "    </tr>\n",
              "  </thead>\n",
              "  <tbody>\n",
              "    <tr>\n",
              "      <th>0</th>\n",
              "      <td>19995</td>\n",
              "      <td>Avatar</td>\n",
              "      <td>in the 22nd century, a paraplegic marine is di...</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>1</th>\n",
              "      <td>285</td>\n",
              "      <td>Pirates of the Caribbean: At World's End</td>\n",
              "      <td>captain barbossa, long believed to be dead, ha...</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>2</th>\n",
              "      <td>206647</td>\n",
              "      <td>Spectre</td>\n",
              "      <td>a cryptic message from bond’s past sends him o...</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>3</th>\n",
              "      <td>49026</td>\n",
              "      <td>The Dark Knight Rises</td>\n",
              "      <td>following the death of district attorney harve...</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>4</th>\n",
              "      <td>49529</td>\n",
              "      <td>John Carter</td>\n",
              "      <td>john carter is a war-weary, former military ca...</td>\n",
              "    </tr>\n",
              "  </tbody>\n",
              "</table>\n",
              "</div>\n",
              "      <button class=\"colab-df-convert\" onclick=\"convertToInteractive('df-1e023eab-7601-4a38-a797-7273876b6dc3')\"\n",
              "              title=\"Convert this dataframe to an interactive table.\"\n",
              "              style=\"display:none;\">\n",
              "        \n",
              "  <svg xmlns=\"http://www.w3.org/2000/svg\" height=\"24px\"viewBox=\"0 0 24 24\"\n",
              "       width=\"24px\">\n",
              "    <path d=\"M0 0h24v24H0V0z\" fill=\"none\"/>\n",
              "    <path d=\"M18.56 5.44l.94 2.06.94-2.06 2.06-.94-2.06-.94-.94-2.06-.94 2.06-2.06.94zm-11 1L8.5 8.5l.94-2.06 2.06-.94-2.06-.94L8.5 2.5l-.94 2.06-2.06.94zm10 10l.94 2.06.94-2.06 2.06-.94-2.06-.94-.94-2.06-.94 2.06-2.06.94z\"/><path d=\"M17.41 7.96l-1.37-1.37c-.4-.4-.92-.59-1.43-.59-.52 0-1.04.2-1.43.59L10.3 9.45l-7.72 7.72c-.78.78-.78 2.05 0 2.83L4 21.41c.39.39.9.59 1.41.59.51 0 1.02-.2 1.41-.59l7.78-7.78 2.81-2.81c.8-.78.8-2.07 0-2.86zM5.41 20L4 18.59l7.72-7.72 1.47 1.35L5.41 20z\"/>\n",
              "  </svg>\n",
              "      </button>\n",
              "      \n",
              "  <style>\n",
              "    .colab-df-container {\n",
              "      display:flex;\n",
              "      flex-wrap:wrap;\n",
              "      gap: 12px;\n",
              "    }\n",
              "\n",
              "    .colab-df-convert {\n",
              "      background-color: #E8F0FE;\n",
              "      border: none;\n",
              "      border-radius: 50%;\n",
              "      cursor: pointer;\n",
              "      display: none;\n",
              "      fill: #1967D2;\n",
              "      height: 32px;\n",
              "      padding: 0 0 0 0;\n",
              "      width: 32px;\n",
              "    }\n",
              "\n",
              "    .colab-df-convert:hover {\n",
              "      background-color: #E2EBFA;\n",
              "      box-shadow: 0px 1px 2px rgba(60, 64, 67, 0.3), 0px 1px 3px 1px rgba(60, 64, 67, 0.15);\n",
              "      fill: #174EA6;\n",
              "    }\n",
              "\n",
              "    [theme=dark] .colab-df-convert {\n",
              "      background-color: #3B4455;\n",
              "      fill: #D2E3FC;\n",
              "    }\n",
              "\n",
              "    [theme=dark] .colab-df-convert:hover {\n",
              "      background-color: #434B5C;\n",
              "      box-shadow: 0px 1px 3px 1px rgba(0, 0, 0, 0.15);\n",
              "      filter: drop-shadow(0px 1px 2px rgba(0, 0, 0, 0.3));\n",
              "      fill: #FFFFFF;\n",
              "    }\n",
              "  </style>\n",
              "\n",
              "      <script>\n",
              "        const buttonEl =\n",
              "          document.querySelector('#df-1e023eab-7601-4a38-a797-7273876b6dc3 button.colab-df-convert');\n",
              "        buttonEl.style.display =\n",
              "          google.colab.kernel.accessAllowed ? 'block' : 'none';\n",
              "\n",
              "        async function convertToInteractive(key) {\n",
              "          const element = document.querySelector('#df-1e023eab-7601-4a38-a797-7273876b6dc3');\n",
              "          const dataTable =\n",
              "            await google.colab.kernel.invokeFunction('convertToInteractive',\n",
              "                                                     [key], {});\n",
              "          if (!dataTable) return;\n",
              "\n",
              "          const docLinkHtml = 'Like what you see? Visit the ' +\n",
              "            '<a target=\"_blank\" href=https://colab.research.google.com/notebooks/data_table.ipynb>data table notebook</a>'\n",
              "            + ' to learn more about interactive tables.';\n",
              "          element.innerHTML = '';\n",
              "          dataTable['output_type'] = 'display_data';\n",
              "          await google.colab.output.renderOutput(dataTable, element);\n",
              "          const docLink = document.createElement('div');\n",
              "          docLink.innerHTML = docLinkHtml;\n",
              "          element.appendChild(docLink);\n",
              "        }\n",
              "      </script>\n",
              "    </div>\n",
              "  </div>\n",
              "  "
            ]
          },
          "metadata": {},
          "execution_count": 75
        }
      ]
    },
    {
      "cell_type": "code",
      "source": [
        "newMovie['tags'][0]"
      ],
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 87
        },
        "id": "pDHLJE8g_Iu7",
        "outputId": "afc457d7-bb77-4fb5-f405-e760694fc13d"
      },
      "execution_count": null,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/plain": [
              "'in the 22nd century, a paraplegic marine is dispatched to the moon pandora on a unique mission, but becomes torn between following orders and protecting an alien civilization. action adventure fantasy sciencefiction cultureclash future spacewar spacecolony society spacetravel futuristic romance space alien tribe alienplanet cgi marine soldier battle loveaffair antiwar powerrelations mindandsoul 3d samworthington zoesaldana sigourneyweaver jamescameron'"
            ],
            "application/vnd.google.colaboratory.intrinsic+json": {
              "type": "string"
            }
          },
          "metadata": {},
          "execution_count": 89
        }
      ]
    },
    {
      "cell_type": "markdown",
      "source": [
        "### Stemming \n",
        "\n",
        "Stemming is a technique in natural language processing that aims to reduce words to their base or root form. It helps to normalize words by removing suffixes or prefixes, so that different forms of the same word are treated as one."
      ],
      "metadata": {
        "id": "Y5U6Jgo1-eH8"
      }
    },
    {
      "cell_type": "code",
      "source": [
        "ps = PorterStemmer()"
      ],
      "metadata": {
        "id": "2o5Y1drV-alt"
      },
      "execution_count": null,
      "outputs": []
    },
    {
      "cell_type": "code",
      "source": [
        "def stem(text):\n",
        "  y= []\n",
        "  for i in text.split():\n",
        "    y.append(ps.stem(i))\n",
        "  return \" \".join(y)"
      ],
      "metadata": {
        "id": "E23ZjfN8-kag"
      },
      "execution_count": null,
      "outputs": []
    },
    {
      "cell_type": "code",
      "source": [
        "stem('in the 22nd century, a paraplegic marine is dispatched to the moon pandora on a unique mission, but becomes torn between following orders and protecting an alien civilization. action adventure fantasy sciencefiction cultureclash future spacewar spacecolony society spacetravel futuristic romance space alien tribe alienplanet cgi marine soldier battle loveaffair antiwar powerrelations mindandsoul 3d samworthington zoesaldana sigourneyweaver jamescameron')"
      ],
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 87
        },
        "id": "_5z4cbkQ_N7F",
        "outputId": "9541e6f5-814d-4d05-90f1-e66a0e549be7"
      },
      "execution_count": null,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/plain": [
              "'in the 22nd century, a parapleg marin is dispatch to the moon pandora on a uniqu mission, but becom torn between follow order and protect an alien civilization. action adventur fantasi sciencefict cultureclash futur spacewar spacecoloni societi spacetravel futurist romanc space alien tribe alienplanet cgi marin soldier battl loveaffair antiwar powerrel mindandsoul 3d samworthington zoesaldana sigourneyweav jamescameron'"
            ],
            "application/vnd.google.colaboratory.intrinsic+json": {
              "type": "string"
            }
          },
          "metadata": {},
          "execution_count": 92
        }
      ]
    },
    {
      "cell_type": "code",
      "source": [
        "newMovie['tags'] = newMovie['tags'].apply(stem)"
      ],
      "metadata": {
        "id": "3hBYDIkN_t5H"
      },
      "execution_count": null,
      "outputs": []
    },
    {
      "cell_type": "markdown",
      "source": [
        "## Modeling"
      ],
      "metadata": {
        "id": "EipcB6I6_8tW"
      }
    },
    {
      "cell_type": "markdown",
      "source": [
        "### Text Vectorization\n",
        "Rrepresenting words, sentences, or even larger units of text as vectors.\n",
        "\n",
        "There are three most used techniques to convert text into numeric feature vectors namely \n",
        "- Bag of Words\n",
        "- tf-idf vectorization \n",
        "- word embedding\n",
        "\n",
        "https://www.deepset.ai/blog/what-is-text-vectorization-in-nlp\n",
        "\n",
        "https://towardsdatascience.com/basics-of-countvectorizer-e26677900f9c#:~:text=Countvectorizer%20is%20a%20method%20to,sparse%20matrix%20as%20shown%20below."
      ],
      "metadata": {
        "id": "sJnrXwLo3-Bv"
      }
    },
    {
      "cell_type": "code",
      "source": [
        "cv = CountVectorizer(max_features= 5000,\n",
        "                     stop_words='english')"
      ],
      "metadata": {
        "id": "SZRkSwM-320U"
      },
      "execution_count": null,
      "outputs": []
    },
    {
      "cell_type": "code",
      "source": [
        "vector = cv.fit_transform(newMovie['tags']).toarray()"
      ],
      "metadata": {
        "id": "o5nrRj_u7Tft"
      },
      "execution_count": null,
      "outputs": []
    },
    {
      "cell_type": "code",
      "source": [
        "vector.shape"
      ],
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "pxUgLljD7qgD",
        "outputId": "dd3be97d-72bf-442c-db9a-ccf42f14b5f3"
      },
      "execution_count": null,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/plain": [
              "(4806, 5000)"
            ]
          },
          "metadata": {},
          "execution_count": 97
        }
      ]
    },
    {
      "cell_type": "code",
      "source": [
        "cv.get_feature_names_out()"
      ],
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "tflXml4F7z8V",
        "outputId": "4adabf0c-1473-4a4a-9c5b-f344e6984d7f"
      },
      "execution_count": null,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/plain": [
              "array(['000', '007', '10', '100', '11', '12', '13', '14', '15', '16',\n",
              "       '17', '17th', '18', '18th', '18thcenturi', '19', '1910', '1920',\n",
              "       '1930', '1940', '1944', '1950', '1950s', '1960', '1960s', '1970',\n",
              "       '1970s', '1971', '1974', '1976', '1980', '1985', '1990', '1999',\n",
              "       '19th', '19thcenturi', '20', '200', '2003', '2009', '20th', '21st',\n",
              "       '23', '24', '25', '30', '300', '3d', '40', '50', '500', '60', '70',\n",
              "       '80', 'aaron', 'aaroneckhart', 'abandon', 'abduct',\n",
              "       'abigailbreslin', 'abil', 'abl', 'aboard', 'abov', 'abus',\n",
              "       'academ', 'academi', 'accept', 'access', 'accid', 'accident',\n",
              "       'acclaim', 'accompani', 'accomplish', 'account', 'accus', 'ace',\n",
              "       'achiev', 'acquaint', 'act', 'action', 'actionhero', 'activ',\n",
              "       'activist', 'activities', 'actor', 'actress', 'actual', 'ad',\n",
              "       'adam', 'adamsandl', 'adamshankman', 'adapt', 'add', 'addict',\n",
              "       'adjust', 'admir', 'admit', 'adolesc', 'adopt', 'ador',\n",
              "       'adrienbrodi', 'adult', 'adultanim', 'adulteri', 'adulthood',\n",
              "       'advanc', 'adventur', 'adventure', 'adventures', 'advertis',\n",
              "       'advic', 'advis', 'affair', 'affect', 'afghanistan', 'africa',\n",
              "       'african', 'africanamerican', 'aftercreditssting', 'afterlif',\n",
              "       'aftermath', 'ag', 'age', 'agediffer', 'agenc', 'agency', 'agenda',\n",
              "       'agent', 'agents', 'aggress', 'ago', 'agre', 'ahead', 'aid',\n",
              "       'aidanquinn', 'ail', 'aim', 'air', 'airplan', 'airplanecrash',\n",
              "       'airport', 'aka', 'al', 'alabama', 'alan', 'alaska', 'albert',\n",
              "       'alcatraz', 'alcohol', 'alecbaldwin', 'alex', 'alexkendrick',\n",
              "       'alfredhitchcock', 'alfredmolina', 'ali', 'alic', 'alice', 'alien',\n",
              "       'alieninvas', 'alienlife', 'alienplanet', 'aliens', 'alik', 'aliv',\n",
              "       'alive', 'allen', 'alli', 'allianc', 'allow', 'alon', 'alongsid',\n",
              "       'alpacino', 'alpha', 'alreadi', 'alter', 'altern', 'alway',\n",
              "       'alyssa', 'alzheimer', 'amanda', 'amandapeet', 'amandaseyfri',\n",
              "       'amateur', 'amaz', 'amazon', 'ambassador', 'ambit', 'ambiti',\n",
              "       'ambul', 'ambush', 'america', 'american', 'americanabroad',\n",
              "       'americancivilwar', 'americanfootbal', 'americanfootballplay',\n",
              "       'amid', 'amidst', 'amnesia', 'amp', 'amsterdam', 'amus',\n",
              "       'amusementpark', 'amy', 'amyadam', 'amysmart', 'ana', 'anakin',\n",
              "       'analyst', 'anarchiccomedi', 'ancient', 'ancientrom',\n",
              "       'ancientworld', 'anderson', 'andi', 'andiemacdowel', 'andrew',\n",
              "       'android', 'andy', 'andygarcía', 'angel', 'angela',\n",
              "       'angelabassett', 'angeles', 'angelinajoli', 'anger', 'angle',\n",
              "       'angri', 'ani', 'anim', 'animalattack', 'animalhorror', 'animals',\n",
              "       'anjelicahuston', 'ann', 'anna', 'annafari', 'annakendrick',\n",
              "       'anne', 'annehathaway', 'annemoss', 'annetteben', 'anni', 'annie',\n",
              "       'anniversari', 'announc', 'annual', 'anonym', 'anoth', 'answer',\n",
              "       'ant', 'antholog', 'anthoni', 'anthonyanderson', 'anthonyhopkin',\n",
              "       'anthropomorph', 'anti', 'antic', 'antihero', 'antiqu',\n",
              "       'antoinefuqua', 'antoniobandera', 'antonyelchin', 'anyon', 'anyth',\n",
              "       'apart', 'apartheid', 'apartment', 'ape', 'apocalyps',\n",
              "       'apocalypse', 'apocalypt', 'appar', 'appear', 'appl', 'apple',\n",
              "       'appoint', 'appreci', 'apprentic', 'approach', 'april', 'aquarium',\n",
              "       'arab', 'arch', 'archaeologist', 'archeolog', 'archer',\n",
              "       'architect', 'arctic', 'area', 'aren', 'arena', 'argument', 'aris',\n",
              "       'aristocrat', 'arm', 'armi', 'armor', 'armsdeal', 'army', 'arnold',\n",
              "       'arnoldschwarzenegg', 'arrang', 'arrangedmarriag', 'arrest',\n",
              "       'arriv', 'arrog', 'art', 'arthur', 'artifact', 'artifici',\n",
              "       'artificialintellig', 'artist', 'ash', 'ashley', 'ashleyjudd',\n",
              "       'ashtonkutch', 'asia', 'asian', 'asid', 'ask', 'aspect', 'aspir',\n",
              "       'assassin', 'assault', 'assembl', 'assign', 'assist', 'assistant',\n",
              "       'associ', 'assum', 'asteroid', 'astronaut', 'asylum', 'atheist',\n",
              "       'athlet', 'atom', 'atomicbomb', 'attack', 'attacks', 'attempt',\n",
              "       'attend', 'attent', 'attic', 'attitud', 'attorney', 'attract',\n",
              "       'auction', 'audienc', 'audit', 'august', 'aunt', 'austin',\n",
              "       'australia', 'australian', 'author', 'autism', 'auto',\n",
              "       'automobilerac', 'aveng', 'averag', 'avoid', 'await', 'awak',\n",
              "       'awaken', 'awar', 'award', 'away', 'awkward', 'awri', 'awry', 'ax',\n",
              "       'babe', 'babi', 'baby', 'bachelor', 'backdrop', 'background',\n",
              "       'backpack', 'bad', 'bag', 'bahama', 'bail', 'balanc', 'ball',\n",
              "       'ballet', 'balloon', 'baltimor', 'ban', 'band', 'bandit',\n",
              "       'bangkok', 'banish', 'bank', 'banker', 'bankrobb', 'bankrobberi',\n",
              "       'bar', 'barbrastreisand', 'bare', 'bargain', 'barn', 'barney',\n",
              "       'baron', 'barri', 'barrylevinson', 'barrysonnenfeld', 'bas',\n",
              "       'base', 'basebal', 'basedoncomicbook', 'basedongraphicnovel',\n",
              "       'basedonnovel', 'basedonplay', 'basedonstagemus', 'basedontrueev',\n",
              "       'basedontruestori', 'basedontvseri', 'basedonvideogam',\n",
              "       'basedonyoungadultnovel', 'basement', 'basketbal', 'basketball',\n",
              "       'bat', 'batman', 'battl', 'battle', 'battlefield', 'bay', 'beach',\n",
              "       'beam', 'bear', 'beard', 'beast', 'beat', 'beauti', 'beautiful',\n",
              "       'beautifulwoman', 'beauty', 'becam', 'becaus', 'becki', 'becom',\n",
              "       'becominganadult', 'bed', 'bedroom', 'bee', 'beer', 'befor',\n",
              "       'befriend', 'began', 'begin', 'begins', 'behavior', 'belief',\n",
              "       'believ', 'bell', 'bella', 'belong', 'belov', 'ben', 'benaffleck',\n",
              "       'bend', 'beneath', 'benefit', 'benfost', 'beniciodeltoro',\n",
              "       'benjamin', 'benjaminbratt', 'benkingsley', 'bennett', 'benstil',\n",
              "       'bent', 'berlin', 'best', 'bestfriend', 'bestfriendsinlov', 'bet',\n",
              "       'beth', 'betray', 'bettemidl', 'better', 'betti', 'beverli',\n",
              "       'bibl', 'bid', 'big', 'bigger', 'biggest', 'bike', 'biker',\n",
              "       'bikini', 'billhad', 'billi', 'billionair', 'billmurray',\n",
              "       'billnighi', 'billpaxton', 'billpullman', 'billybobthornton',\n",
              "       'billycrudup', 'billycryst', 'biographi', 'biolog', 'bird',\n",
              "       'birth', 'birthday', 'bisexu', 'bishop', 'bit', 'bite', 'bitter',\n",
              "       'bizarr', 'black', 'blackmag', 'blackmail', 'blackpeopl',\n",
              "       'blacksmith', 'blade', 'blame', 'blend', 'blind', 'bliss',\n",
              "       'blizzard', 'block', 'blond', 'blood', 'bloodi', 'bloodsplatt',\n",
              "       'bloodthirsti', 'blow', 'blue', 'board', 'boardingschool', 'boat',\n",
              "       'bob', 'bobbi', 'bobbyfarrelli', 'bobhoskin', 'bodi', 'body',\n",
              "       'bodyguard', 'bold', 'bollywood', 'bomb', 'bond', 'bone', 'book',\n",
              "       'border', 'bore', 'boredom', 'born', 'boss', 'boston', 'botch',\n",
              "       'bound', 'boundari', 'bounti', 'bountyhunt', 'bout', 'box',\n",
              "       'boxer', 'boy', 'boyfriend', 'boys', 'bradleycoop', 'bradpitt',\n",
              "       'brain', 'brainwash', 'brand', 'brandon', 'brave', 'braveri',\n",
              "       'brazil', 'brazilian', 'break', 'breakdown', 'breast', 'breath',\n",
              "       'breed', 'brendanfras', 'brendangleeson', 'brent', 'brettratn',\n",
              "       'brian', 'briandepalma', 'bride', 'bridesmaid', 'bridg', 'brief',\n",
              "       'brielarson', 'brien', 'bright', 'brilliant', 'bring', 'brink',\n",
              "       'britain', 'british', 'britishsecretservic', 'brittanymurphi',\n",
              "       'broadcast', 'broadway', 'broke', 'broken', 'broker', 'bronx',\n",
              "       'brook', 'brooklyn', 'broom', 'brothel', 'brother',\n",
              "       'brotherbrotherrelationship', 'brothers',\n",
              "       'brothersisterrelationship', 'brought', 'brown', 'bruce',\n",
              "       'brucegreenwood', 'brucewilli', 'brutal', 'bryansing', 'bu',\n",
              "       'buck', 'bud', 'buddi', 'buddy', 'buddycomedi', 'buddycop',\n",
              "       'budget', 'build', 'building', 'built', 'bullet', 'bulli', 'bumbl',\n",
              "       'bunch', 'bunker', 'bunni', 'burglar', 'buri', 'burn', 'bush',\n",
              "       'busi', 'business', 'businessman', 'bust', 'butcher', 'butler',\n",
              "       'butt', 'button', 'buy', 'buzz', 'cabin', 'caesar', 'cage',\n",
              "       'cairo', 'cal', 'california', 'calvin', 'camcord', 'came',\n",
              "       'camera', 'cameraman', 'camerondiaz', 'camp', 'campaign',\n",
              "       'campbell', 'campu', 'canada', 'canadian', 'cancer', 'candi',\n",
              "       'candid', 'canin', 'cannib', 'canuxploit', 'capabl', 'caper',\n",
              "       'capit', 'capt', 'captain', 'captiv', 'captur', 'capture', 'car',\n",
              "       'caraccid', 'carchas', 'carcrash', 'card', 'care', 'career',\n",
              "       'carefre', 'caretak', 'careymulligan', 'caribbean', 'carjourney',\n",
              "       'carl', 'carlagugino', 'carmen', 'carol', 'carolina', 'carrac',\n",
              "       'carri', 'carrie', 'cartel', 'carter', 'cartoon', 'caryelw',\n",
              "       'case', 'caseyaffleck', 'cash', 'casino', 'cast', 'castl', 'cat',\n",
              "       'cataclysm', 'catastroph', 'catch', 'cateblanchett',\n",
              "       'catherinedeneuv', 'catherinekeen', 'catherinezeta', 'cathol',\n",
              "       'catholic', 'cattl', 'caught', 'caus', 'cavalri', 'cave',\n",
              "       'cavemen', 'celebr', 'celebration', 'cell', 'cellphon', 'cemeteri',\n",
              "       'center', 'centr', 'central', 'centuri', 'centuries', 'century',\n",
              "       'ceo', 'certain', 'chad', 'chain', 'chainsaw', 'challeng',\n",
              "       'chamber', 'champion', 'championship', 'chanc', 'chance', 'chang',\n",
              "       'change', 'changed', 'changes', 'channingtatum', 'chao', 'chaos',\n",
              "       'chaotic', 'chapter', 'charact', 'character', 'characters',\n",
              "       'charg', 'charismat', 'charl', 'charli', 'charlie', 'charliesheen',\n",
              "       'charlizetheron', 'charm', 'chart', 'chase', 'chauffeur',\n",
              "       'chazzpalminteri', 'cheat', 'check', 'cheerlead', 'chef', 'chemic',\n",
              "       'cher', 'chevychas', 'chicago', 'chicken', 'chief', 'child',\n",
              "       'childabus', 'childhero', 'childhood', 'childprodigi', 'children',\n",
              "       'chill', 'chimp', 'china', 'chines', 'chip', 'chipmunk',\n",
              "       'chiwetelejiofor', 'chloe', 'chloëgracemoretz', 'chloësevigni',\n",
              "       'chocol', 'choic', 'choice', 'choos', 'chosen', 'chowyun', 'chri',\n",
              "       'chriscolumbu', 'chriscoop', 'chrisevan', 'chrishemsworth',\n",
              "       'chrisklein', 'chrispin', 'chrisrock', 'christ', 'christian',\n",
              "       'christianbal', 'christianslat', 'christin', 'christinaappleg',\n",
              "       'christinaricci', 'christma', 'christmas', 'christmasparti',\n",
              "       'christmastre', 'christoph', 'christopherlambert',\n",
              "       'christopherlloyd', 'christophernolan', 'christopherplumm',\n",
              "       'christopherwalken', 'christophwaltz', 'chrisweitz', 'chronicl',\n",
              "       'chuck', 'church', 'cia', 'ciaránhind', 'cigarettesmok',\n",
              "       'cillianmurphi', 'cinema', 'circl', 'circu', 'circuit', 'circumst',\n",
              "       'citi', 'citizen', 'city', 'civil', 'civilian', 'civilwar',\n",
              "       'claim', 'clair', 'clairedan', 'claireforlani', 'clan', 'clark',\n",
              "       'clash', 'class', 'classdiffer', 'classic', 'classmat',\n",
              "       'classroom', 'claudevandamm', 'clay', 'clean', 'clear', 'clerk',\n",
              "       'clever', 'client', 'clients', 'cliff', 'climat', 'climb',\n",
              "       'clinteastwood', 'cliveowen', 'clock', 'clone', 'close', 'closer',\n",
              "       'cloud', 'clown', 'club', 'clue', 'clueless', 'clutch', 'coach',\n",
              "       'coast', 'cocain', 'code', 'coffin', 'cohen', 'col', 'cold',\n",
              "       'coldwar', 'cole', 'colin', 'colinfarrel', 'colinfirth', 'collaps',\n",
              "       'colleagu', 'collect', 'collector', 'colleg', 'college', 'collid',\n",
              "       'collis', 'colombia', 'colonel', 'coloni', 'color', 'colorado',\n",
              "       'coma', 'combat', 'combin', 'come', 'comeback', 'comed', 'comedi',\n",
              "       'comedian', 'comedy', 'comet', 'comfort', 'comic', 'coming',\n",
              "       'comingofag', 'comingout', 'command', 'commando', 'commerci',\n",
              "       'commiss', 'commit', 'common', 'commun', 'communist', 'community',\n",
              "       'compani', 'companion', 'company', 'compet', 'competit',\n",
              "       'competition', 'complet', 'complex', 'complic', 'compos',\n",
              "       'compuls', 'comput', 'computerviru', 'conan', 'concern', 'concert',\n",
              "       'concoct', 'condit', 'condition', 'conduct', 'confeder', 'confess',\n",
              "       'confid', 'confin', 'conflict', 'confront', 'confus', 'congress',\n",
              "       'conman', 'connect', 'connecticut', 'connel', 'connor', 'conquer',\n",
              "       'consequ', 'consequences', 'conserv', 'consid', 'conspir',\n",
              "       'conspiraci', 'conspiracy', 'constant', 'constantli', 'construct',\n",
              "       'consum', 'contact', 'contain', 'contemporari', 'contend',\n",
              "       'content', 'contest', 'continu', 'contract', 'contractor',\n",
              "       'control', 'controversi', 'convent', 'converg', 'convers',\n",
              "       'convict', 'convinc', 'cook', 'cool', 'cooper', 'cop', 'cope',\n",
              "       'cops', 'core', 'corner', 'corp', 'corpor', 'corporation', 'corps',\n",
              "       'corrupt', 'cost', 'costum', 'couldn', 'counselor', 'count',\n",
              "       'countess', 'countless', 'countri', 'country', 'countryhous',\n",
              "       'countrymus', 'countrysid', 'coup', 'coupl', 'couple', 'courag',\n",
              "       'cours', 'court', 'courtcas', 'courteneycox', 'courtroom',\n",
              "       'cousin', 'cover', 'covert', 'covet', 'cow', 'cowardli', 'cowboy',\n",
              "       'crab', 'crack', 'craft', 'craig', 'crane', 'crash', 'crave',\n",
              "       'crazi', 'creat', 'creation', 'creativ', 'creator', 'creatur',\n",
              "       'creature', 'creatures', 'credit', 'creepi', 'crew', 'cri',\n",
              "       'crime', 'crimefight', 'crimes', 'crimin', 'criminal', 'criminals',\n",
              "       'crisi', 'crisis', 'critic', 'crocodil', 'crook', 'cross',\n",
              "       'crossdress', 'crowd', 'crown', 'cruel', 'cruelti', 'cruis',\n",
              "       'crusad', 'crush', 'crystal', 'cuba', 'cubagoodingjr', 'culmin',\n",
              "       'cult', 'cultfilm', 'cultur', 'culture', 'cultureclash', 'cun',\n",
              "       'cup', 'cure', 'current', 'curs', 'curse', 'custodi', 'custom',\n",
              "       'cut', 'cuttingthecord', 'cyberpunk', 'cyborg', 'cynic', 'dad',\n",
              "       'daili', 'dakotafan', 'dale', 'damag', 'damon', 'dan',\n",
              "       'danaykroyd', 'danc', 'dancer', 'danger', 'daniel', 'danielcraig',\n",
              "       'danielday', 'danielradcliff', 'danni', 'danny', 'dannyboyl',\n",
              "       'dannydevito', 'dannyglov', 'dare', 'dark', 'darkcomedi',\n",
              "       'darkest', 'darkness', 'darylhannah', 'dash', 'date', 'daughter',\n",
              "       'daughters', 'dave', 'davi', 'david', 'davidarquett',\n",
              "       'davidcronenberg', 'davidduchovni', 'davidfinch',\n",
              "       'davidgordongreen', 'davidmors', 'davido', 'davidschwimm',\n",
              "       'davidspad', 'davidthewli', 'dawn', 'daxshepard', 'day',\n",
              "       'daydream', 'days', 'dc', 'dccomic', 'dea', 'dead', 'deadli',\n",
              "       'deadliest', 'deaf', 'deal', 'dealer', 'dean', 'death',\n",
              "       'deathofafriend', 'deathoffath', 'deathpenalti', 'debt', 'debut',\n",
              "       'decad', 'decapit', 'deceas', 'deceit', 'decept', 'decid', 'decis',\n",
              "       'declar', 'dedic', 'deed', 'deep', 'deeper', 'deepli', 'defeat',\n",
              "       'defend', 'defens', 'defi', 'defin', 'delight', 'deliv',\n",
              "       'deliveri', 'delus', 'demand', 'demimoor', 'demon',\n",
              "       'demonicpossess', 'demons', 'deni', 'deniserichard', 'denmark',\n",
              "       'denni', 'dennisdugan', 'dennishopp', 'dennisquaid', 'dentist',\n",
              "       'denzelwashington', 'depart', 'depend', 'depict', 'depress',\n",
              "       'depth', 'deputi', 'derang', 'derek', 'derekluk', 'descend',\n",
              "       'describ', 'desert', 'design', 'desir', 'desk', 'desol', 'despair',\n",
              "       'desper', 'despit', 'destin', 'destini', 'destiny', 'destroy',\n",
              "       'destroyed', 'destruct', 'destruction', 'detect', 'detective',\n",
              "       'determin', 'detroit', 'devast', 'develop', 'devic', 'devil',\n",
              "       'deviou', 'devis', 'devot', 'diabol', 'diagnos', 'dialogu',\n",
              "       'diamond', 'dian', 'dianekeaton', 'dianekrug', 'dianelan', 'diari',\n",
              "       'dick', 'dictat', 'did', 'didn', 'die', 'died', 'diego', 'dies',\n",
              "       'differ', 'different', 'difficult', 'difficulti', 'dig', 'dilemma',\n",
              "       'diner', 'dinner', 'dinosaur', 'diplomat', 'dire', 'direct',\n",
              "       'director', 'dirt', 'dirti', 'dirtycop', 'disabl', 'disappear',\n",
              "       'disappears', 'disast', 'disaster', 'disastr', 'discov',\n",
              "       'discoveri', 'diseas', 'disease', 'disfigur', 'disgrac', 'disguis',\n",
              "       'dishonesti', 'disillus', 'disney', 'disord', 'dispatch',\n",
              "       'disrupt', 'distant', 'district', 'distrust', 'disturb', 'ditch',\n",
              "       'diva', 'dive', 'divid', 'divis', 'divorc', 'divorce', 'dj', 'dna',\n",
              "       'doc', 'doctor', 'document', 'documentari', 'dodg', 'doe', 'doesn',\n",
              "       'dog', 'doll', 'dollar', 'dolphin', 'domest', 'domin', 'don',\n",
              "       'donaldpetri', 'donaldsutherland', 'doncheadl', 'donnel', 'doom',\n",
              "       'doomsday', 'door', 'doorstep', 'doppelgang', 'dorothi', 'doubl',\n",
              "       'double', 'doublecross', 'doublelif', 'doubt', 'doug', 'dougliman',\n",
              "       'dr', 'dracula', 'drag', 'dragon', 'drama', 'dramat', 'draw',\n",
              "       'drawn', 'dread', 'dream', 'dreams', 'dress', 'drew',\n",
              "       'drewbarrymor', 'drift', 'drifter', 'drink', 'drive', 'driven',\n",
              "       'driver', 'drone', 'drop', 'drown', 'drug', 'drugabus',\n",
              "       'drugaddict', 'drugdeal', 'druglord', 'drugs', 'drugsmuggl',\n",
              "       'drugtraff', 'drugus', 'drunk', 'drunken', 'du', 'dualident',\n",
              "       'dub', 'duck', 'dude', 'duel', 'duke', 'dump', 'duo', 'dure',\n",
              "       'duringcreditssting', 'dustinhoffman', 'dutch', 'duti', 'dwarv',\n",
              "       'dwaynejohnson', 'dyinganddeath', 'dylan', 'dynam', 'dynasti',\n",
              "       'dysfunct', 'dysfunctionalfamili', 'dystopia', 'dystopicfutur',\n",
              "       'eager', 'earli', 'earlier', 'earn', 'earth', 'earthquak', 'easi',\n",
              "       'easili', 'east', 'eat', 'eccentr', 'econom', 'economi', 'eddi',\n",
              "       'eddiegriffin', 'eddiemurphi', 'edg', 'edgar', 'edharri', 'editor',\n",
              "       'educ', 'edward', 'edwardburn', 'edwardnorton', 'edwardzwick',\n",
              "       'effect', 'effort', 'egg', 'ego', 'egypt', 'egyptian', 'el',\n",
              "       'elabor', 'elderli', 'elect', 'element', 'eleph', 'elev',\n",
              "       'eliaskotea', 'elijahwood', 'elimin', 'elisabethshu', 'elit',\n",
              "       'elite', 'elizabeth', 'elizabethbank', 'ella', 'ellenburstyn',\n",
              "       'ellenpag', 'elli', 'elliot', 'elliott', 'els', 'elud', 'elus',\n",
              "       'elv', 'elvi', 'embark', 'embassi', 'embroil', 'emerg', 'emigr',\n",
              "       'emilehirsch', 'emili', 'emilyblunt', 'emilymortim', 'emilywatson',\n",
              "       'emma', 'emmarobert', 'emmaston', 'emmathompson', 'emmawatson',\n",
              "       'emot', 'emperor', 'empir', 'empire', 'employ', 'employe',\n",
              "       'employer', 'enabl', 'enchant', 'encount', 'encourag', 'end',\n",
              "       'endless', 'endoftheworld', 'endur', 'enemi', 'enemies', 'enemy',\n",
              "       'energi', 'enforc', 'engag', 'engin', 'england', 'english',\n",
              "       'enigmat', 'enjoy', 'enlist', 'enorm', 'enrol', 'ensemblecast',\n",
              "       'ensu', 'ensues', 'ensur', 'entangl', 'enter', 'enterpris',\n",
              "       'entertain', 'enthusiast', 'entir', 'entiti', 'environ',\n",
              "       'environment', 'epic', 'epidem', 'episod', 'equal', 'era', 'eric',\n",
              "       'ericbana', 'erin', 'ernest', 'erotic', 'erupt', 'escap',\n",
              "       'escapad', 'escape', 'escapefromprison', 'escort', 'especi',\n",
              "       'espionag', 'establish', 'estat', 'estrang', 'etern', 'ethan',\n",
              "       'ethanhawk', 'ethic', 'eugenelevi', 'europ', 'european', 'eva',\n",
              "       'evacu', 'evad', 'evamend', 'evanrachelwood', 'eve', 'event',\n",
              "       'events', 'eventu', 'eventually', 'everi', 'everybodi', 'everyday',\n",
              "       'everyon', 'everyth', 'evid', 'evil', 'evolut', 'evolv',\n",
              "       'ewanmcgregor', 'ex', 'exact', 'exactli', 'exam', 'examin',\n",
              "       'exchang', 'excit', 'exclus', 'execut', 'exercis', 'exhibit',\n",
              "       'exil', 'exist', 'existence', 'existenti', 'exorc', 'exot',\n",
              "       'exoticisland', 'expect', 'expected', 'expedit', 'experi',\n",
              "       'experienc', 'experience', 'experiment', 'expert', 'explain',\n",
              "       'explod', 'exploit', 'explor', 'explos', 'expos', 'extend',\n",
              "       'extra', 'extramaritalaffair', 'extraordinari', 'extraterrestri',\n",
              "       'extraterrestrialtechnolog', 'extrem', 'extremeviol', 'eye',\n",
              "       'eyes', 'fabl', 'fac', 'face', 'facil', 'fact', 'faction',\n",
              "       'factori', 'fade', 'fail', 'fairi', 'fairytal', 'faith', 'fake',\n",
              "       'falcon', 'fall', 'fallen', 'fallinginlov', 'fals', 'falseident',\n",
              "       'falselyaccus', 'fame', 'famili', 'families', 'family',\n",
              "       'familyconflict', 'familyrelationship', 'famkejanssen', 'famou',\n",
              "       'famous', 'fan', 'fanat', 'fangvamp', 'fans', 'fantasi', 'fantast',\n",
              "       'fantasyworld', 'far', 'farewel', 'farm', 'farmer', 'fascin',\n",
              "       'fashion', 'fast', 'faster', 'fat', 'fatal', 'fate', 'father',\n",
              "       'fatherdaughterrelationship', 'fathersonrelationship', 'favor',\n",
              "       'favorit', 'fbi', 'fbiagent', 'fear', 'fearless', 'fearsom',\n",
              "       'featur', 'fed', 'feder', 'feed', 'feel', 'feet', 'fellow',\n",
              "       'femal', 'female', 'femalecorps', 'femalefriendship', 'femalenud',\n",
              "       'femaleprotagonist', 'fend', 'festiv', 'festival', 'fetish',\n",
              "       'feud', 'fi', 'fiance', 'fiancé', 'fiction', 'fictionalplac',\n",
              "       'field', 'fierc', 'fifth', 'fight', 'fighter', 'figur', 'fil',\n",
              "       'file', 'film', 'filmdirector', 'filmmak', 'filmproduc', 'films',\n",
              "       'final', 'finale', 'financ', 'financi', 'fine', 'finish', 'finn',\n",
              "       'firemen', 'firework', 'firm', 'firsttim', 'fish', 'fisherman',\n",
              "       'fishoutofwat', 'fistfight', 'fit', 'fix', 'flame', 'flash',\n",
              "       'flashback', 'flat', 'fledgl', 'flee', 'flesh', 'fli', 'flight',\n",
              "       'fling', 'flint', 'flirt', 'flood', 'florida', 'florist', 'flower',\n",
              "       'flyingsauc', 'focu', 'focus', 'foe', 'foil', 'foley', 'folk',\n",
              "       'follow', 'food', 'foot', 'footag', 'footbal', 'footchas',\n",
              "       'forbidden', 'forbiddenlov', 'forc', 'force', 'forces', 'ford',\n",
              "       'foreign', 'forest', 'forestwhitak', 'forev', 'forever', 'forg',\n",
              "       'forget', 'forgiv', 'form', 'formid', 'formula', 'fort', 'fortun',\n",
              "       'fortune', 'fortunetel', 'forward', 'foster', 'fought',\n",
              "       'foundfootag', 'fourth', 'fox', 'frame', 'franc', 'france',\n",
              "       'francisco', 'francisfordcoppola', 'frank', 'frankcoraci',\n",
              "       'frankenstein', 'franki', 'frankoz', 'frantic', 'fratern', 'fraud',\n",
              "       'freak', 'fred', 'freddi', 'freddieprinzejr', 'free', 'freedom',\n",
              "       'freeman', 'freez', 'french', 'frequent', 'fresh', 'freshman',\n",
              "       'friend', 'friendli', 'friends', 'friendship', 'frighten', 'frog',\n",
              "       'fromragstorich', 'frontier', 'frozen', 'frustrat', 'fu', 'fuel',\n",
              "       'fugit', 'fulfil', 'fulli', 'fun', 'fund', 'funer', 'funeral',\n",
              "       'furiou', 'futur', 'future', 'futurist', 'fword', 'ga', 'gabriel',\n",
              "       'gabrielbyrn', 'gadget', 'gaelgarcíabern', 'gain', 'galaxi',\n",
              "       'galaxy', 'gambl', 'gambler', 'game', 'games', 'gandhi', 'gang',\n",
              "       'gangs', 'gangster', 'gangsterboss', 'gangwar', 'garag', 'garden',\n",
              "       'garfield', 'gari', 'garrymarshal', 'garygray', 'garyoldman',\n",
              "       'garysinis', 'gasstat', 'gather', 'gave', 'gay', 'gayinterest',\n",
              "       'gayrelationship', 'genehackman', 'gener', 'general', 'generation',\n",
              "       'genet', 'geniu', 'genius', 'gentl', 'geoffreyrush', 'georg',\n",
              "       'george', 'georgea', 'georgeclooney', 'georgemil', 'georgia',\n",
              "       'gerardbutl', 'german', 'germani', 'germany', 'getaway', 'ghetto',\n",
              "       'ghost', 'giant', 'gift', 'gig', 'girl', 'girlfriend', 'girls',\n",
              "       'given', 'glamor', 'glass', 'glennclos', 'global', 'globe',\n",
              "       'glori', 'goal', 'god', 'goe', 'gold', 'golden', 'golf', 'gone',\n",
              "       'good', 'goodvsevil', 'gordon', 'gore', 'goreverbinski', 'gorgeou',\n",
              "       'gorilla', 'gossip', 'got', 'gotham', 'gothamc', 'gotten',\n",
              "       'govern', 'government', 'governor', 'grace', 'grad', 'grade',\n",
              "       'gradual', 'graduat', 'grand', 'grandfath', 'grandfather',\n",
              "       'grandmoth', 'grandmother', 'grant', 'graphic', 'grasp', 'grave',\n",
              "       'great', 'greater', 'greatest', 'greec', 'greed', 'greedi',\n",
              "       'greek', 'green', 'greg', 'gregkinnear', 'gregorypeck', 'grew',\n",
              "       'grief', 'griev', 'griffin', 'grim', 'grip', 'grisli', 'ground',\n",
              "       'group', 'groupoffriend', 'grow', 'growingup', 'grown', 'gruesom',\n",
              "       'gu', 'guard', 'guardian', 'guerrilla', 'guest', 'guid', 'guilt',\n",
              "       'guitar', 'gun', 'gunfight', 'gunman', 'gunsling', 'guru',\n",
              "       'gusvans', 'guy', 'guypearc', 'guyritchi', 'guys',\n",
              "       'gwynethpaltrow', 'gym', 'gypsi', 'ha', 'hack', 'hacker', 'hair',\n",
              "       'haleyjoelos', 'half', 'hall', 'halleberri', 'halloween',\n",
              "       'hallucin', 'han', 'hand', 'handl', 'hands', 'handsom',\n",
              "       'handtohandcombat', 'hang', 'hangov', 'hannah', 'hansel',\n",
              "       'hapless', 'happen', 'happens', 'happi', 'happili', 'happiness',\n",
              "       'happy', 'hara', 'harass', 'harbor', 'hard', 'harder', 'harlem',\n",
              "       'harmoni', 'harold', 'haroldrami', 'harri', 'harriet', 'harrison',\n",
              "       'harrisonford', 'harrow', 'harry', 'harsh', 'hart', 'harvard',\n",
              "       'harvey', 'harveykeitel', 'hasn', 'hatch', 'hate', 'hatr', 'haunt',\n",
              "       'hauntedhous', 'haven', 'havoc', 'hawaii', 'haydenchristensen',\n",
              "       'haze', 'head', 'headlin', 'heal', 'health', 'hear', 'heard',\n",
              "       'heart', 'heartattack', 'heartbreak', 'heat', 'heather',\n",
              "       'heathergraham', 'heathledg', 'heaven', 'heavi', 'heavili',\n",
              "       'heavymet', 'height', 'heir', 'heiress', 'heist', 'held', 'helen',\n",
              "       'helenabonhamcart', 'helenhunt', 'helenmirren', 'helicopt', 'hell',\n",
              "       'help', 'henchmen', 'henri', 'hero', 'heroes', 'heroic', 'heroin',\n",
              "       'heroism', 'hi', 'hidden', 'hiddencamera', 'hide', 'high',\n",
              "       'higher', 'highest', 'highland', 'highli', 'highschool',\n",
              "       'highschoolsport', 'highschoolstud', 'highway', 'hijack', 'hike',\n",
              "       'hilari', 'hilaryduff', 'hilaryswank', 'hill', 'himalaya', 'hip',\n",
              "       'hippi', 'hire', 'histor', 'histori', 'historicalfigur', 'history',\n",
              "       'hit', 'hitch', 'hitchhik', 'hitman', 'ho', 'hobbit', 'hockey',\n",
              "       'hold', 'hole', 'holi', 'holiday', 'holli', 'hollywood', 'home',\n",
              "       'homeinvas', 'homeland', 'homeless', 'homelessperson', 'hometown',\n",
              "       'homicid', 'homophobia', 'homosexu', 'honey', 'honeymoon', 'hong',\n",
              "       'hongkong', 'honor', 'hood', 'hoodlum', 'hook', 'hop', 'hope',\n",
              "       'hopedavi', 'hopelessli', 'hopper', 'hord', 'horribl', 'horrif',\n",
              "       'horrifi', 'horror', 'hors', 'horsebackrid', 'horserac', 'hospit',\n",
              "       'hospital', 'host', 'hostag', 'hostage', 'hostil', 'hot', 'hotel',\n",
              "       'hotelroom', 'hotshot', 'hour', 'hous', 'house', 'household',\n",
              "       'housewif', 'howard', 'howev', 'hud', 'huge', 'hugh', 'hughgrant',\n",
              "       'hughjackman', 'human', 'humananimalrelationship', 'humanity',\n",
              "       'humankind', 'humans', 'humili', 'humor', 'hundr', 'hunger',\n",
              "       'hungri', 'hunt', 'hunter', 'hunters', 'hurrican', 'hurt',\n",
              "       'husband', 'hustler', 'hypnosi', 'hypnot', 'hyster', 'hyun',\n",
              "       'ianmckellen', 'ice', 'icecub', 'icon', 'idea', 'ideal',\n",
              "       'idealist', 'ident', 'identity', 'idol', 'idyl', 'ignit', 'ignor',\n",
              "       'ii', 'iii', 'il', 'ill', 'illeg', 'illegaldrug', 'illegalimmigr',\n",
              "       'illegalprostitut', 'illness', 'illus', 'illustr', 'imag',\n",
              "       'imagin', 'imaginari', 'imagined', 'imax', 'immedi', 'immens',\n",
              "       'immigr', 'immort', 'impact', 'imperi', 'imperson', 'implic',\n",
              "       'import', 'imposs', 'impostor', 'impress', 'imprison', 'inadvert',\n",
              "       'incest', 'incid', 'includ', 'incompet', 'increas', 'increasingli',\n",
              "       'incred', 'independ', 'independentfilm', 'indi', 'india', 'indian',\n",
              "       'indiana', 'indianlead', 'individu', 'industri', 'industry',\n",
              "       'inevit', 'inexplic', 'infam', 'infant', 'infect', 'infidel',\n",
              "       'infiltr', 'influenc', 'inform', 'inhabit', 'inherit', 'initi',\n",
              "       'inject', 'injur', 'injuri', 'inmat', 'inner', 'innoc', 'insan',\n",
              "       'insecur', 'insid', 'insight', 'insist', 'insomnia', 'inspector',\n",
              "       'inspir', 'instal', 'instant', 'instantli', 'instead', 'instinct',\n",
              "       'institut', 'institution', 'instructor', 'insur', 'insurg',\n",
              "       'intellig', 'intend', 'intens', 'intent', 'intergalact', 'intern',\n",
              "       'internet', 'interpret', 'interrog', 'interspeciesrom',\n",
              "       'intertwin', 'interview', 'intim', 'intoler', 'intrigu',\n",
              "       'introduc', 'invad', 'invas', 'invent', 'inventor', 'invest',\n",
              "       'investig', 'investigate', 'invis', 'invit', 'involv', 'iowa',\n",
              "       'ira', 'iran', 'iranian', 'iraq', 'iraqwar', 'ireland', 'irish',\n",
              "       'iron', 'islam', 'island', 'isn', 'isol', 'isra', 'israel', 'issu',\n",
              "       'itali', 'italian', 'ivanreitman', 'jack', 'jackass', 'jackblack',\n",
              "       'jacki', 'jackiechan', 'jacknicholson', 'jackson', 'jacob',\n",
              "       'jadapinkettsmith', 'jade', 'jail', 'jake', 'jakegyllenha',\n",
              "       'jamaica', 'jame', 'james', 'jamescaan', 'jamescameron',\n",
              "       'jamesfranco', 'jamesivori', 'jamesmangold', 'jamesmarsden',\n",
              "       'jamesmcavoy', 'jameswan', 'jameswood', 'jami', 'jamie',\n",
              "       'jamiefoxx', 'jamieleecurti', 'jan', 'jane', 'janitor', 'japan',\n",
              "       'japanes', 'jaredleto', 'jason', 'jasonbateman', 'jasonbigg',\n",
              "       'jasonle', 'jasonschwartzman', 'jasonsegel', 'jasonstatham',\n",
              "       'javierbardem', 'jay', 'jaychandrasekhar', 'jayroach', 'jazz',\n",
              "       'jealousi', 'jean', 'jeanreno', 'jedi', 'jeff', 'jeffbridg',\n",
              "       'jeffdaniel', 'jeffgoldblum', 'jeffreywright', 'jennif',\n",
              "       'jenniferaniston', 'jenniferconnelli', 'jennifergarn',\n",
              "       'jenniferjasonleigh', 'jenniferlawr', 'jenniferlopez',\n",
              "       'jenniferlovehewitt', 'jeremyiron', 'jeremyrenn', 'jerri',\n",
              "       'jersey', 'jerusalem', 'jess', 'jessebradford', 'jesseeisenberg',\n",
              "       'jessica', 'jessicaalba', 'jessicabiel', 'jessicachastain', 'jesu',\n",
              "       'jesus', 'jesuschrist', 'jetli', 'jew', 'jewel', 'jewish',\n",
              "       'jigsaw', 'jill', 'jim', 'jimbroadb', 'jimcarrey', 'jimcaviezel',\n",
              "       'jimmi', 'jimmy', 'jin', 'joanallen', 'joancusack',\n",
              "       'joaquinphoenix', 'job', 'jobinterview', 'jock', 'jodiefost',\n",
              "       'joe', 'joel', 'joelcoen', 'joeledgerton', 'joelschumach',\n",
              "       'joepesci', 'joey', 'john', 'johnc', 'johncarpent', 'johncusack',\n",
              "       'johngoodman', 'johnhurt', 'johnkrasinski', 'johnleguizamo',\n",
              "       'johnmalkovich', 'johnmctiernan', 'johnni', 'johnny', 'johnnydepp',\n",
              "       'johnnyknoxvil', 'johnsingleton', 'johnson', 'johntravolta',\n",
              "       'johnturturro', 'johnwoo', 'join', 'jon', 'jonahhil', 'jonathan',\n",
              "       'jonathanfrak', 'jonathanrhysmey', 'jone', 'jones', 'jonfavreau',\n",
              "       'jonturteltaub', 'jonvoight', 'jordan', 'joseph', 'josephgordon',\n",
              "       'josh', 'joshbrolin', 'joshhartnett', 'joshhutcherson', 'journal',\n",
              "       'journalist', 'journey', 'joy', 'jr', 'juan', 'judelaw', 'judg',\n",
              "       'judidench', 'juli', 'julia', 'julian', 'juliannemoor',\n",
              "       'juliarobert', 'juliastil', 'julie', 'jump', 'jungl', 'jungle',\n",
              "       'junior', 'junki', 'just', 'justic', 'justice', 'justinlong',\n",
              "       'justintimberlak', 'kansa', 'karat', 'karen', 'karlurban', 'kat',\n",
              "       'kate', 'katebeckinsal', 'katebosworth', 'katehudson', 'katemara',\n",
              "       'katewinslet', 'katherin', 'katherineheigl', 'kathi', 'kathyb',\n",
              "       'kati', 'katieholm', 'katniss', 'kay', 'keanureev',\n",
              "       'keiraknightley', 'kelli', 'kelly', 'kellypreston', 'ken',\n",
              "       'kennethbranagh', 'kermit', 'kevin', 'kevinbacon', 'kevincostn',\n",
              "       'kevinhart', 'kevinjam', 'kevinklin', 'kevinsmith', 'kevinspacey',\n",
              "       'key', 'kgb', 'khan', 'kick', 'kid', 'kidnap', 'kidnapp',\n",
              "       'kidnapped', 'kids', 'kidsandfamili', 'kiefersutherland', 'kill',\n",
              "       'killed', 'killer', 'killerrobot', 'killers', 'kim', 'kimbasing',\n",
              "       'kind', 'king', 'kingdom', 'kingpin', 'kirk', 'kirstendunst',\n",
              "       'kiss', 'kit', 'kitchen', 'knew', 'knife', 'knight', 'knit',\n",
              "       'knock', 'know', 'knowledg', 'known', 'kong', 'korea', 'korean',\n",
              "       'kowalski', 'kriskristofferson', 'kristenbel', 'kristenstewart',\n",
              "       'kristenwiig', 'kristinscottthoma', 'krueger', 'kung', 'kungfu',\n",
              "       'kurt', 'kurtrussel', 'kyle', 'la', 'lab', 'labor', 'laboratori',\n",
              "       'lac', 'lack', 'ladi', 'ladies', 'ladykil', 'laid', 'lake', 'land',\n",
              "       'landscap', 'lane', 'languag', 'lapd', 'larg', 'larger', 'largest',\n",
              "       'larri', 'laser', 'lasergun', 'lassehallström', 'lasvega', 'late',\n",
              "       'later', 'latest', 'laugh', 'launch', 'laura', 'lauralinney',\n",
              "       'laurencefishburn', 'lavish', 'law', 'lawman', 'lawrenc', 'lawyer',\n",
              "       'lax', 'lay', 'lazi', 'le', 'lead', 'leader', 'leadership',\n",
              "       'leagu', 'learn', 'leav', 'led', 'lee', 'left', 'leg', 'legaci',\n",
              "       'legacy', 'legal', 'legend', 'legendari', 'legends', 'legion',\n",
              "       'lenaheadey', 'length', 'leo', 'leon', 'leonardnimoy',\n",
              "       'leonardodicaprio', 'lesbian', 'lesbianrelationship', 'lesliemann',\n",
              "       'leslienielsen', 'lesson', 'let', 'lethal', 'letter', 'level',\n",
              "       'levitt', 'lewi', 'lgbt', 'li', 'liaison', 'liamneeson', 'liar',\n",
              "       'liber', 'lie', 'lieuten', 'lievschreib', 'lif', 'life',\n",
              "       'lifeanddeath', 'lifelong', 'lifestyl', 'lifetim', 'lift', 'light',\n",
              "       'lightn', 'lik', 'like', 'lili', 'limit', 'lincoln', 'linda',\n",
              "       'lindsaylohan', 'line', 'lines', 'link', 'lion', 'lisa',\n",
              "       'lisakudrow', 'list', 'listen', 'liter', 'literatur', 'littl',\n",
              "       'littleboy', 'live', 'liveactionandanim', 'lives', 'living',\n",
              "       'lizzi', 'll', 'lloyd', 'lo', 'loan', 'local', 'locat', 'lock',\n",
              "       'logan', 'loganlerman', 'lola', 'london', 'londonengland', 'lone',\n",
              "       'loneli', 'loner', 'lonewolf', 'long', 'longer', 'longtim', 'look',\n",
              "       'loop', 'loos', 'loose', 'loot', 'lord', 'losangel', 'lose',\n",
              "       'loser', 'loss', 'lossofbroth', 'lossofchild', 'lossoffamili',\n",
              "       'lossoffath', 'lossofhusband', 'lossoflov', 'lossofmoth',\n",
              "       'lossofpar', 'lossofson', 'lost', 'lot', 'lotteri', 'lou', 'loui',\n",
              "       'louisiana', 'lov', 'lovabl', 'love', 'loveatfirstsight',\n",
              "       'loveless', 'lovelett', 'loveofone', 'lover', 'loves', 'lovesick',\n",
              "       'lovetriangl', 'low', 'loyal', 'loyalti', 'lt', 'luca', 'luci',\n",
              "       'luck', 'lucki', 'lucy', 'lucyliu', 'luke', 'lukewilson', 'lure',\n",
              "       'lurk', 'lust', 'luxuri', 'ma', 'machin', 'machine', 'machinegun',\n",
              "       'maci', 'mad', 'madam', 'madea', 'madison', 'madness', 'madonna',\n",
              "       'mafia', 'magazin', 'maggi', 'maggie', 'magic', 'magician', 'maid',\n",
              "       'mail', 'main', 'maintain', 'major', 'mak', 'make', 'malcolm',\n",
              "       'malcolmd', 'male', 'malefemalerelationship', 'malefriendship',\n",
              "       'malenud', 'malibu', 'mall', 'man', 'manag', 'manager',\n",
              "       'mandymoor', 'manhattan', 'manhunt', 'mani', 'maniac', 'manipul',\n",
              "       'mankind', 'mann', 'manner', 'mansion', 'manufactur',\n",
              "       'manvsmachin', 'map', 'mar', 'marcforst', 'march', 'marcu', 'mari',\n",
              "       'maria', 'mariabello', 'marijuana', 'marin', 'marisatomei', 'mark',\n",
              "       'market', 'markruffalo', 'markstrong', 'markwahlberg',\n",
              "       'marlonbrando', 'marlonwayan', 'marri', 'marriag', 'marriage',\n",
              "       'marriagecrisi', 'marriagepropos', 'married', 'marriedcoupl',\n",
              "       'marsh', 'marshal', 'martha', 'marti', 'martial', 'martialart',\n",
              "       'martian', 'martin', 'martincampbel', 'martinfreeman',\n",
              "       'martinlawr', 'martinscorses', 'marvelcinematicunivers',\n",
              "       'marvelcom', 'mary', 'marymccormack', 'mask', 'maskedkil', 'mass',\n",
              "       'massacr', 'massiv', 'massmurd', 'master', 'mastermind', 'masturb',\n",
              "       'match', 'mate', 'materi', 'mathemat', 'mathematician', 'matrix',\n",
              "       'matt', 'mattdamon', 'mattdillon', 'matter',\n",
              "       'matteroflifeanddeath', 'matthew', 'matthewbroderick',\n",
              "       'matthewlillard', 'matthewmcconaughey', 'maverick', 'max', 'maya',\n",
              "       'mayb', 'mayhem', 'mayor', 'maze', 'mccall', 'mcclane', 'mean',\n",
              "       'meant', 'meanwhil', 'meat', 'mechan', 'medal', 'medallion',\n",
              "       'media', 'medic', 'medicin', 'mediev', 'meet', 'mega', 'megan',\n",
              "       'megryan', 'melbrook', 'melgibson', 'melissa', 'melvin', 'member',\n",
              "       'members', 'memoir', 'memori', 'memoryloss', 'men', 'menac',\n",
              "       'mental', 'mentalil', 'mentallydis', 'mentor', 'mephisto',\n",
              "       'mercenari', 'merchant', 'merciless', 'mere', 'mermaid',\n",
              "       'merylstreep', 'messag', 'met', 'metal', 'meteor', 'method',\n",
              "       'metro', 'mexican', 'mexicanstandoff', 'mexico', 'mia', 'miami',\n",
              "       'michael', 'michaelangarano', 'michaelbay', 'michaelcain',\n",
              "       'michaeldougla', 'michaelfassbend', 'michaelj', 'michaelkeaton',\n",
              "       'michaelmoor', 'michaelshannon', 'michaelsheen', 'michel',\n",
              "       'michellemonaghan', 'michellepfeiff', 'michellerodriguez',\n",
              "       'michigan', 'mickey', 'mickeyrourk', 'mid', 'middl', 'middle',\n",
              "       'middleag', 'middleeast', 'midlifecrisi', 'midnight', 'midst',\n",
              "       'midwest', 'mighti', 'mike', 'mikemy', 'mikenewel', 'milakuni',\n",
              "       'mild', 'mile', 'militari', 'millajovovich', 'miller', 'million',\n",
              "       'millionair', 'milo', 'mind', 'mindcontrol', 'miner', 'minion',\n",
              "       'minist', 'minnesota', 'minniedriv', 'minor', 'minut', 'miracl',\n",
              "       'miracul', 'miranda', 'mirror', 'misadventur', 'misanthrop',\n",
              "       'mischiev', 'miser', 'misfit', 'misguid', 'mismatch', 'misogynist',\n",
              "       'miss', 'missil', 'missing', 'missingperson', 'mission',\n",
              "       'missionari', 'missionofmurd', 'mississippi', 'missouri', 'mistak',\n",
              "       'mistaken', 'mistakenident', 'mistakenli', 'mistress', 'mitch',\n",
              "       'mitchel', 'mix', 'mob', 'mobster', 'mockumentari', 'model',\n",
              "       'modern', 'mole', 'molli', 'mom', 'moment', 'money', 'monica',\n",
              "       'monk', 'monkey', 'monster', 'monsters', 'monstrou', 'montana',\n",
              "       'month', 'months', 'montreal', 'moon', 'moonlight', 'moor',\n",
              "       'moore', 'moral', 'morganfreeman', 'morgu', 'mormon', 'morn',\n",
              "       'morrischestnut', 'mortal', 'moscow', 'mose', 'mossad', 'mostli',\n",
              "       'motel', 'mother', 'motherdaughterrelationship', 'motherrol',\n",
              "       'mothersonrelationship', 'motion', 'motiv', 'motley', 'motor',\n",
              "       'motorcycl', 'mount', 'mountain', 'mountains', 'mous', 'mouth',\n",
              "       'movement', 'movi', 'movie', 'movieinmovi', 'movies', 'moviestar',\n",
              "       'mr', 'multi', 'multipl', 'multiplestorylin', 'mumblecor',\n",
              "       'mumblegor', 'murder', 'murdered', 'murderer', 'murderhunt',\n",
              "       'murphi', 'murray', 'muse', 'museum', 'music', 'musicband',\n",
              "       'musician', 'musket', 'muslim', 'mut', 'mutant', 'mutat', 'mutini',\n",
              "       'mutual', 'mysteri', 'mystery', 'mystic', 'myth', 'mythic',\n",
              "       'mytholog', 'naiv', 'nam', 'nanni', 'naomiwatt', 'narcot',\n",
              "       'narnia', 'narrat', 'nasa', 'nasti', 'natalieportman', 'nathan',\n",
              "       'nation', 'nativ', 'nativeamerican', 'natur', 'naturaldisast',\n",
              "       'nature', 'navi', 'navig', 'navys', 'nazi', 'nazigermani', 'nba',\n",
              "       'near', 'nearbi', 'nearli', 'necessari', 'need', 'nefari',\n",
              "       'negoti', 'neighbor', 'neighborhood', 'neil', 'neiljordan',\n",
              "       'nelson', 'nemesi', 'nemesis', 'neo', 'nephew', 'nerd', 'nerdi',\n",
              "       'netherland', 'network', 'nevada', 'nevecampbel', 'new', 'newborn',\n",
              "       'newcom', 'newfound', 'newident', 'newjersey', 'newli', 'newlov',\n",
              "       'newlyw', 'newmexico', 'news', 'newspap', 'newyear', 'newyork',\n",
              "       'newyorkc', 'nialong', 'nice', 'nick', 'nicknolt', 'nicol',\n",
              "       'nicolascag', 'nicolekidman', 'niec', 'niece', 'night',\n",
              "       'nightclub', 'nightlif', 'nightmar', 'nightmare', 'nightshyamalan',\n",
              "       'nightstand', 'ninja', 'noah', 'nobl', 'nobodi', 'noir', 'nomad',\n",
              "       'non', 'normal', 'norman', 'north', 'northern', 'nose', 'note',\n",
              "       'noth', 'notic', 'notori', 'novel', 'novelist', 'nowher',\n",
              "       'nuclear', 'nuclearmissil', 'nuditi', 'number', 'numberintitl',\n",
              "       'numer', 'nun', 'nurs', 'nypd', 'object', 'observ', 'obsess',\n",
              "       'obsession', 'obstacl', 'obtain', 'occasion', 'occult', 'occup',\n",
              "       'occupi', 'occur', 'ocean', 'odd', 'oddbal', 'odds', 'odyssey',\n",
              "       'offer', 'offic', 'office', 'officer', 'offici', 'ogr', 'ohio',\n",
              "       'oil', 'old', 'older', 'oliv', 'oliverston', 'olivia',\n",
              "       'oliviawild', 'olymp', 'olympicgam', 'omar', 'onc', 'onli',\n",
              "       'onlin', 'ontherun', 'open', 'oper', 'opera', 'operation',\n",
              "       'opportun', 'oppos', 'opposit', 'oppositesattract', 'oppress',\n",
              "       'orc', 'orchestr', 'order', 'ordinari', 'oregon', 'organ',\n",
              "       'organization', 'organizedcrim', 'origin', 'orlandobloom',\n",
              "       'orlean', 'orphan', 'orphanag', 'orphanage', 'oscar', 'oscaraward',\n",
              "       'oscarisaac', 'otherworldli', 'outback', 'outbreak', 'outcast',\n",
              "       'outerspac', 'outlaw', 'outrag', 'outsid', 'outwit', 'overcom',\n",
              "       'overrun', 'overthrow', 'overwhelm', 'owenwilson', 'owl', 'owner',\n",
              "       'oxford', 'oz', 'pacif', 'pack', 'packag', 'pact', 'pageant',\n",
              "       'paid', 'pain', 'paint', 'painter', 'pair', 'pal', 'palac', 'pam',\n",
              "       'pan', 'pandora', 'panic', 'panther', 'paper', 'parallel',\n",
              "       'parallelworld', 'paranoia', 'paranoid', 'paranorm', 'parent',\n",
              "       'parents', 'parentskidsrelationship', 'pari', 'paris', 'parisian',\n",
              "       'park', 'parker', 'parodi', 'parol', 'parrish', 'parti',\n",
              "       'particip', 'particularli', 'parties', 'partner', 'partners',\n",
              "       'partnership', 'party', 'pass', 'passeng', 'passion', 'past',\n",
              "       'pastor', 'path', 'patient', 'patriarch', 'patriciaarquett',\n",
              "       'patrick', 'patrickstewart', 'patrickwilson', 'patriot', 'patrol',\n",
              "       'paul', 'paulapatton', 'paulbettani', 'paulgiamatti',\n",
              "       'paulgreengrass', 'paulnewman', 'paulrudd', 'paulw', 'paulwalk',\n",
              "       'pawn', 'pay', 'peac', 'peace', 'pearl', 'peasant', 'pedophilia',\n",
              "       'penguin', 'penn', 'pennsylvania', 'penélopecruz', 'peopl',\n",
              "       'people', 'perfect', 'perform', 'peril', 'period', 'perioddrama',\n",
              "       'perry', 'persian', 'person', 'persuad', 'peru', 'pet', 'pete',\n",
              "       'peter', 'peterberg', 'peterjackson', 'petersarsgaard', 'peterseg',\n",
              "       'petti', 'phantom', 'phil', 'philadelphia', 'philipseymourhoffman',\n",
              "       'phillipnoyc', 'philosoph', 'philosophi', 'phone', 'photo',\n",
              "       'photograph', 'photographi', 'physic', 'pianist', 'piano',\n",
              "       'picard', 'pick', 'pictur', 'picture', 'piec', 'piercebrosnan',\n",
              "       'pierr', 'pig', 'pilot', 'pimp', 'pink', 'pinocchio',\n",
              "       'piperperabo', 'pirat', 'pistol', 'pit', 'pitch', 'place', 'plagu',\n",
              "       'plan', 'plane', 'planet', 'plannedmurd', 'plans', 'plant',\n",
              "       'plantat', 'play', 'playboy', 'player', 'playground', 'playwright',\n",
              "       'pleasur', 'pledg', 'plenti', 'plot', 'plung', 'po', 'poet',\n",
              "       'poetri', 'point', 'poison', 'poker', 'polar', 'polic', 'police',\n",
              "       'policebrut', 'policechas', 'policeman', 'policeoffic',\n",
              "       'policeoper', 'polit', 'politician', 'polli', 'pool', 'poor',\n",
              "       'pop', 'popstar', 'popul', 'popular', 'porn', 'pornographi',\n",
              "       'port', 'portal', 'porter', 'portrait', 'portray', 'pose', 'posit',\n",
              "       'possess', 'possibl', 'post', 'posttraumaticstressdisord', 'pot',\n",
              "       'potenti', 'potter', 'pound', 'poverti', 'pow', 'power',\n",
              "       'poweroutag', 'powers', 'practic', 'prank', 'prayer', 'pre',\n",
              "       'preacher', 'preciou', 'predat', 'predict', 'prefer', 'pregnanc',\n",
              "       'pregnancyandbirth', 'pregnant', 'prehistor', 'prejudic',\n",
              "       'premonit', 'prepar', 'prequel', 'presenc', 'present', 'presid',\n",
              "       'president', 'presidenti', 'presidentialelect', 'press', 'pressur',\n",
              "       'prestigi', 'presum', 'pretend', 'pretti', 'prevent', 'previou',\n",
              "       'prey', 'price', 'priceless', 'pride', 'priest', 'prime', 'princ',\n",
              "       'prince', 'princess', 'princip', 'principl', 'prison',\n",
              "       'prisonersofwar', 'privat', 'privatedetect', 'privileg', 'prize',\n",
              "       'pro', 'problem', 'problems', 'process', 'prodigi', 'produc',\n",
              "       'product', 'production', 'profession', 'professor', 'profil',\n",
              "       'profit', 'program', 'progress', 'project', 'prom', 'promin',\n",
              "       'promis', 'promot', 'prompt', 'proof', 'properti', 'propheci',\n",
              "       'propos', 'prosecut', 'prospect', 'prostitut', 'protect',\n",
              "       'protest', 'prove', 'provid', 'psychiatr', 'psychiatrist',\n",
              "       'psychic', 'psycholog', 'psychologist', 'psychopath', 'psychot',\n",
              "       'pub', 'puberti', 'public', 'publicist', 'publish', 'pull',\n",
              "       'punish', 'punk', 'puppet', 'puppi', 'purchas', 'pure', 'purpos',\n",
              "       'pursu', 'pursuit', 'push', 'quarantin', 'quarterback', 'queen',\n",
              "       'queenlatifah', 'quentintarantino', 'quest', 'question', 'quick',\n",
              "       'quickli', 'quiet', 'quirki', 'quit', 'rabbit', 'race',\n",
              "       'raceagainsttim', 'racehors', 'racer', 'rachaelleighcook',\n",
              "       'rachel', 'rachelmcadam', 'rachelweisz', 'racial', 'racism',\n",
              "       'radiat', 'radic', 'radio', 'rag', 'rage', 'rageandh', 'ragtag',\n",
              "       'raid', 'railroad', 'rain', 'rais', 'ralli', 'ralph', 'ralphfienn',\n",
              "       'rampag', 'ran', 'ranch', 'rancher', 'ranger', 'rank', 'ransom',\n",
              "       'rape', 'rapidli', 'rapmus', 'rapper', 'rare', 'rat', 'rate',\n",
              "       'ravag', 'raw', 'ray', 'rayliotta', 'raymond', 'raywinston',\n",
              "       'reach', 'reaction', 'read', 'readi', 'real', 'realis', 'realiti',\n",
              "       'reality', 'realiz', 'realli', 'realm', 'reaper', 'reason',\n",
              "       'rebecca', 'rebeccahal', 'rebel', 'rebelli', 'rebellion', 'reboot',\n",
              "       'rebuild', 'receiv', 'recent', 'reckless', 'reclaim', 'reclus',\n",
              "       'reconcil', 'reconnect', 'record', 'recount', 'recov', 'recreat',\n",
              "       'recruit', 'red', 'redempt', 'redemption', 'rediscov', 'redneck',\n",
              "       'reel', 'reesewitherspoon', 'reflect', 'refug', 'refus', 'regain',\n",
              "       'regard', 'regim', 'regret', 'regular', 'reign', 'reilli',\n",
              "       'reject', 'rekindl', 'rel', 'relat', 'relationship',\n",
              "       'relationshipproblem', 'relationships', 'releas', 'relentless',\n",
              "       'reli', 'religi', 'religion', 'religionandsupernatur', 'reloc',\n",
              "       'reluct', 'reluctantli', 'remain', 'remak', 'remark', 'rememb',\n",
              "       'remind', 'reminisc', 'remot', 'renegad', 'renerusso',\n",
              "       'rennyharlin', 'renown', 'rent', 'renéezellweg', 'repair', 'repay',\n",
              "       'replac', 'report', 'reporter', 'repres', 'repress', 'reput',\n",
              "       'request', 'requir', 'rescu', 'rescue', 'research', 'resid',\n",
              "       'resist', 'resistance', 'resolv', 'resort', 'resourc', 'resources',\n",
              "       'respect', 'respond', 'respons', 'rest', 'restaur', 'restaurant',\n",
              "       'restor', 'result', 'results', 'resurfac', 'resurrect', 'retel',\n",
              "       'retir', 'retreat', 'retriev', 'return', 'reunion', 'reunit',\n",
              "       'reveal', 'revealed', 'revel', 'reveng', 'revenge', 'reverend',\n",
              "       'reviv', 'revolut', 'revolutionari', 'revolv', 'reward', 'rich',\n",
              "       'richard', 'richarddonn', 'richarddreyfuss', 'richardger',\n",
              "       'richardlinklat', 'rick', 'ricki', 'rid', 'riddl', 'ride', 'rider',\n",
              "       'ridicul', 'ridleyscott', 'rifl', 'rig', 'right', 'rightandjustic',\n",
              "       'riley', 'ring', 'riot', 'rip', 'ripley', 'rise', 'risk', 'ritual',\n",
              "       'rival', 'rivalri', 'river', 'road', 'roadmovi', 'roadtrip',\n",
              "       'roam', 'roar', 'rob', 'robber', 'robberi', 'robcohen', 'robert',\n",
              "       'robertdeniro', 'robertdowneyjr', 'robertduval', 'robertenglund',\n",
              "       'robertredford', 'robertrodriguez', 'robertzemecki', 'robin',\n",
              "       'robinson', 'robinwilliam', 'robinwright', 'robot', 'robrein',\n",
              "       'rock', 'rockandrol', 'rocket', 'rocki', 'rockstar', 'roger',\n",
              "       'rogerdonaldson', 'rogermoor', 'rogu', 'rolandemmerich', 'role',\n",
              "       'roll', 'roller', 'roman', 'romanc', 'romance', 'romant',\n",
              "       'romanticcomedi', 'rome', 'romeo', 'romero', 'ron', 'ronhoward',\n",
              "       'ronni', 'roof', 'rooftop', 'rooki', 'room', 'roommat', 'root',\n",
              "       'rosamundpik', 'rosariodawson', 'rose', 'rosebyrn', 'ross',\n",
              "       'rough', 'round', 'routin', 'row', 'roy', 'royal', 'royalti',\n",
              "       'rubi', 'rugbi', 'rugrat', 'ruin', 'rule', 'ruler', 'rules',\n",
              "       'rumor', 'run', 'runaway', 'runner', 'rupertgrint', 'rural',\n",
              "       'ruralset', 'rush', 'russel', 'russell', 'russellcrow', 'russia',\n",
              "       'russian', 'ruth', 'ruthless', 'ryan', 'ryangosl', 'ryanphillipp',\n",
              "       'ryanreynold', 'sabotag', 'sacr', 'sacrific', 'sad', 'sadism',\n",
              "       'sadist', 'safe', 'safeti', 'safety', 'saga', 'said', 'sail',\n",
              "       'sailor', 'saint', 'sale', 'salesman', 'salli', 'salmahayek',\n",
              "       'sam', 'samantha', 'samanthamorton', 'sammend', 'samneil',\n",
              "       'samraimi', 'samrockwel', 'samuel', 'samuell', 'samurai', 'san',\n",
              "       'sand', 'sandi', 'sandrabullock', 'sanfrancisco', 'santa',\n",
              "       'santaclau', 'sara', 'sarah', 'sarahjessicapark',\n",
              "       'sarahmichellegellar', 'sarapaxton', 'satan', 'satellit', 'satir',\n",
              "       'satisfi', 'savag', 'save', 'savingtheworld', 'saw', 'say',\n",
              "       'sbook', 'scam', 'scandal', 'scar', 'scare', 'scari',\n",
              "       'scarlettjohansson', 'scene', 'schedul', 'scheme', 'schizophrenia',\n",
              "       'scholarship', 'school', 'schoolteach', 'sci', 'scienc',\n",
              "       'sciencefict', 'scientif', 'scientist', 'score', 'scotland',\n",
              "       'scott', 'scottglenn', 'scottish', 'scout', 'scrambl', 'scream',\n",
              "       'screen', 'screenplay', 'screenwrit', 'script', 'scubadiv',\n",
              "       'sdailylif', 'sea', 'seal', 'sean', 'seanbean', 'seanconneri',\n",
              "       'seannwilliamscott', 'seanpenn', 'search', 'seas', 'seasid',\n",
              "       'season', 'seattl', 'sebastian', 'seclud', 'second', 'secret',\n",
              "       'secretag', 'secretari', 'secretident', 'secretintelligenceservic',\n",
              "       'secretli', 'secretlov', 'secretmiss', 'secretorgan', 'secrets',\n",
              "       'secretservic', 'secretsocieti', 'section', 'secur',\n",
              "       'securityguard', 'seduc', 'seduct', 'seek', 'seemingli', 'seen',\n",
              "       'seiz', 'sel', 'self', 'selfsacrific', 'sell', 'selmablair',\n",
              "       'semi', 'senat', 'send', 'senior', 'sens', 'sensat', 'sensit',\n",
              "       'sent', 'sentenc', 'seo', 'separ', 'sequel', 'sergeant', 'seri',\n",
              "       'serial', 'serialkil', 'series', 'seriesofmurd', 'seriou',\n",
              "       'seriously', 'serv', 'servant', 'servic', 'service', 'session',\n",
              "       'set', 'seth', 'sethgreen', 'sethrogen', 'settl', 'settler', 'sev',\n",
              "       'seven', 'sever', 'sewer', 'sex', 'sexaddict', 'sexi', 'sexual',\n",
              "       'sexualabus', 'sexualobsess', 'shadi', 'shadow', 'shadowi',\n",
              "       'shake', 'shaken', 'shakespear', 'shakespeare', 'shane',\n",
              "       'shanghai', 'shannynsossamon', 'shape', 'share', 'shark',\n",
              "       'sharkattack', 'sharonston', 'sharp', 'shatter', 'shaw',\n",
              "       'shawnlevi', 'shelter', 'shepherd', 'sheriff', 'shi',\n",
              "       'shialabeouf', 'shield', 'shift', 'ship', 'shipwreck', 'shock',\n",
              "       'shoe', 'shoot', 'shootout', 'shop', 'short', 'shot', 'shotgun',\n",
              "       'showdown', 'shower', 'shredder', 'shrek', 'shut', 'shuttl',\n",
              "       'shyness', 'sibl', 'sick', 'sid', 'sidekick', 'sidney', 'sight',\n",
              "       'sign', 'signal', 'sigourneyweav', 'silenc', 'silent',\n",
              "       'silentfilm', 'silver', 'similar', 'simon', 'simonpegg',\n",
              "       'simonwest', 'simpl', 'simpli', 'simpson', 'simultan', 'sin',\n",
              "       'sinc', 'sing', 'singer', 'singl', 'single', 'singlefath',\n",
              "       'singlemoth', 'singlepar', 'sinist', 'sir', 'sister', 'sisters',\n",
              "       'sistersisterrelationship', 'sit', 'site', 'sittingonatoilet',\n",
              "       'situat', 'situation', 'size', 'skateboard', 'skeleton', 'skeptic',\n",
              "       'ski', 'skill', 'skull', 'sky', 'skyscrap', 'slacker', 'slapstick',\n",
              "       'slasher', 'slaughter', 'slave', 'slaveri', 'slavery', 'sleazi',\n",
              "       'sleep', 'sleepi', 'sleepwalk', 'slif', 'slip', 'slowli', 'slum',\n",
              "       'small', 'smalltown', 'smart', 'smash', 'smith', 'smitten',\n",
              "       'smoke', 'smuggl', 'smuggler', 'smurf', 'snake', 'snatch',\n",
              "       'sniper', 'snow', 'snowstorm', 'soccer', 'social', 'societi',\n",
              "       'society', 'sociopath', 'sofia', 'solar', 'sold', 'soldi',\n",
              "       'soldier', 'soldiers', 'sole', 'solitari', 'solomon', 'solv',\n",
              "       'somebodi', 'someon', 'someth', 'sometim', 'somewhat', 'somewher',\n",
              "       'son', 'song', 'songwrit', 'soon', 'sophi', 'sorcer', 'sorcerer',\n",
              "       'sorceri', 'soror', 'sort', 'soul', 'sound', 'soundtrack', 'sour',\n",
              "       'south', 'southafrica', 'southern', 'southernusa', 'soviet',\n",
              "       'sovietunion', 'space', 'spacecraft', 'spacemarin', 'spacemiss',\n",
              "       'spaceopera', 'spaceship', 'spacetravel', 'spain', 'span',\n",
              "       'spanish', 'spark', 'speak', 'speci', 'special', 'specialist',\n",
              "       'spectacular', 'speech', 'speed', 'spell', 'spencer', 'spend',\n",
              "       'spent', 'spi', 'spider', 'spike', 'spikele', 'spin', 'spiral',\n",
              "       'spirit', 'spiritu', 'spite', 'spoil', 'spoof', 'sport',\n",
              "       'sportsteam', 'spot', 'spotlight', 'spread', 'spring', 'squad',\n",
              "       'squar', 'st', 'stab', 'stadium', 'staff', 'stage', 'stak',\n",
              "       'stake', 'stalk', 'stalker', 'stan', 'stand', 'stanley', 'star',\n",
              "       'starcrossedlov', 'stardom', 'starfleet', 'stark', 'start',\n",
              "       'state', 'states', 'station', 'statu', 'stay', 'steal',\n",
              "       'steampunk', 'steel', 'stella', 'step', 'stepfath', 'stephen',\n",
              "       'stephendorff', 'stephenfrear', 'stephenherek', 'stephenrea',\n",
              "       'stepmoth', 'steve', 'stevebuscemi', 'stevecarel', 'stevemartin',\n",
              "       'steven', 'stevenseag', 'stevensoderbergh', 'stevenspielberg',\n",
              "       'stevezahn', 'stewardess', 'stewart', 'stick', 'stir', 'stock',\n",
              "       'stockbrok', 'stolen', 'stone', 'stoneag', 'stoner', 'stop',\n",
              "       'stopmot', 'store', 'stori', 'stories', 'storm', 'story',\n",
              "       'straight', 'strain', 'strand', 'strang', 'stranger', 'strateg',\n",
              "       'strategi', 'stray', 'street', 'streetgang', 'streets', 'strength',\n",
              "       'stress', 'stretch', 'strict', 'strike', 'strikes', 'strip',\n",
              "       'stripclub', 'stripper', 'strive', 'strong', 'struggl', 'stu',\n",
              "       'stuart', 'stuck', 'student', 'students', 'studi', 'studio',\n",
              "       'stumbl', 'stun', 'stunt', 'stupid', 'style', 'su', 'sub',\n",
              "       'subject', 'submachinegun', 'submarin', 'subsequ', 'suburban',\n",
              "       'suburbia', 'subway', 'succeed', 'success', 'successful',\n",
              "       'successor', 'sudden', 'suddenli', 'sue', 'suffer', 'suggest',\n",
              "       'suicid', 'suicide', 'suicideattempt', 'suit', 'suitor',\n",
              "       'sullivan', 'summer', 'summon', 'sun', 'sunglass', 'super',\n",
              "       'supercomput', 'superhero', 'superhuman', 'superhumanstrength',\n",
              "       'superman', 'supermarket', 'supernatur', 'supernaturalpow',\n",
              "       'superpow', 'superstar', 'supervillain', 'supervisor', 'suppli',\n",
              "       'support', 'suppos', 'suppress', 'suppressedpast', 'sure', 'surf',\n",
              "       'surfac', 'surface', 'surfer', 'surgeon', 'surgeri', 'surpris',\n",
              "       'surreal', 'surround', 'surveil', 'surviv', 'survival', 'survive',\n",
              "       'survivor', 'survivors', 'susan', 'susansarandon', 'suspect',\n",
              "       'suspens', 'suspici', 'suspicion', 'swallow', 'sweep', 'sweet',\n",
              "       'sweetheart', 'swept', 'swimmingpool', 'swing', 'switch', 'sword',\n",
              "       'swordandsorceri', 'swordfight', 'swordplay', 'sylvesterstallon',\n",
              "       'symbol', 'tabl', 'tactic', 'tag', 'tail', 'tak', 'taken', 'tale',\n",
              "       'talent', 'talk', 'talkinganim', 'tall', 'tank', 'tap', 'tape',\n",
              "       'target', 'task', 'tast', 'tattoo', 'taxi', 'taxidriv', 'taylor',\n",
              "       'teach', 'teacher', 'team', 'tear', 'tech', 'technolog',\n",
              "       'technology', 'ted', 'teen', 'teenag', 'teenagecrush',\n",
              "       'teenagegirl', 'teenager', 'teenagers', 'teenagesexu',\n",
              "       'teencomedi', 'teenmovi', 'teens', 'telekinesi', 'telepathi',\n",
              "       'teleport', 'televis', 'tell', 'tens', 'tension', 'term', 'termin',\n",
              "       'terminalil', 'terrencehoward', 'terri', 'terribl', 'terrier',\n",
              "       'terrifi', 'territori', 'terror', 'terrorist', 'terrygilliam',\n",
              "       'tess', 'test', 'tested', 'texa', 'texas', 'th', 'thailand',\n",
              "       'thandienewton', 'thank', 'thanksgiv', 'theater', 'theatremilieu',\n",
              "       'theft', 'theme', 'themselv', 'theori', 'therapist', 'thi',\n",
              "       'thief', 'thiev', 'thing', 'things', 'think', 'thirst', 'thirti',\n",
              "       'thoma', 'thomashadenchurch', 'thomasjan', 'thompson', 'thought',\n",
              "       'thousand', 'threat', 'threaten', 'thrill', 'thriller', 'throne',\n",
              "       'throw', 'thrown', 'thrust', 'thu', 'thug', 'thwart', 'tibet',\n",
              "       'tick', 'ticket', 'tie', 'tiger', 'tildaswinton', 'tim',\n",
              "       'timallen', 'timburton', 'time', 'timeless', 'times', 'timetravel',\n",
              "       'timothyolyph', 'timrobbin', 'timroth', 'timstori', 'tini', 'tire',\n",
              "       'titan', 'titl', 'tobeymaguir', 'today', 'todd', 'toddphillip',\n",
              "       'togeth', 'tokyo', 'told', 'tom', 'tomcruis', 'tomhank',\n",
              "       'tomhardi', 'tommi', 'tommyleejon', 'tomshadyac', 'tomwilkinson',\n",
              "       'toni', 'tonicollett', 'tonyscott', 'took', 'tool', 'tooth',\n",
              "       'torment', 'torn', 'tornado', 'toronto', 'tortur', 'total',\n",
              "       'totalitarian', 'touch', 'tough', 'toughest', 'tour', 'tourist',\n",
              "       'tournament', 'tower', 'town', 'toxic', 'toy', 'toycomestolif',\n",
              "       'trace', 'track', 'trade', 'trader', 'tradit', 'traffic',\n",
              "       'traffick', 'tragedi', 'tragedy', 'tragic', 'trail', 'train',\n",
              "       'trainer', 'traitor', 'transfer', 'transform', 'transit',\n",
              "       'transplant', 'transport', 'trap', 'trauma', 'traumat', 'travel',\n",
              "       'treacher', 'treasur', 'treasurehunt', 'treat', 'treatment',\n",
              "       'tree', 'trek', 'tri', 'trial', 'triangl', 'triangle', 'tribe',\n",
              "       'trick', 'trigger', 'trio', 'trip', 'triumph', 'troop', 'tropic',\n",
              "       'troubl', 'trouble', 'troy', 'truck', 'trucker', 'true', 'truli',\n",
              "       'trust', 'truth', 'tsunami', 'tunnel', 'turbul', 'turmoil', 'turn',\n",
              "       'turned', 'turner', 'turtl', 'tv', 'tvmovi', 'tvshow', 'tvstation',\n",
              "       'twenti', 'twin', 'twinbroth', 'twist', 'tycoon', 'tyler',\n",
              "       'tylerperri', 'type', 'typic', 'tyrann', 'téaleoni', 'ufo', 'ugli',\n",
              "       'ultim', 'ultra', 'umathurman', 'unabl', 'unawar', 'unbeknownst',\n",
              "       'uncl', 'uncle', 'uncomfort', 'unconvent', 'uncov', 'undead',\n",
              "       'undercov', 'undercoverag', 'undercovercop', 'underdog', 'undergo',\n",
              "       'underground', 'understand', 'undertak', 'underwat', 'underworld',\n",
              "       'unemploy', 'unexpect', 'unexpectedli', 'unexplain', 'unfaith',\n",
              "       'unfold', 'unforgett', 'unfortun', 'unfortunately', 'unhappi',\n",
              "       'unimagin', 'union', 'uniqu', 'unit', 'univers', 'universe',\n",
              "       'university', 'unknown', 'unleash', 'unless', 'unlik',\n",
              "       'unlikelyfriendship', 'unlock', 'unorthodox', 'unpreced',\n",
              "       'unpredict', 'unravel', 'unrequitedlov', 'unsimulatedsex',\n",
              "       'unsoci', 'unstabl', 'unstopp', 'unsuspect', 'unusu', 'unveil',\n",
              "       'unwit', 'unwittingli', 'upcom', 'upper', 'upperclass', 'upris',\n",
              "       'upset', 'upsid', 'uptight', 'urban', 'urg', 'usa', 'usapresid',\n",
              "       'use', 'usual', 'utah', 'vacat', 'vacation', 'val', 'valentine',\n",
              "       'valkilm', 'valley', 'valu', 'valuabl', 'vampir', 'vampire',\n",
              "       'vampires', 'van', 'vandal', 'vanessa', 'vanessahudgen', 'vanish',\n",
              "       'varieti', 'variou', 'vast', 'vatican', 'vault', 'vega', 'vegas',\n",
              "       'vegetarian', 'veng', 'vengeanc', 'vengeance', 'venic', 'ventur',\n",
              "       'verafarmiga', 'verg', 'veri', 'version', 'verylittledialogu',\n",
              "       'vet', 'veteran', 'vice', 'viciou', 'victim', 'victims', 'victor',\n",
              "       'victori', 'victoria', 'victorian', 'victory', 'video', 'videogam',\n",
              "       'vienna', 'vietnam', 'vietnamveteran', 'vietnamwar', 'view',\n",
              "       'viewer', 'viggomortensen', 'vigilant', 'vike', 'villag',\n",
              "       'village', 'villain', 'vincent', 'vincevaughn', 'vindiesel',\n",
              "       'vineyard', 'violenc', 'violence', 'violent', 'virgin', 'virginia',\n",
              "       'virginiamadsen', 'virginity', 'virtual', 'virtualr', 'viru',\n",
              "       'vision', 'visit', 'visitor', 'visual', 'vlad', 'voic', 'voice',\n",
              "       'volatil', 'volcano', 'volunt', 'vomit', 'von', 'voodoo', 'vorort',\n",
              "       'vow', 'voyag', 'voyeur', 'wa', 'wacki', 'wade', 'wage', 'wager',\n",
              "       'wai', 'wait', 'waiter', 'waitress', 'wake', 'walk', 'walker',\n",
              "       'wall', 'wallet', 'wallstreet', 'walt', 'walter', 'wander', 'wang',\n",
              "       'want', 'war', 'warcrim', 'ward', 'warden', 'warehous', 'warhead',\n",
              "       'warlock', 'warlord', 'warm', 'warn', 'warondrug', 'warren',\n",
              "       'warrenbeatti', 'warrior', 'wars', 'warship', 'warveteran', 'wash',\n",
              "       'washington', 'washingtond', 'wasn', 'wast', 'wasteland', 'watch',\n",
              "       'water', 'wave', 'way', 'ways', 'weak', 'wealth', 'wealthi',\n",
              "       'weapon', 'weapons', 'wear', 'weather', 'web', 'wed', 'wedding',\n",
              "       'week', 'weekend', 'weird', 'welcom', 'went', 'werewolf',\n",
              "       'wesanderson', 'wesbentley', 'wescraven', 'wesley', 'wesleysnip',\n",
              "       'west', 'western', 'whale', 'whatev', 'wheelchair', 'whi', 'whip',\n",
              "       'whisk', 'white', 'whitehous', 'whoopigoldberg', 'wick', 'widow',\n",
              "       'wield', 'wif', 'wife', 'wifehusbandrelationship', 'wild',\n",
              "       'wilder', 'wilderness', 'wildli', 'willemdafo', 'willferrel',\n",
              "       'willi', 'william', 'williamh', 'williamhurt', 'williamshatn',\n",
              "       'willpatton', 'willsmith', 'wilson', 'win', 'wind', 'window',\n",
              "       'wine', 'wing', 'winner', 'winonaryd', 'winter', 'wipe', 'wise',\n",
              "       'wish', 'wit', 'witch', 'witchhunt', 'wizard', 'wolf',\n",
              "       'wolfgangpetersen', 'woman', 'womandirector', 'womanrel', 'women',\n",
              "       'won', 'wonder', 'woo', 'wood', 'woodi', 'woods', 'woodyallen',\n",
              "       'woodyharrelson', 'word', 'work', 'workahol', 'worker', 'workers',\n",
              "       'working', 'world', 'worlds', 'worldwari', 'worldwarii',\n",
              "       'worldwid', 'worri', 'wors', 'worse', 'worship', 'worst', 'worth',\n",
              "       'wound', 'wreak', 'wrestl', 'wrestler', 'wretch', 'wright',\n",
              "       'write', 'writer', 'written', 'wrong', 'wwii', 'wyom',\n",
              "       'xenophobia', 'yacht', 'yakuza', 'yard', 'year', 'yearn', 'years',\n",
              "       'yellow', 'york', 'yorker', 'young', 'youngadult', 'youngboy',\n",
              "       'younger', 'youngest', 'youngster', 'youth', 'yuppi', 'zacefron',\n",
              "       'zachgalifianaki', 'zacksnyd', 'zealand', 'zebra', 'zeu',\n",
              "       'zhangziyi', 'zoe', 'zoesaldana', 'zombi', 'zombies', 'zone',\n",
              "       'zoo', 'zooeydeschanel'], dtype=object)"
            ]
          },
          "metadata": {},
          "execution_count": 98
        }
      ]
    },
    {
      "cell_type": "markdown",
      "source": [
        "### Cosine similarity \n",
        "Cosine similarity: measures the similarity between two vectors of an inner product space. It is measured by the cosine of the angle between two vectors and determines whether two vectors are pointing in roughly the same direction. It is often used to measure document similarity in text analysis.\n",
        "\n",
        "**Cosine Similarity**\n",
        "$$ \\cos(\\theta) = \\frac{A \\cdot B}{||A|| * ||B||}$$\n"
      ],
      "metadata": {
        "id": "KUrBppTcBKqo"
      }
    },
    {
      "cell_type": "code",
      "source": [
        "similarity = cosine_similarity(vector)"
      ],
      "metadata": {
        "id": "7t639r528VNW"
      },
      "execution_count": null,
      "outputs": []
    },
    {
      "cell_type": "code",
      "source": [
        "similarity"
      ],
      "metadata": {
        "id": "HgyAG9T0DEGj"
      },
      "execution_count": null,
      "outputs": []
    },
    {
      "cell_type": "markdown",
      "source": [
        "## Recommendation"
      ],
      "metadata": {
        "id": "d-nGl9vzFVb-"
      }
    },
    {
      "cell_type": "code",
      "source": [
        "def recommend(movie):\n",
        "  movie_index = newMovie[newMovie['title'] == movie].index[0]\n",
        "  distances = similarity[movie_index]\n",
        "  movies_list = sorted(list(enumerate(distances)), reverse= True, key= lambda x:x[1])[1:6]\n",
        "\n",
        "  for i in movies_list:\n",
        "    print(newMovie.iloc[i[0]].title)"
      ],
      "metadata": {
        "id": "53hU4XewEpa0"
      },
      "execution_count": null,
      "outputs": []
    },
    {
      "cell_type": "code",
      "source": [
        "recommend('Avatar')"
      ],
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "SkLOf_F6D_Zm",
        "outputId": "53950ed3-1355-478c-86d7-8850ada84043"
      },
      "execution_count": null,
      "outputs": [
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Aliens vs Predator: Requiem\n",
            "Aliens\n",
            "Falcon Rising\n",
            "Independence Day\n",
            "Titan A.E.\n"
          ]
        }
      ]
    },
    {
      "cell_type": "code",
      "source": [
        "recommend('The Dark Knight')"
      ],
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "N5nIu4Y5Hv_N",
        "outputId": "5056a57d-196a-425e-a937-c0ffc31177c3"
      },
      "execution_count": null,
      "outputs": [
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "The Dark Knight Rises\n",
            "Batman Begins\n",
            "Batman Returns\n",
            "Batman Forever\n",
            "Batman\n"
          ]
        }
      ]
    },
    {
      "cell_type": "code",
      "source": [
        "newMovie.head(3)"
      ],
      "metadata": {
        "id": "-tuu2P3RM5q0"
      },
      "execution_count": null,
      "outputs": []
    },
    {
      "cell_type": "markdown",
      "source": [
        "## Dumping of the data set and the similarity matrix as Pickel files for further implementation"
      ],
      "metadata": {
        "id": "vipiloWhEUYv"
      }
    },
    {
      "cell_type": "code",
      "source": [
        "pickle.dump(newMovie.to_dict(), open('movies_dict.pkl', 'wb'))"
      ],
      "metadata": {
        "id": "XXkLBMsVLaXj"
      },
      "execution_count": null,
      "outputs": []
    },
    {
      "cell_type": "code",
      "source": [
        "pickle.dump(similarity, open('similarity.pkl', 'wb'))"
      ],
      "metadata": {
        "id": "vPzOAzX4PkA8"
      },
      "execution_count": null,
      "outputs": []
    }
  ]
}