Objective2_b_v2.ipynb

{
 "cells": [
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# Data Cleaning: Normalize individual functions"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Background\n",
    "\n",
    "There have been quite a few notebooks in this competition focusing on the task of data mining using various types of Python string manipulations, most notably regular expression or regex, for short. While these notebooks achieve highly satisfactory outcomes and create directions for future research or inquiries, they quickly encounter their limits due to the poor quality of the given dataset(s). Recall that we are given a collection of .txt files that describe past City of Los Angeles' jobs along with their pdf versions for the actual job postings. While the City has done an excellent jobs of composing these text files, the **source** that generated these .txt files is not revealed, which makes it very hard for participants to anticipate all possible inconsistencies in the data. For example, a diligent search shows that file, FIRE ASSISTANT CHIEF 2166 011218.txt, doesn't have JOB_DUTIES field, which is very questionable since the `kaggle_data_dictionary.csv` file explicitly spells that every job must have this field (see *Accepts Null Values?* column).\n",
    "\n",
    "By now, hopefully we can see that such inconsistencies will certainly fail any attempt to write code for data mining purposes **before** data cleaning. Even if we can agree to hand-wave this problem (e.g., violating the non-null requirement of JOB_DUTIES field), a person with a strong scientific mindset cannot just hand in the solution and walk away without at least noting where/what/why we have missing values. On the other hand, since it is well-known that exploratory data analysis (EDA) and data cleaning typically take up much of the time of a data scientist, it is understandable that very few kernels (if none at all) are dedicated to tackling data cleaning issue. For unstructured data like .txt files, this could mean one has to actively read the descriptions of several jobs before being able to figure out what should be done for data cleaning.\n",
    "\n",
    "<font size=4, color='red'>**Important Details.**</font> This series of notebooks is dedicated to data cleaning as I've realized that this dataset is very rich in information. Thus, a first complete and accurate [csv file](https://www.kaggle.com/c/data-science-for-good-city-of-los-angeles/overview), which advanced analyses can be built upon, will definitely assist the City of Los Angeles in restructuring their job posting to attract more talents in the upcoming years. The approach taken here is quite novel, at least comparing to other kernels. First, I focus on writing code to parse SYSTEMS ANALYST 1596 102717.txt into a csv file that is exactly the same as `sample job class export template.csv`. This is done by writing 25 main functions, each of which is dedicated to only extracting information for 25 field names, besides two helper functions. Then I use these functions to validate the consistency of other .txt files and manually change/modify the files to fit the pattern of SYSTEMS ANALYST 1596 102717.txt. For example, in the requirement section of ACCOUNTANT 1513 062218.txt, there is no itemizer, e.g., 1) or 1., so I'll manually add a 1. before the word, Graduation, to match with the pattern in SYSTEMS ANALYST 1596 102717.txt.\n",
    "\n",
    "Admittedly, the steps taken here are extremely labor-intensive. While I agree that there might be other easier ways, I do this for a purpose as I've learned that it is the best way to get myself familiar with this unstructured data. As mentioned above, since **the source that generated these text file is not known**, we really have no idea on how to retrieve relevant information from pattern matching on raw data. For example, one might attempt to do something such as `job[job.find('REQUIREMENTS/MINIMUM QUALIFICATIONS':job.find('PROCESS NOTES')]` or any similar expressions using regex. Although that this statement may help him retrieve **only** relevant information regarding school type, education majors, etc., this is not guranteed! For instance, I found that in some jobs, the word, PROCESS NOTES, came after the word WHERE TO APPLY, which unarguably causes severe headache later. The only way to avoid this, as far as I realize, is to patiently do some manual data cleaning before any analysis.\n",
    "\n",
    "Mention job bulletins_clean"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Import relevant modules"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 1,
   "metadata": {},
   "outputs": [],
   "source": [
    "import os                       # module to interface with the underlying OS\n",
    "import numpy as np              # linear algebra\n",
    "import pandas as pd             # dataframe\n",
    "import re                       # regular expression\n",
    "import matplotlib.pyplot as plt # data visualization\n",
    "%matplotlib inline\n",
    "import toolkits as tk           # user-define module for efficiently reading files"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Get paths and names of files in each path"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 2,
   "metadata": {},
   "outputs": [],
   "source": [
    "# Path and list of jobs in Job Bulletins.\n",
    "# NOTE 1: These are raw data\n",
    "(raw_path, raw_jobs) = tk.get_raw_jobs() # tk is a user-define module\n",
    "\n",
    "# Path and list of jobs in JobBulletins_cleaned\n",
    "# NOTE 2: These are cleaned data\n",
    "(cleaned_path, cleaned_jobs) = tk.get_cleaned_jobs()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Normalize JOB_CLASS_TITLES (jct)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 3,
   "metadata": {},
   "outputs": [],
   "source": [
    "# This is a helper function\n",
    "def job_class_title(job):\n",
    "    '''Returns the field JOB_CLASS_TITLE (jct)'''\n",
    "    # From the beginning to the word Class Code is where the information located\n",
    "    temp = job[:job.index('Class Code')]\n",
    "    # Split at white space, skipping all escape characters. This feature of split is amazing!\n",
    "    jct = temp.split()\n",
    "    \n",
    "    # Returns\n",
    "    jct = ' '.join(jct) # join back words with white spaces\n",
    "    return jct"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 4,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "311 DIRECTOR\n",
      "ACCOUNTANT\n",
      "ACCOUNTING CLERK\n",
      "ACCOUNTING RECORDS SUPERVISOR\n",
      "ADMINISTRATIVE ANALYST\n",
      "ADMINISTRATIVE CLERK\n",
      "ADMINISTRATIVE HEARING EXAMINER\n",
      "ADVANCE PRACTICE PROVIDER CORRECTIONAL CARE\n",
      "AIR CONDITIONING MECHANIC\n",
      "AIR CONDITIONING MECHANIC SUPERVISOR\n",
      "AIRPORT AIDE\n",
      "AIRPORT CHIEF INFORMATION SECURITY OFFICER\n",
      "AIRPORT ENGINEER\n",
      "AIRPORT GUIDE\n",
      "AIRPORT INFORMATION SPECIALIST\n",
      "AIRPORT LABOR RELATIONS ADVOCATE\n",
      "AIRPORT MANAGER\n",
      "AIRPORT POLICE CAPTAIN\n",
      "AIRPORT POLICE LIEUTENANT\n",
      "AIRPORT POLICE OFFICER\n",
      "AIRPORT POLICE SPECIALIST\n",
      "AIRPORT SUPERINTENDENT OF OPERATIONS\n",
      "AIRPORTS MAINTENANCE SUPERINTENDENT\n",
      "AIRPORTS MAINTENANCE SUPERVISOR\n",
      "AIRPORTS PUBLIC AND COMMUNITY RELATIONS DIRECTOR\n",
      "ANIMAL CARE ASSISTANT\n",
      "ANIMAL CARE TECHNICIAN\n",
      "WATER TREATMENT OPERATOR\n",
      "ANIMAL CONTROL OFFICER\n",
      "ANIMAL KEEPER\n",
      "APPARATUS OPERATOR\n",
      "APPLICATIONS PROGRAMMER\n",
      "APPRENTICE - METAL TRADES\n",
      "APPRENTICE MACHINIST\n",
      "AQUARIST\n",
      "AQUARIUM EDUCATOR\n",
      "AQUATIC DIRECTOR\n",
      "AQUATIC FACILITY MANAGER\n",
      "AQUEDUCT AND RESERVOIR KEEPER\n",
      "AQUEDUCT AND RESERVOIR SUPERVISOR\n",
      "ARCHITECT\n",
      "CAMPUS INTERVIEWS ONLY ARCHITECTURAL ASSOCIATE\n",
      "ARCHITECTURAL DRAFTING TECHNICIAN\n",
      "ARCHIVIST\n",
      "ART CENTER DIRECTOR\n",
      "ART CURATOR\n",
      "ART INSTRUCTOR\n",
      "ARTS ASSOCIATE\n",
      "ARTS MANAGER\n",
      "ASBESTOS SUPERVISOR\n",
      "ASBESTOS WORKER\n",
      "ASPHALT PLANT OPERATOR\n",
      "ASPHALT PLANT SUPERVISOR\n",
      "ASSISTANT AIRPORT MANAGER\n",
      "ASSISTANT COMMUNICATIONS CABLE WORKER\n",
      "ASSISTANT COMMUNICATIONS ELECTRICIAN\n",
      "ASSISTANT DEPUTY SUPERINTENDENT OF BUILDING\n",
      "ASSISTANT DIRECTOR INFORMATION SYSTEMS\n",
      "ASSISTANT GARDENER\n",
      "ASSISTANT INSPECTOR\n",
      "ASSISTANT RETIREMENT PLAN MANAGER\n",
      "ASSISTANT SIGNAL SYSTEMS ELECTRICIAN\n",
      "ASSISTANT STREET LIGHTING ELECTRICIAN\n",
      "ASSISTANT TREE SURGEON\n",
      "ASSISTANT UTILITY BUYER\n",
      "ASSOCIATE ZONING ADMINISTRATOR\n",
      "AUDIO VISUAL TECHNICIAN\n",
      "AUDITOR\n",
      "AUTO BODY BUILDER AND REPAIRER\n",
      "AUTO BODY REPAIR SUPERVISOR\n",
      "AUTO ELECTRICIAN\n",
      "AUTO PAINTER\n",
      "AUTOMOTIVE DISPATCHER\n",
      "AUTOMOTIVE SUPERVISOR\n",
      "AVIONICS SPECIALIST\n",
      "BACKGROUND INVESTIGATION MANAGER\n",
      "BACKGROUND INVESTIGATOR\n",
      "BENEFITS SPECIALIST\n",
      "BLACKSMITH\n",
      "BOILERMAKER\n",
      "BOILERMAKER SUPERVISOR\n",
      "BUILDING CIVIL ENGINEER\n",
      "BUILDING CONSTRUCTION AND MAINTENANCE SUPERINTENDENT\n",
      "BUILDING ELECTRICAL ENGINEER\n",
      "BUILDING INSPECTOR\n",
      "BUILDING MAINTENANCE DISTRICT SUPERVISOR\n",
      "BUILDING MECHANICAL ENGINEER\n",
      "BUILDING MECHANICAL INSPECTOR\n",
      "BUILDING OPERATING ENGINEER\n",
      "BUILDING REPAIR SUPERVISOR\n",
      "BUILDING REPAIRER\n",
      "BUS OPERATOR\n",
      "BUS OPERATOR SUPERVISOR\n",
      "CABLE TELEVISION PRODUCTION MANAGER\n",
      "CARPENTER\n",
      "CARPENTER SUPERVISOR\n",
      "CARPET LAYER\n",
      "CEMENT FINISHER\n",
      "CEMENT FINISHER SUPERVISOR\n",
      "CEMENT FINISHER WORKER\n",
      "CHEMIST\n",
      "CHIEF ADMINISTRATIVE ANALYST\n",
      "CHIEF AIRPORTS ENGINEER\n",
      "CHIEF BENEFITS ANALYST\n",
      "CHIEF BUILDING OPERATING ENGINEER\n",
      "CHIEF CLERK\n",
      "CHIEF CLERK PERSONNEL\n",
      "CHIEF CLERK POLICE\n",
      "CHIEF CLERK POLICE\n",
      "CHIEF COMMUNICATIONS OPERATOR\n",
      "CHIEF CONSTRUCTION INSPECTOR\n",
      "CHIEF CUSTODIAN SUPERVISOR\n",
      "CHIEF ELECTRIC PLANT OPERATOR\n",
      "CHIEF ENVIRONMENTAL COMPLIANCE INSPECTOR\n",
      "CHIEF FINANCIAL OFFICER\n",
      "CHIEF FORENSIC CHEMIST\n",
      "CHIEF HARBOR ENGINEER\n",
      "CHIEF INSPECTOR\n",
      "CHIEF INTERNAL AUDITOR\n",
      "CHIEF MANAGEMENT ANALYST\n",
      "CHIEF OF AIRPORT PLANNING\n",
      "CHIEF OF DRAFTING OPERATIONS\n",
      "CHIEF OF OPERATIONS\n",
      "CHIEF OF PARKING ENFORCEMENT OPERATIONS\n",
      "CHIEF PARK RANGER\n",
      "CHIEF PORT PILOT\n",
      "CHIEF SAFETY ENGINEER PRESSURE VESSELS\n",
      "CHIEF SECURITY OFFICER\n",
      "CHIEF STREET SERVICES INVESTIGATOR\n",
      "CHIEF TAX COMPLIANCE OFFICER\n",
      "CHIEF TRANSPORTATION INVESTIGATOR\n",
      "CITY PLANNER\n",
      "CITY PLANNING ASSOCIATE\n",
      "CIVIL ENGINEER\n",
      "CIVIL ENGINEERING ASSOCIATE\n",
      "CIVIL ENGINEERING DRAFTING TECHNICIAN\n",
      "CLAIMS AGENT\n",
      "COMMERCIAL FIELD REPRESENTATIVE\n",
      "COMMERCIAL FIELD SUPERVISOR\n",
      "COMMERCIAL SERVICE SUPERVISOR\n",
      "COMMISSION EXECUTIVE ASSISTANT\n",
      "COMMUNICATIONS CABLE SUPERVISOR\n",
      "COMMUNICATIONS CABLE WORKER\n",
      "COMMUNICATIONS ELECTRICIAN\n",
      "COMMUNICATIONS ELECTRICIAN SUPERVISOR\n",
      "COMMUNICATIONS ENGINEER\n",
      "COMMUNICATIONS ENGINEERING ASSOCIATE\n",
      "COMMUNICATIONS INFORMATION REPRESENTATIVE\n",
      "COMMUNITY AFFAIRS ADVOCATE\n",
      "COMMUNITY HOUSING PROGRAMS MANAGER\n",
      "COMMUNITY PROGRAM ASSISTANT\n",
      "COMPLIANCE PROGRAM MANAGER\n",
      "CONSTRUCTION AND MAINTENANCE SUPERINTENDENT\n",
      "CONSTRUCTION AND MAINTENANCE SUPERVISOR\n",
      "CONSTRUCTION EQUIPMENT SERVICE WORKER\n",
      "CONSTRUCTION ESTIMATOR\n",
      "CONSTRUCTION INSPECTOR\n",
      "CONTRACT ADMINISTRATOR\n",
      "CONTROL SYSTEMS ENGINEERING ASSOCIATE\n",
      "CORRECTIONAL NURSE\n",
      "CRIME AND INTELLIGENCE ANALYST\n",
      "CRIMINALIST\n",
      "CUSTODIAL SERVICES ASSISTANT\n",
      "CUSTODIAN\n",
      "CUSTODIAN SUPERVISOR\n",
      "CUSTOMER SERVICE REPRESENTATIVE\n",
      "CUSTOMER SERVICE SPECIALIST\n",
      "DATA PROCESSING TECHNICIAN\n",
      "DATABASE ARCHITECT\n",
      "DECK HAND\n",
      "DELIVERY DRIVER\n",
      "DEPARTMENTAL CHIEF ACCOUNTANT\n",
      "DETENTION OFFICER\n",
      "DIRECTOR OF AIRPORT MARKETING\n",
      "DIRECTOR OF AIRPORT OPERATIONS\n",
      "DIRECTOR OF AIRPORTS ADMINISTRATION REVISED\n",
      "DIRECTOR OF COMMUNICATIONS SERVICES\n",
      "DIRECTOR OF ENFORCEMENT OPERATIONS\n",
      "DIRECTOR OF FIELD OPERATIONS\n",
      "DIRECTOR OF HOUSING\n",
      "DIRECTOR OF MAINTENANCE AIRPORTS\n",
      "DIRECTOR OF POLICE TRANSPORTATION\n",
      "DIRECTOR OF PORT CONSTRUCTION AND MAINTENANCE\n",
      "DIRECTOR OF PRINTING SERVICES\n",
      "DIRECTOR OF SECURITY SERVICES\n",
      "DIRECTOR OF SYSTEMS\n",
      "DISTRICT SUPERVISOR ANIMAL SERVICES (Class Title of District Supervisor Animal Regulation)\n",
      "DIVISION LIBRARIAN\n",
      "DRILL RIG OPERATOR\n",
      "DUPLICATING MACHINE OPERATOR\n",
      "ELECTRIC DISTRIBUTION MECHANIC\n",
      "ELECTRIC DISTRIBUTION MECHANIC SUPERVISOR\n",
      "ELECTRIC METER SETTER\n",
      "ELECTRIC SERVICE REPRESENTATIVE\n",
      "ELECTRIC STATION OPERATOR\n",
      "ELECTRIC TROUBLE DISPATCHER\n",
      "ELECTRICAL CRAFT HELPER\n",
      "ELECTRICAL ENGINEERING ASSOCIATE\n",
      "ELECTRICAL ENGINEERING DRAFTING TECHNICIAN\n",
      "ELECTRICAL INSPECTOR\n",
      "ELECTRICAL MECHANIC\n",
      "ELECTRICAL MECHANIC SUPERVISOR\n",
      "ELECTRICAL REPAIR SUPERVISOR\n",
      "ELECTRICAL REPAIRER\n",
      "ELECTRICAL SERVICE WORKER\n",
      "ELECTRICAL SERVICES MANAGER\n",
      "ELECTRICAL TESTER\n",
      "ELECTRICIAN\n",
      "ELECTRICIAN SUPERVISOR\n",
      "ELEVATOR MECHANIC\n",
      "ELEVATOR MECHANIC HELPER\n",
      "ELEVATOR REPAIR SUPERVISOR\n",
      "EMERGENCY MANAGEMENT COORDINATOR\n",
      "EMERGENCY MEDICAL SERVICES (EMS) EDUCATOR\n",
      "EMS ADVANCED PROVIDER\n",
      "EMS NURSE PRACTITIONER SUPERVISOR\n",
      "ENGINEER OF FIRE DEPARTMENT\n",
      "ENGINEER OF SURVEYS\n",
      "ENGINEERING DESIGNER\n",
      "ENGINEERING GEOLOGIST\n",
      "ENGINEERING GEOLOGIST ASSOCIATE\n",
      "ENVIRONMENTAL AFFAIRS OFFICER\n",
      "ENVIRONMENTAL COMPLIANCE INSPECTOR\n",
      "ENVIRONMENTAL ENGINEER\n",
      "CAMPUS INTERVIEWS ONLY ENVIRONMENTAL ENGINEERING ASSOCIATE\n",
      "ENVIRONMENTAL SPECIALIST\n",
      "ENVIRONMENTAL SUPERVISOR\n",
      "EQUIPMENT MECHANIC (Automotive Mechanic)\n",
      "EQUIPMENT OPERATOR\n",
      "EQUIPMENT REPAIR SUPERVISOR\n",
      "EQUIPMENT SPECIALIST\n",
      "EQUIPMENT SUPERINTENDENT\n",
      "EQUIPMENT SUPERVISOR\n",
      "EXAMINER OF QUESTIONED DOCUMENTS\n",
      "EXECUTIVE ADMINISTRATIVE ASSISTANT\n",
      "EXECUTIVE ASSISTANT AIRPORTS\n",
      "EXHIBIT PREPARATOR\n",
      "FIELD ENGINEERING AIDE\n",
      "FINANCIAL ANALYST\n",
      "FINANCIAL DEVELOPMENT OFFICER\n",
      "FINANCIAL MANAGER\n",
      "FINGERPRINT IDENTIFICATION EXPERT\n",
      "FIRE ASSISTANT CHIEF\n",
      "FIRE BATTALION CHIEF\n",
      "FIRE CAPTAIN\n",
      "FIRE HELICOPTER PILOT\n",
      "FIRE INSPECTOR\n",
      "FIRE PROTECTION ENGINEERING ASSOCIATE\n",
      "FIRE SPECIAL INVESTIGATOR\n",
      "FIRE SPRINKLER INSPECTOR\n",
      "FIREARMS EXAMINER\n",
      "FIREBOAT MATE\n",
      "FIREBOAT PILOT\n",
      "FIREFIGHTER\n",
      "FISCAL SYSTEMS SPECIALIST\n",
      "FLEET SERVICES MANAGER\n",
      "FORENSIC PRINT SPECIALIST\n",
      "GALLERY ATTENDANT\n",
      "GARAGE ASSISTANT\n",
      "GARAGE ATTENDANT\n",
      "GARDENER CARETAKER\n",
      "GENERAL AUTOMOTIVE SUPERVISOR\n",
      "GENERAL SERVICES MANAGER\n",
      "GEOGRAPHIC INFORMATION SYSTEMS CHIEF\n",
      "GEOGRAPHIC INFORMATION SYSTEMS SPECIALIST\n",
      "GEOGRAPHIC INFORMATION SYSTEMS SUPERVISOR\n",
      "GEOTECHNICAL ENGINEER\n",
      "GOLF STARTER\n",
      "GOLF STARTER SUPERVISOR\n",
      "GRAPHICS DESIGNER\n",
      "GRAPHICS SUPERVISOR\n",
      "HARBOR ENGINEER\n",
      "HARBOR PLANNING AND ECONOMIC ANALYST\n",
      "HARBOR PLANNING AND RESEARCH DIRECTOR\n",
      "HEAD CUSTODIAN SUPERVISOR\n",
      "HEATING AND REFRIGERATION INSPECTOR\n",
      "HEAVY DUTY EQUIPMENT MECHANIC\n",
      "HEAVY DUTY TRUCK OPERATOR\n",
      "HELICOPTER MECHANIC\n",
      "HELICOPTER MECHANIC SUPERVISOR\n",
      "HOUSING INSPECTOR\n",
      "HOUSING INVESTIGATOR\n",
      "HOUSING PLANNING AND ECONOMIC ANALYST\n",
      "HUMAN RELATIONS ADVOCATE\n",
      "HYDROGRAPHER\n",
      "IMPROVEMENT ASSESSOR SUPERVISOR\n",
      "INDUSTRIAL AND COMMERCIAL FINANCE OFFICER\n",
      "INDUSTRIAL CHEMIST\n",
      "INDUSTRIAL GRAPHICS SUPERVISOR\n",
      "INDUSTRIAL HYGIENIST\n",
      "INFORMATION SERVICES SPECIALIST\n",
      "INFORMATION SYSTEMS MANAGER\n",
      "INSTRUMENT MECHANIC\n",
      "INSTRUMENT MECHANIC SUPERVISOR\n",
      "INTERNAL AUDITOR\n",
      "INVESTMENT OFFICER\n",
      "IRRIGATION SPECIALIST\n",
      "LABOR SUPERVISOR\n",
      "LABORATORY TECHNICIAN\n",
      "LAND SURVEYING ASSISTANT\n",
      "LANDSCAPE ARCHITECT\n",
      "LANDSCAPE ARCHITECTURAL ASSOCIATE\n",
      "LEGISLATIVE ASSISTANT\n",
      "LEGISLATIVE REPRESENTATIVE\n",
      "LIBRARIAN\n",
      "LIBRARY ASSISTANT\n",
      "LICENSED VOCATIONAL NURSE\n",
      "LINE MAINTENANCE ASSISTANT\n",
      "LOCKSMITH\n",
      "MACHINIST\n",
      "MACHINIST SUPERVISOR\n",
      "MAINTENANCE AND CONSTRUCTION HELPER\n",
      "MAINTENANCE LABORER\n",
      "MANAGEMENT AIDE\n",
      "MANAGEMENT ANALYST\n",
      "MANAGEMENT ASSISTANT\n",
      "MANAGING WATER UTILITY ENGINEER\n",
      "MARINE AQUARIUM CURATOR\n",
      "MARINE AQUARIUM PROGRAM DIRECTOR\n",
      "MARINE ENVIRONMENTAL MANAGER\n",
      "MARINE ENVIRONMENTAL SUPERVISOR Class Code: 9433 Open Date: 07-11-14 ANNUAL SALARY $92,769 to $115,278 *$85,503 to $106,216 NOTES: *1. Individuals hired on or after July 2, 2013 shall be hired at three (3) premium levels (one premium level equals 2.75%) below the salary range. 2. Candidates from the eligible list are normally appointed to vacancies in the lower pay grade positions. 3. The current salary range is subject to change. You may confirm the starting salary with the hiring department before accepting a job offer. DUTIES A Marine Environmental Supervisor oversees the preparation of studies of the Los Angeles Harbor, hazardous materials site assessments, characterization and remedial action plans, air and water quality programs, environmental assessments, environmental impact reports, and statements relative to the effect of port development on the environment; supervises the preparation and administration of contracts for technical environmental services and research; supervises the analysis of proposed environmental legislation; applies sound supervisory principles and techniques in building and maintaining an effective work force; and fulfills equal employment opportunity responsibilities. REQUIREMENTS 1. Three years full-time paid professional experience at the level of Environmental Specialist, responsible for performing technical marine environmental activities, such as designing and implementing comprehensive studies of water or sediment quality in coastal zones and preparing comprehensive environmental assessments of coastal marine development projects; or 2. A Master's degree in environmental, ecological, or biological science, or oceanography, geology, environmental planning, environmental law, or a related field and two years of full-time paid professional experience at the level of Environmental Specialist as described in requirement #1. NOTES: 1. In addition to the regular City application form, each applicant is required to complete the Marine Environmental Supervisor Qualifications Questionnaire at the time of filing. The Marine Environmental Supervisor Qualifications Questionnaire is located within the Supplemental Question Section of the City application. Applicants who fail to complete the Qualifications Questionnaire will not be considered further in this examination, and their application will not be processed. 2. Applicants who lack six months or less of the required experience may file for this examination. However, they cannot be appointed until the full experience requirement is met. 3. For qualifying work experience gained outside of the City of Los Angeles, the term \"professional experience\" applies to positions that require possession of a degree from a recognized four-year college or university in order to obtain that position. Therefore, to be considered \"professional,\" non-City qualifying experience must be gained in positions after obtaining a four-year degree. 4. Minimum requirements for an Environmental Specialist is either (a) graduation from a recognized four-year college with a degree in environmental, ecological, biological, chemical, atmospheric, environmental health, environmental planning, or related field with at least 15 semester units or 20 quarter units in environmental studies; or (b) graduation from a recognized four-year college and one year of full-time paid professional experience performing technical environmental review and analysis. 5. A valid California driver's license is required. Candidates will be disqualified and not eligible for hire if within the past 36 months they were convicted of a major moving violation, such as driving under the influence of alcohol and/or drugs, and may be disqualified if there are three or more moving violations and/or at-fault accidents within the past 36 months. SELECTIVE CERTIFICATION In accordance with Charter Section 1010 (b) and Civil Service Rule 5.31, selective certification will be used for some positions that require special skills and/or training in one or more of the following areas. Only persons possessing the following at the time of filing may be considered for appointment to fill such positions: 1. One year of full-time paid professional experience in managing and preparing environmental assessments, including Environmental Impact Reports and Statements pursuant to CEQA/NEPA requirements for port or coastal marine developmental projects. WHERE TO APPLY Applications will only be accepted online. When you are viewing the online job bulletin of your choice, simply scroll to the top of the page and select the \"Apply\" icon. Online job bulletins are also available at http://agency.governmentjobs.com/lacity/default.cfm for Open Competitive Examinations and at http://agency.governmentjobs.com/lacity/default.cfm?promotionaljobs=1 for Promotional Examinations. NOTE: Applicants are urged to apply early to ensure you have time to resolve any technical issues you may encounter. In accordance with Civil Service Rule 4.2, all applicants who apply may not be tested in this examination. To meet anticipated hiring needs, only a limited number of qualified applicants will be invited to participate in the written test in the following order: 1) Los Angeles City Promotional applicants who meet the minimum requirements. You must have received a regular appointment to a City position or be on a reserve list to apply for this examination as a promotional candidate; 2) Applicants currently employed by the City of Los Angeles on a part-time or exempt basis who meet the minimum requirements; 3) Remaining applicants who meet the minimum requirements in sufficient numbers to meet hiring needs in the order that applications were received. Applications submitted during the filing period will be kept on file for two years from July 11, 2014 in the event that additional applicants need to be tested to meet hiring needs. EXPERT REVIEW COMMITTEE Should a large number of qualified candidates file for this examination, an expert review committee may be assembled to evaluate each candidate's qualifications for the position of Marine Environmental Supervisor. In this evaluation, the expert review committee will assess each candidate's training and experience based upon the information in the candidate's City employment application and the Qualifications Questionnaire. Those candidates considered by the expert review committee as possessing the greatest likelihood of successfully performing the duties of a Marine Environmental Supervisor, based solely on the information presented to the committee, will be invited to participate in the interview. APPLICATION DEADLINE Applications and Qualifications Questionnaires must be received by THURSDAY, JULY 24, 2014. SELECTION PROCESS Examination Weight: Interview. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 100% The examination will consist entirely of an evaluation of professional and personal qualifications by interview. In the interview, emphasis may be placed on the adequacy of the candidate's education, training, and experience as they relate to the knowledge of: effects of pollutants on marine and terrestrial ecosystems; existing and proposed laws and regulations on port and coastline pollution; methods of combating and controlling pollution problems; technological advances that minimize the environmental impact of development projects; instruments and techniques for testing the quality of ocean and ground waters, air, soil, and sediments; environmental regulatory agencies and their responsibilities; safety principles and practices used in handling hazardous materials and laboratory testing at contamination sites; principles and practices of supervision including: directing, assigning, motivating, training, counseling, disciplining, commending, and evaluating the work of subordinates; pertinent City and Personnel Department rules, policies, and procedures, including Equal Employment Opportunity and Memoranda of Understanding; and the ability to analyze environmental problems and prepare comprehensive programs for solution; direct and coordinate the work of groups of employees and consultants engaged in environmental activities; deal tactfully and effectively with others; effectively communicate orally and in writing, in a clear, concise manner; and other necessary skills, knowledge, and abilities. The Qualifications Questionnaire will not be separately scored, but will be considered by the interview board in evaluating each candidate's qualifications. Candidates may expect the panel members to discuss this information during the interview. Qualifications Questionnaires submitted by candidates on the day of the interview will not be accepted for presentation to the interview board. Candidates will be notified by mail of the date, time, and location of the interview, which will be held in Los Angeles. It is anticipated that interviews will begin during the period of OCTOBER 20, 2014 to OCTOBER 31, 2014. NOTES: 1. As a covered entity under the Fair Employment and Housing Act and Title II of the Americans with Disabilities Act, the City of Los Angeles does not discriminate on the basis of disability and upon request, will provide reasonable accommodations to ensure equal access to its programs, services, and activities. To request a disability accommodation, please complete the Disability Accommodation Form within 14 calendar days of the submittal of the City application. The Disability Accommodation Form can be obtained at http://per.lacity.org/exams/verify_disability.pdf. 2. Applications are accepted subject to review to ensure that minimum qualifications are met. Candidates may be disqualified at any time if it is determined that they do not possess the minimum qualifications stated on this bulletin. 3. The promotional list will ordinarily be used ahead of the open competitive list. However, if open competitive candidates receive a higher score, without military credits, than the highest available promotional candidate, after adding 0.25 of a point seniority credit for each year of service, the Civil Service Commission, upon request of the appointing authority, may approve certification of such open competitive candidates ahead of the promotional candidates. 4. A final average score of 70% is required to be placed on the eligible list. 5. In conjunction with Civil Service rules, applicants who are current eligible City employees or are on a reserve list will be considered Promotional candidates while all other applicants will be considered Open candidates. 6. You must have received a regular appointment to a City position or be on a reserve list to file on a promotional basis. 7. If, in accordance with the Rule of Three Whole Scores, all applicants are eligible for appointment consideration, the examination will consist entirely of an evaluation of the candidate's City application by Personnel Department staff to ensure that the minimum qualifications have been met. Notice: If you receive and accept an offer of employment to a regular position with the City of Los Angeles, your employee benefit coverage (including health and dental coverage as well as life insurance) will commence approximately six weeks after your original regular appointment. Not all positions in the City receive benefit coverage; you should inquire regarding the availability of employee benefits prior to accepting a position. GLOSSARY 9 - CITY COUNCIL REVIEW STATEMENT THIS EXAMINATION IS TO BE GIVEN BOTH ON AN INTERDEPARTMENTAL PROMOTIONAL AND AN OPEN COMPETITIVE BASIS The City of Los Angeles does not discriminate on the basis of race, religion, national origin, sex, age, marital status, sexual orientation, gender identity, gender expression, disability, creed, color, ancestry, medical condition (cancer), or Acquired Immune Deficiency Syndrome.\n",
      "MASONRY WORKER\n",
      "MATERIALS TESTING ENGINEERING ASSOCIATE\n",
      "MATERIALS TESTING TECHNICIAN\n",
      "MECHANICAL ENGINEER\n",
      "MECHANICAL ENGINEERING ASSOCIATE\n",
      "MECHANICAL ENGINEERING DRAFTING TECHNICIAN\n",
      "MECHANICAL HELPER\n",
      "MECHANICAL REPAIR GENERAL SUPERVISOR\n",
      "MECHANICAL REPAIR SUPERVISOR\n",
      "MECHANICAL REPAIRER\n",
      "MEDICAL ASSISTANT\n",
      "METER READER\n",
      "MOTION PICTURE AND TELEVISION MANAGER\n",
      "MOTOR SWEEPER OPERATOR\n",
      "OCCUPATIONAL HEALTH NURSE\n",
      "OFFICE ENGINEERING TECHNICIAN\n",
      "OFFICE SERVICES ASSISTANT\n",
      "OFFICE TRAINEE\n",
      "OPERATIONS AND STATISTICAL RESEARCH ANALYST\n",
      "PAINTER\n",
      "PAINTER SUPERVISOR\n",
      "PARK MAINTENANCE SUPERVISOR\n",
      "PARK RANGER\n",
      "PARK SERVICES ATTENDANT\n",
      "PARK SERVICES SUPERVISOR\n",
      "PARKING ATTENDANT\n",
      "PARKING ENFORCEMENT MANAGER\n",
      "PARKING MANAGER\n",
      "PARKING METER TECHNICIAN\n",
      "PARKING METER TECHNICIAN SUPERVISOR\n",
      "PAYROLL ANALYST\n",
      "PAYROLL SUPERVISOR\n",
      "PERFORMING ARTS DIRECTOR\n",
      "PERSONNEL ANALYST\n",
      "PERSONNEL DIRECTOR\n",
      "PERSONNEL RECORDS SUPERVISOR\n",
      "PERSONNEL RESEARCH ANALYST\n",
      "PHOTOGRAPHER\n",
      "PILE DRIVER WORKER\n",
      "PIPEFITTER\n",
      "PIPEFITTER SUPERVISOR\n",
      "PLANNING ASSISTANT\n",
      "PLUMBER\n",
      "PLUMBER SUPERVISOR\n",
      "PLUMBING INSPECTOR\n",
      "POLICE ADMINISTRATOR\n",
      "POLICE CAPTAIN\n",
      "POLICE COMMANDER\n",
      "POLICE DETECTIVE\n",
      "POLICE LIEUTENANT\n",
      "POLICE OFFICER\n",
      "POLICE PERFORMANCE AUDITOR\n",
      "POLICE SERGEANT\n",
      "POLICE SERVICE REPRESENTATIVE\n",
      "POLICE SPECIAL INVESTIGATOR\n",
      "POLICE SPECIALIST\n",
      "POLICE SURVEILLANCE SPECIALIST\n",
      "POLYGRAPH EXAMINER\n",
      "PORT ELECTRICAL MECHANIC\n",
      "PORT ELECTRICAL MECHANIC SUPERVISOR\n",
      "PORT MAINTENANCE SUPERVISOR\n",
      "PORT PILOT\n",
      "PORT POLICE CAPTAIN\n",
      "PORT POLICE LIEUTENANT\n",
      "PORT POLICE OFFICER\n",
      "PORT POLICE SERGEANT\n",
      "PORTFOLIO MANAGER\n",
      "POWER ENGINEERING MANAGER\n",
      "POWER SHOVEL OPERATOR\n",
      "PRE-PRESS OPERATOR\n",
      "PRINCIPAL ACCOUNTANT\n",
      "PRINCIPAL ANIMAL KEEPER\n",
      "PRINCIPAL CITY PLANNER\n",
      "PRINCIPAL CIVIL ENGINEER\n",
      "PRINCIPAL CIVIL ENGINEERING DRAFTING TECHNICIAN\n",
      "PRINCIPAL CLERK\n",
      "PRINCIPAL CLERK POLICE\n",
      "PRINCIPAL CLERK UTILITY\n",
      "PRINCIPAL COMMUNICATIONS OPERATOR\n",
      "PRINCIPAL CONSTRUCTION INSPECTOR\n",
      "PRINCIPAL DEPUTY CONTROLLER\n",
      "PRINCIPAL DETENTION OFFICER\n",
      "PRINCIPAL ELECTRIC TROUBLE DISPATCHER\n",
      "PRINCIPAL ELECTRICAL ENGINEERING DRAFTING TECHNICIAN\n",
      "PRINCIPAL ENVIRONMENTAL ENGINEER\n",
      "PRINCIPAL GROUNDS MAINTENANCE SUPERVISOR\n",
      "PRINCIPAL INSPECTOR\n",
      "PRINCIPAL LIBRARIAN\n",
      "PRINCIPAL MECHANICAL ENGINEERING DRAFTING TECHNICIAN\n",
      "PRINCIPAL PHOTOGRAPHER\n",
      "PRINCIPAL PROPERTY OFFICER\n",
      "PRINCIPAL PUBLIC RELATIONS REPRESENTATIVE\n",
      "PRINCIPAL RECREATION SUPERVISOR\n",
      "PRINCIPAL SECURITY OFFICER\n",
      "PRINCIPAL STOREKEEPER\n",
      "PRINCIPAL TAX AUDITOR\n",
      "PRINCIPAL TAX COMPLIANCE OFFICER\n",
      "PRINCIPAL TRANSPORTATION ENGINEER\n",
      "PRINCIPAL UTILITY ACCOUNTANT\n",
      "PRINCIPAL WORKERS' COMPENSATION ANALYST\n",
      "PRINTING PRESS OPERATOR\n",
      "PRINTING SERVICES SUPERINTENDENT\n",
      "PROCUREMENT ANALYST\n",
      "PROCUREMENT SUPERVISOR\n",
      "PROGRAMMER ANALYST\n",
      "PROPERTY MANAGER\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "PROPERTY OFFICER\n",
      "PROTECTIVE COATING WORKER\n",
      "PUBLIC INFORMATION DIRECTOR\n",
      "PUBLIC RELATIONS SPECIALIST\n",
      "PUBLIC SAFETY RISK MANAGER\n",
      "RATES MANAGER\n",
      "REAL ESTATE ASSOCIATE\n",
      "REAL ESTATE OFFICER\n",
      "REAL ESTATE TRAINEE\n",
      "RECREATION COORDINATOR\n",
      "RECREATION FACILITY DIRECTOR\n",
      "RECREATION SUPERVISOR\n",
      "REFUSE COLLECTION SUPERVISOR\n",
      "REFUSE COLLECTION TRUCK OPERATOR\n",
      "REFUSE CREW FIELD INSTRUCTOR\n",
      "REHABILITATION CONSTRUCTION SPECIALIST\n",
      "REHABILITATION PROJECT COORDINATOR\n",
      "REINFORCING STEEL WORKER\n",
      "REPROGRAPHICS OPERATOR\n",
      "REPROGRAPHICS SUPERVISOR\n",
      "RETIREMENT PLAN MANAGER\n",
      "RIDESHARE PROGRAM ADMINISTRATOR\n",
      "RISK AND INSURANCE ASSISTANT\n",
      "RISK MANAGEMENT AND PREVENTION PROGRAM SPECIALIST\n",
      "RISK MANAGER\n",
      "ROOFER\n",
      "ROOFER SUPERVISOR\n",
      "SAFETY ADMINISTRATOR\n",
      "SAFETY ENGINEER\n",
      "SAFETY ENGINEER ELEVATORS\n",
      "SAFETY ENGINEER PRESSURE VESSELS\n",
      "SAFETY ENGINEERING ASSOCIATE\n",
      "SANITATION SOLID RESOURCES MANAGER\n",
      "SANITATION WASTEWATER MANAGER\n",
      "SECRETARY\n",
      "SECRETARY LEGAL\n",
      "SECURITY AIDE\n",
      "SECURITY OFFICER\n",
      "SENIOR ACCOUNTANT\n",
      "SENIOR ADMINISTRATIVE ANALYST\n",
      "SENIOR ADMINISTRATIVE CLERK\n",
      "SENIOR ANIMAL CONTROL OFFICER\n",
      "SENIOR ANIMAL KEEPER\n",
      "SENIOR ARCHITECT\n",
      "SENIOR ARCHITECTURAL DRAFTING TECHNICIAN\n",
      "SENIOR AUDITOR\n",
      "SENIOR AUTOMOTIVE SUPERVISOR\n",
      "SENIOR BUILDING INSPECTOR\n",
      "SENIOR BUILDING MECHANICAL INSPECTOR\n",
      "SENIOR BUILDING OPERATING ENGINEER\n",
      "SENIOR CARPENTER\n",
      "SENIOR CHEMIST\n",
      "SENIOR CITY PLANNER\n",
      "SENIOR CIVIL ENGINEER\n",
      "SENIOR CIVIL ENGINEERING DRAFTING TECHNICIAN\n",
      "SENIOR CLAIMS REPRESENTATIVE\n",
      "SENIOR COMMERCIAL FIELD REPRESENTATIVE\n",
      "SENIOR COMMUNICATIONS CABLE WORKER\n",
      "SENIOR COMMUNICATIONS ELECTRICIAN\n",
      "SENIOR COMMUNICATIONS ELECTRICIAN SUPERVISOR\n",
      "SENIOR COMMUNICATIONS ENGINEER\n",
      "SENIOR COMMUNICATIONS OPERATOR\n",
      "SENIOR COMPUTER OPERATOR\n",
      "SENIOR CONSTRUCTION ENGINEER\n",
      "SENIOR CONSTRUCTION ESTIMATOR\n",
      "SENIOR CONSTRUCTION INSPECTOR\n",
      "SENIOR CUSTODIAN\n",
      "SENIOR DATA PROCESSING TECHNICIAN\n",
      "SENIOR DETENTION OFFICER\n",
      "SENIOR ELECTRIC SERVICE REPRESENTATIVE\n",
      "SENIOR ELECTRIC TROUBLE DISPATCHER\n",
      "SENIOR ELECTRICAL ENGINEERING DRAFTING TECHNICIAN\n",
      "SENIOR ELECTRICAL INSPECTOR\n",
      "SENIOR ELECTRICAL MECHANIC\n",
      "SENIOR ELECTRICAL MECHANIC SUPERVISOR\n",
      "SENIOR ELECTRICAL REPAIR SUPERVISOR\n",
      "SENIOR ELECTRICAL TEST TECHNICIAN\n",
      "SENIOR ELECTRICIAN\n",
      "SENIOR ENVIRONMENTAL COMPLIANCE INSPECTOR\n",
      "SENIOR ENVIRONMENTAL ENGINEER\n",
      "SENIOR EQUIPMENT MECHANIC\n",
      "WATER UTILITY SUPERINTENDENT\n",
      "SENIOR FIRE PROTECTION ENGINEER\n",
      "SENIOR FORENSIC PRINT SPECIALIST\n",
      "SENIOR GARDENER\n",
      "SENIOR HEATING AND REFRIGERATION INSPECTOR\n",
      "SENIOR HEAVY DUTY EQUIPMENT MECHANIC\n",
      "SENIOR HOUSING INSPECTOR\n",
      "SENIOR HOUSING INVESTIGATOR\n",
      "SENIOR HYDROGRAPHER\n",
      "SENIOR INDUSTRIAL HYGIENIST\n",
      "SENIOR LABOR RELATIONS SPECIALIST\n",
      "SENIOR LEGISLATIVE ASSISTANT\n",
      "SENIOR LIBRARIAN\n",
      "SENIOR LOAD DISPATCHER\n",
      "SENIOR MACHINIST SUPERVISOR\n",
      "SENIOR MANAGEMENT ANALYST\n",
      "SENIOR MECHANICAL ENGINEERING DRAFTING TECHNICIAN\n",
      "SENIOR MECHANICAL REPAIRER\n",
      "SENIOR PAINTER\n",
      "SENIOR PARK MAINTENANCE SUPERVISOR\n",
      "SENIOR PARK RANGER\n",
      "SENIOR PARK SERVICES ATTENDANT\n",
      "SENIOR PARKING ATTENDANT\n",
      "SENIOR PERSONNEL ANALYST\n",
      "SENIOR PHOTOGRAPHER\n",
      "SENIOR PLUMBER\n",
      "SENIOR PLUMBING INSPECTOR\n",
      "SENIOR POLICE SERVICE REPRESENTATIVE\n",
      "SENIOR PORT ELECTRICAL MECHANIC\n",
      "SENIOR PROPERTY OFFICER\n",
      "SENIOR REAL ESTATE OFFICER\n",
      "SENIOR RECREATION DIRECTOR\n",
      "SENIOR ROOFER\n",
      "SENIOR SAFETY ENGINEER ELEVATORS\n",
      "SENIOR SAFETY ENGINEER PRESSURE VESSELS\n",
      "SENIOR SECURITY OFFICER\n",
      "SENIOR STOREKEEPER\n",
      "SENIOR STREET LIGHTING ENGINEER\n",
      "SENIOR STRUCTURAL ENGINEER\n",
      "SENIOR SURVEY SUPERVISOR\n",
      "SENIOR SYSTEMS ANALYST\n",
      "SENIOR TAX AUDITOR\n",
      "SENIOR TITLE EXAMINER\n",
      "SENIOR TRAFFIC SUPERVISOR\n",
      "SENIOR TRANSPORTATION ENGINEER\n",
      "SENIOR TRANSPORTATION INVESTIGATOR\n",
      "SENIOR UNDERGROUND DISTRIBUTION CONSTRUCTION SUPERVISOR\n",
      "SENIOR UTILITY ACCOUNTANT\n",
      "SENIOR UTILITY BUYER\n",
      "SENIOR UTILITY SERVICES SPECIALIST\n",
      "SENIOR UTILITY SERVICES SPECIALIST\n",
      "SENIOR WASTEWATER TREATMENT OPERATOR\n",
      "SENIOR WINDOW CLEANER\n",
      "SENIOR WORKERS' COMPENSATION ANALYST\n",
      "SHEET METAL SUPERVISOR\n",
      "SHEET METAL WORKER\n",
      "SHIFT SUPERINTENDENT WASTEWATER TREATMENT\n",
      "SHIP CARPENTER\n",
      "SHOPS SUPERINTENDENT\n",
      "SIGN PAINTER\n",
      "SIGN SHOP SUPERVISOR\n",
      "SIGNAL SYSTEMS ELECTRICIAN\n",
      "SIGNAL SYSTEMS SUPERINTENDENT\n",
      "SIGNAL SYSTEMS SUPERVISOR\n",
      "SOCIAL WORKER\n",
      "SOLID RESOURCES SUPERINTENDENT\n",
      "SOLID WASTE DISPOSAL SUPERINTENDENT\n",
      "SPECIAL INVESTIGATOR\n",
      "SENIOR CRIME AND INTELLIGENCE ANALYST\n",
      "STAFF ASSISTANT TO GENERAL MANAGER WATER AND POWER\n",
      "STEAM PLANT ASSISTANT\n",
      "STEAM PLANT MAINTENANCE MECHANIC\n",
      "STEAM PLANT MAINTENANCE SUPERVISOR\n",
      "STEAM PLANT OPERATOR\n",
      "STOREKEEPER\n",
      "STORES SUPERVISOR\n",
      "STREET LIGHTING CONSTRUCTION AND MAINTENANCE SUPERINTENDENT\n",
      "STREET LIGHTING ELECTRICIAN\n",
      "STREET LIGHTING ELECTRICIAN SUPERVISOR\n",
      "STREET LIGHTING ENGINEER\n",
      "CAMPUS INTERVIEWS ONLY STREET LIGHTING ENGINEERING ASSOCIATE\n",
      "STREET SERVICES GENERAL SUPERINTENDENT\n",
      "STREET SERVICES INVESTIGATOR\n",
      "STREET SERVICES SUPERINTENDENT\n",
      "STREET SERVICES SUPERVISOR\n",
      "STREET SERVICES WORKER\n",
      "STREET TREE SUPERINTENDENT\n",
      "STRUCTURAL ENGINEER\n",
      "STRUCTURAL ENGINEERING ASSOCIATE\n",
      "STRUCTURAL STEEL FABRICATOR\n",
      "STRUCTURAL STEEL FABRICATOR SUPERVISOR\n",
      "SUPERINTENDENT OF RECREATION AND PARKS OPERATIONS\n",
      "SUPERVISING CRIMINALIST\n",
      "SUPERVISING OCCUPATIONAL HEALTH NURSE\n",
      "SUPERVISING TRANSPORTATION PLANNER\n",
      "SUPERVISING WATER SERVICE REPRESENTATIVE\n",
      "SUPPLY SERVICES MANAGER\n",
      "SUPPLY SERVICES PAYMENT CLERK\n",
      "SURVEY PARTY CHIEF\n",
      "SURVEY SUPERVISOR\n",
      "SYSTEMS AIDE\n",
      "SYSTEMS ANALYST\n",
      "SYSTEMS PROGRAMMER\n",
      "TAX AUDITOR\n",
      "TAX COMPLIANCE AIDE\n",
      "TAX COMPLIANCE OFFICER\n",
      "TELECOMMUNICATIONS PLANNING AND UTILIZATION OFFICER\n",
      "Tile Setter\n",
      "TIRE REPAIRER\n",
      "TITLE EXAMINER\n",
      "TRAFFIC MARKING AND SIGN SUPERINTENDENT\n",
      "TRAFFIC OFFICER\n",
      "TRAFFIC PAINTER AND SIGN POSTER\n",
      "TRANSMISSION AND DISTRIBUTION DISTRICT SUPERVISOR\n",
      "TRANSPORTATION ENGINEER\n",
      "TRANSPORTATION ENGINEERING AIDE\n",
      "TRANSPORTATION ENGINEERING ASSOCIATE\n",
      "TRANSPORTATION INVESTIGATOR\n",
      "TRANSPORTATION PLANNING ASSOCIATE\n",
      "TREASURY ACCOUNTANT\n",
      "TREE SURGEON\n",
      "TREE SURGEON ASSISTANT\n",
      "TREE SURGEON SUPERVISOR\n",
      "TRUCK AND EQUIPMENT DISPATCHER\n",
      "TRUCK OPERATOR\n",
      "UNDERGROUND DISTRIBUTION CONSTRUCTION MECHANIC\n",
      "UNDERGROUND DISTRIBUTION CONSTRUCTION SUPERVISOR\n",
      "UPHOLSTERER\n",
      "UTILITIES SERVICE INVESTIGATOR\n",
      "UTILITY ACCOUNTANT\n",
      "UTILITY ADMINISTRATOR\n",
      "UTILITY BUYER\n",
      "UTILITY EXECUTIVE SECRETARY\n",
      "UTILITY SERVICES MANAGER\n",
      "UTILITY SERVICES SPECIALIST\n",
      "VETERINARY TECHNICIAN\n",
      "VIDEO PRODUCTION COORDINATOR\n",
      "VIDEO TECHNICIAN\n",
      "VOLUNTEER COORDINATOR\n",
      "WAREHOUSE AND TOOLROOM WORKER\n",
      "WASTEWATER TREATMENT OPERATOR\n",
      "WASTEWATER COLLECTION WORKER\n",
      "WASTEWATER TREATMENT ELECTRICIAN\n",
      "WASTEWATER TREATMENT ELECTRICIAN SUPERVISOR\n",
      "WASTEWATER TREATMENT LABORATORY MANAGER\n",
      "WASTEWATER TREATMENT MECHANIC\n",
      "WASTEWATER TREATMENT MECHANIC SUPERVISOR\n",
      "WASTEWATER TREATMENT OPERATOR\n",
      "WATER BIOLOGIST\n",
      "WATER MICROBIOLOGIST\n",
      "WATER SERVICE REPRESENTATIVE\n",
      "WATER SERVICE SUPERVISOR\n",
      "WATER SERVICE WORKER\n",
      "WATER SERVICES MANAGER\n",
      "WATER TREATMENT OPERATOR\n",
      "WATER TREATMENT SUPERVISOR\n",
      "WATER UTILITY OPERATOR\n",
      "WATER UTILITY OPERATOR SUPERVISOR\n",
      "WATER UTILITY SUPERINTENDENT\n",
      "WATER UTILITY SUPERVISOR\n",
      "WATER UTILITY WORKER\n",
      "WATERSHED RESOURCES SPECIALIST\n",
      "WATERWORKS ENGINEER\n",
      "WATERWORKS MECHANIC SUPERVISOR\n",
      "WELDER\n",
      "WELDER SUPERVISOR\n",
      "WHARFINGER\n",
      "WINDOW CLEANER\n",
      "WORKERS' COMPENSATION ANALYST\n",
      "WORKERS' COMPENSATION CLAIMS ASSISTANT\n",
      "X-Ray and Laboratory Technician\n",
      "ZOO CURATOR\n",
      "ZOO CURATOR OF EDUCATION\n",
      "ZOO REGISTRAR\n"
     ]
    }
   ],
   "source": [
    "# Normalization Strategy: \n",
    "# print jct in the try clause and print job_path in the except clause\n",
    "# look at printouts and detect unusual jct's.\n",
    "for file_name in raw_jobs:\n",
    "    job_path = raw_path + file_name        # define path to file_name\n",
    "    raw_job  = open(job_path, 'rt').read() # read in job as a string\n",
    "    try:\n",
    "        print(job_class_title(job=raw_job)) \n",
    "    except:                                # do some pretty printings here to help our eyes from pain\n",
    "        ## define some useful variables\n",
    "        border_line = '##############################################################################################'\n",
    "        how_many    = int((len(border_line) - len(job_path))/2)\n",
    "        print(border_line)\n",
    "        ## do pretty printings\n",
    "        print('#'*how_many + job_path + '#'*how_many)\n",
    "        print(border_line)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "A few things to notice here:\n",
    "1. The function `job_class_title` was able to read all raw jobs (no errors were catched).\n",
    "2. On the first eyeview, it's clear that the following two jobs fall out of the pattern are DISTRICT SUPERVISOR ANIMAL SERVICES 4320 022318.txt and MARINE ENVIRONMENTAL SUPERVISOR 9433 071114 (1).txt since they have their titles too long:\n",
    "    * Of course, this is due to the bug introduced in our code since it is based solely on SYSTEMS ANALYST 1596 102717.txt. Thus, one may come back to the function `job_class_title` and modify it by using regex, for example, to capture all titles. However, we will **not** do that since the approach we are taking here is **data normalization**, that is, we make sure every job follows the same pattern as SYSTEMS ANALYST 1596 102717.txt by modifying its content.\n",
    "    * This may sound unexciting; however, the real benefit of this approach won't come in until later when the need to parse information regarding jobs' requirements arises. Once getting there, we'll see that the data normalization approach outperforms most of the traditional ones, which focus on writing functions that fit all jobs. On top of that, by patiently modifying these jobs manually, we've already familiarized ourselves with this type of unstructured data as well as raised our awarenesses when missing values occur.\n",
    "    * These two jobs were modified by deleting unecessary information (DISTRICT SUPERVISOR ANIMAL SERVICES 4320 022318.txt) and entering into a new line (MARINE ENVIRONMENTAL SUPERVISOR 9433 071114 (1).txt):\n",
    "        * DISTRICT SUPERVISOR ANIMAL SERVICES 4320 022318.txt\n",
    "        * MARINE ENVIRONMENTAL SUPERVISOR 9433 071114 (1).txt\n",
    "3. On the second eyeview, we see that some jobs have suspiciously weird titles, such as CAMPUS INTERVIEW ONLY. \n",
    "    * The following list names the jobs that were modified. The phrase CAMPUS INTERVIEW ONLY that used to appear before the job title was moved to the section NOTES: and put inside forward and backward Python prompt symbol, i.e. >>>CAMPUS INTERVIEW ONLY<<<\n",
    "        * CityofLA/Job Bulletins/ARCHITECTURAL ASSOCIATE 7926 013114 REV 032916.txt\n",
    "        * CityofLA/Job Bulletins/ENVIRONMENTAL ENGINEERING ASSOCIATE  7871 020113 REV 032916.txt\n",
    "        * CityofLA/Job Bulletins/STREET LIGHTING ENGINEERING ASSOCIATE 7527 101102 REV 032916.txt"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "**Let's rerun the function and observe the changes. Note we use .txt files in the JobBulletins_cleaned folder.**\n",
    "\n",
    "Observing the printouts carefully this time, we see that all of the nuances above have been resolved."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 5,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "311 DIRECTOR\n",
      "ACCOUNTANT\n",
      "ACCOUNTING CLERK\n",
      "ACCOUNTING RECORDS SUPERVISOR\n",
      "ADMINISTRATIVE ANALYST\n",
      "ADMINISTRATIVE CLERK\n",
      "ADMINISTRATIVE HEARING EXAMINER\n",
      "ADVANCE PRACTICE PROVIDER CORRECTIONAL CARE\n",
      "AIR CONDITIONING MECHANIC\n",
      "AIR CONDITIONING MECHANIC SUPERVISOR\n",
      "AIRPORT AIDE\n",
      "AIRPORT CHIEF INFORMATION SECURITY OFFICER\n",
      "AIRPORT ENGINEER\n",
      "AIRPORT GUIDE\n",
      "AIRPORT INFORMATION SPECIALIST\n",
      "AIRPORT LABOR RELATIONS ADVOCATE\n",
      "AIRPORT MANAGER\n",
      "AIRPORT POLICE CAPTAIN\n",
      "AIRPORT POLICE LIEUTENANT\n",
      "AIRPORT POLICE OFFICER\n",
      "AIRPORT POLICE SPECIALIST\n",
      "AIRPORT SUPERINTENDENT OF OPERATIONS\n",
      "AIRPORTS MAINTENANCE SUPERINTENDENT\n",
      "AIRPORTS MAINTENANCE SUPERVISOR\n",
      "AIRPORTS PUBLIC AND COMMUNITY RELATIONS DIRECTOR\n",
      "ANIMAL CARE ASSISTANT\n",
      "ANIMAL CARE TECHNICIAN\n",
      "WATER TREATMENT OPERATOR\n",
      "ANIMAL CONTROL OFFICER\n",
      "ANIMAL KEEPER\n",
      "APPARATUS OPERATOR\n",
      "APPLICATIONS PROGRAMMER\n",
      "APPRENTICE - METAL TRADES\n",
      "APPRENTICE MACHINIST\n",
      "AQUARIST\n",
      "AQUARIUM EDUCATOR\n",
      "AQUATIC DIRECTOR\n",
      "AQUATIC FACILITY MANAGER\n",
      "AQUEDUCT AND RESERVOIR KEEPER\n",
      "AQUEDUCT AND RESERVOIR SUPERVISOR\n",
      "ARCHITECT\n",
      "ARCHITECTURAL ASSOCIATE\n",
      "ARCHITECTURAL DRAFTING TECHNICIAN\n",
      "ARCHIVIST\n",
      "ART CENTER DIRECTOR\n",
      "ART CURATOR\n",
      "ART INSTRUCTOR\n",
      "ARTS ASSOCIATE\n",
      "ARTS MANAGER\n",
      "ASBESTOS SUPERVISOR\n",
      "ASBESTOS WORKER\n",
      "ASPHALT PLANT OPERATOR\n",
      "ASPHALT PLANT SUPERVISOR\n",
      "ASSISTANT AIRPORT MANAGER\n",
      "ASSISTANT COMMUNICATIONS CABLE WORKER\n",
      "ASSISTANT COMMUNICATIONS ELECTRICIAN\n",
      "ASSISTANT DEPUTY SUPERINTENDENT OF BUILDING\n",
      "ASSISTANT DIRECTOR INFORMATION SYSTEMS\n",
      "ASSISTANT GARDENER\n",
      "ASSISTANT INSPECTOR\n",
      "ASSISTANT RETIREMENT PLAN MANAGER\n",
      "ASSISTANT SIGNAL SYSTEMS ELECTRICIAN\n",
      "ASSISTANT STREET LIGHTING ELECTRICIAN\n",
      "ASSISTANT TREE SURGEON\n",
      "ASSISTANT UTILITY BUYER\n",
      "ASSOCIATE ZONING ADMINISTRATOR\n",
      "AUDIO VISUAL TECHNICIAN\n",
      "AUDITOR\n",
      "AUTO BODY BUILDER AND REPAIRER\n",
      "AUTO BODY REPAIR SUPERVISOR\n",
      "AUTO ELECTRICIAN\n",
      "AUTO PAINTER\n",
      "AUTOMOTIVE DISPATCHER\n",
      "AUTOMOTIVE SUPERVISOR\n",
      "AVIONICS SPECIALIST\n",
      "BACKGROUND INVESTIGATION MANAGER\n",
      "BACKGROUND INVESTIGATOR\n",
      "BENEFITS SPECIALIST\n",
      "BLACKSMITH\n",
      "BOILERMAKER\n",
      "BOILERMAKER SUPERVISOR\n",
      "BUILDING CIVIL ENGINEER\n",
      "BUILDING CONSTRUCTION AND MAINTENANCE SUPERINTENDENT\n",
      "BUILDING ELECTRICAL ENGINEER\n",
      "BUILDING INSPECTOR\n",
      "BUILDING MAINTENANCE DISTRICT SUPERVISOR\n",
      "BUILDING MECHANICAL ENGINEER\n",
      "BUILDING MECHANICAL INSPECTOR\n",
      "BUILDING OPERATING ENGINEER\n",
      "BUILDING REPAIR SUPERVISOR\n",
      "BUILDING REPAIRER\n",
      "BUS OPERATOR\n",
      "BUS OPERATOR SUPERVISOR\n",
      "CABLE TELEVISION PRODUCTION MANAGER\n",
      "CARPENTER\n",
      "CARPENTER SUPERVISOR\n",
      "CARPET LAYER\n",
      "CEMENT FINISHER\n",
      "CEMENT FINISHER SUPERVISOR\n",
      "CEMENT FINISHER WORKER\n",
      "CHEMIST\n",
      "CHIEF ADMINISTRATIVE ANALYST\n",
      "CHIEF AIRPORTS ENGINEER\n",
      "CHIEF BENEFITS ANALYST\n",
      "CHIEF BUILDING OPERATING ENGINEER\n",
      "CHIEF CLERK\n",
      "CHIEF CLERK PERSONNEL\n",
      "CHIEF CLERK POLICE\n",
      "CHIEF CLERK POLICE\n",
      "CHIEF COMMUNICATIONS OPERATOR\n",
      "CHIEF CONSTRUCTION INSPECTOR\n",
      "CHIEF CUSTODIAN SUPERVISOR\n",
      "CHIEF ELECTRIC PLANT OPERATOR\n",
      "CHIEF ENVIRONMENTAL COMPLIANCE INSPECTOR\n",
      "CHIEF FINANCIAL OFFICER\n",
      "CHIEF FORENSIC CHEMIST\n",
      "CHIEF HARBOR ENGINEER\n",
      "CHIEF INSPECTOR\n",
      "CHIEF INTERNAL AUDITOR\n",
      "CHIEF MANAGEMENT ANALYST\n",
      "CHIEF OF AIRPORT PLANNING\n",
      "CHIEF OF DRAFTING OPERATIONS\n",
      "CHIEF OF OPERATIONS\n",
      "CHIEF OF PARKING ENFORCEMENT OPERATIONS\n",
      "CHIEF PARK RANGER\n",
      "CHIEF PORT PILOT\n",
      "CHIEF SAFETY ENGINEER PRESSURE VESSELS\n",
      "CHIEF SECURITY OFFICER\n",
      "CHIEF STREET SERVICES INVESTIGATOR\n",
      "CHIEF TAX COMPLIANCE OFFICER\n",
      "CHIEF TRANSPORTATION INVESTIGATOR\n",
      "CITY PLANNER\n",
      "CITY PLANNING ASSOCIATE\n",
      "CIVIL ENGINEER\n",
      "CIVIL ENGINEERING ASSOCIATE\n",
      "CIVIL ENGINEERING DRAFTING TECHNICIAN\n",
      "CLAIMS AGENT\n",
      "COMMERCIAL FIELD REPRESENTATIVE\n",
      "COMMERCIAL FIELD SUPERVISOR\n",
      "COMMERCIAL SERVICE SUPERVISOR\n",
      "COMMISSION EXECUTIVE ASSISTANT\n",
      "COMMUNICATIONS CABLE SUPERVISOR\n",
      "COMMUNICATIONS CABLE WORKER\n",
      "COMMUNICATIONS ELECTRICIAN\n",
      "COMMUNICATIONS ELECTRICIAN SUPERVISOR\n",
      "COMMUNICATIONS ENGINEER\n",
      "COMMUNICATIONS ENGINEERING ASSOCIATE\n",
      "COMMUNICATIONS INFORMATION REPRESENTATIVE\n",
      "COMMUNITY AFFAIRS ADVOCATE\n",
      "COMMUNITY HOUSING PROGRAMS MANAGER\n",
      "COMMUNITY PROGRAM ASSISTANT\n",
      "COMPLIANCE PROGRAM MANAGER\n",
      "CONSTRUCTION AND MAINTENANCE SUPERINTENDENT\n",
      "CONSTRUCTION AND MAINTENANCE SUPERVISOR\n",
      "CONSTRUCTION EQUIPMENT SERVICE WORKER\n",
      "CONSTRUCTION ESTIMATOR\n",
      "CONSTRUCTION INSPECTOR\n",
      "CONTRACT ADMINISTRATOR\n",
      "CONTROL SYSTEMS ENGINEERING ASSOCIATE\n",
      "CORRECTIONAL NURSE\n",
      "CRIME AND INTELLIGENCE ANALYST\n",
      "CRIMINALIST\n",
      "CUSTODIAL SERVICES ASSISTANT\n",
      "CUSTODIAN\n",
      "CUSTODIAN SUPERVISOR\n",
      "CUSTOMER SERVICE REPRESENTATIVE\n",
      "CUSTOMER SERVICE SPECIALIST\n",
      "DATA PROCESSING TECHNICIAN\n",
      "DATABASE ARCHITECT\n",
      "DECK HAND\n",
      "DELIVERY DRIVER\n",
      "DEPARTMENTAL CHIEF ACCOUNTANT\n",
      "DETENTION OFFICER\n",
      "DIRECTOR OF AIRPORT MARKETING\n",
      "DIRECTOR OF AIRPORT OPERATIONS\n",
      "DIRECTOR OF AIRPORTS ADMINISTRATION\n",
      "DIRECTOR OF COMMUNICATIONS SERVICES\n",
      "DIRECTOR OF ENFORCEMENT OPERATIONS\n",
      "DIRECTOR OF FIELD OPERATIONS\n",
      "DIRECTOR OF HOUSING\n",
      "DIRECTOR OF MAINTENANCE AIRPORTS\n",
      "DIRECTOR OF POLICE TRANSPORTATION\n",
      "DIRECTOR OF PORT CONSTRUCTION AND MAINTENANCE\n",
      "DIRECTOR OF PRINTING SERVICES\n",
      "DIRECTOR OF SECURITY SERVICES\n",
      "DIRECTOR OF SYSTEMS\n",
      "DISTRICT SUPERVISOR ANIMAL SERVICES\n",
      "DIVISION LIBRARIAN\n",
      "DRILL RIG OPERATOR\n",
      "DUPLICATING MACHINE OPERATOR\n",
      "ELECTRIC DISTRIBUTION MECHANIC\n",
      "ELECTRIC DISTRIBUTION MECHANIC SUPERVISOR\n",
      "ELECTRIC METER SETTER\n",
      "ELECTRIC SERVICE REPRESENTATIVE\n",
      "ELECTRIC STATION OPERATOR\n",
      "ELECTRIC TROUBLE DISPATCHER\n",
      "ELECTRICAL CRAFT HELPER\n",
      "ELECTRICAL ENGINEERING ASSOCIATE\n",
      "ELECTRICAL ENGINEERING DRAFTING TECHNICIAN\n",
      "ELECTRICAL INSPECTOR\n",
      "ELECTRICAL MECHANIC\n",
      "ELECTRICAL MECHANIC SUPERVISOR\n",
      "ELECTRICAL REPAIR SUPERVISOR\n",
      "ELECTRICAL REPAIRER\n",
      "ELECTRICAL SERVICE WORKER\n",
      "ELECTRICAL SERVICES MANAGER\n",
      "ELECTRICAL TESTER\n",
      "ELECTRICIAN\n",
      "ELECTRICIAN SUPERVISOR\n",
      "ELEVATOR MECHANIC\n",
      "ELEVATOR MECHANIC HELPER\n",
      "ELEVATOR REPAIR SUPERVISOR\n",
      "EMERGENCY MANAGEMENT COORDINATOR\n",
      "EMERGENCY MEDICAL SERVICES [EMS] EDUCATOR\n",
      "EMS ADVANCED PROVIDER\n",
      "EMS NURSE PRACTITIONER SUPERVISOR\n",
      "ENGINEER OF FIRE DEPARTMENT\n",
      "ENGINEER OF SURVEYS\n",
      "ENGINEERING DESIGNER\n",
      "ENGINEERING GEOLOGIST\n",
      "ENGINEERING GEOLOGIST ASSOCIATE\n",
      "ENVIRONMENTAL AFFAIRS OFFICER\n",
      "ENVIRONMENTAL COMPLIANCE INSPECTOR\n",
      "ENVIRONMENTAL ENGINEER\n",
      "ENVIRONMENTAL ENGINEERING ASSOCIATE\n",
      "ENVIRONMENTAL SPECIALIST\n",
      "ENVIRONMENTAL SUPERVISOR\n",
      "EQUIPMENT MECHANIC [Automotive Mechanic]\n",
      "EQUIPMENT OPERATOR\n",
      "EQUIPMENT REPAIR SUPERVISOR\n",
      "EQUIPMENT SPECIALIST\n",
      "EQUIPMENT SUPERINTENDENT\n",
      "EQUIPMENT SUPERVISOR\n",
      "EXAMINER OF QUESTIONED DOCUMENTS\n",
      "EXECUTIVE ADMINISTRATIVE ASSISTANT\n",
      "EXECUTIVE ASSISTANT AIRPORTS\n",
      "EXHIBIT PREPARATOR\n",
      "FIELD ENGINEERING AIDE\n",
      "FINANCIAL ANALYST\n",
      "FINANCIAL DEVELOPMENT OFFICER\n",
      "FINANCIAL MANAGER\n",
      "FINGERPRINT IDENTIFICATION EXPERT\n",
      "FIRE ASSISTANT CHIEF\n",
      "FIRE BATTALION CHIEF\n",
      "FIRE CAPTAIN\n",
      "FIRE HELICOPTER PILOT\n",
      "FIRE INSPECTOR\n",
      "FIRE PROTECTION ENGINEERING ASSOCIATE\n",
      "FIRE SPECIAL INVESTIGATOR\n",
      "FIRE SPRINKLER INSPECTOR\n",
      "FIREARMS EXAMINER\n",
      "FIREBOAT MATE\n",
      "FIREBOAT PILOT\n",
      "FIREFIGHTER\n",
      "FISCAL SYSTEMS SPECIALIST\n",
      "FLEET SERVICES MANAGER\n",
      "FORENSIC PRINT SPECIALIST\n",
      "GALLERY ATTENDANT\n",
      "GARAGE ASSISTANT\n",
      "GARAGE ATTENDANT\n",
      "GARDENER CARETAKER\n",
      "GENERAL AUTOMOTIVE SUPERVISOR\n",
      "GENERAL SERVICES MANAGER\n",
      "GEOGRAPHIC INFORMATION SYSTEMS CHIEF\n",
      "GEOGRAPHIC INFORMATION SYSTEMS SPECIALIST\n",
      "GEOGRAPHIC INFORMATION SYSTEMS SUPERVISOR\n",
      "GEOTECHNICAL ENGINEER\n",
      "GOLF STARTER\n",
      "GOLF STARTER SUPERVISOR\n",
      "GRAPHICS DESIGNER\n",
      "GRAPHICS SUPERVISOR\n",
      "HARBOR ENGINEER\n",
      "HARBOR PLANNING AND ECONOMIC ANALYST\n",
      "HARBOR PLANNING AND RESEARCH DIRECTOR\n",
      "HEAD CUSTODIAN SUPERVISOR\n",
      "HEATING AND REFRIGERATION INSPECTOR\n",
      "HEAVY DUTY EQUIPMENT MECHANIC\n",
      "HEAVY DUTY TRUCK OPERATOR\n",
      "HELICOPTER MECHANIC\n",
      "HELICOPTER MECHANIC SUPERVISOR\n",
      "HOUSING INSPECTOR\n",
      "HOUSING INVESTIGATOR\n",
      "HOUSING PLANNING AND ECONOMIC ANALYST\n",
      "HUMAN RELATIONS ADVOCATE\n",
      "HYDROGRAPHER\n",
      "IMPROVEMENT ASSESSOR SUPERVISOR\n",
      "INDUSTRIAL AND COMMERCIAL FINANCE OFFICER\n",
      "INDUSTRIAL CHEMIST\n",
      "INDUSTRIAL GRAPHICS SUPERVISOR\n",
      "INDUSTRIAL HYGIENIST\n",
      "INFORMATION SERVICES SPECIALIST\n",
      "INFORMATION SYSTEMS MANAGER\n",
      "INSTRUMENT MECHANIC\n",
      "INSTRUMENT MECHANIC SUPERVISOR\n",
      "INTERNAL AUDITOR\n",
      "INVESTMENT OFFICER\n",
      "IRRIGATION SPECIALIST\n",
      "LABOR SUPERVISOR\n",
      "LABORATORY TECHNICIAN\n",
      "LAND SURVEYING ASSISTANT\n",
      "LANDSCAPE ARCHITECT\n",
      "LANDSCAPE ARCHITECTURAL ASSOCIATE\n",
      "LEGISLATIVE ASSISTANT\n",
      "LEGISLATIVE REPRESENTATIVE\n",
      "LIBRARIAN\n",
      "LIBRARY ASSISTANT\n",
      "LICENSED VOCATIONAL NURSE\n",
      "LINE MAINTENANCE ASSISTANT\n",
      "LOCKSMITH\n",
      "MACHINIST\n",
      "MACHINIST SUPERVISOR\n",
      "MAINTENANCE AND CONSTRUCTION HELPER\n",
      "MAINTENANCE LABORER\n",
      "MANAGEMENT AIDE\n",
      "MANAGEMENT ANALYST\n",
      "MANAGEMENT ASSISTANT\n",
      "MANAGING WATER UTILITY ENGINEER\n",
      "MARINE AQUARIUM CURATOR\n",
      "MARINE AQUARIUM PROGRAM DIRECTOR\n",
      "MARINE ENVIRONMENTAL MANAGER\n",
      "MARINE ENVIRONMENTAL SUPERVISOR\n",
      "MASONRY WORKER\n",
      "MATERIALS TESTING ENGINEERING ASSOCIATE\n",
      "MATERIALS TESTING TECHNICIAN\n",
      "MECHANICAL ENGINEER\n",
      "MECHANICAL ENGINEERING ASSOCIATE\n",
      "MECHANICAL ENGINEERING DRAFTING TECHNICIAN\n",
      "MECHANICAL HELPER\n",
      "MECHANICAL REPAIR GENERAL SUPERVISOR\n",
      "MECHANICAL REPAIR SUPERVISOR\n",
      "MECHANICAL REPAIRER\n",
      "MEDICAL ASSISTANT\n",
      "METER READER\n",
      "MOTION PICTURE AND TELEVISION MANAGER\n",
      "MOTOR SWEEPER OPERATOR\n",
      "OCCUPATIONAL HEALTH NURSE\n",
      "OFFICE ENGINEERING TECHNICIAN\n",
      "OFFICE SERVICES ASSISTANT\n",
      "OFFICE TRAINEE\n",
      "OPERATIONS AND STATISTICAL RESEARCH ANALYST\n",
      "PAINTER\n",
      "PAINTER SUPERVISOR\n",
      "PARK MAINTENANCE SUPERVISOR\n",
      "PARK RANGER\n",
      "PARK SERVICES ATTENDANT\n",
      "PARK SERVICES SUPERVISOR\n",
      "PARKING ATTENDANT\n",
      "PARKING ENFORCEMENT MANAGER\n",
      "PARKING MANAGER\n",
      "PARKING METER TECHNICIAN\n",
      "PARKING METER TECHNICIAN SUPERVISOR\n",
      "PAYROLL ANALYST\n",
      "PAYROLL SUPERVISOR\n",
      "PERFORMING ARTS DIRECTOR\n",
      "PERSONNEL ANALYST\n",
      "PERSONNEL DIRECTOR\n",
      "PERSONNEL RECORDS SUPERVISOR\n",
      "PERSONNEL RESEARCH ANALYST\n",
      "PHOTOGRAPHER\n",
      "PILE DRIVER WORKER\n",
      "PIPEFITTER\n",
      "PIPEFITTER SUPERVISOR\n",
      "PLANNING ASSISTANT\n",
      "PLUMBER\n",
      "PLUMBER SUPERVISOR\n",
      "PLUMBING INSPECTOR\n",
      "POLICE ADMINISTRATOR\n",
      "POLICE CAPTAIN\n",
      "POLICE COMMANDER\n",
      "POLICE DETECTIVE\n",
      "POLICE LIEUTENANT\n",
      "POLICE OFFICER\n",
      "POLICE PERFORMANCE AUDITOR\n",
      "POLICE SERGEANT\n",
      "POLICE SERVICE REPRESENTATIVE\n",
      "POLICE SPECIAL INVESTIGATOR\n",
      "POLICE SPECIALIST\n",
      "POLICE SURVEILLANCE SPECIALIST\n",
      "POLYGRAPH EXAMINER\n",
      "PORT ELECTRICAL MECHANIC\n",
      "PORT ELECTRICAL MECHANIC SUPERVISOR\n",
      "PORT MAINTENANCE SUPERVISOR\n",
      "PORT PILOT\n",
      "PORT POLICE CAPTAIN\n",
      "PORT POLICE LIEUTENANT\n",
      "PORT POLICE OFFICER\n",
      "PORT POLICE SERGEANT\n",
      "PORTFOLIO MANAGER\n",
      "POWER ENGINEERING MANAGER\n",
      "POWER SHOVEL OPERATOR\n",
      "PRE-PRESS OPERATOR\n",
      "PRINCIPAL ACCOUNTANT\n",
      "PRINCIPAL ANIMAL KEEPER\n",
      "PRINCIPAL CITY PLANNER\n",
      "PRINCIPAL CIVIL ENGINEER\n",
      "PRINCIPAL CIVIL ENGINEERING DRAFTING TECHNICIAN\n",
      "PRINCIPAL CLERK\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "PRINCIPAL CLERK POLICE\n",
      "PRINCIPAL CLERK UTILITY\n",
      "PRINCIPAL COMMUNICATIONS OPERATOR\n",
      "PRINCIPAL CONSTRUCTION INSPECTOR\n",
      "PRINCIPAL DEPUTY CONTROLLER\n",
      "PRINCIPAL DETENTION OFFICER\n",
      "PRINCIPAL ELECTRIC TROUBLE DISPATCHER\n",
      "PRINCIPAL ELECTRICAL ENGINEERING DRAFTING TECHNICIAN\n",
      "PRINCIPAL ENVIRONMENTAL ENGINEER\n",
      "PRINCIPAL GROUNDS MAINTENANCE SUPERVISOR\n",
      "PRINCIPAL INSPECTOR\n",
      "PRINCIPAL LIBRARIAN\n",
      "PRINCIPAL MECHANICAL ENGINEERING DRAFTING TECHNICIAN\n",
      "PRINCIPAL PHOTOGRAPHER\n",
      "PRINCIPAL PROPERTY OFFICER\n",
      "PRINCIPAL PUBLIC RELATIONS REPRESENTATIVE\n",
      "PRINCIPAL RECREATION SUPERVISOR\n",
      "PRINCIPAL SECURITY OFFICER\n",
      "PRINCIPAL STOREKEEPER\n",
      "PRINCIPAL TAX AUDITOR\n",
      "PRINCIPAL TAX COMPLIANCE OFFICER\n",
      "PRINCIPAL TRANSPORTATION ENGINEER\n",
      "PRINCIPAL UTILITY ACCOUNTANT\n",
      "PRINCIPAL WORKERS' COMPENSATION ANALYST\n",
      "PRINTING PRESS OPERATOR\n",
      "PRINTING SERVICES SUPERINTENDENT\n",
      "PROCUREMENT ANALYST\n",
      "PROCUREMENT SUPERVISOR\n",
      "PROGRAMMER ANALYST\n",
      "PROPERTY MANAGER\n",
      "PROPERTY OFFICER\n",
      "PROTECTIVE COATING WORKER\n",
      "PUBLIC INFORMATION DIRECTOR\n",
      "PUBLIC RELATIONS SPECIALIST\n",
      "PUBLIC SAFETY RISK MANAGER\n",
      "RATES MANAGER\n",
      "REAL ESTATE ASSOCIATE\n",
      "REAL ESTATE OFFICER\n",
      "REAL ESTATE TRAINEE\n",
      "RECREATION COORDINATOR\n",
      "RECREATION FACILITY DIRECTOR\n",
      "RECREATION SUPERVISOR\n",
      "REFUSE COLLECTION SUPERVISOR\n",
      "REFUSE COLLECTION TRUCK OPERATOR\n",
      "REFUSE CREW FIELD INSTRUCTOR\n",
      "REHABILITATION CONSTRUCTION SPECIALIST\n",
      "REHABILITATION PROJECT COORDINATOR\n",
      "REINFORCING STEEL WORKER\n",
      "REPROGRAPHICS OPERATOR\n",
      "REPROGRAPHICS SUPERVISOR\n",
      "RETIREMENT PLAN MANAGER\n",
      "RIDESHARE PROGRAM ADMINISTRATOR\n",
      "RISK AND INSURANCE ASSISTANT\n",
      "RISK MANAGEMENT AND PREVENTION PROGRAM SPECIALIST\n",
      "RISK MANAGER\n",
      "ROOFER\n",
      "ROOFER SUPERVISOR\n",
      "SAFETY ADMINISTRATOR\n",
      "SAFETY ENGINEER\n",
      "SAFETY ENGINEER ELEVATORS\n",
      "SAFETY ENGINEER PRESSURE VESSELS\n",
      "SAFETY ENGINEERING ASSOCIATE\n",
      "SANITATION SOLID RESOURCES MANAGER\n",
      "SANITATION WASTEWATER MANAGER\n",
      "SECRETARY\n",
      "SECRETARY LEGAL\n",
      "SECURITY AIDE\n",
      "SECURITY OFFICER\n",
      "SENIOR ACCOUNTANT\n",
      "SENIOR ADMINISTRATIVE ANALYST\n",
      "SENIOR ADMINISTRATIVE CLERK\n",
      "SENIOR ANIMAL CONTROL OFFICER\n",
      "SENIOR ANIMAL KEEPER\n",
      "SENIOR ARCHITECT\n",
      "SENIOR ARCHITECTURAL DRAFTING TECHNICIAN\n",
      "SENIOR AUDITOR\n",
      "SENIOR AUTOMOTIVE SUPERVISOR\n",
      "SENIOR BUILDING INSPECTOR\n",
      "SENIOR BUILDING MECHANICAL INSPECTOR\n",
      "SENIOR BUILDING OPERATING ENGINEER\n",
      "SENIOR CARPENTER\n",
      "SENIOR CHEMIST\n",
      "SENIOR CITY PLANNER\n",
      "SENIOR CIVIL ENGINEER\n",
      "SENIOR CIVIL ENGINEERING DRAFTING TECHNICIAN\n",
      "SENIOR CLAIMS REPRESENTATIVE\n",
      "SENIOR COMMERCIAL FIELD REPRESENTATIVE\n",
      "SENIOR COMMUNICATIONS CABLE WORKER\n",
      "SENIOR COMMUNICATIONS ELECTRICIAN\n",
      "SENIOR COMMUNICATIONS ELECTRICIAN SUPERVISOR\n",
      "SENIOR COMMUNICATIONS ENGINEER\n",
      "SENIOR COMMUNICATIONS OPERATOR\n",
      "SENIOR COMPUTER OPERATOR\n",
      "SENIOR CONSTRUCTION ENGINEER\n",
      "SENIOR CONSTRUCTION ESTIMATOR\n",
      "SENIOR CONSTRUCTION INSPECTOR\n",
      "SENIOR CUSTODIAN\n",
      "SENIOR DATA PROCESSING TECHNICIAN\n",
      "SENIOR DETENTION OFFICER\n",
      "SENIOR ELECTRIC SERVICE REPRESENTATIVE\n",
      "SENIOR ELECTRIC TROUBLE DISPATCHER\n",
      "SENIOR ELECTRICAL ENGINEERING DRAFTING TECHNICIAN\n",
      "SENIOR ELECTRICAL INSPECTOR\n",
      "SENIOR ELECTRICAL MECHANIC\n",
      "SENIOR ELECTRICAL MECHANIC SUPERVISOR\n",
      "SENIOR ELECTRICAL REPAIR SUPERVISOR\n",
      "SENIOR ELECTRICAL TEST TECHNICIAN\n",
      "SENIOR ELECTRICIAN\n",
      "SENIOR ENVIRONMENTAL COMPLIANCE INSPECTOR\n",
      "SENIOR ENVIRONMENTAL ENGINEER\n",
      "SENIOR EQUIPMENT MECHANIC\n",
      "WATER UTILITY SUPERINTENDENT\n",
      "SENIOR FIRE PROTECTION ENGINEER\n",
      "SENIOR FORENSIC PRINT SPECIALIST\n",
      "SENIOR GARDENER\n",
      "SENIOR HEATING AND REFRIGERATION INSPECTOR\n",
      "SENIOR HEAVY DUTY EQUIPMENT MECHANIC\n",
      "SENIOR HOUSING INSPECTOR\n",
      "SENIOR HOUSING INVESTIGATOR\n",
      "SENIOR HYDROGRAPHER\n",
      "SENIOR INDUSTRIAL HYGIENIST\n",
      "SENIOR LABOR RELATIONS SPECIALIST\n",
      "SENIOR LEGISLATIVE ASSISTANT\n",
      "SENIOR LIBRARIAN\n",
      "SENIOR LOAD DISPATCHER\n",
      "SENIOR MACHINIST SUPERVISOR\n",
      "SENIOR MANAGEMENT ANALYST\n",
      "SENIOR MECHANICAL ENGINEERING DRAFTING TECHNICIAN\n",
      "SENIOR MECHANICAL REPAIRER\n",
      "SENIOR PAINTER\n",
      "SENIOR PARK MAINTENANCE SUPERVISOR\n",
      "SENIOR PARK RANGER\n",
      "SENIOR PARK SERVICES ATTENDANT\n",
      "SENIOR PARKING ATTENDANT\n",
      "SENIOR PERSONNEL ANALYST\n",
      "SENIOR PHOTOGRAPHER\n",
      "SENIOR PLUMBER\n",
      "SENIOR PLUMBING INSPECTOR\n",
      "SENIOR POLICE SERVICE REPRESENTATIVE\n",
      "SENIOR PORT ELECTRICAL MECHANIC\n",
      "SENIOR PROPERTY OFFICER\n",
      "SENIOR REAL ESTATE OFFICER\n",
      "SENIOR RECREATION DIRECTOR\n",
      "SENIOR ROOFER\n",
      "SENIOR SAFETY ENGINEER ELEVATORS\n",
      "SENIOR SAFETY ENGINEER PRESSURE VESSELS\n",
      "SENIOR SECURITY OFFICER\n",
      "SENIOR STOREKEEPER\n",
      "SENIOR STREET LIGHTING ENGINEER\n",
      "SENIOR STRUCTURAL ENGINEER\n",
      "SENIOR SURVEY SUPERVISOR\n",
      "SENIOR SYSTEMS ANALYST\n",
      "SENIOR TAX AUDITOR\n",
      "SENIOR TITLE EXAMINER\n",
      "SENIOR TRAFFIC SUPERVISOR\n",
      "SENIOR TRANSPORTATION ENGINEER\n",
      "SENIOR TRANSPORTATION INVESTIGATOR\n",
      "SENIOR UNDERGROUND DISTRIBUTION CONSTRUCTION SUPERVISOR\n",
      "SENIOR UTILITY ACCOUNTANT\n",
      "SENIOR UTILITY BUYER\n",
      "SENIOR UTILITY SERVICES SPECIALIST\n",
      "SENIOR UTILITY SERVICES SPECIALIST\n",
      "SENIOR WASTEWATER TREATMENT OPERATOR\n",
      "SENIOR WINDOW CLEANER\n",
      "SENIOR WORKERS' COMPENSATION ANALYST\n",
      "SHEET METAL SUPERVISOR\n",
      "SHEET METAL WORKER\n",
      "SHIFT SUPERINTENDENT WASTEWATER TREATMENT\n",
      "SHIP CARPENTER\n",
      "SHOPS SUPERINTENDENT\n",
      "SIGN PAINTER\n",
      "SIGN SHOP SUPERVISOR\n",
      "SIGNAL SYSTEMS ELECTRICIAN\n",
      "SIGNAL SYSTEMS SUPERINTENDENT\n",
      "SIGNAL SYSTEMS SUPERVISOR\n",
      "SOCIAL WORKER\n",
      "SOLID RESOURCES SUPERINTENDENT\n",
      "SOLID WASTE DISPOSAL SUPERINTENDENT\n",
      "SPECIAL INVESTIGATOR\n",
      "SENIOR CRIME AND INTELLIGENCE ANALYST\n",
      "STAFF ASSISTANT TO GENERAL MANAGER WATER AND POWER\n",
      "STEAM PLANT ASSISTANT\n",
      "STEAM PLANT MAINTENANCE MECHANIC\n",
      "STEAM PLANT MAINTENANCE SUPERVISOR\n",
      "STEAM PLANT OPERATOR\n",
      "STOREKEEPER\n",
      "STORES SUPERVISOR\n",
      "STREET LIGHTING CONSTRUCTION AND MAINTENANCE SUPERINTENDENT\n",
      "STREET LIGHTING ELECTRICIAN\n",
      "STREET LIGHTING ELECTRICIAN SUPERVISOR\n",
      "STREET LIGHTING ENGINEER\n",
      "STREET LIGHTING ENGINEERING ASSOCIATE\n",
      "STREET SERVICES GENERAL SUPERINTENDENT\n",
      "STREET SERVICES INVESTIGATOR\n",
      "STREET SERVICES SUPERINTENDENT\n",
      "STREET SERVICES SUPERVISOR\n",
      "STREET SERVICES WORKER\n",
      "STREET TREE SUPERINTENDENT\n",
      "STRUCTURAL ENGINEER\n",
      "STRUCTURAL ENGINEERING ASSOCIATE\n",
      "STRUCTURAL STEEL FABRICATOR\n",
      "STRUCTURAL STEEL FABRICATOR SUPERVISOR\n",
      "SUPERINTENDENT OF RECREATION AND PARKS OPERATIONS\n",
      "SUPERVISING CRIMINALIST\n",
      "SUPERVISING OCCUPATIONAL HEALTH NURSE\n",
      "SUPERVISING TRANSPORTATION PLANNER\n",
      "SUPERVISING WATER SERVICE REPRESENTATIVE\n",
      "SUPPLY SERVICES MANAGER\n",
      "SUPPLY SERVICES PAYMENT CLERK\n",
      "SURVEY PARTY CHIEF\n",
      "SURVEY SUPERVISOR\n",
      "SYSTEMS AIDE\n",
      "SYSTEMS ANALYST\n",
      "SYSTEMS PROGRAMMER\n",
      "TAX AUDITOR\n",
      "TAX COMPLIANCE AIDE\n",
      "TAX COMPLIANCE OFFICER\n",
      "TELECOMMUNICATIONS PLANNING AND UTILIZATION OFFICER\n",
      "TILE SETTER\n",
      "TIRE REPAIRER\n",
      "TITLE EXAMINER\n",
      "TRAFFIC MARKING AND SIGN SUPERINTENDENT\n",
      "TRAFFIC OFFICER\n",
      "TRAFFIC PAINTER AND SIGN POSTER\n",
      "TRANSMISSION AND DISTRIBUTION DISTRICT SUPERVISOR\n",
      "TRANSPORTATION ENGINEER\n",
      "TRANSPORTATION ENGINEERING AIDE\n",
      "TRANSPORTATION ENGINEERING ASSOCIATE\n",
      "TRANSPORTATION INVESTIGATOR\n",
      "TRANSPORTATION PLANNING ASSOCIATE\n",
      "TREASURY ACCOUNTANT\n",
      "TREE SURGEON\n",
      "TREE SURGEON ASSISTANT\n",
      "TREE SURGEON SUPERVISOR\n",
      "TRUCK AND EQUIPMENT DISPATCHER\n",
      "TRUCK OPERATOR\n",
      "UNDERGROUND DISTRIBUTION CONSTRUCTION MECHANIC\n",
      "UNDERGROUND DISTRIBUTION CONSTRUCTION SUPERVISOR\n",
      "UPHOLSTERER\n",
      "UTILITIES SERVICE INVESTIGATOR\n",
      "UTILITY ACCOUNTANT\n",
      "UTILITY ADMINISTRATOR\n",
      "UTILITY BUYER\n",
      "UTILITY EXECUTIVE SECRETARY\n",
      "UTILITY SERVICES MANAGER\n",
      "UTILITY SERVICES SPECIALIST\n",
      "VETERINARY TECHNICIAN\n",
      "VIDEO PRODUCTION COORDINATOR\n",
      "VIDEO TECHNICIAN\n",
      "VOLUNTEER COORDINATOR\n",
      "WAREHOUSE AND TOOLROOM WORKER\n",
      "WASTEWATER TREATMENT OPERATOR\n",
      "WASTEWATER COLLECTION WORKER\n",
      "WASTEWATER TREATMENT ELECTRICIAN\n",
      "WASTEWATER TREATMENT ELECTRICIAN SUPERVISOR\n",
      "WASTEWATER TREATMENT LABORATORY MANAGER\n",
      "WASTEWATER TREATMENT MECHANIC\n",
      "WASTEWATER TREATMENT MECHANIC SUPERVISOR\n",
      "WASTEWATER TREATMENT OPERATOR\n",
      "WATER BIOLOGIST\n",
      "WATER MICROBIOLOGIST\n",
      "WATER SERVICE REPRESENTATIVE\n",
      "WATER SERVICE SUPERVISOR\n",
      "WATER SERVICE WORKER\n",
      "WATER SERVICES MANAGER\n",
      "WATER TREATMENT OPERATOR\n",
      "WATER TREATMENT SUPERVISOR\n",
      "WATER UTILITY OPERATOR\n",
      "WATER UTILITY OPERATOR SUPERVISOR\n",
      "WATER UTILITY SUPERINTENDENT\n",
      "WATER UTILITY SUPERVISOR\n",
      "WATER UTILITY WORKER\n",
      "WATERSHED RESOURCES SPECIALIST\n",
      "WATERWORKS ENGINEER\n",
      "WATERWORKS MECHANIC SUPERVISOR\n",
      "WELDER\n",
      "WELDER SUPERVISOR\n",
      "WHARFINGER\n",
      "WINDOW CLEANER\n",
      "WORKERS' COMPENSATION ANALYST\n",
      "WORKERS' COMPENSATION CLAIMS ASSISTANT\n",
      "X-Ray and Laboratory Technician\n",
      "ZOO CURATOR\n",
      "ZOO CURATOR OF EDUCATION\n",
      "ZOO REGISTRAR\n"
     ]
    }
   ],
   "source": [
    "# Rerun the function job_class_title using cleaned data\n",
    "for file_name in cleaned_jobs:\n",
    "    job_path     = cleaned_path + file_name     # define path to file_name\n",
    "    cleaned_job  = open(job_path, 'rt').read()  # read in job as a string\n",
    "    try:\n",
    "        print(job_class_title(job=cleaned_job)) \n",
    "    except:                                     # do some pretty printings here to help our eyes from pain\n",
    "        ## define some useful variables\n",
    "        border_line = '##############################################################################################'\n",
    "        how_many    = int((len(border_line) - len(job_path))/2)\n",
    "        print(border_line)\n",
    "        ## do pretty printings\n",
    "        print('#'*how_many + job_path + '#'*how_many)\n",
    "        print(border_line)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Normalize JOB_CLASS_NO (jcn)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 6,
   "metadata": {},
   "outputs": [],
   "source": [
    "# This is a helper function\n",
    "def job_class_no(job):\n",
    "    '''Returns the field JOB_CLASS_NO (jcn)'''\n",
    "    # From the word Class Code to the word Open Date is where the information located.\n",
    "    temp = job[job.index('Class Code'):job.index('Open Date')]\n",
    "    # Check if anything in temp is a digit via isdigit(). If it is, get it\n",
    "    jcn  = [e for e in temp.split() if e.isdigit()][0] # first element is what we want\n",
    "    # Per requirement, if Class Code only has 3 non-zero digits, then becomes 0###\n",
    "    if len(jcn) <= 3:\n",
    "        jcn = '0'+jcn\n",
    "    \n",
    "    # Returns\n",
    "    return jcn"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 7,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "9206\n",
      "1513\n",
      "1223\n",
      "1119\n",
      "1590\n",
      "1358\n",
      "9135\n",
      "2325\n",
      "3774\n",
      "3781\n",
      "1540\n",
      "1404\n",
      "7256\n",
      "0845\n",
      "1783\n",
      "9210\n",
      "7260\n",
      "3228\n",
      "3227\n",
      "3225\n",
      "3236\n",
      "7268\n",
      "3331\n",
      "3336\n",
      "1788\n",
      "4323\n",
      "4310\n",
      "5885\n",
      "4311\n",
      "4304\n",
      "2121\n",
      "1429\n",
      "3789\n",
      "3764\n",
      "2400\n",
      "2493\n",
      "2419\n",
      "2423\n",
      "5813\n",
      "5816\n",
      "7925\n",
      "7926\n",
      "7922\n",
      "1191\n",
      "2478\n",
      "2448\n",
      "2447\n",
      "2454\n",
      "2455\n",
      "3440\n",
      "3435\n",
      "4143\n",
      "4145\n",
      "7259\n",
      "3808\n",
      "3684\n",
      "4219\n",
      "9377\n",
      "3142\n",
      "4208\n",
      "9415\n",
      "3818\n",
      "3809\n",
      "3150\n",
      "1860\n",
      "7998\n",
      "6147\n",
      "1517\n",
      "3704\n",
      "3706\n",
      "3707\n",
      "3721\n",
      "3595\n",
      "3714\n",
      "3565\n",
      "1759\n",
      "1764\n",
      "1203\n",
      "3733\n",
      "3735\n",
      "3737\n",
      "7244\n",
      "3124\n",
      "7543\n",
      "4211\n",
      "3190\n",
      "7561\n",
      "4251\n",
      "5923\n",
      "3338\n",
      "3333\n",
      "3588\n",
      "3589\n",
      "1801\n",
      "3344\n",
      "3346\n",
      "3418\n",
      "3353\n",
      "3354\n",
      "3351\n",
      "7833\n",
      "1554\n",
      "7274\n",
      "9151\n",
      "5927\n",
      "1253\n",
      "1260\n",
      "1249\n",
      "1249\n",
      "1466\n",
      "7296\n",
      "3182\n",
      "5237\n",
      "4289\n",
      "9230\n",
      "2237\n",
      "9286\n",
      "4254\n",
      "1619\n",
      "9182\n",
      "7945\n",
      "7271\n",
      "7258\n",
      "9180\n",
      "1968\n",
      "5154\n",
      "4260\n",
      "3187\n",
      "4286\n",
      "1211\n",
      "4275\n",
      "7944\n",
      "7941\n",
      "7237\n",
      "7246\n",
      "7232\n",
      "1767\n",
      "1600\n",
      "1603\n",
      "1213\n",
      "9734\n",
      "3800\n",
      "3802\n",
      "3686\n",
      "3689\n",
      "7610\n",
      "7607\n",
      "1461\n",
      "2496\n",
      "8500\n",
      "2501\n",
      "9165\n",
      "3129\n",
      "3127\n",
      "3541\n",
      "3341\n",
      "7291\n",
      "9168\n",
      "7230\n",
      "2317\n",
      "2236\n",
      "2234\n",
      "3149\n",
      "3156\n",
      "3176\n",
      "1230\n",
      "1229\n",
      "1136\n",
      "1470\n",
      "5131\n",
      "1121\n",
      "1593\n",
      "3211\n",
      "1768\n",
      "9304\n",
      "9302\n",
      "7625\n",
      "4266\n",
      "4321\n",
      "1568\n",
      "7270\n",
      "3722\n",
      "3123\n",
      "1488\n",
      "3208\n",
      "9375\n",
      "4320\n",
      "6157\n",
      "3521\n",
      "1493\n",
      "3879\n",
      "3873\n",
      "3822\n",
      "7520\n",
      "5224\n",
      "3828\n",
      "3799\n",
      "7525\n",
      "7532\n",
      "4221\n",
      "3841\n",
      "3835\n",
      "3855\n",
      "3853\n",
      "3825\n",
      "5265\n",
      "7512\n",
      "3863\n",
      "3865\n",
      "3866\n",
      "3860\n",
      "3869\n",
      "1702\n",
      "2322\n",
      "2341\n",
      "2340\n",
      "2131\n",
      "9486\n",
      "7217\n",
      "7255\n",
      "7253\n",
      "7320\n",
      "4292\n",
      "7872\n",
      "7871\n",
      "7310\n",
      "7304\n",
      "3711\n",
      "3525\n",
      "3746\n",
      "3734\n",
      "3750\n",
      "3527\n",
      "3229\n",
      "1117\n",
      "9186\n",
      "2444\n",
      "7228\n",
      "1549\n",
      "1571\n",
      "1557\n",
      "1157\n",
      "2166\n",
      "2152\n",
      "2142\n",
      "3563\n",
      "2128\n",
      "7978\n",
      "1632\n",
      "4240\n",
      "2233\n",
      "5125\n",
      "5127\n",
      "2112\n",
      "1555\n",
      "9103\n",
      "2200\n",
      "2442\n",
      "3538\n",
      "3531\n",
      "3141\n",
      "3718\n",
      "9601\n",
      "7211\n",
      "7213\n",
      "7214\n",
      "7239\n",
      "2453\n",
      "2479\n",
      "1670\n",
      "7935\n",
      "9279\n",
      "9224\n",
      "9234\n",
      "3178\n",
      "4245\n",
      "3743\n",
      "3584\n",
      "3742\n",
      "3749\n",
      "4243\n",
      "8516\n",
      "8504\n",
      "9207\n",
      "7263\n",
      "1564\n",
      "9191\n",
      "7834\n",
      "1490\n",
      "2330\n",
      "1456\n",
      "1409\n",
      "3843\n",
      "3844\n",
      "1625\n",
      "9146\n",
      "3913\n",
      "3126\n",
      "7854\n",
      "7283\n",
      "7929\n",
      "7933\n",
      "1182\n",
      "9482\n",
      "6152\n",
      "1172\n",
      "2332\n",
      "3882\n",
      "3393\n",
      "3763\n",
      "3766\n",
      "3115\n",
      "3112\n",
      "1508\n",
      "9184\n",
      "1539\n",
      "9406\n",
      "2425\n",
      "2403\n",
      "9437\n",
      "##############################################################################################\n",
      "##########CityofLA/Job Bulletins/MARINE ENVIRONMENTAL SUPERVISOR 9433 071114 (1).txt##########\n",
      "##############################################################################################\n",
      "3451\n",
      "7967\n",
      "7968\n",
      "7558\n",
      "7554\n",
      "7551\n",
      "3771\n",
      "3731\n",
      "3795\n",
      "3773\n",
      "2310\n",
      "1611\n",
      "1789\n",
      "3585\n",
      "2314\n",
      "7212\n",
      "1360\n",
      "1101\n",
      "1779\n",
      "3423\n",
      "3426\n",
      "3145\n",
      "1966\n",
      "2412\n",
      "2426\n",
      "3530\n",
      "9025\n",
      "9170\n",
      "3738\n",
      "3757\n",
      "1630\n",
      "1170\n",
      "2449\n",
      "1731\n",
      "1714\n",
      "1129\n",
      "1739\n",
      "1793\n",
      "3553\n",
      "3433\n",
      "3438\n",
      "7939\n",
      "3443\n",
      "3446\n",
      "4231\n",
      "9196\n",
      "2244\n",
      "2251\n",
      "2223\n",
      "2232\n",
      "2214\n",
      "1627\n",
      "2227\n",
      "2207\n",
      "1640\n",
      "2217\n",
      "3687\n",
      "2240\n",
      "3758\n",
      "3759\n",
      "3128\n",
      "5151\n",
      "3224\n",
      "3223\n",
      "3221\n",
      "3222\n",
      "9143\n",
      "9453\n",
      "3558\n",
      "1481\n",
      "1525\n",
      "4312\n",
      "7946\n",
      "9489\n",
      "7219\n",
      "1201\n",
      "1152\n",
      "1202\n",
      "1458\n",
      "7297\n",
      "9653\n",
      "3215\n",
      "3830\n",
      "7531\n",
      "7875\n",
      "3147\n",
      "4226\n",
      "6155\n",
      "7550\n",
      "1794\n",
      "3210\n",
      "1786\n",
      "2464\n",
      "3200\n",
      "1839\n",
      "1524\n",
      "1195\n",
      "9266\n",
      "1589\n",
      "1777\n",
      "1494\n",
      "1496\n",
      "1859\n",
      "1852\n",
      "1431\n",
      "1964\n",
      "3207\n",
      "3463\n",
      "##############################################################################################\n",
      "##############CityofLA/Job Bulletins/PUBLIC INFORMATION DIRECTOR 1800 030317.txt##############\n",
      "##############################################################################################\n",
      "1785\n",
      "7976\n",
      "5601\n",
      "1941\n",
      "1960\n",
      "1937\n",
      "2469\n",
      "2434\n",
      "2460\n",
      "4101\n",
      "3580\n",
      "4100\n",
      "1569\n",
      "8502\n",
      "3483\n",
      "3162\n",
      "3163\n",
      "9149\n",
      "2485\n",
      "1645\n",
      "7980\n",
      "1530\n",
      "3476\n",
      "3478\n",
      "1728\n",
      "1727\n",
      "4263\n",
      "4261\n",
      "1726\n",
      "4126\n",
      "4128\n",
      "1116\n",
      "1924\n",
      "3199\n",
      "3181\n",
      "1523\n",
      "1541\n",
      "1368\n",
      "4316\n",
      "4305\n",
      "7927\n",
      "7208\n",
      "1518\n",
      "3716\n",
      "4213\n",
      "4253\n",
      "5925\n",
      "3345\n",
      "7830\n",
      "7947\n",
      "9485\n",
      "7207\n",
      "1770\n",
      "1602\n",
      "3801\n",
      "3638\n",
      "3691\n",
      "7614\n",
      "1467\n",
      "1428\n",
      "7289\n",
      "3347\n",
      "7294\n",
      "3157\n",
      "1139\n",
      "3212\n",
      "7521\n",
      "3829\n",
      "7209\n",
      "4223\n",
      "3834\n",
      "3836\n",
      "3856\n",
      "7515\n",
      "3864\n",
      "4293\n",
      "7874\n",
      "3712\n",
      "3980\n",
      "7981\n",
      "2201\n",
      "3143\n",
      "4247\n",
      "3745\n",
      "4244\n",
      "8517\n",
      "7264\n",
      "2331\n",
      "9202\n",
      "1187\n",
      "6153\n",
      "5235\n",
      "3768\n",
      "9171\n",
      "7210\n",
      "3772\n",
      "3424\n",
      "3146\n",
      "1967\n",
      "2422\n",
      "3529\n",
      "9167\n",
      "1795\n",
      "3444\n",
      "4233\n",
      "2209\n",
      "3847\n",
      "3209\n",
      "1961\n",
      "2446\n",
      "3477\n",
      "4264\n",
      "4262\n",
      "3184\n",
      "1837\n",
      "9536\n",
      "9425\n",
      "7288\n",
      "1597\n",
      "1519\n",
      "1947\n",
      "3218\n",
      "9262\n",
      "4273\n",
      "3815\n",
      "1521\n",
      "1862\n",
      "3753\n",
      "3753\n",
      "4124\n",
      "3174\n",
      "1769\n",
      "3777\n",
      "3775\n",
      "7242\n",
      "3348\n",
      "3780\n",
      "3428\n",
      "3419\n",
      "3819\n",
      "3832\n",
      "3839\n",
      "2385\n",
      "4102\n",
      "4108\n",
      "0602\n",
      "2241\n",
      "9185\n",
      "5622\n",
      "5630\n",
      "3786\n",
      "5624\n",
      "1835\n",
      "1866\n",
      "3820\n",
      "3811\n",
      "3840\n",
      "7537\n",
      "7527\n",
      "4160\n",
      "4283\n",
      "4158\n",
      "4152\n",
      "4150\n",
      "3160\n",
      "7956\n",
      "7957\n",
      "3793\n",
      "3794\n",
      "2472\n",
      "2235\n",
      "2315\n",
      "2481\n",
      "1697\n",
      "1865\n",
      "1214\n",
      "7286\n",
      "7287\n",
      "1599\n",
      "1596\n",
      "1455\n",
      "1514\n",
      "1173\n",
      "1179\n",
      "7640\n",
      "3493\n",
      "3727\n",
      "1943\n",
      "3430\n",
      "3214\n",
      "3421\n",
      "3875\n",
      "7278\n",
      "7285\n",
      "7280\n",
      "4271\n",
      "2480\n",
      "1609\n",
      "3114\n",
      "3151\n",
      "3117\n",
      "3586\n",
      "3583\n",
      "3812\n",
      "3814\n",
      "3723\n",
      "1631\n",
      "1511\n",
      "9105\n",
      "1861\n",
      "1336\n",
      "9106\n",
      "3755\n",
      "2369\n",
      "1802\n",
      "6145\n",
      "2495\n",
      "1832\n",
      "4123\n",
      "4110\n",
      "5615\n",
      "5613\n",
      "7840\n",
      "5614\n",
      "5617\n",
      "4123\n",
      "7856\n",
      "7857\n",
      "1693\n",
      "3930\n",
      "3931\n",
      "9602\n",
      "5885\n",
      "5887\n",
      "5854\n",
      "5857\n",
      "3980\n",
      "3976\n",
      "3912\n",
      "7862\n",
      "7248\n",
      "3987\n",
      "3796\n",
      "3798\n",
      "1190\n",
      "3173\n",
      "1774\n",
      "1775\n",
      "2358\n",
      "4297\n",
      "4300\n",
      "4290\n"
     ]
    }
   ],
   "source": [
    "# Normalization Strategy: \n",
    "# print jcn in the try clause and print job_path in the except clause\n",
    "# look at printouts and detect unusual jctn's.\n",
    "for file_name in raw_jobs:\n",
    "    job_path = raw_path + file_name        # define path to file_name\n",
    "    raw_job  = open(job_path, 'rt').read() # read in job as a string\n",
    "    try:\n",
    "        print(job_class_no(job=raw_job))\n",
    "    except:                                # do some pretty printings here to help our eyes from pain\n",
    "        ## define some useful variables\n",
    "        border_line = '##############################################################################################'\n",
    "        how_many    = int((len(border_line) - len(job_path))/2)\n",
    "        print(border_line)\n",
    "        ## do pretty printings\n",
    "        print('#'*how_many + job_path + '#'*how_many)\n",
    "        print(border_line)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Below list two jobs that were caught with errors. MARINE ENVIRONMENTAL SUPERVISOR 9433 071114 (1).txt has 'Class  Code' (two white spaces) instead of 'Class Code' (one white space) and PUBLIC INFORMATION DIRECTOR 1800 030317.txt has 'Open date' instead of 'Open Date'. They were thus modified to fix these limitations.\n",
    "* CityofLA/Job Bulletins/PUBLIC INFORMATION DIRECTOR 1800 030317.txt\n",
    "* CityofLA/Job Bulletins/MARINE ENVIRONMENTAL SUPERVISOR 9433 071114 (1).txt"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "**Let's rerun the function and observe the changes. Note we use .txt files in the JobBulletins_cleaned folder.**\n",
    "\n",
    "Observing the printouts carefully this time, we see that all of the nuances above have been resolved."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 8,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "9206\n",
      "1513\n",
      "1223\n",
      "1119\n",
      "1590\n",
      "1358\n",
      "9135\n",
      "2325\n",
      "3774\n",
      "3781\n",
      "1540\n",
      "1404\n",
      "7256\n",
      "0845\n",
      "1783\n",
      "9210\n",
      "7260\n",
      "3228\n",
      "3227\n",
      "3225\n",
      "3236\n",
      "7268\n",
      "3331\n",
      "3336\n",
      "1788\n",
      "4323\n",
      "4310\n",
      "5885\n",
      "4311\n",
      "4304\n",
      "2121\n",
      "1429\n",
      "3789\n",
      "3764\n",
      "2400\n",
      "2493\n",
      "2419\n",
      "2423\n",
      "5813\n",
      "5816\n",
      "7925\n",
      "7926\n",
      "7922\n",
      "1191\n",
      "2478\n",
      "2448\n",
      "2447\n",
      "2454\n",
      "2455\n",
      "3440\n",
      "3435\n",
      "4143\n",
      "4145\n",
      "7259\n",
      "3808\n",
      "3684\n",
      "4219\n",
      "9377\n",
      "3142\n",
      "4208\n",
      "9415\n",
      "3818\n",
      "3809\n",
      "3150\n",
      "1860\n",
      "7998\n",
      "6147\n",
      "1517\n",
      "3704\n",
      "3706\n",
      "3707\n",
      "3721\n",
      "3595\n",
      "3714\n",
      "3565\n",
      "1759\n",
      "1764\n",
      "1203\n",
      "3733\n",
      "3735\n",
      "3737\n",
      "7244\n",
      "3124\n",
      "7543\n",
      "4211\n",
      "3190\n",
      "7561\n",
      "4251\n",
      "5923\n",
      "3338\n",
      "3333\n",
      "3588\n",
      "3589\n",
      "1801\n",
      "3344\n",
      "3346\n",
      "3418\n",
      "3353\n",
      "3354\n",
      "3351\n",
      "7833\n",
      "1554\n",
      "7274\n",
      "9151\n",
      "5927\n",
      "1253\n",
      "1260\n",
      "1249\n",
      "1249\n",
      "1466\n",
      "7296\n",
      "3182\n",
      "5237\n",
      "4289\n",
      "9230\n",
      "2237\n",
      "9286\n",
      "4254\n",
      "1619\n",
      "9182\n",
      "7945\n",
      "7271\n",
      "7258\n",
      "9180\n",
      "1968\n",
      "5154\n",
      "4260\n",
      "3187\n",
      "4286\n",
      "1211\n",
      "4275\n",
      "7944\n",
      "7941\n",
      "7237\n",
      "7246\n",
      "7232\n",
      "1767\n",
      "1600\n",
      "1603\n",
      "1213\n",
      "9734\n",
      "3800\n",
      "3802\n",
      "3686\n",
      "3689\n",
      "7610\n",
      "7607\n",
      "1461\n",
      "2496\n",
      "8500\n",
      "2501\n",
      "9165\n",
      "3129\n",
      "3127\n",
      "3541\n",
      "3341\n",
      "7291\n",
      "9168\n",
      "7230\n",
      "2317\n",
      "2236\n",
      "2234\n",
      "3149\n",
      "3156\n",
      "3176\n",
      "1230\n",
      "1229\n",
      "1136\n",
      "1470\n",
      "5131\n",
      "1121\n",
      "1593\n",
      "3211\n",
      "1768\n",
      "9304\n",
      "9302\n",
      "7625\n",
      "4266\n",
      "4321\n",
      "1568\n",
      "7270\n",
      "3722\n",
      "3123\n",
      "1488\n",
      "3208\n",
      "9375\n",
      "4320\n",
      "6157\n",
      "3521\n",
      "1493\n",
      "3879\n",
      "3873\n",
      "3822\n",
      "7520\n",
      "5224\n",
      "3828\n",
      "3799\n",
      "7525\n",
      "7532\n",
      "4221\n",
      "3841\n",
      "3835\n",
      "3855\n",
      "3853\n",
      "3825\n",
      "5265\n",
      "7512\n",
      "3863\n",
      "3865\n",
      "3866\n",
      "3860\n",
      "3869\n",
      "1702\n",
      "2322\n",
      "2341\n",
      "2340\n",
      "2131\n",
      "9486\n",
      "7217\n",
      "7255\n",
      "7253\n",
      "7320\n",
      "4292\n",
      "7872\n",
      "7871\n",
      "7310\n",
      "7304\n",
      "3711\n",
      "3525\n",
      "3746\n",
      "3734\n",
      "3750\n",
      "3527\n",
      "3229\n",
      "1117\n",
      "9186\n",
      "2444\n",
      "7228\n",
      "1549\n",
      "1571\n",
      "1557\n",
      "1157\n",
      "2166\n",
      "2152\n",
      "2142\n",
      "3563\n",
      "2128\n",
      "7978\n",
      "1632\n",
      "4240\n",
      "2233\n",
      "5125\n",
      "5127\n",
      "2112\n",
      "1555\n",
      "9103\n",
      "2200\n",
      "2442\n",
      "3538\n",
      "3531\n",
      "3141\n",
      "3718\n",
      "9601\n",
      "7211\n",
      "7213\n",
      "7214\n",
      "7239\n",
      "2453\n",
      "2479\n",
      "1670\n",
      "7935\n",
      "9279\n",
      "9224\n",
      "9234\n",
      "3178\n",
      "4245\n",
      "3743\n",
      "3584\n",
      "3742\n",
      "3749\n",
      "4243\n",
      "8516\n",
      "8504\n",
      "9207\n",
      "7263\n",
      "1564\n",
      "9191\n",
      "7834\n",
      "1490\n",
      "2330\n",
      "1456\n",
      "1409\n",
      "3843\n",
      "3844\n",
      "1625\n",
      "9146\n",
      "3913\n",
      "3126\n",
      "7854\n",
      "7283\n",
      "7929\n",
      "7933\n",
      "1182\n",
      "9482\n",
      "6152\n",
      "1172\n",
      "2332\n",
      "3882\n",
      "3393\n",
      "3763\n",
      "3766\n",
      "3115\n",
      "3112\n",
      "1508\n",
      "9184\n",
      "1539\n",
      "9406\n",
      "2425\n",
      "2403\n",
      "9437\n",
      "9433\n",
      "3451\n",
      "7967\n",
      "7968\n",
      "7558\n",
      "7554\n",
      "7551\n",
      "3771\n",
      "3731\n",
      "3795\n",
      "3773\n",
      "2310\n",
      "1611\n",
      "1789\n",
      "3585\n",
      "2314\n",
      "7212\n",
      "1360\n",
      "1101\n",
      "1779\n",
      "3423\n",
      "3426\n",
      "3145\n",
      "1966\n",
      "2412\n",
      "2426\n",
      "3530\n",
      "9025\n",
      "9170\n",
      "3738\n",
      "3757\n",
      "1630\n",
      "1170\n",
      "2449\n",
      "1731\n",
      "1714\n",
      "1129\n",
      "1739\n",
      "1793\n",
      "3553\n",
      "3433\n",
      "3438\n",
      "7939\n",
      "3443\n",
      "3446\n",
      "4231\n",
      "9196\n",
      "2244\n",
      "2251\n",
      "2223\n",
      "2232\n",
      "2214\n",
      "1627\n",
      "2227\n",
      "2207\n",
      "1640\n",
      "2217\n",
      "3687\n",
      "2240\n",
      "3758\n",
      "3759\n",
      "3128\n",
      "5151\n",
      "3224\n",
      "3223\n",
      "3221\n",
      "3222\n",
      "9143\n",
      "9453\n",
      "3558\n",
      "1481\n",
      "1525\n",
      "4312\n",
      "7946\n",
      "9489\n",
      "7219\n",
      "1201\n",
      "1152\n",
      "1202\n",
      "1458\n",
      "7297\n",
      "9653\n",
      "3215\n",
      "3830\n",
      "7531\n",
      "7875\n",
      "3147\n",
      "4226\n",
      "6155\n",
      "7550\n",
      "1794\n",
      "3210\n",
      "1786\n",
      "2464\n",
      "3200\n",
      "1839\n",
      "1524\n",
      "1195\n",
      "9266\n",
      "1589\n",
      "1777\n",
      "1494\n",
      "1496\n",
      "1859\n",
      "1852\n",
      "1431\n",
      "1964\n",
      "3207\n",
      "3463\n",
      "1800\n",
      "1785\n",
      "7976\n",
      "5601\n",
      "1941\n",
      "1960\n",
      "1937\n",
      "2469\n",
      "2434\n",
      "2460\n",
      "4101\n",
      "3580\n",
      "4100\n",
      "1569\n",
      "8502\n",
      "3483\n",
      "3162\n",
      "3163\n",
      "9149\n",
      "2485\n",
      "1645\n",
      "7980\n",
      "1530\n",
      "3476\n",
      "3478\n",
      "1728\n",
      "1727\n",
      "4263\n",
      "4261\n",
      "1726\n",
      "4126\n",
      "4128\n",
      "1116\n",
      "1924\n",
      "3199\n",
      "3181\n",
      "1523\n",
      "1541\n",
      "1368\n",
      "4316\n",
      "4305\n",
      "7927\n",
      "7208\n",
      "1518\n",
      "3716\n",
      "4213\n",
      "4253\n",
      "5925\n",
      "3345\n",
      "7830\n",
      "7947\n",
      "9485\n",
      "7207\n",
      "1770\n",
      "1602\n",
      "3801\n",
      "3638\n",
      "3691\n",
      "7614\n",
      "1467\n",
      "1428\n",
      "7289\n",
      "3347\n",
      "7294\n",
      "3157\n",
      "1139\n",
      "3212\n",
      "7521\n",
      "3829\n",
      "7209\n",
      "4223\n",
      "3834\n",
      "3836\n",
      "3856\n",
      "7515\n",
      "3864\n",
      "4293\n",
      "7874\n",
      "3712\n",
      "3980\n",
      "7981\n",
      "2201\n",
      "3143\n",
      "4247\n",
      "3745\n",
      "4244\n",
      "8517\n",
      "7264\n",
      "2331\n",
      "9202\n",
      "1187\n",
      "6153\n",
      "5235\n",
      "3768\n",
      "9171\n",
      "7210\n",
      "3772\n",
      "3424\n",
      "3146\n",
      "1967\n",
      "2422\n",
      "3529\n",
      "9167\n",
      "1795\n",
      "3444\n",
      "4233\n",
      "2209\n",
      "3847\n",
      "3209\n",
      "1961\n",
      "2446\n",
      "3477\n",
      "4264\n",
      "4262\n",
      "3184\n",
      "1837\n",
      "9536\n",
      "9425\n",
      "7288\n",
      "1597\n",
      "1519\n",
      "1947\n",
      "3218\n",
      "9262\n",
      "4273\n",
      "3815\n",
      "1521\n",
      "1862\n",
      "3753\n",
      "3753\n",
      "4124\n",
      "3174\n",
      "1769\n",
      "3777\n",
      "3775\n",
      "7242\n",
      "3348\n",
      "3780\n",
      "3428\n",
      "3419\n",
      "3819\n",
      "3832\n",
      "3839\n",
      "2385\n",
      "4102\n",
      "4108\n",
      "0602\n",
      "2241\n",
      "9185\n",
      "5622\n",
      "5630\n",
      "3786\n",
      "5624\n",
      "1835\n",
      "1866\n",
      "3820\n",
      "3811\n",
      "3840\n",
      "7537\n",
      "7527\n",
      "4160\n",
      "4283\n",
      "4158\n",
      "4152\n",
      "4150\n",
      "3160\n",
      "7956\n",
      "7957\n",
      "3793\n",
      "3794\n",
      "2472\n",
      "2235\n",
      "2315\n",
      "2481\n",
      "1697\n",
      "1865\n",
      "1214\n",
      "7286\n",
      "7287\n",
      "1599\n",
      "1596\n",
      "1455\n",
      "1514\n",
      "1173\n",
      "1179\n",
      "7640\n",
      "3493\n",
      "3727\n",
      "1943\n",
      "3430\n",
      "3214\n",
      "3421\n",
      "3875\n",
      "7278\n",
      "7285\n",
      "7280\n",
      "4271\n",
      "2480\n",
      "1609\n",
      "3114\n",
      "3151\n",
      "3117\n",
      "3586\n",
      "3583\n",
      "3812\n",
      "3814\n",
      "3723\n",
      "1631\n",
      "1511\n",
      "9105\n",
      "1861\n",
      "1336\n",
      "9106\n",
      "3755\n",
      "2369\n",
      "1802\n",
      "6145\n",
      "2495\n",
      "1832\n",
      "4123\n",
      "4110\n",
      "5615\n",
      "5613\n",
      "7840\n",
      "5614\n",
      "5617\n",
      "4123\n",
      "7856\n",
      "7857\n",
      "1693\n",
      "3930\n",
      "3931\n",
      "9602\n",
      "5885\n",
      "5887\n",
      "5854\n",
      "5857\n",
      "3980\n",
      "3976\n",
      "3912\n",
      "7862\n",
      "7248\n",
      "3987\n",
      "3796\n",
      "3798\n",
      "1190\n",
      "3173\n",
      "1774\n",
      "1775\n",
      "2358\n",
      "4297\n",
      "4300\n",
      "4290\n"
     ]
    }
   ],
   "source": [
    "# Rerun the function job_class_no using cleaned data\n",
    "for file_name in cleaned_jobs:\n",
    "    job_path     = cleaned_path + file_name     # define path to file_name\n",
    "    cleaned_job  = open(job_path, 'rt').read()  # read in job as a string\n",
    "    try:\n",
    "        print(job_class_no(job=cleaned_job)) \n",
    "    except:                                     # do some pretty printings here to help our eyes from pain\n",
    "        ## define some useful variables\n",
    "        border_line = '##############################################################################################'\n",
    "        how_many    = int((len(border_line) - len(job_path))/2)\n",
    "        print(border_line)\n",
    "        ## do pretty printings\n",
    "        print('#'*how_many + job_path + '#'*how_many)\n",
    "        print(border_line)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Get DUTIES"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 3,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "CityofLA/Job Bulletins/APPARATUS OPERATOR 2121 071417 (1).txt\n",
      "CityofLA/Job Bulletins/ENGINEER OF FIRE DEPARTMENT 2131 111116.txt\n",
      "CityofLA/Job Bulletins/FIRE ASSISTANT CHIEF 2166 011218.txt\n",
      "CityofLA/Job Bulletins/FIRE BATTALION CHIEF 2152 030918.txt\n",
      "CityofLA/Job Bulletins/FIRE HELICOPTER PILOT 3563 081415 REV. 081815.txt\n",
      "CityofLA/Job Bulletins/FIRE INSPECTOR 2128 031717.txt\n"
     ]
    }
   ],
   "source": [
    "# First, make sure the word 'DUTIES' can be found in the job postings.\n",
    "# Do an index('DUTIES') in the try clause, not find('DUTIES'), to catch the errors\n",
    "for file_name in raw_jobs:\n",
    "    job_path = raw_path + file_name        # define path to file_name\n",
    "    raw_job  = open(job_path, 'rt').read() # read in job as a string\n",
    "    try:\n",
    "        if 'DUTIES' not in raw_job.split():\n",
    "            print(job_path)\n",
    "    except:                                # do some pretty printings here to help our eyes from pain\n",
    "        ## define some useful variables\n",
    "        border_line = '##############################################################################################'\n",
    "        how_many    = int((len(border_line) - len(job_path))/2)\n",
    "        print(border_line)\n",
    "        ## do pretty printings\n",
    "        print('#'*how_many + job_path + '#'*how_many)\n",
    "        print(border_line)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Below is a list of jobs which don't have the word DUTIES in them. \n",
    "* CityofLA/Job Bulletins/APPARATUS OPERATOR 2121 071417 (1).txt\n",
    "* CityofLA/Job Bulletins/ENGINEER OF FIRE DEPARTMENT 2131 111116.txt\n",
    "* CityofLA/Job Bulletins/FIRE ASSISTANT CHIEF 2166 011218.txt\n",
    "* CityofLA/Job Bulletins/FIRE BATTALION CHIEF 2152 030918.txt\n",
    "* CityofLA/Job Bulletins/FIRE HELICOPTER PILOT 3563 081415 REV. 081815.txt\n",
    "* CityofLA/Job Bulletins/FIRE INSPECTOR 2128 031717.txt\n",
    "\n",
    "This is very questionable as discussed in the Background above. However, we'll proceed for the moment and note that a missing value here indicates that a job posting doesn't have a DUTIES section. On the other hand, we modify the content of these missing-duties jobs by purposely adding the word DUTIES before the word REQUIREMENTS/MINIMUM QUALIFICATIONS in order to normalize them."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "**Let's rerun the function and observe the changes. Note we use .txt files in the JobBulletins_cleaned folder.**\n",
    "\n",
    "Observing the printouts carefully this time, we see that all of the nuances above have been resolved."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 4,
   "metadata": {},
   "outputs": [],
   "source": [
    "# Rerun the code above to check if every job has the word DUTIES in it.\n",
    "# If nothing gets printed out, that means we pass the test.\n",
    "for file_name in cleaned_jobs:\n",
    "    job_path     = cleaned_path + file_name     # define path to file_name\n",
    "    cleaned_job  = open(job_path, 'rt').read()  # read in job as a string\n",
    "    try:\n",
    "        if 'DUTIES' not in raw_job.split():\n",
    "            print(job_path)\n",
    "    except:                                     # do some pretty printings here to help our eyes from pain\n",
    "        ## define some useful variables\n",
    "        border_line = '##############################################################################################'\n",
    "        how_many    = int((len(border_line) - len(job_path))/2)\n",
    "        print(border_line)\n",
    "        ## do pretty printings\n",
    "        print('#'*how_many + job_path + '#'*how_many)\n",
    "        print(border_line)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 5,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "CityofLA/Job Bulletins/311 DIRECTOR  9206 041814.txt\n",
      "CityofLA/Job Bulletins/ACCOUNTANT 1513 062218.txt\n",
      "CityofLA/Job Bulletins/ACCOUNTING CLERK 1223 071318.txt\n",
      "CityofLA/Job Bulletins/ACCOUNTING RECORDS SUPERVISOR 1119 072718.txt\n",
      "CityofLA/Job Bulletins/ADMINISTRATIVE CLERK 1358 033018 (2).txt\n",
      "CityofLA/Job Bulletins/ADMINISTRATIVE HEARING EXAMINER 9135 100915.txt\n",
      "CityofLA/Job Bulletins/ADVANCE PRACTICE PROVIDER CORRECTIONAL CARE 2325 020808 REV 111214.txt\n",
      "CityofLA/Job Bulletins/AIR CONDITIONING MECHANIC SUPERVISOR 3781 111618 2.txt\n",
      "CityofLA/Job Bulletins/AIRPORT AIDE 1540 081018.txt\n",
      "CityofLA/Job Bulletins/AIRPORT CHIEF INFORMATION SECURITY OFFICER 1404 120415_Modified.txt\n",
      "CityofLA/Job Bulletins/AIRPORT ENGINEER 7256 070618.txt\n",
      "CityofLA/Job Bulletins/AIRPORT GUIDE 0845 042018.txt\n",
      "CityofLA/Job Bulletins/AIRPORT INFORMATION SPECIALIST 1783 121115.txt\n",
      "CityofLA/Job Bulletins/AIRPORT POLICE CAPTAIN 3228 021618.txt\n",
      "CityofLA/Job Bulletins/AIRPORT POLICE LIEUTENANT 3227 091616.txt\n",
      "CityofLA/Job Bulletins/AIRPORT POLICE OFFICER 3225 110906 Rev 060115.txt\n",
      "CityofLA/Job Bulletins/AIRPORT POLICE SPECIALIST 3236 063017 (2).txt\n",
      "CityofLA/Job Bulletins/AIRPORT SUPERINTENDENT OF OPERATIONS 7268 121815 (1).txt\n",
      "CityofLA/Job Bulletins/ANIMAL CARE TECHNICIAN 4310 040116 REV 041416.txt\n",
      "CityofLA/Job Bulletins/ANIMAL CARE TECHNICIAN SUPERVISOR 4313 122118.txt\n",
      "CityofLA/Job Bulletins/APPRENTICE - METAL TRADES 3789 070816.txt\n",
      "CityofLA/Job Bulletins/APPRENTICE MACHINIST 3764 071516.txt\n",
      "CityofLA/Job Bulletins/AQUARIST 2400 050214.txt\n",
      "CityofLA/Job Bulletins/AQUARIUM EDUCATOR 2493 010816.txt\n",
      "CityofLA/Job Bulletins/AQUATIC FACILITY MANAGER 2423 052915 REVISED 060915.txt\n",
      "CityofLA/Job Bulletins/AQUEDUCT AND RESERVOIR KEEPER 5813 063017 (1).txt\n",
      "CityofLA/Job Bulletins/AQUEDUCT AND RESERVOIR SUPERVISOR 5816 091115.txt\n",
      "CityofLA/Job Bulletins/ARCHITECTURAL ASSOCIATE 7926 013114 REV 032916.txt\n",
      "CityofLA/Job Bulletins/ARCHIVIST 1191 020918.txt\n",
      "CityofLA/Job Bulletins/ART CENTER DIRECTOR 2478 053014.txt\n",
      "CityofLA/Job Bulletins/ART INSTRUCTOR 2447 051316.txt\n",
      "CityofLA/Job Bulletins/ASBESTOS SUPERVISOR 3440 012916.txt\n",
      "CityofLA/Job Bulletins/ASPHALT PLANT OPERATOR 4143 102414.txt\n",
      "CityofLA/Job Bulletins/ASPHALT PLANT SUPERVISOR 4145 110317.txt\n",
      "CityofLA/Job Bulletins/ASSISTANT DIRECTOR INFORMATION SYSTEMS 9377 030218.txt\n",
      "CityofLA/Job Bulletins/ASSISTANT INSPECTOR 4208 111315.txt\n",
      "CityofLA/Job Bulletins/ASSISTANT RETIREMENT PLAN MANAGER 9415 050616.txt\n",
      "CityofLA/Job Bulletins/ASSISTANT SIGNAL SYSTEMS ELECTRICIAN 3818 073115_REVISED.txt\n",
      "CityofLA/Job Bulletins/ASSISTANT STREET LIGHTING ELECTRICIAN 3809 072117 REV 080818.txt\n",
      "CityofLA/Job Bulletins/AUDIO VISUAL TECHNICIAN 6147 062014.txt\n",
      "CityofLA/Job Bulletins/AUDITOR 1517 031816 (1).txt\n",
      "CityofLA/Job Bulletins/AUTO BODY REPAIR SUPERVISOR 3706 051515.txt\n",
      "CityofLA/Job Bulletins/AUTO ELECTRICIAN 3707 052215.txt\n",
      "CityofLA/Job Bulletins/AUTOMOTIVE DISPATCHER 3595 102017 revised.txt\n",
      "CityofLA/Job Bulletins/AUTOMOTIVE SUPERVISOR 3714 062416.txt\n",
      "CityofLA/Job Bulletins/AVIONICS SPECIALIST 3565 103114revised.txt\n",
      "CityofLA/Job Bulletins/BENEFITS SPECIALIST 1203 011918.txt\n",
      "CityofLA/Job Bulletins/BOILERMAKER 3735 110714.txt\n",
      "CityofLA/Job Bulletins/BOILERMAKER SUPERVISOR 3737 101714.txt\n",
      "CityofLA/Job Bulletins/BUILDING CIVIL ENGINEER 7244 032318.txt\n",
      "CityofLA/Job Bulletins/BUILDING CONSTRUCTION AND MAINTENANCE SUPERINTENDENT 3124 122818.txt\n",
      "CityofLA/Job Bulletins/BUILDING ELECTRICAL ENGINEER 7543 071516 REV 071816.txt\n",
      "CityofLA/Job Bulletins/BUILDING OPERATING ENGINEER 5923 111618 REV 112818.txt\n",
      "CityofLA/Job Bulletins/BUILDING REPAIR SUPERVISOR 3338 111816.txt\n",
      "CityofLA/Job Bulletins/BUILDING REPAIRER 3333 030218.txt\n",
      "CityofLA/Job Bulletins/BUS OPERATOR 3588 090216.txt\n",
      "CityofLA/Job Bulletins/BUS OPERATOR SUPERVISOR 3589 012216.txt\n",
      "CityofLA/Job Bulletins/CARPENTER SUPERVISOR 3346 051316.txt\n",
      "CityofLA/Job Bulletins/CARPET LAYER 3418 061915.txt\n",
      "CityofLA/Job Bulletins/CEMENT FINISHER SUPERVISOR 3354 120916.txt\n",
      "CityofLA/Job Bulletins/CEMENT FINISHER WORKER 3351 103015.txt\n",
      "CityofLA/Job Bulletins/CHIEF ADMINISTRATIVE ANALYST 1554 062416.txt\n",
      "CityofLA/Job Bulletins/CHIEF AIRPORTS ENGINEER 7274 051515 (1).txt\n",
      "CityofLA/Job Bulletins/CHIEF BUILDING OPERATING ENGINEER 5927 080516.txt\n",
      "CityofLA/Job Bulletins/CHIEF CLERK PERSONNEL 1260 042117.txt\n",
      "CityofLA/Job Bulletins/CHIEF CLERK POLICE 1219 061215.txt\n",
      "CityofLA/Job Bulletins/CHIEF CLERK POLICE 1249 083118.txt\n",
      "CityofLA/Job Bulletins/CHIEF CONSTRUCTION INSPECTOR 7296 122818.txt\n",
      "CityofLA/Job Bulletins/CHIEF CUSTODIAN SUPERVISOR 3182 041015.txt\n",
      "CityofLA/Job Bulletins/CHIEF ELECTRIC PLANT OPERATOR 5237 121115.txt\n",
      "CityofLA/Job Bulletins/CHIEF ENVIRONMENTAL COMPLIANCE INSPECTOR 4289 033018.txt\n",
      "CityofLA/Job Bulletins/CHIEF FINANCIAL OFFICER 9230 041114.txt\n",
      "CityofLA/Job Bulletins/CHIEF HARBOR ENGINEER 9286 112015.txt\n",
      "CityofLA/Job Bulletins/CHIEF INSPECTOR 4254 082517.txt\n",
      "CityofLA/Job Bulletins/CHIEF INTERNAL AUDITOR 1619 090916 (5).txt\n",
      "CityofLA/Job Bulletins/CHIEF MANAGEMENT ANALYST 9182 020918.txt\n",
      "CityofLA/Job Bulletins/CHIEF OF DRAFTING OPERATIONS 7271  042018.txt\n",
      "CityofLA/Job Bulletins/CHIEF OF PARKING ENFORCEMENT OPERATIONS 9180 031618.txt\n",
      "CityofLA/Job Bulletins/CHIEF PARK RANGER 1968 120106 REV 121306.txt\n",
      "CityofLA/Job Bulletins/CHIEF PORT PILOT 5154 031816.txt\n",
      "CityofLA/Job Bulletins/CHIEF STREET SERVICES INVESTIGATOR 4286 2017Revised 11.21.txt\n",
      "CityofLA/Job Bulletins/CHIEF TAX COMPLIANCE OFFICER 1211 041814.txt\n",
      "CityofLA/Job Bulletins/CHIEF TRANSPORTATION INVESTIGATOR 4275 103114.txt\n",
      "CityofLA/Job Bulletins/CIVIL ENGINEER 7237 020918.txt\n",
      "CityofLA/Job Bulletins/CLAIMS AGENT 1767 020317.txt\n",
      "CityofLA/Job Bulletins/COMMERCIAL SERVICE SUPERVISOR  1213 061617.txt\n",
      "CityofLA/Job Bulletins/COMMISSION EXECUTIVE ASSISTANT 9734 092118.txt\n",
      "CityofLA/Job Bulletins/COMMUNICATIONS CABLE SUPERVISOR 3800 051917 REVISED 060117.txt\n",
      "CityofLA/Job Bulletins/COMMUNICATIONS CABLE WORKER 3802 11816.txt\n",
      "CityofLA/Job Bulletins/COMMUNITY AFFAIRS ADVOCATE 2496 111414.txt\n",
      "CityofLA/Job Bulletins/COMMUNITY HOUSING PROGRAMS MANAGER 8500 072018 REV 080918 (2).txt\n",
      "CityofLA/Job Bulletins/CONSTRUCTION AND MAINTENANCE SUPERINTENDENT 3129 082616 REV 090816.txt\n",
      "CityofLA/Job Bulletins/CONSTRUCTION AND MAINTENANCE SUPERVISOR 3127 030416.txt\n",
      "CityofLA/Job Bulletins/CONSTRUCTION ESTIMATOR 3341 070816 REVISED 072116 (1).txt\n",
      "CityofLA/Job Bulletins/CORRECTIONAL NURSE 2317 101615.txt\n",
      "CityofLA/Job Bulletins/CRIMINALIST 2234 030918.txt\n",
      "CityofLA/Job Bulletins/CUSTODIAN SUPERVISOR 3176 042817 051117 REV.txt\n",
      "CityofLA/Job Bulletins/CUSTOMER SERVICE REPRESENTATIVE 1230 020918.txt\n",
      "CityofLA/Job Bulletins/DECK HAND 5131 093016.txt\n",
      "CityofLA/Job Bulletins/DEPARTMENTAL CHIEF ACCOUNTANT 1593 111717 revised 11.21.txt\n",
      "CityofLA/Job Bulletins/DIRECTOR OF HOUSING 1568 062317.txt\n",
      "CityofLA/Job Bulletins/DIRECTOR OF MAINTENANCE AIRPORTS 7270 041516.txt\n",
      "CityofLA/Job Bulletins/DIRECTOR OF POLICE TRANSPORTATION 3722 061915.txt\n",
      "CityofLA/Job Bulletins/DIRECTOR OF PORT CONSTRUCTION AND MAINTENANCE 3123 030416.txt\n",
      "CityofLA/Job Bulletins/ELECTRIC DISTRIBUTION MECHANIC SUPERVISOR 3873 102816.txt\n",
      "CityofLA/Job Bulletins/ELECTRIC SERVICE REPRESENTATIVE 7520 020317.txt\n",
      "CityofLA/Job Bulletins/ELECTRIC TROUBLE DISPATCHER 3828 063017 (1).txt\n",
      "CityofLA/Job Bulletins/ELECTRICAL ENGINEERING DRAFTING TECHNICIAN 7532 113018.txt\n",
      "CityofLA/Job Bulletins/ELECTRICAL INSPECTOR 4221 030218.txt\n",
      "CityofLA/Job Bulletins/ELECTRICAL MECHANIC SUPERVISOR 3835 072216 REVISED 080416.txt\n",
      "CityofLA/Job Bulletins/ELECTRICAL REPAIR SUPERVISOR 3855 092217 (7).txt\n",
      "CityofLA/Job Bulletins/ELEVATOR MECHANIC 3866 012717 REV 080718.txt\n",
      "CityofLA/Job Bulletins/ELEVATOR REPAIR SUPERVISOR 032516 REVISED 040516.txt\n",
      "CityofLA/Job Bulletins/EMERGENCY MEDICAL SERVICES EDUCATOR  2322 110615 REV 112515.txt\n",
      "CityofLA/Job Bulletins/EMS NURSE PRACTITIONER SUPERVISOR 2340 031116 REV 032316 (1).txt\n",
      "CityofLA/Job Bulletins/ENGINEER OF SURVEYS 9486 101615.txt\n",
      "CityofLA/Job Bulletins/ENGINEERING DESIGNER 7217 082517 REV 090717.txt\n",
      "CityofLA/Job Bulletins/ENGINEERING GEOLOGIST 7255 022318.txt\n",
      "CityofLA/Job Bulletins/ENGINEERING GEOLOGIST ASSOCIATE 7253 082517.txt\n",
      "CityofLA/Job Bulletins/ENVIRONMENTAL COMPLIANCE INSPECTOR 4292 080516 REV 081616.txt\n",
      "CityofLA/Job Bulletins/ENVIRONMENTAL ENGINEER  7872 082616 REV 090116.txt\n",
      "CityofLA/Job Bulletins/ENVIRONMENTAL ENGINEERING ASSOCIATE  7871 020113 REV 032916.txt\n",
      "CityofLA/Job Bulletins/ENVIRONMENTAL SPECIALIST 7310 012916.txt\n",
      "CityofLA/Job Bulletins/ENVIRONMENTAL SUPERVISOR 7304 052518 (1).txt\n",
      "CityofLA/Job Bulletins/EQUIPMENT REPAIR SUPERVISOR 3746 012717.txt\n",
      "CityofLA/Job Bulletins/EQUIPMENT SUPERINTENDENT 3750 121914.txt\n",
      "CityofLA/Job Bulletins/EQUIPMENT SUPERVISOR 3527 041318.txt\n",
      "CityofLA/Job Bulletins/EXAMINER OF QUESTIONED DOCUMENTS 3229 120415.txt\n",
      "CityofLA/Job Bulletins/EXECUTIVE ADMINISTRATIVE ASSISTANT 1117 083118.txt\n",
      "CityofLA/Job Bulletins/EXECUTIVE ASSISTANT AIRPORTS 9186 060917 (1).txt\n",
      "CityofLA/Job Bulletins/EXHIBIT PREPARATOR 2444 062416.txt\n",
      "CityofLA/Job Bulletins/FINANCIAL MANAGER 1557 070116 Rev.txt\n",
      "CityofLA/Job Bulletins/FINGERPRINT IDENTIFICATION EXPERT 1157 052915.txt\n",
      "CityofLA/Job Bulletins/FIRE BATTALION CHIEF 2152 030918.txt\n",
      "CityofLA/Job Bulletins/FIRE CAPTAIN 2142 033018.txt\n",
      "CityofLA/Job Bulletins/FIRE HELICOPTER PILOT 3563 081415 REV. 081815.txt\n",
      "CityofLA/Job Bulletins/FIRE INSPECTOR 2128 031717.txt\n",
      "CityofLA/Job Bulletins/FIRE PROTECTION ENGINEERING ASSOCIATE 7978 041318.txt\n",
      "CityofLA/Job Bulletins/FIRE SPECIAL INVESTIGATOR 1632 021216.txt\n",
      "CityofLA/Job Bulletins/FIREARMS EXAMINER 2233 062416.txt\n",
      "CityofLA/Job Bulletins/FIREBOAT MATE 5125 102315 rev110515.txt\n",
      "CityofLA/Job Bulletins/FIREBOAT PILOT 5127 102315 rev110515 (1).txt\n",
      "CityofLA/Job Bulletins/GALLERY ATTENDANT 2442 092515.txt\n",
      "CityofLA/Job Bulletins/GARAGE ASSISTANT 3538 012017.txt\n",
      "CityofLA/Job Bulletins/GARAGE ATTENDANT 3531 013015.txt\n",
      "CityofLA/Job Bulletins/GENERAL AUTOMOTIVE SUPERVISOR 3718 061915.txt\n",
      "CityofLA/Job Bulletins/GENERAL SERVICES MANAGER  9601 042117.txt\n",
      "CityofLA/Job Bulletins/GEOGRAPHIC INFORMATION SYSTEMS CHIEF  7211 030416.txt\n",
      "CityofLA/Job Bulletins/GEOGRAPHIC INFORMATION SYSTEMS SPECIALIST 7213 012414 revised.txt\n",
      "CityofLA/Job Bulletins/GEOTECHNICAL ENGINEER 7239 090718 REV 092018.txt\n",
      "CityofLA/Job Bulletins/GOLF STARTER 2453 121115.txt\n",
      "CityofLA/Job Bulletins/GOLF STARTER SUPERVISOR 2479 120817.txt\n",
      "CityofLA/Job Bulletins/GRAPHICS SUPERVISOR 7935 052617 (4).txt\n",
      "CityofLA/Job Bulletins/HARBOR PLANNING AND ECONOMIC ANALYST 9224 111816 REV 112916.txt\n",
      "CityofLA/Job Bulletins/HEATING AND REFRIGERATION INSPECTOR 4245 121115.txt\n",
      "CityofLA/Job Bulletins/HEAVY DUTY EQUIPMENT MECHANIC 3743 021717.txt\n",
      "CityofLA/Job Bulletins/HELICOPTER MECHANIC 3742 072206 REV 020818.txt\n",
      "CityofLA/Job Bulletins/HELICOPTER MECHANIC SUPERVISOR 3749 121616 REV 122216.txt\n",
      "CityofLA/Job Bulletins/HYDROGRAPHER 7263 012717.txt\n",
      "CityofLA/Job Bulletins/IMPROVEMENT ASSESSOR SUPERVISOR 1564 100215.txt\n",
      "CityofLA/Job Bulletins/INDUSTRIAL AND COMMERCIAL FINANCE OFFICER 9191 rev051515.txt\n",
      "CityofLA/Job Bulletins/INDUSTRIAL CHEMIST 7834 020714.txt\n",
      "CityofLA/Job Bulletins/INFORMATION SYSTEMS MANAGER 1409 090117 (2).txt\n",
      "CityofLA/Job Bulletins/INSTRUMENT MECHANIC SUPERVISOR 3844 051917 final.txt\n",
      "CityofLA/Job Bulletins/INTERNAL AUDITOR 1625 011918.txt\n",
      "CityofLA/Job Bulletins/IRRIGATION SPECIALIST 3913 020615.txt\n",
      "CityofLA/Job Bulletins/LABOR SUPERVISOR 3126 121815.txt\n",
      "CityofLA/Job Bulletins/LABORATORY TECHNICIAN 7854 030416.txt\n",
      "CityofLA/Job Bulletins/LAND SURVEYING ASSISTANT 7283 120817.txt\n",
      "CityofLA/Job Bulletins/LANDSCAPE ARCHITECT 7929 090718.txt\n",
      "CityofLA/Job Bulletins/LANDSCAPE ARCHITECTURAL ASSOCIATE  7933 07222016.txt\n",
      "CityofLA/Job Bulletins/LEGISLATIVE ASSISTANT 1182 091815.txt\n",
      "CityofLA/Job Bulletins/LIBRARIAN 6152 051217 REV 020218.txt\n",
      "CityofLA/Job Bulletins/LIBRARY ASSISTANT 1172 051118 (2).txt\n",
      "CityofLA/Job Bulletins/LICENSED VOCATIONAL NURSE  2332 042415.txt\n",
      "CityofLA/Job Bulletins/LINE MAINTENANCE ASSISTANT 3882 122818.txt\n",
      "CityofLA/Job Bulletins/MACHINIST 3763 061016.txt\n",
      "CityofLA/Job Bulletins/MACHINIST SUPERVISOR 3766 121815.txt\n",
      "CityofLA/Job Bulletins/MANAGEMENT ASSISTANT 1539 032318.txt\n",
      "CityofLA/Job Bulletins/MARINE AQUARIUM PROGRAM DIRECTOR 2403 082517.txt\n",
      "CityofLA/Job Bulletins/MARINE ENVIRONMENTAL MANAGER 9437 060614.txt\n",
      "CityofLA/Job Bulletins/MARINE ENVIRONMENTAL SUPERVISOR 9433 071114 (1).txt\n",
      "CityofLA/Job Bulletins/MATERIALS TESTING TECHNICIAN 7968 081318.txt\n",
      "CityofLA/Job Bulletins/MECHANICAL HELPER 3771 011317.txt\n",
      "CityofLA/Job Bulletins/MECHANICAL REPAIR GENERAL SUPERVISOR 3731 040116 REV 041416.txt\n",
      "CityofLA/Job Bulletins/MECHANICAL REPAIR SUPERVISOR 3795 051818.txt\n",
      "CityofLA/Job Bulletins/MECHANICAL REPAIRER 3773 092118.txt\n",
      "CityofLA/Job Bulletins/METER READER 1611 080715.txt\n",
      "CityofLA/Job Bulletins/MOTOR SWEEPER OPERATOR 3585 031618.txt\n",
      "CityofLA/Job Bulletins/OCCUPATIONAL HEALTH NURSE  2314 020317 REV 022317 (1).txt\n",
      "CityofLA/Job Bulletins/OFFICE ENGINEERING TECHNICIAN 7212 110218.txt\n",
      "CityofLA/Job Bulletins/OFFICE TRAINEE 1101 012017.txt\n",
      "CityofLA/Job Bulletins/PAINTER SUPERVISOR 3426 120514.txt\n",
      "CityofLA/Job Bulletins/PARK SERVICES ATTENDANT 2412 032219.txt\n",
      "CityofLA/Job Bulletins/PARK SERVICES SUPERVISOR 2426 072018.txt\n",
      "CityofLA/Job Bulletins/PARKING ENFORCEMENT MANAGER 9025 021916 rev022516.txt\n",
      "CityofLA/Job Bulletins/PARKING MANAGER 9170 020714.txt\n",
      "CityofLA/Job Bulletins/PARKING METER TECHNICIAN 3738 110615 (1).txt\n",
      "CityofLA/Job Bulletins/PARKING METER TECHNICIAN SUPERVISOR 3757 2017.txt\n",
      "CityofLA/Job Bulletins/PAYROLL ANALYST 1630 031816.txt\n",
      "CityofLA/Job Bulletins/PAYROLL SUPERVISOR 1170 102618.txt\n",
      "CityofLA/Job Bulletins/PERSONNEL DIRECTOR 1714 050418.txt\n",
      "CityofLA/Job Bulletins/PERSONNEL RECORDS SUPERVISOR 1129 041318.txt\n",
      "CityofLA/Job Bulletins/PHOTOGRAPHER 1793 041516.txt\n",
      "CityofLA/Job Bulletins/PILE DRIVER WORKER 3553 041417.txt\n",
      "CityofLA/Job Bulletins/PIPEFITTER SUPERVISOR 3438 081216.txt\n",
      "CityofLA/Job Bulletins/PLUMBER 3443 113018.txt\n",
      "CityofLA/Job Bulletins/POLICE COMMANDER 2251 092917.txt\n",
      "CityofLA/Job Bulletins/POLICE DETECTIVE 2223 033018.txt\n",
      "CityofLA/Job Bulletins/POLICE OFFICER 2214 110906 Rev 060115.txt\n",
      "CityofLA/Job Bulletins/POLICE PERFORMANCE AUDITOR 1627 120216.txt\n",
      "CityofLA/Job Bulletins/POLICE SERGEANT 2227 102116.txt\n",
      "CityofLA/Job Bulletins/POLICE SERVICE REPRESENTATIVE 2207 051316 REV 051716.txt\n",
      "CityofLA/Job Bulletins/POLICE SPECIAL INVESTIGATOR 1640 072018 REV 011019.txt\n",
      "CityofLA/Job Bulletins/POLICE SPECIALIST 2217 110906 Rev 060115.txt\n",
      "CityofLA/Job Bulletins/POLICE SURVEILLANCE SPECIALIST 3687 052215.txt\n",
      "CityofLA/Job Bulletins/POLYGRAPH EXAMINER 2240 121517.txt\n",
      "CityofLA/Job Bulletins/PORT ELECTRICAL MECHANIC 3758 022616.txt\n",
      "CityofLA/Job Bulletins/PORT ELECTRICAL MECHANIC SUPERVISOR 3759 031816.txt\n",
      "CityofLA/Job Bulletins/PORT MAINTENANCE SUPERVISOR 3128 052016 REV 060216.txt\n",
      "CityofLA/Job Bulletins/PORT POLICE CAPTAIN 3224 110416.txt\n",
      "CityofLA/Job Bulletins/PORT POLICE LIEUTENANT 3223 120916.txt\n",
      "CityofLA/Job Bulletins/PORT POLICE OFFICER 3221 110906 Rev 060115.txt\n",
      "CityofLA/Job Bulletins/PORT POLICE SERGEANT 3222 121616.txt\n",
      "CityofLA/Job Bulletins/POWER SHOVEL OPERATOR 3558 062416.txt\n",
      "CityofLA/Job Bulletins/PRE-PRESS OPERATOR 1481 072817 (4).txt\n",
      "CityofLA/Job Bulletins/PRINCIPAL ACCOUNTANT 1525 121517.txt\n",
      "CityofLA/Job Bulletins/PRINCIPAL ANIMAL KEEPER 4312 070618.txt\n",
      "CityofLA/Job Bulletins/PRINCIPAL CIVIL ENGINEER 9489 022318.txt\n",
      "CityofLA/Job Bulletins/PRINCIPAL CIVIL ENGINEERING DRAFTING TECHNICIAN 7219 110218.txt\n",
      "CityofLA/Job Bulletins/PRINCIPAL CLERK 1201 021618.txt\n",
      "CityofLA/Job Bulletins/PRINCIPAL CLERK POLICE 1152 121815.txt\n",
      "CityofLA/Job Bulletins/PRINCIPAL COMMUNICATIONS OPERATOR 1458 072514.txt\n",
      "CityofLA/Job Bulletins/PRINCIPAL CONSTRUCTION INSPECTOR 7297 021618.txt\n",
      "CityofLA/Job Bulletins/PRINCIPAL DEPUTY CONTROLLER 7260 032814.txt\n",
      "CityofLA/Job Bulletins/PRINCIPAL DETENTION OFFICER 3215 101218.txt\n",
      "CityofLA/Job Bulletins/PRINCIPAL ELECTRIC TROUBLE DISPATCHER 3830 022616.txt\n",
      "CityofLA/Job Bulletins/PRINCIPAL ELECTRICAL ENGINEERING DRAFTING TECHNICIAN 7531 090916 TRACK CHANGES.txt\n",
      "CityofLA/Job Bulletins/PRINCIPAL ENVIRONMENTAL ENGINEER 7875 092118.txt\n",
      "CityofLA/Job Bulletins/PRINCIPAL GROUNDS MAINTENANCE SUPERVISOR  3147 111315.txt\n",
      "CityofLA/Job Bulletins/PRINCIPAL INSPECTOR 4226 061617.txt\n",
      "CityofLA/Job Bulletins/PRINCIPAL MECHANICAL ENGINEERING DRAFTING TECHNICIAN 7550 081415.txt\n",
      "CityofLA/Job Bulletins/PRINCIPAL PHOTOGRAPHER 1794 040116.txt\n",
      "CityofLA/Job Bulletins/PRINCIPAL PROPERTY OFFICER 3210 121517.txt\n",
      "CityofLA/Job Bulletins/PRINCIPAL RECREATION SUPERVISOR 2464 021618.txt\n",
      "CityofLA/Job Bulletins/PRINCIPAL STOREKEEPER 1839 072718.txt\n",
      "CityofLA/Job Bulletins/PRINCIPAL TAX AUDITOR 1524 110416.txt\n",
      "CityofLA/Job Bulletins/PRINCIPAL TAX COMPLIANCE OFFICER 1195 030218.txt\n",
      "CityofLA/Job Bulletins/PRINCIPAL UTILITY ACCOUNTANT 1589 030218 updated.txt\n",
      "CityofLA/Job Bulletins/PRINCIPAL WORKERS_ COMPENSATION ANALYST 1777 071814.txt\n",
      "CityofLA/Job Bulletins/PRINTING PRESS OPERATOR 1494 092515.txt\n",
      "CityofLA/Job Bulletins/PROPERTY OFFICER 3207 071417 (1).txt\n",
      "CityofLA/Job Bulletins/PROTECTIVE COATING WORKER 3463 082115.txt\n",
      "CityofLA/Job Bulletins/PUBLIC RELATIONS SPECIALIST 1785 012017.txt\n",
      "CityofLA/Job Bulletins/RATES MANAGER 5601 012017.txt\n",
      "CityofLA/Job Bulletins/REAL ESTATE ASSOCIATE 1941 052716.txt\n",
      "CityofLA/Job Bulletins/REAL ESTATE OFFICER 1960 051118.txt\n",
      "CityofLA/Job Bulletins/RECREATION COORDINATOR 2469 091517(1).txt\n",
      "CityofLA/Job Bulletins/RECREATION SUPERVISOR 2460 101416 REVISED 102716.txt\n",
      "CityofLA/Job Bulletins/REFUSE COLLECTION SUPERVISOR 4101 033117.txt\n",
      "CityofLA/Job Bulletins/REHABILITATION PROJECT COORDINATOR 8502 032715.txt\n",
      "CityofLA/Job Bulletins/REINFORCING STEEL WORKER 3483 022318.txt\n",
      "CityofLA/Job Bulletins/REPROGRAPHICS OPERATOR 3162 110615.txt\n",
      "CityofLA/Job Bulletins/REPROGRAPHICS SUPERVISOR  3163 091517.txt\n",
      "CityofLA/Job Bulletins/RETIREMENT PLAN MANAGER 9149 052314 (1).txt\n",
      "CityofLA/Job Bulletins/RISK AND INSURANCE ASSISTANT 1645 072718.txt\n",
      "CityofLA/Job Bulletins/RISK MANAGER 1530 2016 061716_REVISED.txt\n",
      "CityofLA/Job Bulletins/ROOFER 3476 121214.txt\n",
      "CityofLA/Job Bulletins/SAFETY ADMINISTRATOR 1728 101615.txt\n",
      "CityofLA/Job Bulletins/SAFETY ENGINEER 1727 021717.txt\n",
      "CityofLA/Job Bulletins/SAFETY ENGINEER ELEVATORS 4263 112015 REV 120215.txt\n",
      "CityofLA/Job Bulletins/SANITATION SOLID RESOURCES MANAGER 4126 060515.txt\n",
      "CityofLA/Job Bulletins/SECRETARY 1116 030317.txt\n",
      "CityofLA/Job Bulletins/SECRETARY LEGAL  1924 081718.txt\n",
      "CityofLA/Job Bulletins/SECURITY AIDE  3199 090415.txt\n",
      "CityofLA/Job Bulletins/SENIOR ACCOUNTANT 1523 030218.txt\n",
      "CityofLA/Job Bulletins/SENIOR ADMINISTRATIVE CLERK 1368 062918 REV 091718.txt\n",
      "CityofLA/Job Bulletins/SENIOR ANIMAL CONTROL OFFICER 4316 111618.txt\n",
      "CityofLA/Job Bulletins/SENIOR ANIMAL KEEPER 4305 022616.txt\n",
      "CityofLA/Job Bulletins/SENIOR ARCHITECTURAL DRAFTING TECHNICIAN 7208 091418.txt\n",
      "CityofLA/Job Bulletins/SENIOR AUDITOR 1518 102618.txt\n",
      "CityofLA/Job Bulletins/SENIOR AUTOMOTIVE SUPERVISOR 3716 112015.txt\n",
      "CityofLA/Job Bulletins/SENIOR BUILDING INSPECTOR 4213 010816.txt\n",
      "CityofLA/Job Bulletins/SENIOR BUILDING MECHANICAL INSPECTOR 4253 2017 REV (1).txt\n",
      "CityofLA/Job Bulletins/SENIOR BUILDING OPERATING ENGINEER 5925 011615 (1).txt\n",
      "CityofLA/Job Bulletins/SENIOR CARPENTER  3345 081117 REV 082417.txt\n",
      "CityofLA/Job Bulletins/SENIOR CHEMIST 7830 030416.txt\n",
      "CityofLA/Job Bulletins/SENIOR CIVIL ENGINEERING DRAFTING TECHNICIAN 7207 081718.txt\n",
      "CityofLA/Job Bulletins/SENIOR CLAIMS REPRESENTATIVE 1770 070717 (1).txt\n",
      "CityofLA/Job Bulletins/SENIOR COMMUNICATIONS CABLE WORKER 3801 102116 draft.txt\n",
      "CityofLA/Job Bulletins/SENIOR COMMUNICATIONS ELECTRICIAN 3638 030317 (1).txt\n",
      "CityofLA/Job Bulletins/SENIOR COMMUNICATIONS ELECTRICIAN SUPERVISOR 3691 041318.txt\n",
      "CityofLA/Job Bulletins/SENIOR COMMUNICATIONS OPERATOR 1467 122118.txt\n",
      "CityofLA/Job Bulletins/SENIOR COMPUTER OPERATOR 1428 102017.txt\n",
      "CityofLA/Job Bulletins/SENIOR CONSTRUCTION ENGINEER 7289 042514.txt\n",
      "CityofLA/Job Bulletins/SENIOR DATA PROCESSING TECHNICIAN 1139 081117.txt\n",
      "CityofLA/Job Bulletins/SENIOR DETENTION OFFICER 3212 012017.txt\n",
      "CityofLA/Job Bulletins/SENIOR ELECTRIC TROUBLE DISPATCHER 3829 100716.txt\n",
      "CityofLA/Job Bulletins/SENIOR ELECTRICAL ENGINEERING DRAFTING TECHNICIAN 7209 042817 REV 051117.txt\n",
      "CityofLA/Job Bulletins/SENIOR ELECTRICAL INSPECTOR 4223 042718.txt\n",
      "CityofLA/Job Bulletins/SENIOR ELECTRICAL MECHANIC 3834 060217 (2) REVISED.txt\n",
      "CityofLA/Job Bulletins/SENIOR ELECTRICAL MECHANIC SUPERVISOR 3836 080417.txt\n",
      "CityofLA/Job Bulletins/SENIOR ELECTRICAL REPAIR SUPERVISOR 3856 060118.txt\n",
      "CityofLA/Job Bulletins/SENIOR ELECTRICAL TEST TECHNICIAN  7515 092917 REV 101117.txt\n",
      "CityofLA/Job Bulletins/SENIOR ELECTRICIAN  3864 102116 Rev 110216.txt\n",
      "CityofLA/Job Bulletins/SENIOR ENVIRONMENTAL COMPLIANCE INSPECTOR 4293 042916 REV 051916.txt\n",
      "CityofLA/Job Bulletins/SENIOR ENVIRONMENTAL ENGINEER 7874 121815.txt\n",
      "CityofLA/Job Bulletins/SENIOR EQUIPMENT MECHANIC 3712 010518 REV 080718.txt\n",
      "CityofLA/Job Bulletins/SENIOR FIRE PROTECTION ENGINEER 7981 021916 rev022516.txt\n",
      "CityofLA/Job Bulletins/SENIOR FORENSIC PRINT SPECIALIST 2201 090718.txt\n",
      "CityofLA/Job Bulletins/SENIOR GARDENER 3143 121517 (1)revised.txt\n",
      "CityofLA/Job Bulletins/SENIOR HEATING AND REFRIGERATION INSPECTOR 4247 121115.txt\n",
      "CityofLA/Job Bulletins/SENIOR HEAVY DUTY EQUIPMENT MECHANIC 3745 012017.txt\n",
      "CityofLA/Job Bulletins/SENIOR HOUSING INSPECTOR 4244 042718.txt\n",
      "CityofLA/Job Bulletins/SENIOR HYDROGRAPHER 7264 030714.txt\n",
      "CityofLA/Job Bulletins/SENIOR LIBRARIAN 6153 033117.txt\n",
      "CityofLA/Job Bulletins/SENIOR LOAD DISPATCHER 5235 060118.txt\n",
      "CityofLA/Job Bulletins/SENIOR MACHINIST SUPERVISOR 3768 051016.txt\n",
      "CityofLA/Job Bulletins/SENIOR MANAGEMENT ANALYST 9171 040618.txt\n",
      "CityofLA/Job Bulletins/SENIOR MECHANICAL ENGINEERING DRAFTING TECHNICIAN 7210 110416.txt\n",
      "CityofLA/Job Bulletins/SENIOR MECHANICAL REPAIRER 3772 030416.txt\n",
      "CityofLA/Job Bulletins/SENIOR PAINTER 3424 041318.txt\n",
      "CityofLA/Job Bulletins/SENIOR PARK MAINTENANCE SUPERVISOR 3146 101416.txt\n",
      "CityofLA/Job Bulletins/SENIOR PARK RANGER 1967 091815.txt\n",
      "CityofLA/Job Bulletins/SENIOR PARKING ATTENDANT 3529 032417.txt\n",
      "CityofLA/Job Bulletins/SENIOR PHOTOGRAPHER 1795 041516 REVISED 042816.txt\n",
      "CityofLA/Job Bulletins/SENIOR PLUMBER 3444 020516.txt\n",
      "CityofLA/Job Bulletins/SENIOR PLUMBING INSPECTOR 4233 051818.txt\n",
      "CityofLA/Job Bulletins/SENIOR POLICE SERVICE REPRESENTATIVE 2209 020918.txt\n",
      "CityofLA/Job Bulletins/SENIOR PROPERTY OFFICER 3209 012618.txt\n",
      "CityofLA/Job Bulletins/SENIOR RECREATION DIRECTOR 2446 050517 REV 051117.txt\n",
      "CityofLA/Job Bulletins/SENIOR ROOFER 3477 101708 REV 110608.txt\n",
      "CityofLA/Job Bulletins/SENIOR SAFETY ENGINEER ELEVATORS 4264  042718.txt\n",
      "CityofLA/Job Bulletins/SENIOR SECURITY OFFICER 3184 122818.txt\n",
      "CityofLA/Job Bulletins/SENIOR STOREKEEPER 1837 052518.txt\n",
      "CityofLA/Job Bulletins/SENIOR SYSTEMS ANALYST 1597 100617.txt\n",
      "CityofLA/Job Bulletins/SENIOR TITLE EXAMINER 1947 121517.txt\n",
      "CityofLA/Job Bulletins/SENIOR TRAFFIC SUPERVISOR 3218 121517.txt\n",
      "CityofLA/Job Bulletins/SENIOR TRANSPORTATION INVESTIGATOR 4273 070717 (2).txt\n",
      "CityofLA/Job Bulletins/SENIOR UNDERGROUND DISTRIBUTION CONSTRUCTION SUPERVISOR 3815 072817.txt\n",
      "CityofLA/Job Bulletins/SENIOR UTILITY ACCOUNTANT 1521 100716.txt\n",
      "CityofLA/Job Bulletins/SENIOR UTILITY BUYER 1862 052518.txt\n",
      "CityofLA/Job Bulletins/SENIOR UTILITY SERVICES SPECIALIST 3573 113018.txt\n",
      "CityofLA/Job Bulletins/SENIOR UTILITY SERVICES SPECIALIST 3753 121815 (1).txt\n",
      "CityofLA/Job Bulletins/SENIOR WINDOW CLEANER 3174 013114 Rev021314.txt\n",
      "CityofLA/Job Bulletins/SHEET METAL SUPERVISOR 3777 061314.txt\n",
      "CityofLA/Job Bulletins/SHEET METAL WORKER 3775 093016.txt\n",
      "CityofLA/Job Bulletins/SHIFT SUPERINTENDENT WASTEWATER TREATMENT 7242 072415.txt\n",
      "CityofLA/Job Bulletins/SHOPS SUPERINTENDENT 3780 051118.txt\n",
      "CityofLA/Job Bulletins/SIGN PAINTER 3428 121214.txt\n",
      "CityofLA/Job Bulletins/SIGN SHOP SUPERVISOR 3419 030615.txt\n",
      "CityofLA/Job Bulletins/SIGNAL SYSTEMS SUPERINTENDENT 3832 110416.txt\n",
      "CityofLA/Job Bulletins/SIGNAL SYSTEMS SUPERVISOR 3839 092818.txt\n",
      "CityofLA/Job Bulletins/SOCIAL WORKER 2385 102717  revised.txt\n",
      "CityofLA/Job Bulletins/SOLID RESOURCES SUPERINTENDENT 4102 031017 REV 032317 (2).txt\n",
      "CityofLA/Job Bulletins/SPECIAL INVESTIGATOR 0602 042216.txt\n",
      "CityofLA/Job Bulletins/SR CRIME _ INTELLIGENCE ANALYST 2241 011516.txt\n",
      "CityofLA/Job Bulletins/STAFF ASSISTANT TO GENERAL MANAGER WATER AND POWER 9185 032715.txt\n",
      "CityofLA/Job Bulletins/STEAM PLANT MAINTENANCE MECHANIC 5630 0902116.txt\n",
      "CityofLA/Job Bulletins/STEAM PLANT MAINTENANCE SUPERVISOR 3786 033117.txt\n",
      "CityofLA/Job Bulletins/STEAM PLANT OPERATOR 5624 101416.txt\n",
      "CityofLA/Job Bulletins/STORES SUPERVISOR 1866 122917.txt\n",
      "CityofLA/Job Bulletins/STREET LIGHTING CONSTRUCTION AND MAINTENANCE SUPERINTENDENT 3820 051818.txt\n",
      "CityofLA/Job Bulletins/STREET LIGHTING ELECTRICIAN SUPERVISOR 3840 031717.txt\n",
      "CityofLA/Job Bulletins/STREET LIGHTING ENGINEERING ASSOCIATE 7527 101102 REV 032916.txt\n",
      "CityofLA/Job Bulletins/STREET SERVICES GENERAL SUPERINTENDENT 4160 042916.txt\n",
      "CityofLA/Job Bulletins/STREET SERVICES INVESTIGATOR 4283 102315 REV 110315.txt\n",
      "CityofLA/Job Bulletins/STREET SERVICES SUPERVISOR 4152 082815.txt\n",
      "CityofLA/Job Bulletins/STREET SERVICES WORKER 4150 032318.txt\n",
      "CityofLA/Job Bulletins/STREET TREE SUPERINTENDENT 3160 060917.txt\n",
      "CityofLA/Job Bulletins/STRUCTURAL ENGINEER 7956 101918.txt\n",
      "CityofLA/Job Bulletins/STRUCTURAL STEEL FABRICATOR 3793 122316.txt\n",
      "CityofLA/Job Bulletins/STRUCTURAL STEEL FABRICATOR SUPERVISOR 3794 060217.txt\n",
      "CityofLA/Job Bulletins/SUPERINTENDENT OF RECREATION AND PARKS OPERATIONS 2472 012618.txt\n",
      "CityofLA/Job Bulletins/SUPERVISING CRIMINALIST 2235 030416.txt\n",
      "CityofLA/Job Bulletins/SUPERVISING OCCUPATIONAL HEALTH  2315 111414.txt\n",
      "CityofLA/Job Bulletins/SUPERVISING TRANSPORTATION PLANNER 2481 072216.txt\n",
      "CityofLA/Job Bulletins/SUPERVISING WATER SERVICE REPRESENTATIVE 1697 081318.txt\n",
      "CityofLA/Job Bulletins/SURVEY PARTY CHIEF 7286 093016.txt\n",
      "CityofLA/Job Bulletins/SURVEY SUPERVISOR 7287 110918.txt\n",
      "CityofLA/Job Bulletins/SYSTEMS AIDE 1599 070116.txt\n",
      "CityofLA/Job Bulletins/SYSTEMS PROGRAMMER 1455 091616 REV 100416.txt\n",
      "CityofLA/Job Bulletins/TAX COMPLIANCE AIDE 1173 061215 (1).txt\n",
      "CityofLA/Job Bulletins/TAX COMPLIANCE OFFICER 1179 111816.txt\n",
      "CityofLA/Job Bulletins/TILE SETTER 3493 090415.txt\n",
      "CityofLA/Job Bulletins/TITLE EXAMINER 1943 032318 REV 040518.txt\n",
      "CityofLA/Job Bulletins/TRAFFIC MARKING AND SIGN SUPERINTENDENT 3430 032219.txt\n",
      "CityofLA/Job Bulletins/TRAFFIC OFFICER 3214 040116.txt\n",
      "CityofLA/Job Bulletins/TRAFFIC PAINTER AND SIGN POSTER 3421 033117.txt\n",
      "CityofLA/Job Bulletins/TRANSMISSION AND DISTRIBUTION DISTRICT SUPERVISOR 3875 050418 REV 051718.txt\n",
      "CityofLA/Job Bulletins/TRANSPORTATION ENGINEER 7278 092917.txt\n",
      "CityofLA/Job Bulletins/TRANSPORTATION ENGINEERING AIDE 7285 100915.txt\n",
      "CityofLA/Job Bulletins/TRANSPORTATION ENGINEERING ASSOCIATE 7280 072415.txt\n",
      "CityofLA/Job Bulletins/TRANSPORTATION INVESTIGATOR 4271 061016.txt\n",
      "CityofLA/Job Bulletins/TRANSPORTATION PLANNING ASSOCIATE 2480 072018.txt\n",
      "CityofLA/Job Bulletins/TREE SURGEON ASSISTANT 3151 060316.txt\n",
      "CityofLA/Job Bulletins/TRUCK OPERATOR 3583 012618.txt\n",
      "CityofLA/Job Bulletins/UNDERGROUND DISTRIBUTION CONSTRUCTION SUPERVISOR 3814 121418 REV 122718 (1).txt\n",
      "CityofLA/Job Bulletins/UPHOLSTERER 3723 041715.txt\n",
      "CityofLA/Job Bulletins/UTILITIES SERVICE INVESTIGATOR 1631 101615 (1).txt\n",
      "CityofLA/Job Bulletins/UTILITY ACCOUNTANT 1511 092818.txt\n",
      "CityofLA/Job Bulletins/UTILITY ADMINISTRATOR 9105 060217.txt\n",
      "CityofLA/Job Bulletins/UTILITY BUYER 1861 090718.txt\n",
      "CityofLA/Job Bulletins/UTILITY EXECUTIVE SECRETARY 1336 042817 (1).txt\n",
      "CityofLA/Job Bulletins/UTILITY SERVICES SPECIALIST 3755 072117 (1).txt\n",
      "CityofLA/Job Bulletins/VETERINARY TECHNICIAN 2369 020599 REV 120417.txt\n",
      "CityofLA/Job Bulletins/VIDEO TECHNICIAN 6145 012717.txt\n",
      "CityofLA/Job Bulletins/WASTEWATER TREATMENT ELECTRICIAN SUPERVISOR 5613 060515.txt\n",
      "CityofLA/Job Bulletins/WATER BIOLOGIST 7856 120216.txt\n",
      "CityofLA/Job Bulletins/WATER MICROBIOLOGIST  7857 072514 rev073114.txt\n",
      "CityofLA/Job Bulletins/WATER SERVICE REPRESENTATIVE 1693 111717.txt\n",
      "CityofLA/Job Bulletins/WATER SERVICE SUPERVISOR 3930 012717.txt\n",
      "CityofLA/Job Bulletins/WATER TREATMENT OPERATOR 5885 122118.txt\n",
      "CityofLA/Job Bulletins/WATER TREATMENT SUPERVISOR 5887 072018.txt\n",
      "CityofLA/Job Bulletins/WATER UTILITY SUPERINTENDENT 3980 121418.txt\n",
      "CityofLA/Job Bulletins/WATERSHED RESOURCES SPECIALIST  7862 080516 (1).txt\n",
      "CityofLA/Job Bulletins/WATERWORKS ENGINEER 7248 071516 (1).txt\n",
      "CityofLA/Job Bulletins/WATERWORKS MECHANIC SUPERVISOR 3987 051614 (1).txt\n",
      "CityofLA/Job Bulletins/WELDER SUPERVISOR 3798 120817.txt\n",
      "CityofLA/Job Bulletins/WORKERS_ COMPENSATION ANALYST 1774 032417R.txt\n",
      "CityofLA/Job Bulletins/WORKERS_ COMPENSATION CLAIMS ASSISTANT 1775 041114.txt\n",
      "CityofLA/Job Bulletins/X-RAY AND LABORATORY TECHNICIAN 2358 012916.txt\n",
      "CityofLA/Job Bulletins/ZOO CURATOR 4297 040816.txt\n"
     ]
    }
   ],
   "source": [
    "# Second, make sure the pharase 'REQUIREMENTS/MINIMUM QUALIFICATIONS' can be found in the job postings.\n",
    "# Do an index() in the try clause, not find(), to catch the errors\n",
    "for file_name in raw_jobs:\n",
    "    job_path = raw_path + file_name        # define path to file_name\n",
    "    raw_job  = open(job_path, 'rt').read() # read in job as a string\n",
    "    try:\n",
    "        if 'REQUIREMENTS/MINIMUM QUALIFICATIONS' not in raw_job.split('\\n'):\n",
    "            print(job_path)\n",
    "    except:                                # do some pretty printings here to help our eyes from pain\n",
    "        ## define some useful variables\n",
    "        border_line = '##############################################################################################'\n",
    "        how_many    = int((len(border_line) - len(job_path))/2)\n",
    "        print(border_line)\n",
    "        ## do pretty printings\n",
    "        print('#'*how_many + job_path + '#'*how_many)\n",
    "        print(border_line)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "This time, the list is quite long, but again, patience will pay off later. We'll modify the contents of the following jobs by manually adding into them the phrase REQUIREMENTS/MINIMUM QUALIFICATIONS.\n",
    "* CityofLA/Job Bulletins/311 DIRECTOR  9206 041814.txt\n",
    "* CityofLA/Job Bulletins/ACCOUNTANT 1513 062218.txt\n",
    "* CityofLA/Job Bulletins/ACCOUNTING CLERK 1223 071318.txt\n",
    "* CityofLA/Job Bulletins/ACCOUNTING RECORDS SUPERVISOR 1119 072718.txt\n",
    "* CityofLA/Job Bulletins/ADMINISTRATIVE CLERK 1358 033018 (2).txt\n",
    "* CityofLA/Job Bulletins/ADMINISTRATIVE HEARING EXAMINER 9135 100915.txt\n",
    "* CityofLA/Job Bulletins/ADVANCE PRACTICE PROVIDER CORRECTIONAL CARE 2325 020808 REV 111214.txt\n",
    "* CityofLA/Job Bulletins/AIR CONDITIONING MECHANIC SUPERVISOR 3781 111618 2.txt\n",
    "* CityofLA/Job Bulletins/AIRPORT AIDE 1540 081018.txt\n",
    "* CityofLA/Job Bulletins/AIRPORT CHIEF INFORMATION SECURITY OFFICER 1404 120415_Modified.txt\n",
    "* CityofLA/Job Bulletins/AIRPORT ENGINEER 7256 070618.txt\n",
    "* CityofLA/Job Bulletins/AIRPORT GUIDE 0845 042018.txt\n",
    "* CityofLA/Job Bulletins/AIRPORT INFORMATION SPECIALIST 1783 121115.txt\n",
    "* CityofLA/Job Bulletins/AIRPORT POLICE CAPTAIN 3228 021618.txt\n",
    "* CityofLA/Job Bulletins/AIRPORT POLICE LIEUTENANT 3227 091616.txt\n",
    "* CityofLA/Job Bulletins/AIRPORT POLICE OFFICER 3225 110906 Rev 060115.txt\n",
    "* CityofLA/Job Bulletins/AIRPORT POLICE SPECIALIST 3236 063017 (2).txt\n",
    "* CityofLA/Job Bulletins/AIRPORT SUPERINTENDENT OF OPERATIONS 7268 121815 (1).txt\n",
    "* CityofLA/Job Bulletins/ANIMAL CARE TECHNICIAN 4310 040116 REV 041416.txt\n",
    "* CityofLA/Job Bulletins/ANIMAL CARE TECHNICIAN SUPERVISOR 4313 122118.txt\n",
    "* CityofLA/Job Bulletins/APPRENTICE - METAL TRADES 3789 070816.txt\n",
    "* CityofLA/Job Bulletins/APPRENTICE MACHINIST 3764 071516.txt\n",
    "* CityofLA/Job Bulletins/AQUARIST 2400 050214.txt\n",
    "* CityofLA/Job Bulletins/AQUARIUM EDUCATOR 2493 010816.txt\n",
    "* CityofLA/Job Bulletins/AQUATIC FACILITY MANAGER 2423 052915 REVISED 060915.txt\n",
    "* CityofLA/Job Bulletins/AQUEDUCT AND RESERVOIR KEEPER 5813 063017 (1).txt\n",
    "* CityofLA/Job Bulletins/AQUEDUCT AND RESERVOIR SUPERVISOR 5816 091115.txt\n",
    "* CityofLA/Job Bulletins/ARCHITECTURAL ASSOCIATE 7926 013114 REV 032916.txt\n",
    "* CityofLA/Job Bulletins/ARCHIVIST 1191 020918.txt\n",
    "* CityofLA/Job Bulletins/ART CENTER DIRECTOR 2478 053014.txt\n",
    "* CityofLA/Job Bulletins/ART INSTRUCTOR 2447 051316.txt\n",
    "* CityofLA/Job Bulletins/ASBESTOS SUPERVISOR 3440 012916.txt\n",
    "* CityofLA/Job Bulletins/ASPHALT PLANT OPERATOR 4143 102414.txt\n",
    "* CityofLA/Job Bulletins/ASPHALT PLANT SUPERVISOR 4145 110317.txt\n",
    "* CityofLA/Job Bulletins/ASSISTANT DIRECTOR INFORMATION SYSTEMS 9377 030218.txt\n",
    "* CityofLA/Job Bulletins/ASSISTANT INSPECTOR 4208 111315.txt\n",
    "* CityofLA/Job Bulletins/ASSISTANT RETIREMENT PLAN MANAGER 9415 050616.txt\n",
    "* CityofLA/Job Bulletins/ASSISTANT SIGNAL SYSTEMS ELECTRICIAN 3818 073115_REVISED.txt\n",
    "* CityofLA/Job Bulletins/ASSISTANT STREET LIGHTING ELECTRICIAN 3809 072117 REV 080818.txt\n",
    "* CityofLA/Job Bulletins/AUDIO VISUAL TECHNICIAN 6147 062014.txt\n",
    "* CityofLA/Job Bulletins/AUDITOR 1517 031816 (1).txt\n",
    "* CityofLA/Job Bulletins/AUTO BODY REPAIR SUPERVISOR 3706 051515.txt\n",
    "* CityofLA/Job Bulletins/AUTO ELECTRICIAN 3707 052215.txt\n",
    "* CityofLA/Job Bulletins/AUTOMOTIVE DISPATCHER 3595 102017 revised.txt\n",
    "* CityofLA/Job Bulletins/AUTOMOTIVE SUPERVISOR 3714 062416.txt\n",
    "* CityofLA/Job Bulletins/AVIONICS SPECIALIST 3565 103114revised.txt\n",
    "* CityofLA/Job Bulletins/BENEFITS SPECIALIST 1203 011918.txt\n",
    "* CityofLA/Job Bulletins/BOILERMAKER 3735 110714.txt\n",
    "* CityofLA/Job Bulletins/BOILERMAKER SUPERVISOR 3737 101714.txt\n",
    "* CityofLA/Job Bulletins/BUILDING CIVIL ENGINEER 7244 032318.txt\n",
    "* CityofLA/Job Bulletins/BUILDING CONSTRUCTION AND MAINTENANCE SUPERINTENDENT 3124 122818.txt\n",
    "* CityofLA/Job Bulletins/BUILDING ELECTRICAL ENGINEER 7543 071516 REV 071816.txt\n",
    "* CityofLA/Job Bulletins/BUILDING OPERATING ENGINEER 5923 111618 REV 112818.txt\n",
    "* CityofLA/Job Bulletins/BUILDING REPAIR SUPERVISOR 3338 111816.txt\n",
    "* CityofLA/Job Bulletins/BUILDING REPAIRER 3333 030218.txt\n",
    "* CityofLA/Job Bulletins/BUS OPERATOR 3588 090216.txt\n",
    "* CityofLA/Job Bulletins/BUS OPERATOR SUPERVISOR 3589 012216.txt\n",
    "* CityofLA/Job Bulletins/CARPENTER SUPERVISOR 3346 051316.txt\n",
    "* CityofLA/Job Bulletins/CARPET LAYER 3418 061915.txt\n",
    "* CityofLA/Job Bulletins/CEMENT FINISHER SUPERVISOR 3354 120916.txt\n",
    "* CityofLA/Job Bulletins/CEMENT FINISHER WORKER 3351 103015.txt\n",
    "* CityofLA/Job Bulletins/CHIEF ADMINISTRATIVE ANALYST 1554 062416.txt\n",
    "* CityofLA/Job Bulletins/CHIEF AIRPORTS ENGINEER 7274 051515 (1).txt\n",
    "* CityofLA/Job Bulletins/CHIEF BUILDING OPERATING ENGINEER 5927 080516.txt\n",
    "* CityofLA/Job Bulletins/CHIEF CLERK PERSONNEL 1260 042117.txt\n",
    "* CityofLA/Job Bulletins/CHIEF CLERK POLICE 1219 061215.txt\n",
    "* CityofLA/Job Bulletins/CHIEF CLERK POLICE 1249 083118.txt\n",
    "* CityofLA/Job Bulletins/CHIEF CONSTRUCTION INSPECTOR 7296 122818.txt\n",
    "* CityofLA/Job Bulletins/CHIEF CUSTODIAN SUPERVISOR 3182 041015.txt\n",
    "* CityofLA/Job Bulletins/CHIEF ELECTRIC PLANT OPERATOR 5237 121115.txt\n",
    "* CityofLA/Job Bulletins/CHIEF ENVIRONMENTAL COMPLIANCE INSPECTOR 4289 033018.txt\n",
    "* CityofLA/Job Bulletins/CHIEF FINANCIAL OFFICER 9230 041114.txt\n",
    "* CityofLA/Job Bulletins/CHIEF HARBOR ENGINEER 9286 112015.txt\n",
    "* CityofLA/Job Bulletins/CHIEF INSPECTOR 4254 082517.txt\n",
    "* CityofLA/Job Bulletins/CHIEF INTERNAL AUDITOR 1619 090916 (5).txt\n",
    "* CityofLA/Job Bulletins/CHIEF MANAGEMENT ANALYST 9182 020918.txt\n",
    "* CityofLA/Job Bulletins/CHIEF OF DRAFTING OPERATIONS 7271  042018.txt\n",
    "* CityofLA/Job Bulletins/CHIEF OF PARKING ENFORCEMENT OPERATIONS 9180 031618.txt\n",
    "* CityofLA/Job Bulletins/CHIEF PARK RANGER 1968 120106 REV 121306.txt\n",
    "* CityofLA/Job Bulletins/CHIEF PORT PILOT 5154 031816.txt\n",
    "* CityofLA/Job Bulletins/CHIEF STREET SERVICES INVESTIGATOR 4286 2017Revised 11.21.txt\n",
    "* CityofLA/Job Bulletins/CHIEF TAX COMPLIANCE OFFICER 1211 041814.txt\n",
    "* CityofLA/Job Bulletins/CHIEF TRANSPORTATION INVESTIGATOR 4275 103114.txt\n",
    "* CityofLA/Job Bulletins/CIVIL ENGINEER 7237 020918.txt\n",
    "* CityofLA/Job Bulletins/CLAIMS AGENT 1767 020317.txt\n",
    "* CityofLA/Job Bulletins/COMMERCIAL SERVICE SUPERVISOR  1213 061617.txt\n",
    "* CityofLA/Job Bulletins/COMMISSION EXECUTIVE ASSISTANT 9734 092118.txt\n",
    "* CityofLA/Job Bulletins/COMMUNICATIONS CABLE SUPERVISOR 3800 051917 REVISED 060117.txt\n",
    "* CityofLA/Job Bulletins/COMMUNICATIONS CABLE WORKER 3802 11816.txt\n",
    "* CityofLA/Job Bulletins/COMMUNITY AFFAIRS ADVOCATE 2496 111414.txt\n",
    "* CityofLA/Job Bulletins/COMMUNITY HOUSING PROGRAMS MANAGER 8500 072018 REV 080918 (2).txt\n",
    "* CityofLA/Job Bulletins/CONSTRUCTION AND MAINTENANCE SUPERINTENDENT 3129 082616 REV 090816.txt\n",
    "* CityofLA/Job Bulletins/CONSTRUCTION AND MAINTENANCE SUPERVISOR 3127 030416.txt\n",
    "* CityofLA/Job Bulletins/CONSTRUCTION ESTIMATOR 3341 070816 REVISED 072116 (1).txt\n",
    "* CityofLA/Job Bulletins/CORRECTIONAL NURSE 2317 101615.txt\n",
    "* CityofLA/Job Bulletins/CRIMINALIST 2234 030918.txt\n",
    "* CityofLA/Job Bulletins/CUSTODIAN SUPERVISOR 3176 042817 051117 REV.txt\n",
    "* CityofLA/Job Bulletins/CUSTOMER SERVICE REPRESENTATIVE 1230 020918.txt\n",
    "* CityofLA/Job Bulletins/DECK HAND 5131 093016.txt\n",
    "* CityofLA/Job Bulletins/DEPARTMENTAL CHIEF ACCOUNTANT 1593 111717 revised 11.21.txt\n",
    "* CityofLA/Job Bulletins/DIRECTOR OF HOUSING 1568 062317.txt\n",
    "* CityofLA/Job Bulletins/DIRECTOR OF MAINTENANCE AIRPORTS 7270 041516.txt\n",
    "* CityofLA/Job Bulletins/DIRECTOR OF POLICE TRANSPORTATION 3722 061915.txt\n",
    "* CityofLA/Job Bulletins/DIRECTOR OF PORT CONSTRUCTION AND MAINTENANCE 3123 030416.txt\n",
    "* CityofLA/Job Bulletins/ELECTRIC DISTRIBUTION MECHANIC SUPERVISOR 3873 102816.txt\n",
    "* CityofLA/Job Bulletins/ELECTRIC SERVICE REPRESENTATIVE 7520 020317.txt\n",
    "* CityofLA/Job Bulletins/ELECTRIC TROUBLE DISPATCHER 3828 063017 (1).txt\n",
    "* CityofLA/Job Bulletins/ELECTRICAL ENGINEERING DRAFTING TECHNICIAN 7532 113018.txt\n",
    "* CityofLA/Job Bulletins/ELECTRICAL INSPECTOR 4221 030218.txt\n",
    "* CityofLA/Job Bulletins/ELECTRICAL MECHANIC SUPERVISOR 3835 072216 REVISED 080416.txt\n",
    "* CityofLA/Job Bulletins/ELECTRICAL REPAIR SUPERVISOR 3855 092217 (7).txt\n",
    "* CityofLA/Job Bulletins/ELEVATOR MECHANIC 3866 012717 REV 080718.txt\n",
    "* CityofLA/Job Bulletins/ELEVATOR REPAIR SUPERVISOR 032516 REVISED 040516.txt\n",
    "* CityofLA/Job Bulletins/EMERGENCY MEDICAL SERVICES EDUCATOR  2322 110615 REV 112515.txt\n",
    "* CityofLA/Job Bulletins/EMS NURSE PRACTITIONER SUPERVISOR 2340 031116 REV 032316 (1).txt\n",
    "* CityofLA/Job Bulletins/ENGINEER OF SURVEYS 9486 101615.txt\n",
    "* CityofLA/Job Bulletins/ENGINEERING DESIGNER 7217 082517 REV 090717.txt\n",
    "* CityofLA/Job Bulletins/ENGINEERING GEOLOGIST 7255 022318.txt\n",
    "* CityofLA/Job Bulletins/ENGINEERING GEOLOGIST ASSOCIATE 7253 082517.txt\n",
    "* CityofLA/Job Bulletins/ENVIRONMENTAL COMPLIANCE INSPECTOR 4292 080516 REV 081616.txt\n",
    "* CityofLA/Job Bulletins/ENVIRONMENTAL ENGINEER  7872 082616 REV 090116.txt\n",
    "* CityofLA/Job Bulletins/ENVIRONMENTAL ENGINEERING ASSOCIATE  7871 020113 REV 032916.txt\n",
    "* CityofLA/Job Bulletins/ENVIRONMENTAL SPECIALIST 7310 012916.txt\n",
    "* CityofLA/Job Bulletins/ENVIRONMENTAL SUPERVISOR 7304 052518 (1).txt\n",
    "* CityofLA/Job Bulletins/EQUIPMENT REPAIR SUPERVISOR 3746 012717.txt\n",
    "* CityofLA/Job Bulletins/EQUIPMENT SUPERINTENDENT 3750 121914.txt\n",
    "* CityofLA/Job Bulletins/EQUIPMENT SUPERVISOR 3527 041318.txt\n",
    "* CityofLA/Job Bulletins/EXAMINER OF QUESTIONED DOCUMENTS 3229 120415.txt\n",
    "* CityofLA/Job Bulletins/EXECUTIVE ADMINISTRATIVE ASSISTANT 1117 083118.txt\n",
    "* CityofLA/Job Bulletins/EXECUTIVE ASSISTANT AIRPORTS 9186 060917 (1).txt\n",
    "* CityofLA/Job Bulletins/EXHIBIT PREPARATOR 2444 062416.txt\n",
    "* CityofLA/Job Bulletins/FINANCIAL MANAGER 1557 070116 Rev.txt\n",
    "* CityofLA/Job Bulletins/FINGERPRINT IDENTIFICATION EXPERT 1157 052915.txt\n",
    "* CityofLA/Job Bulletins/FIRE BATTALION CHIEF 2152 030918.txt\n",
    "* CityofLA/Job Bulletins/FIRE CAPTAIN 2142 033018.txt\n",
    "* CityofLA/Job Bulletins/FIRE HELICOPTER PILOT 3563 081415 REV. 081815.txt\n",
    "* CityofLA/Job Bulletins/FIRE INSPECTOR 2128 031717.txt\n",
    "* CityofLA/Job Bulletins/FIRE PROTECTION ENGINEERING ASSOCIATE 7978 041318.txt\n",
    "* CityofLA/Job Bulletins/FIRE SPECIAL INVESTIGATOR 1632 021216.txt\n",
    "* CityofLA/Job Bulletins/FIREARMS EXAMINER 2233 062416.txt\n",
    "* CityofLA/Job Bulletins/FIREBOAT MATE 5125 102315 rev110515.txt\n",
    "* CityofLA/Job Bulletins/FIREBOAT PILOT 5127 102315 rev110515 (1).txt\n",
    "* CityofLA/Job Bulletins/GALLERY ATTENDANT 2442 092515.txt\n",
    "* CityofLA/Job Bulletins/GARAGE ASSISTANT 3538 012017.txt\n",
    "* CityofLA/Job Bulletins/GARAGE ATTENDANT 3531 013015.txt\n",
    "* CityofLA/Job Bulletins/GENERAL AUTOMOTIVE SUPERVISOR 3718 061915.txt\n",
    "* CityofLA/Job Bulletins/GENERAL SERVICES MANAGER  9601 042117.txt\n",
    "* CityofLA/Job Bulletins/GEOGRAPHIC INFORMATION SYSTEMS CHIEF  7211 030416.txt\n",
    "* CityofLA/Job Bulletins/GEOGRAPHIC INFORMATION SYSTEMS SPECIALIST 7213 012414 revised.txt\n",
    "* CityofLA/Job Bulletins/GEOTECHNICAL ENGINEER 7239 090718 REV 092018.txt\n",
    "* CityofLA/Job Bulletins/GOLF STARTER 2453 121115.txt\n",
    "* CityofLA/Job Bulletins/GOLF STARTER SUPERVISOR 2479 120817.txt\n",
    "* CityofLA/Job Bulletins/GRAPHICS SUPERVISOR 7935 052617 (4).txt\n",
    "* CityofLA/Job Bulletins/HARBOR PLANNING AND ECONOMIC ANALYST 9224 111816 REV 112916.txt\n",
    "* CityofLA/Job Bulletins/HEATING AND REFRIGERATION INSPECTOR 4245 121115.txt\n",
    "* CityofLA/Job Bulletins/HEAVY DUTY EQUIPMENT MECHANIC 3743 021717.txt\n",
    "* CityofLA/Job Bulletins/HELICOPTER MECHANIC 3742 072206 REV 020818.txt\n",
    "* CityofLA/Job Bulletins/HELICOPTER MECHANIC SUPERVISOR 3749 121616 REV 122216.txt\n",
    "* CityofLA/Job Bulletins/HYDROGRAPHER 7263 012717.txt\n",
    "* CityofLA/Job Bulletins/IMPROVEMENT ASSESSOR SUPERVISOR 1564 100215.txt\n",
    "* CityofLA/Job Bulletins/INDUSTRIAL AND COMMERCIAL FINANCE OFFICER 9191 rev051515.txt\n",
    "* CityofLA/Job Bulletins/INDUSTRIAL CHEMIST 7834 020714.txt\n",
    "* CityofLA/Job Bulletins/INFORMATION SYSTEMS MANAGER 1409 090117 (2).txt\n",
    "* CityofLA/Job Bulletins/INSTRUMENT MECHANIC SUPERVISOR 3844 051917 final.txt\n",
    "* CityofLA/Job Bulletins/INTERNAL AUDITOR 1625 011918.txt\n",
    "* CityofLA/Job Bulletins/IRRIGATION SPECIALIST 3913 020615.txt\n",
    "* CityofLA/Job Bulletins/LABOR SUPERVISOR 3126 121815.txt\n",
    "* CityofLA/Job Bulletins/LABORATORY TECHNICIAN 7854 030416.txt\n",
    "* CityofLA/Job Bulletins/LAND SURVEYING ASSISTANT 7283 120817.txt\n",
    "* CityofLA/Job Bulletins/LANDSCAPE ARCHITECT 7929 090718.txt\n",
    "* CityofLA/Job Bulletins/LANDSCAPE ARCHITECTURAL ASSOCIATE  7933 07222016.txt\n",
    "* CityofLA/Job Bulletins/LEGISLATIVE ASSISTANT 1182 091815.txt\n",
    "* CityofLA/Job Bulletins/LIBRARIAN 6152 051217 REV 020218.txt\n",
    "* CityofLA/Job Bulletins/LIBRARY ASSISTANT 1172 051118 (2).txt\n",
    "* CityofLA/Job Bulletins/LICENSED VOCATIONAL NURSE  2332 042415.txt\n",
    "* CityofLA/Job Bulletins/LINE MAINTENANCE ASSISTANT 3882 122818.txt\n",
    "* CityofLA/Job Bulletins/MACHINIST 3763 061016.txt\n",
    "* CityofLA/Job Bulletins/MACHINIST SUPERVISOR 3766 121815.txt\n",
    "* CityofLA/Job Bulletins/MANAGEMENT ASSISTANT 1539 032318.txt\n",
    "* CityofLA/Job Bulletins/MARINE AQUARIUM PROGRAM DIRECTOR 2403 082517.txt\n",
    "* CityofLA/Job Bulletins/MARINE ENVIRONMENTAL MANAGER 9437 060614.txt\n",
    "* CityofLA/Job Bulletins/MARINE ENVIRONMENTAL SUPERVISOR 9433 071114 (1).txt\n",
    "* CityofLA/Job Bulletins/MATERIALS TESTING TECHNICIAN 7968 081318.txt\n",
    "* CityofLA/Job Bulletins/MECHANICAL HELPER 3771 011317.txt\n",
    "* CityofLA/Job Bulletins/MECHANICAL REPAIR GENERAL SUPERVISOR 3731 040116 REV 041416.txt\n",
    "* CityofLA/Job Bulletins/MECHANICAL REPAIR SUPERVISOR 3795 051818.txt\n",
    "* CityofLA/Job Bulletins/MECHANICAL REPAIRER 3773 092118.txt\n",
    "* CityofLA/Job Bulletins/METER READER 1611 080715.txt\n",
    "* CityofLA/Job Bulletins/MOTOR SWEEPER OPERATOR 3585 031618.txt\n",
    "* CityofLA/Job Bulletins/OCCUPATIONAL HEALTH NURSE  2314 020317 REV 022317 (1).txt\n",
    "* CityofLA/Job Bulletins/OFFICE ENGINEERING TECHNICIAN 7212 110218.txt\n",
    "* CityofLA/Job Bulletins/OFFICE TRAINEE 1101 012017.txt\n",
    "* CityofLA/Job Bulletins/PAINTER SUPERVISOR 3426 120514.txt\n",
    "* CityofLA/Job Bulletins/PARK SERVICES ATTENDANT 2412 032219.txt\n",
    "* CityofLA/Job Bulletins/PARK SERVICES SUPERVISOR 2426 072018.txt\n",
    "* CityofLA/Job Bulletins/PARKING ENFORCEMENT MANAGER 9025 021916 rev022516.txt\n",
    "* CityofLA/Job Bulletins/PARKING MANAGER 9170 020714.txt\n",
    "* CityofLA/Job Bulletins/PARKING METER TECHNICIAN 3738 110615 (1).txt\n",
    "* CityofLA/Job Bulletins/PARKING METER TECHNICIAN SUPERVISOR 3757 2017.txt\n",
    "* CityofLA/Job Bulletins/PAYROLL ANALYST 1630 031816.txt\n",
    "* CityofLA/Job Bulletins/PAYROLL SUPERVISOR 1170 102618.txt\n",
    "* CityofLA/Job Bulletins/PERSONNEL DIRECTOR 1714 050418.txt\n",
    "* CityofLA/Job Bulletins/PERSONNEL RECORDS SUPERVISOR 1129 041318.txt\n",
    "* CityofLA/Job Bulletins/PHOTOGRAPHER 1793 041516.txt\n",
    "* CityofLA/Job Bulletins/PILE DRIVER WORKER 3553 041417.txt\n",
    "* CityofLA/Job Bulletins/PIPEFITTER SUPERVISOR 3438 081216.txt\n",
    "* CityofLA/Job Bulletins/PLUMBER 3443 113018.txt\n",
    "* CityofLA/Job Bulletins/POLICE COMMANDER 2251 092917.txt\n",
    "* CityofLA/Job Bulletins/POLICE DETECTIVE 2223 033018.txt\n",
    "* CityofLA/Job Bulletins/POLICE OFFICER 2214 110906 Rev 060115.txt\n",
    "* CityofLA/Job Bulletins/POLICE PERFORMANCE AUDITOR 1627 120216.txt\n",
    "* CityofLA/Job Bulletins/POLICE SERGEANT 2227 102116.txt\n",
    "* CityofLA/Job Bulletins/POLICE SERVICE REPRESENTATIVE 2207 051316 REV 051716.txt\n",
    "* CityofLA/Job Bulletins/POLICE SPECIAL INVESTIGATOR 1640 072018 REV 011019.txt\n",
    "* CityofLA/Job Bulletins/POLICE SPECIALIST 2217 110906 Rev 060115.txt\n",
    "* CityofLA/Job Bulletins/POLICE SURVEILLANCE SPECIALIST 3687 052215.txt\n",
    "* CityofLA/Job Bulletins/POLYGRAPH EXAMINER 2240 121517.txt\n",
    "* CityofLA/Job Bulletins/PORT ELECTRICAL MECHANIC 3758 022616.txt\n",
    "* CityofLA/Job Bulletins/PORT ELECTRICAL MECHANIC SUPERVISOR 3759 031816.txt\n",
    "* CityofLA/Job Bulletins/PORT MAINTENANCE SUPERVISOR 3128 052016 REV 060216.txt\n",
    "* CityofLA/Job Bulletins/PORT POLICE CAPTAIN 3224 110416.txt\n",
    "* CityofLA/Job Bulletins/PORT POLICE LIEUTENANT 3223 120916.txt\n",
    "* CityofLA/Job Bulletins/PORT POLICE OFFICER 3221 110906 Rev 060115.txt\n",
    "* CityofLA/Job Bulletins/PORT POLICE SERGEANT 3222 121616.txt\n",
    "* CityofLA/Job Bulletins/POWER SHOVEL OPERATOR 3558 062416.txt\n",
    "* CityofLA/Job Bulletins/PRE-PRESS OPERATOR 1481 072817 (4).txt\n",
    "* CityofLA/Job Bulletins/PRINCIPAL ACCOUNTANT 1525 121517.txt\n",
    "* CityofLA/Job Bulletins/PRINCIPAL ANIMAL KEEPER 4312 070618.txt\n",
    "* CityofLA/Job Bulletins/PRINCIPAL CIVIL ENGINEER 9489 022318.txt\n",
    "* CityofLA/Job Bulletins/PRINCIPAL CIVIL ENGINEERING DRAFTING TECHNICIAN 7219 110218.txt\n",
    "* CityofLA/Job Bulletins/PRINCIPAL CLERK 1201 021618.txt\n",
    "* CityofLA/Job Bulletins/PRINCIPAL CLERK POLICE 1152 121815.txt\n",
    "* CityofLA/Job Bulletins/PRINCIPAL COMMUNICATIONS OPERATOR 1458 072514.txt\n",
    "* CityofLA/Job Bulletins/PRINCIPAL CONSTRUCTION INSPECTOR 7297 021618.txt\n",
    "* CityofLA/Job Bulletins/PRINCIPAL DEPUTY CONTROLLER 7260 032814.txt\n",
    "* CityofLA/Job Bulletins/PRINCIPAL DETENTION OFFICER 3215 101218.txt\n",
    "* CityofLA/Job Bulletins/PRINCIPAL ELECTRIC TROUBLE DISPATCHER 3830 022616.txt\n",
    "* CityofLA/Job Bulletins/PRINCIPAL ELECTRICAL ENGINEERING DRAFTING TECHNICIAN 7531 090916 TRACK CHANGES.txt\n",
    "* CityofLA/Job Bulletins/PRINCIPAL ENVIRONMENTAL ENGINEER 7875 092118.txt\n",
    "* CityofLA/Job Bulletins/PRINCIPAL GROUNDS MAINTENANCE SUPERVISOR  3147 111315.txt\n",
    "* CityofLA/Job Bulletins/PRINCIPAL INSPECTOR 4226 061617.txt\n",
    "* CityofLA/Job Bulletins/PRINCIPAL MECHANICAL ENGINEERING DRAFTING TECHNICIAN 7550 081415.txt\n",
    "* CityofLA/Job Bulletins/PRINCIPAL PHOTOGRAPHER 1794 040116.txt\n",
    "* CityofLA/Job Bulletins/PRINCIPAL PROPERTY OFFICER 3210 121517.txt\n",
    "* CityofLA/Job Bulletins/PRINCIPAL RECREATION SUPERVISOR 2464 021618.txt\n",
    "* CityofLA/Job Bulletins/PRINCIPAL STOREKEEPER 1839 072718.txt\n",
    "* CityofLA/Job Bulletins/PRINCIPAL TAX AUDITOR 1524 110416.txt\n",
    "* CityofLA/Job Bulletins/PRINCIPAL TAX COMPLIANCE OFFICER 1195 030218.txt\n",
    "* CityofLA/Job Bulletins/PRINCIPAL UTILITY ACCOUNTANT 1589 030218 updated.txt\n",
    "* CityofLA/Job Bulletins/PRINCIPAL WORKERS_ COMPENSATION ANALYST 1777 071814.txt\n",
    "* CityofLA/Job Bulletins/PRINTING PRESS OPERATOR 1494 092515.txt\n",
    "* CityofLA/Job Bulletins/PROPERTY OFFICER 3207 071417 (1).txt\n",
    "* CityofLA/Job Bulletins/PROTECTIVE COATING WORKER 3463 082115.txt\n",
    "* CityofLA/Job Bulletins/PUBLIC RELATIONS SPECIALIST 1785 012017.txt\n",
    "* CityofLA/Job Bulletins/RATES MANAGER 5601 012017.txt\n",
    "* CityofLA/Job Bulletins/REAL ESTATE ASSOCIATE 1941 052716.txt\n",
    "* CityofLA/Job Bulletins/REAL ESTATE OFFICER 1960 051118.txt\n",
    "* CityofLA/Job Bulletins/RECREATION COORDINATOR 2469 091517(1).txt\n",
    "* CityofLA/Job Bulletins/RECREATION SUPERVISOR 2460 101416 REVISED 102716.txt\n",
    "* CityofLA/Job Bulletins/REFUSE COLLECTION SUPERVISOR 4101 033117.txt\n",
    "* CityofLA/Job Bulletins/REHABILITATION PROJECT COORDINATOR 8502 032715.txt\n",
    "* CityofLA/Job Bulletins/REINFORCING STEEL WORKER 3483 022318.txt\n",
    "* CityofLA/Job Bulletins/REPROGRAPHICS OPERATOR 3162 110615.txt\n",
    "* CityofLA/Job Bulletins/REPROGRAPHICS SUPERVISOR  3163 091517.txt\n",
    "* CityofLA/Job Bulletins/RETIREMENT PLAN MANAGER 9149 052314 (1).txt\n",
    "* CityofLA/Job Bulletins/RISK AND INSURANCE ASSISTANT 1645 072718.txt\n",
    "* CityofLA/Job Bulletins/RISK MANAGER 1530 2016 061716_REVISED.txt\n",
    "* CityofLA/Job Bulletins/ROOFER 3476 121214.txt\n",
    "* CityofLA/Job Bulletins/SAFETY ADMINISTRATOR 1728 101615.txt\n",
    "* CityofLA/Job Bulletins/SAFETY ENGINEER 1727 021717.txt\n",
    "* CityofLA/Job Bulletins/SAFETY ENGINEER ELEVATORS 4263 112015 REV 120215.txt\n",
    "* CityofLA/Job Bulletins/SANITATION SOLID RESOURCES MANAGER 4126 060515.txt\n",
    "* CityofLA/Job Bulletins/SECRETARY 1116 030317.txt\n",
    "* CityofLA/Job Bulletins/SECRETARY LEGAL  1924 081718.txt\n",
    "* CityofLA/Job Bulletins/SECURITY AIDE  3199 090415.txt\n",
    "* CityofLA/Job Bulletins/SENIOR ACCOUNTANT 1523 030218.txt\n",
    "* CityofLA/Job Bulletins/SENIOR ADMINISTRATIVE CLERK 1368 062918 REV 091718.txt\n",
    "* CityofLA/Job Bulletins/SENIOR ANIMAL CONTROL OFFICER 4316 111618.txt\n",
    "* CityofLA/Job Bulletins/SENIOR ANIMAL KEEPER 4305 022616.txt\n",
    "* CityofLA/Job Bulletins/SENIOR ARCHITECTURAL DRAFTING TECHNICIAN 7208 091418.txt\n",
    "* CityofLA/Job Bulletins/SENIOR AUDITOR 1518 102618.txt\n",
    "* CityofLA/Job Bulletins/SENIOR AUTOMOTIVE SUPERVISOR 3716 112015.txt\n",
    "* CityofLA/Job Bulletins/SENIOR BUILDING INSPECTOR 4213 010816.txt\n",
    "* CityofLA/Job Bulletins/SENIOR BUILDING MECHANICAL INSPECTOR 4253 2017 REV (1).txt\n",
    "* CityofLA/Job Bulletins/SENIOR BUILDING OPERATING ENGINEER 5925 011615 (1).txt\n",
    "* CityofLA/Job Bulletins/SENIOR CARPENTER  3345 081117 REV 082417.txt\n",
    "* CityofLA/Job Bulletins/SENIOR CHEMIST 7830 030416.txt\n",
    "* CityofLA/Job Bulletins/SENIOR CIVIL ENGINEERING DRAFTING TECHNICIAN 7207 081718.txt\n",
    "* CityofLA/Job Bulletins/SENIOR CLAIMS REPRESENTATIVE 1770 070717 (1).txt\n",
    "* CityofLA/Job Bulletins/SENIOR COMMUNICATIONS CABLE WORKER 3801 102116 draft.txt\n",
    "* CityofLA/Job Bulletins/SENIOR COMMUNICATIONS ELECTRICIAN 3638 030317 (1).txt\n",
    "* CityofLA/Job Bulletins/SENIOR COMMUNICATIONS ELECTRICIAN SUPERVISOR 3691 041318.txt\n",
    "* CityofLA/Job Bulletins/SENIOR COMMUNICATIONS OPERATOR 1467 122118.txt\n",
    "* CityofLA/Job Bulletins/SENIOR COMPUTER OPERATOR 1428 102017.txt\n",
    "* CityofLA/Job Bulletins/SENIOR CONSTRUCTION ENGINEER 7289 042514.txt\n",
    "* CityofLA/Job Bulletins/SENIOR DATA PROCESSING TECHNICIAN 1139 081117.txt\n",
    "* CityofLA/Job Bulletins/SENIOR DETENTION OFFICER 3212 012017.txt\n",
    "* CityofLA/Job Bulletins/SENIOR ELECTRIC TROUBLE DISPATCHER 3829 100716.txt\n",
    "* CityofLA/Job Bulletins/SENIOR ELECTRICAL ENGINEERING DRAFTING TECHNICIAN 7209 042817 REV 051117.txt\n",
    "* CityofLA/Job Bulletins/SENIOR ELECTRICAL INSPECTOR 4223 042718.txt\n",
    "* CityofLA/Job Bulletins/SENIOR ELECTRICAL MECHANIC 3834 060217 (2) REVISED.txt\n",
    "* CityofLA/Job Bulletins/SENIOR ELECTRICAL MECHANIC SUPERVISOR 3836 080417.txt\n",
    "* CityofLA/Job Bulletins/SENIOR ELECTRICAL REPAIR SUPERVISOR 3856 060118.txt\n",
    "* CityofLA/Job Bulletins/SENIOR ELECTRICAL TEST TECHNICIAN  7515 092917 REV 101117.txt\n",
    "* CityofLA/Job Bulletins/SENIOR ELECTRICIAN  3864 102116 Rev 110216.txt\n",
    "* CityofLA/Job Bulletins/SENIOR ENVIRONMENTAL COMPLIANCE INSPECTOR 4293 042916 REV 051916.txt\n",
    "* CityofLA/Job Bulletins/SENIOR ENVIRONMENTAL ENGINEER 7874 121815.txt\n",
    "* CityofLA/Job Bulletins/SENIOR EQUIPMENT MECHANIC 3712 010518 REV 080718.txt\n",
    "* CityofLA/Job Bulletins/SENIOR FIRE PROTECTION ENGINEER 7981 021916 rev022516.txt\n",
    "* CityofLA/Job Bulletins/SENIOR FORENSIC PRINT SPECIALIST 2201 090718.txt\n",
    "* CityofLA/Job Bulletins/SENIOR GARDENER 3143 121517 (1)revised.txt\n",
    "* CityofLA/Job Bulletins/SENIOR HEATING AND REFRIGERATION INSPECTOR 4247 121115.txt\n",
    "* CityofLA/Job Bulletins/SENIOR HEAVY DUTY EQUIPMENT MECHANIC 3745 012017.txt\n",
    "* CityofLA/Job Bulletins/SENIOR HOUSING INSPECTOR 4244 042718.txt\n",
    "* CityofLA/Job Bulletins/SENIOR HYDROGRAPHER 7264 030714.txt\n",
    "* CityofLA/Job Bulletins/SENIOR LIBRARIAN 6153 033117.txt\n",
    "* CityofLA/Job Bulletins/SENIOR LOAD DISPATCHER 5235 060118.txt\n",
    "* CityofLA/Job Bulletins/SENIOR MACHINIST SUPERVISOR 3768 051016.txt\n",
    "* CityofLA/Job Bulletins/SENIOR MANAGEMENT ANALYST 9171 040618.txt\n",
    "* CityofLA/Job Bulletins/SENIOR MECHANICAL ENGINEERING DRAFTING TECHNICIAN 7210 110416.txt\n",
    "* CityofLA/Job Bulletins/SENIOR MECHANICAL REPAIRER 3772 030416.txt\n",
    "* CityofLA/Job Bulletins/SENIOR PAINTER 3424 041318.txt\n",
    "* CityofLA/Job Bulletins/SENIOR PARK MAINTENANCE SUPERVISOR 3146 101416.txt\n",
    "* CityofLA/Job Bulletins/SENIOR PARK RANGER 1967 091815.txt\n",
    "* CityofLA/Job Bulletins/SENIOR PARKING ATTENDANT 3529 032417.txt\n",
    "* CityofLA/Job Bulletins/SENIOR PHOTOGRAPHER 1795 041516 REVISED 042816.txt\n",
    "* CityofLA/Job Bulletins/SENIOR PLUMBER 3444 020516.txt\n",
    "* CityofLA/Job Bulletins/SENIOR PLUMBING INSPECTOR 4233 051818.txt\n",
    "* CityofLA/Job Bulletins/SENIOR POLICE SERVICE REPRESENTATIVE 2209 020918.txt\n",
    "* CityofLA/Job Bulletins/SENIOR PROPERTY OFFICER 3209 012618.txt\n",
    "* CityofLA/Job Bulletins/SENIOR RECREATION DIRECTOR 2446 050517 REV 051117.txt\n",
    "* CityofLA/Job Bulletins/SENIOR ROOFER 3477 101708 REV 110608.txt\n",
    "* CityofLA/Job Bulletins/SENIOR SAFETY ENGINEER ELEVATORS 4264  042718.txt\n",
    "* CityofLA/Job Bulletins/SENIOR SECURITY OFFICER 3184 122818.txt\n",
    "* CityofLA/Job Bulletins/SENIOR STOREKEEPER 1837 052518.txt\n",
    "* CityofLA/Job Bulletins/SENIOR SYSTEMS ANALYST 1597 100617.txt\n",
    "* CityofLA/Job Bulletins/SENIOR TITLE EXAMINER 1947 121517.txt\n",
    "* CityofLA/Job Bulletins/SENIOR TRAFFIC SUPERVISOR 3218 121517.txt\n",
    "* CityofLA/Job Bulletins/SENIOR TRANSPORTATION INVESTIGATOR 4273 070717 (2).txt\n",
    "* CityofLA/Job Bulletins/SENIOR UNDERGROUND DISTRIBUTION CONSTRUCTION SUPERVISOR 3815 072817.txt\n",
    "* CityofLA/Job Bulletins/SENIOR UTILITY ACCOUNTANT 1521 100716.txt\n",
    "* CityofLA/Job Bulletins/SENIOR UTILITY BUYER 1862 052518.txt\n",
    "* CityofLA/Job Bulletins/SENIOR UTILITY SERVICES SPECIALIST 3573 113018.txt\n",
    "* CityofLA/Job Bulletins/SENIOR UTILITY SERVICES SPECIALIST 3753 121815 (1).txt\n",
    "* CityofLA/Job Bulletins/SENIOR WINDOW CLEANER 3174 013114 Rev021314.txt\n",
    "* CityofLA/Job Bulletins/SHEET METAL SUPERVISOR 3777 061314.txt\n",
    "* CityofLA/Job Bulletins/SHEET METAL WORKER 3775 093016.txt\n",
    "* CityofLA/Job Bulletins/SHIFT SUPERINTENDENT WASTEWATER TREATMENT 7242 072415.txt\n",
    "* CityofLA/Job Bulletins/SHOPS SUPERINTENDENT 3780 051118.txt\n",
    "* CityofLA/Job Bulletins/SIGN PAINTER 3428 121214.txt\n",
    "* CityofLA/Job Bulletins/SIGN SHOP SUPERVISOR 3419 030615.txt\n",
    "* CityofLA/Job Bulletins/SIGNAL SYSTEMS SUPERINTENDENT 3832 110416.txt\n",
    "* CityofLA/Job Bulletins/SIGNAL SYSTEMS SUPERVISOR 3839 092818.txt\n",
    "* CityofLA/Job Bulletins/SOCIAL WORKER 2385 102717  revised.txt\n",
    "* CityofLA/Job Bulletins/SOLID RESOURCES SUPERINTENDENT 4102 031017 REV 032317 (2).txt\n",
    "* CityofLA/Job Bulletins/SPECIAL INVESTIGATOR 0602 042216.txt\n",
    "* CityofLA/Job Bulletins/SR CRIME _ INTELLIGENCE ANALYST 2241 011516.txt\n",
    "* CityofLA/Job Bulletins/STAFF ASSISTANT TO GENERAL MANAGER WATER AND POWER 9185 032715.txt\n",
    "* CityofLA/Job Bulletins/STEAM PLANT MAINTENANCE MECHANIC 5630 0902116.txt\n",
    "* CityofLA/Job Bulletins/STEAM PLANT MAINTENANCE SUPERVISOR 3786 033117.txt\n",
    "* CityofLA/Job Bulletins/STEAM PLANT OPERATOR 5624 101416.txt\n",
    "* CityofLA/Job Bulletins/STORES SUPERVISOR 1866 122917.txt\n",
    "* CityofLA/Job Bulletins/STREET LIGHTING CONSTRUCTION AND MAINTENANCE SUPERINTENDENT 3820 051818.txt\n",
    "* CityofLA/Job Bulletins/STREET LIGHTING ELECTRICIAN SUPERVISOR 3840 031717.txt\n",
    "* CityofLA/Job Bulletins/STREET LIGHTING ENGINEERING ASSOCIATE 7527 101102 REV 032916.txt\n",
    "* CityofLA/Job Bulletins/STREET SERVICES GENERAL SUPERINTENDENT 4160 042916.txt\n",
    "* CityofLA/Job Bulletins/STREET SERVICES INVESTIGATOR 4283 102315 REV 110315.txt\n",
    "* CityofLA/Job Bulletins/STREET SERVICES SUPERVISOR 4152 082815.txt\n",
    "* CityofLA/Job Bulletins/STREET SERVICES WORKER 4150 032318.txt\n",
    "* CityofLA/Job Bulletins/STREET TREE SUPERINTENDENT 3160 060917.txt\n",
    "* CityofLA/Job Bulletins/STRUCTURAL ENGINEER 7956 101918.txt\n",
    "* CityofLA/Job Bulletins/STRUCTURAL STEEL FABRICATOR 3793 122316.txt\n",
    "* CityofLA/Job Bulletins/STRUCTURAL STEEL FABRICATOR SUPERVISOR 3794 060217.txt\n",
    "* CityofLA/Job Bulletins/SUPERINTENDENT OF RECREATION AND PARKS OPERATIONS 2472 012618.txt\n",
    "* CityofLA/Job Bulletins/SUPERVISING CRIMINALIST 2235 030416.txt\n",
    "* CityofLA/Job Bulletins/SUPERVISING OCCUPATIONAL HEALTH  2315 111414.txt\n",
    "* CityofLA/Job Bulletins/SUPERVISING TRANSPORTATION PLANNER 2481 072216.txt\n",
    "* CityofLA/Job Bulletins/SUPERVISING WATER SERVICE REPRESENTATIVE 1697 081318.txt\n",
    "* CityofLA/Job Bulletins/SURVEY PARTY CHIEF 7286 093016.txt\n",
    "* CityofLA/Job Bulletins/SURVEY SUPERVISOR 7287 110918.txt\n",
    "* CityofLA/Job Bulletins/SYSTEMS AIDE 1599 070116.txt\n",
    "* CityofLA/Job Bulletins/SYSTEMS PROGRAMMER 1455 091616 REV 100416.txt\n",
    "* CityofLA/Job Bulletins/TAX COMPLIANCE AIDE 1173 061215 (1).txt\n",
    "* CityofLA/Job Bulletins/TAX COMPLIANCE OFFICER 1179 111816.txt\n",
    "* CityofLA/Job Bulletins/TILE SETTER 3493 090415.txt\n",
    "* CityofLA/Job Bulletins/TITLE EXAMINER 1943 032318 REV 040518.txt\n",
    "* CityofLA/Job Bulletins/TRAFFIC MARKING AND SIGN SUPERINTENDENT 3430 032219.txt\n",
    "* CityofLA/Job Bulletins/TRAFFIC OFFICER 3214 040116.txt\n",
    "* CityofLA/Job Bulletins/TRAFFIC PAINTER AND SIGN POSTER 3421 033117.txt\n",
    "* CityofLA/Job Bulletins/TRANSMISSION AND DISTRIBUTION DISTRICT SUPERVISOR 3875 050418 REV 051718.txt\n",
    "* CityofLA/Job Bulletins/TRANSPORTATION ENGINEER 7278 092917.txt\n",
    "* CityofLA/Job Bulletins/TRANSPORTATION ENGINEERING AIDE 7285 100915.txt\n",
    "* CityofLA/Job Bulletins/TRANSPORTATION ENGINEERING ASSOCIATE 7280 072415.txt\n",
    "* CityofLA/Job Bulletins/TRANSPORTATION INVESTIGATOR 4271 061016.txt\n",
    "* CityofLA/Job Bulletins/TRANSPORTATION PLANNING ASSOCIATE 2480 072018.txt\n",
    "* CityofLA/Job Bulletins/TREE SURGEON ASSISTANT 3151 060316.txt\n",
    "* CityofLA/Job Bulletins/TRUCK OPERATOR 3583 012618.txt\n",
    "* CityofLA/Job Bulletins/UNDERGROUND DISTRIBUTION CONSTRUCTION SUPERVISOR 3814 121418 REV 122718 (1).txt\n",
    "* CityofLA/Job Bulletins/UPHOLSTERER 3723 041715.txt\n",
    "* CityofLA/Job Bulletins/UTILITIES SERVICE INVESTIGATOR 1631 101615 (1).txt\n",
    "* CityofLA/Job Bulletins/UTILITY ACCOUNTANT 1511 092818.txt\n",
    "* CityofLA/Job Bulletins/UTILITY ADMINISTRATOR 9105 060217.txt\n",
    "* CityofLA/Job Bulletins/UTILITY BUYER 1861 090718.txt\n",
    "* CityofLA/Job Bulletins/UTILITY EXECUTIVE SECRETARY 1336 042817 (1).txt\n",
    "* CityofLA/Job Bulletins/UTILITY SERVICES SPECIALIST 3755 072117 (1).txt\n",
    "* CityofLA/Job Bulletins/VETERINARY TECHNICIAN 2369 020599 REV 120417.txt\n",
    "* CityofLA/Job Bulletins/VIDEO TECHNICIAN 6145 012717.txt\n",
    "* CityofLA/Job Bulletins/WASTEWATER TREATMENT ELECTRICIAN SUPERVISOR 5613 060515.txt\n",
    "* CityofLA/Job Bulletins/WATER BIOLOGIST 7856 120216.txt\n",
    "* CityofLA/Job Bulletins/WATER MICROBIOLOGIST  7857 072514 rev073114.txt\n",
    "* CityofLA/Job Bulletins/WATER SERVICE REPRESENTATIVE 1693 111717.txt\n",
    "* CityofLA/Job Bulletins/WATER SERVICE SUPERVISOR 3930 012717.txt\n",
    "* CityofLA/Job Bulletins/WATER TREATMENT OPERATOR 5885 122118.txt\n",
    "* CityofLA/Job Bulletins/WATER TREATMENT SUPERVISOR 5887 072018.txt\n",
    "* CityofLA/Job Bulletins/WATER UTILITY SUPERINTENDENT 3980 121418.txt\n",
    "* CityofLA/Job Bulletins/WATERSHED RESOURCES SPECIALIST  7862 080516 (1).txt\n",
    "* CityofLA/Job Bulletins/WATERWORKS ENGINEER 7248 071516 (1).txt\n",
    "* CityofLA/Job Bulletins/WATERWORKS MECHANIC SUPERVISOR 3987 051614 (1).txt\n",
    "* CityofLA/Job Bulletins/WELDER SUPERVISOR 3798 120817.txt\n",
    "* CityofLA/Job Bulletins/WORKERS_ COMPENSATION ANALYST 1774 032417R.txt\n",
    "* CityofLA/Job Bulletins/WORKERS_ COMPENSATION CLAIMS ASSISTANT 1775 041114.txt\n",
    "* CityofLA/Job Bulletins/X-RAY AND LABORATORY TECHNICIAN 2358 012916.txt\n",
    "* CityofLA/Job Bulletins/ZOO CURATOR 4297 040816.txt"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "**Let's rerun the function and observe the changes. Note we use .txt files in the JobBulletins_cleaned folder.**\n",
    "\n",
    "Observing the printouts carefully this time, we see that all of the nuances above have been resolved."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 6,
   "metadata": {},
   "outputs": [],
   "source": [
    "# Rerun the code above to check if every job has the pharase 'REQUIREMENTS/MINIMUM QUALIFICATIONS' in it.\n",
    "# If nothing gets printed out, that means we pass the test.\n",
    "for file_name in cleaned_jobs:\n",
    "    job_path     = cleaned_path + file_name    # define path to file_name\n",
    "    cleaned_job  = open(job_path, 'rt').read() # read in job as a string\n",
    "    try:\n",
    "        if 'REQUIREMENTS/MINIMUM QUALIFICATIONS' not in cleaned_job.split('\\n'):\n",
    "            print(job_path)\n",
    "    except:                                    # do some pretty printings here to help our eyes from pain\n",
    "        ## define some useful variables\n",
    "        border_line = '##############################################################################################'\n",
    "        how_many    = int((len(border_line) - len(job_path))/2)\n",
    "        print(border_line)\n",
    "        ## do pretty printings\n",
    "        print('#'*how_many + job_path + '#'*how_many)\n",
    "        print(border_line)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Finally, since our code depends on a strict logical order of sections in a job posting, we want to make sure that there is no other section between DUTIES and REQUIREMENTS/MINIMUM QUALIFICATIONS. Now, you can understand why the labor-intensive work we've done so far has started to pay off. Experience shows that sometimes there is a NOTE: or NOTES: section follows DUTIES before REQUIREMENTS/MINIMUM QUALIFICATIONS, although this doesn't happen a lot. The code below thus attempts to identify which job has this pattern. If there is one, we'll move it to **before** DUTIES and change it to NOTES (without colon to avoid confusion with another NOTES:). Also note that we're verifying this on .txt files in JobBulletings_cleaned."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 7,
   "metadata": {},
   "outputs": [],
   "source": [
    "# Make sure there is no other section between DUTIES and REQUIREMENTS/MINIMUM QUALIFICATIONS.\n",
    "for file_name in cleaned_jobs:\n",
    "    job_path     = cleaned_path + file_name    # define path to file_name\n",
    "    cleaned_job  = open(job_path, 'rt').read() # read in job as a string\n",
    "    try:\n",
    "        txt = (cleaned_job[cleaned_job.index('DUTIES')\n",
    "                            :cleaned_job.index('REQUIREMENTS/MINIMUM QUALIFICATIONS')]) # extract relevant text\n",
    "        txt = txt.replace(':', ' ')             # strip off colons\n",
    "        if ('NOTES' in txt) or ('NOTE' in txt): # search for NOTES or NOTE\n",
    "            print(job_path)\n",
    "    except:                                    # do some pretty printings here to help our eyes from pain\n",
    "        ## define some useful variables\n",
    "        border_line = '##############################################################################################'\n",
    "        how_many    = int((len(border_line) - len(job_path))/2)\n",
    "        print(border_line)\n",
    "        ## do pretty printings\n",
    "        print('#'*how_many + job_path + '#'*how_many)\n",
    "        print(border_line)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "There were a few of these but I forgot to note them. Anyways, as mentioned,they were moved to before DUTIES and changed the section's name to NOTES."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "**Let's rerun the function and observe the changes. Note we use .txt files in the JobBulletins_cleaned folder.**\n",
    "\n",
    "Observing the printouts carefully this time, we see that all of the nuances above have been resolved."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 14,
   "metadata": {},
   "outputs": [],
   "source": [
    "# Make sure there is no other section between DUTIES and REQUIREMENTS/MINIMUM QUALIFICATIONS.\n",
    "for file_name in cleaned_jobs:\n",
    "    job_path     = cleaned_path + file_name    # define path to file_name\n",
    "    cleaned_job  = open(job_path, 'rt').read() # read in job as a string\n",
    "    try:\n",
    "        txt = (cleaned_job[cleaned_job.index('DUTIES')\n",
    "                            :cleaned_job.index('REQUIREMENTS/MINIMUM QUALIFICATIONS')]) # extract relevant text\n",
    "        txt = txt.replace(':', ' ')             # strip off colons\n",
    "        if ('NOTES' in txt) or ('NOTE' in txt): # search for NOTES or NOTE\n",
    "            print(job_path)\n",
    "    except:                                    # do some pretty printings here to help our eyes from pain\n",
    "        ## define some useful variables\n",
    "        border_line = '##############################################################################################'\n",
    "        how_many    = int((len(border_line) - len(job_path))/2)\n",
    "        print(border_line)\n",
    "        ## do pretty printings\n",
    "        print('#'*how_many + job_path + '#'*how_many)\n",
    "        print(border_line)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": [
    "# Define a function\n",
    "def job_duties(job):\n",
    "    '''Returns JOB_DUTIES (jd)'''\n",
    "    # From DUTIES to REQUIREMENTS/MINIMUM QUALIFICATIONS is where the information located\n",
    "    temp = job[job.find('DUTIES'):job.find('REQUIREMENTS/MINIMUM QUALIFICATIONS')]\n",
    "    # Split at white space and ignore the 0th element (the word 'DUTIES')\n",
    "    temp = temp.split()[1:]\n",
    "    # Join with white space to get the required format\n",
    "    duties = ' '.join(temp)\n",
    "    \n",
    "    return duties\n",
    "\n",
    "# Test\n",
    "job_duties(job=sa)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Get DRIVERS_LICENSE_REQ\n",
    "This takes quite a few steps to set up so we can make sure that the acquired result is accurate. First, we write a very simple function to detect which job requires applicant to have a valid driver license. The idea is that if a sentence has the word driver and if it has the word 'may' in it, then a driver's license is optional; otherwise, a it is required. Note that the code is structured for the purpose of identifying as many jobs with driver's licenses as it can. That is, if the word **may** doesn't exist, then the code will \"force\" the job to require a driver's license. Thus, even though we start with a simple function and may not give accurate results, the final output will be accurate since we can look at the printouts from this function and clean our data."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 8,
   "metadata": {},
   "outputs": [],
   "source": [
    "# This is a helper function\n",
    "def drivers_license_req(job):\n",
    "    '''Returns DRIVERS_LICENSE_REQ(dlr)'''\n",
    "    # Locate the information\n",
    "    temp = job[job.index('PROCESS NOTES'):]\n",
    "    temp = temp.split('\\n')\n",
    "\n",
    "    # Determine whether driver license is required for the job\n",
    "    # The approach I took here was to look at each sentence based on their index in temp.\n",
    "    dlr = []\n",
    "    for possibly_contains_dlr in temp:\n",
    "        if 'driver' in possibly_contains_dlr:\n",
    "            DL_info = ([e for e in possibly_contains_dlr.split('.') if len(e) > 3])\n",
    "            for sentence in DL_info:\n",
    "                if 'may' in sentence:\n",
    "                    dlr.append('P')\n",
    "                    break\n",
    "                else:\n",
    "                    dlr.append('R')\n",
    "                    break\n",
    "            break\n",
    "    # Returns\n",
    "    return dlr"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Next, we look at which job requires a driver license and then we'll add these cues \" ^^^ @@@\" within the sentence. These cues will captured what type of driver license is required. We have to do this manually."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 9,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "CityofLA/JobBulletins_cleaned/AIR CONDITIONING MECHANIC 3774 041417.txt\n",
      "CityofLA/JobBulletins_cleaned/AIR CONDITIONING MECHANIC SUPERVISOR 3781 111618 2.txt\n",
      "CityofLA/JobBulletins_cleaned/AIRPORT ENGINEER 7256 070618.txt\n",
      "CityofLA/JobBulletins_cleaned/AIRPORT INFORMATION SPECIALIST 1783 121115.txt\n",
      "CityofLA/JobBulletins_cleaned/AIRPORT POLICE CAPTAIN 3228 021618.txt\n",
      "CityofLA/JobBulletins_cleaned/AIRPORT POLICE LIEUTENANT 3227 091616.txt\n",
      "CityofLA/JobBulletins_cleaned/AIRPORT POLICE OFFICER 3225 110906 Rev 060115.txt\n",
      "CityofLA/JobBulletins_cleaned/AIRPORT POLICE SPECIALIST 3236 063017 (2).txt\n",
      "CityofLA/JobBulletins_cleaned/AIRPORT SUPERINTENDENT OF OPERATIONS 7268 121815 (1).txt\n",
      "CityofLA/JobBulletins_cleaned/ANIMAL CARE ASSISTANT 4323 020119.txt\n",
      "CityofLA/JobBulletins_cleaned/ANIMAL CARE TECHNICIAN 4310 040116 REV 041416.txt\n",
      "CityofLA/JobBulletins_cleaned/ANIMAL CARE TECHNICIAN SUPERVISOR 4313 122118.txt\n",
      "CityofLA/JobBulletins_cleaned/ANIMAL CONTROL OFFICER  4311 061518.txt\n",
      "CityofLA/JobBulletins_cleaned/APPARATUS OPERATOR 2121 071417 (1).txt\n",
      "CityofLA/JobBulletins_cleaned/APPRENTICE - METAL TRADES 3789 070816.txt\n",
      "CityofLA/JobBulletins_cleaned/APPRENTICE MACHINIST 3764 071516.txt\n",
      "CityofLA/JobBulletins_cleaned/AQUATIC DIRECTOR 2419  082517 REV 0090717.txt\n",
      "CityofLA/JobBulletins_cleaned/AQUEDUCT AND RESERVOIR SUPERVISOR 5816 091115.txt\n",
      "CityofLA/JobBulletins_cleaned/ARCHITECT 7925 033018.txt\n",
      "CityofLA/JobBulletins_cleaned/ART CURATOR 2448 071516 REV 072816.txt\n",
      "CityofLA/JobBulletins_cleaned/ASBESTOS WORKER 3435 100518.txt\n",
      "CityofLA/JobBulletins_cleaned/ASPHALT PLANT SUPERVISOR 4145 110317.txt\n",
      "CityofLA/JobBulletins_cleaned/ASSISTANT AIRPORT MANAGER 7259 012618.txt\n",
      "CityofLA/JobBulletins_cleaned/ASSISTANT COMMUNICATIONS CABLE WORKER 3808 080417 REVISED 081717.txt\n",
      "CityofLA/JobBulletins_cleaned/ASSISTANT RETIREMENT PLAN MANAGER 9415 050616.txt\n",
      "CityofLA/JobBulletins_cleaned/ASSISTANT STREET LIGHTING ELECTRICIAN 3809 072117 REV 080818.txt\n",
      "CityofLA/JobBulletins_cleaned/AVIONICS SPECIALIST 3565 103114revised.txt\n",
      "CityofLA/JobBulletins_cleaned/BACKGROUND INVESTIGATION MANAGER 1759 060917 (2).txt\n",
      "CityofLA/JobBulletins_cleaned/BLACKSMITH 3733 082517 REV 090717.txt\n",
      "CityofLA/JobBulletins_cleaned/BOILERMAKER SUPERVISOR 3737 101714.txt\n",
      "CityofLA/JobBulletins_cleaned/BUILDING ELECTRICAL ENGINEER 7543 071516 REV 071816.txt\n",
      "CityofLA/JobBulletins_cleaned/BUILDING INSPECTOR 4211 101918.txt\n",
      "CityofLA/JobBulletins_cleaned/BUILDING MECHANICAL INSPECTOR 4251 082815 REV 080818.txt\n",
      "CityofLA/JobBulletins_cleaned/BUILDING REPAIR SUPERVISOR 3338 111816.txt\n",
      "CityofLA/JobBulletins_cleaned/BUS OPERATOR 3588 090216.txt\n",
      "CityofLA/JobBulletins_cleaned/BUS OPERATOR SUPERVISOR 3589 012216.txt\n",
      "CityofLA/JobBulletins_cleaned/CABLE TELEVISION PRODUCTION MANAGER 1801 121418.txt\n",
      "CityofLA/JobBulletins_cleaned/CARPET LAYER 3418 061915.txt\n",
      "CityofLA/JobBulletins_cleaned/CEMENT FINISHER WORKER 3351 103015.txt\n",
      "CityofLA/JobBulletins_cleaned/CHEMIST  7833 102017.txt\n",
      "CityofLA/JobBulletins_cleaned/CHIEF FORENSIC CHEMIST 2237 092818.txt\n",
      "CityofLA/JobBulletins_cleaned/CHIEF INSPECTOR 4254 082517.txt\n",
      "CityofLA/JobBulletins_cleaned/CHIEF OF OPERATIONS 7258 042018 REV 051318.txt\n",
      "CityofLA/JobBulletins_cleaned/CHIEF OF PARKING ENFORCEMENT OPERATIONS 9180 031618.txt\n",
      "CityofLA/JobBulletins_cleaned/CHIEF PORT PILOT 5154 031816.txt\n",
      "CityofLA/JobBulletins_cleaned/CHIEF SAFETY ENGINEER PRESSURE VESSELS 4260 120916 REV 122016.txt\n",
      "CityofLA/JobBulletins_cleaned/CHIEF SECURITY OFFICER 3187 092818.txt\n",
      "CityofLA/JobBulletins_cleaned/CHIEF STREET SERVICES INVESTIGATOR 4286 2017Revised 11.21.txt\n",
      "CityofLA/JobBulletins_cleaned/CHIEF TRANSPORTATION INVESTIGATOR 4275 103114.txt\n",
      "CityofLA/JobBulletins_cleaned/CLAIMS AGENT 1767 020317.txt\n",
      "CityofLA/JobBulletins_cleaned/COMMERCIAL FIELD REPRESENTATIVE 1600 120718.txt\n",
      "CityofLA/JobBulletins_cleaned/COMMERCIAL FIELD SUPERVISOR 1603 121616.txt\n",
      "CityofLA/JobBulletins_cleaned/COMMUNICATIONS CABLE SUPERVISOR 3800 051917 REVISED 060117.txt\n",
      "CityofLA/JobBulletins_cleaned/CONSTRUCTION ESTIMATOR 3341 070816 REVISED 072116 (1).txt\n",
      "CityofLA/JobBulletins_cleaned/CONTRACT ADMINISTRATOR 9168 031017.txt\n",
      "CityofLA/JobBulletins_cleaned/CONTROL SYSTEMS ENGINEERING ASSOCIATE 7230 090817 (1).txt\n",
      "CityofLA/JobBulletins_cleaned/CRIMINALIST 2234 030918.txt\n",
      "CityofLA/JobBulletins_cleaned/DECK HAND 5131 093016.txt\n",
      "CityofLA/JobBulletins_cleaned/DELIVERY DRIVER 1121 032318.txt\n",
      "CityofLA/JobBulletins_cleaned/DETENTION OFFICER 3211 113018.txt\n",
      "CityofLA/JobBulletins_cleaned/DIRECTOR OF AIRPORT MARKETING 1768 042718.txt\n",
      "CityofLA/JobBulletins_cleaned/DIRECTOR OF AIRPORT OPERATIONS 9304 062317 (3).txt\n",
      "CityofLA/JobBulletins_cleaned/DIRECTOR OF AIRPORTS ADMINISTRATION 9302 012717.txt\n",
      "CityofLA/JobBulletins_cleaned/DIRECTOR OF COMMUNICATIONS SERVICES 7625 042718.txt\n",
      "CityofLA/JobBulletins_cleaned/DIRECTOR OF FIELD OPERATIONS 4321 040618.txt\n",
      "CityofLA/JobBulletins_cleaned/DIRECTOR OF POLICE TRANSPORTATION 3722 061915.txt\n",
      "CityofLA/JobBulletins_cleaned/DIRECTOR OF PORT CONSTRUCTION AND MAINTENANCE 3123 030416.txt\n",
      "CityofLA/JobBulletins_cleaned/DIRECTOR OF PRINTING SERVICES 1488 101218 REV 102418 (3).txt\n",
      "CityofLA/JobBulletins_cleaned/DIRECTOR OF SECURITY SERVICES 3208 040717.txt\n",
      "CityofLA/JobBulletins_cleaned/DISTRICT SUPERVISOR ANIMAL SERVICES 4320 022318.txt\n",
      "CityofLA/JobBulletins_cleaned/DRILL RIG OPERATOR 3521 033018.txt\n",
      "CityofLA/JobBulletins_cleaned/ELECTRIC DISTRIBUTION MECHANIC 3879 040717.txt\n",
      "CityofLA/JobBulletins_cleaned/ELECTRIC DISTRIBUTION MECHANIC SUPERVISOR 3873 102816.txt\n",
      "CityofLA/JobBulletins_cleaned/ELECTRICAL INSPECTOR 4221 030218.txt\n",
      "CityofLA/JobBulletins_cleaned/ELECTRICAL MECHANIC 3841 012017.txt\n",
      "CityofLA/JobBulletins_cleaned/ELECTRICAL REPAIR SUPERVISOR 3855 092217 (7).txt\n",
      "CityofLA/JobBulletins_cleaned/ELECTRICAL REPAIRER 3853 122917 updated.txt\n",
      "CityofLA/JobBulletins_cleaned/ELECTRICAL TESTER 7512 102816.txt\n",
      "CityofLA/JobBulletins_cleaned/EMERGENCY MANAGEMENT COORDINATOR 1702 102618.txt\n",
      "CityofLA/JobBulletins_cleaned/EMERGENCY MEDICAL SERVICES EDUCATOR  2322 110615 REV 112515.txt\n",
      "CityofLA/JobBulletins_cleaned/EMS ADVANCED PROVIDER 2341 111618 REV 122018.txt\n",
      "CityofLA/JobBulletins_cleaned/EMS NURSE PRACTITIONER SUPERVISOR 2340 031116 REV 032316 (1).txt\n",
      "CityofLA/JobBulletins_cleaned/ENVIRONMENTAL AFFAIRS OFFICER 7320 061518.txt\n",
      "CityofLA/JobBulletins_cleaned/ENVIRONMENTAL COMPLIANCE INSPECTOR 4292 080516 REV 081616.txt\n",
      "CityofLA/JobBulletins_cleaned/ENVIRONMENTAL ENGINEER  7872 082616 REV 090116.txt\n",
      "CityofLA/JobBulletins_cleaned/EQUIPMENT MECHANIC 3711 051818.txt\n",
      "CityofLA/JobBulletins_cleaned/EXAMINER OF QUESTIONED DOCUMENTS 3229 120415.txt\n",
      "CityofLA/JobBulletins_cleaned/EXHIBIT PREPARATOR 2444 062416.txt\n",
      "CityofLA/JobBulletins_cleaned/FIELD ENGINEERING AIDE 7228 092316 REV 080718 (2).txt\n",
      "CityofLA/JobBulletins_cleaned/FINANCIAL DEVELOPMENT OFFICER 1571 102017 revised.txt\n",
      "CityofLA/JobBulletins_cleaned/FINGERPRINT IDENTIFICATION EXPERT 1157 052915.txt\n",
      "CityofLA/JobBulletins_cleaned/FIRE INSPECTOR 2128 031717.txt\n",
      "CityofLA/JobBulletins_cleaned/FIRE SPRINKLER INSPECTOR 4240 062317 REVISED 070617 (2).txt\n",
      "CityofLA/JobBulletins_cleaned/FIREFIGHTER 2112 011918.txt\n",
      "CityofLA/JobBulletins_cleaned/FORENSIC  PRINT SPECIALIST 2200 062218.txt\n",
      "CityofLA/JobBulletins_cleaned/GARAGE ATTENDANT 3531 013015.txt\n",
      "CityofLA/JobBulletins_cleaned/GENERAL SERVICES MANAGER  9601 042117.txt\n",
      "CityofLA/JobBulletins_cleaned/GEOTECHNICAL ENGINEER 7239 090718 REV 092018.txt\n",
      "CityofLA/JobBulletins_cleaned/GOLF STARTER 2453 121115.txt\n",
      "CityofLA/JobBulletins_cleaned/GOLF STARTER SUPERVISOR 2479 120817.txt\n",
      "CityofLA/JobBulletins_cleaned/HARBOR PLANNING AND ECONOMIC ANALYST 9224 111816 REV 112916.txt\n",
      "CityofLA/JobBulletins_cleaned/HARBOR PLANNING AND RESEARCH DIRECTOR 9234 081018 REV 082318.txt\n",
      "CityofLA/JobBulletins_cleaned/HEATING AND REFRIGERATION INSPECTOR 4245 121115.txt\n",
      "CityofLA/JobBulletins_cleaned/HOUSING INSPECTOR 4243 070618 REV 010819.txt\n",
      "CityofLA/JobBulletins_cleaned/HOUSING INVESTIGATOR 8516 062918.txt\n",
      "CityofLA/JobBulletins_cleaned/HOUSING PLANNING AND ECONOMIC ANALYST 8504 Bulletin FINAL DRAFT.txt\n",
      "CityofLA/JobBulletins_cleaned/IMPROVEMENT ASSESSOR SUPERVISOR 1564 100215.txt\n",
      "CityofLA/JobBulletins_cleaned/INDUSTRIAL AND COMMERCIAL FINANCE OFFICER 9191 rev051515.txt\n",
      "CityofLA/JobBulletins_cleaned/INDUSTRIAL GRAPHICS SUPERVISOR 1490 052518.txt\n",
      "CityofLA/JobBulletins_cleaned/INDUSTRIAL HYGIENIST 2330 012618.txt\n",
      "CityofLA/JobBulletins_cleaned/INSTRUMENT MECHANIC 3843 060818 2.txt\n",
      "CityofLA/JobBulletins_cleaned/INSTRUMENT MECHANIC SUPERVISOR 3844 051917 final.txt\n",
      "CityofLA/JobBulletins_cleaned/LANDSCAPE ARCHITECT 7929 090718.txt\n",
      "CityofLA/JobBulletins_cleaned/LEGISLATIVE REPRESENTATIVE 9482 122917.txt\n",
      "CityofLA/JobBulletins_cleaned/LICENSED VOCATIONAL NURSE  2332 042415.txt\n",
      "CityofLA/JobBulletins_cleaned/LINE MAINTENANCE ASSISTANT 3882 122818.txt\n",
      "CityofLA/JobBulletins_cleaned/MANAGING WATER UTILITY ENGINEER 9406 032417 REV 040417.txt\n",
      "CityofLA/JobBulletins_cleaned/MARINE AQUARIUM CURATOR 2425 091517.txt\n",
      "CityofLA/JobBulletins_cleaned/MARINE AQUARIUM PROGRAM DIRECTOR 2403 082517.txt\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "CityofLA/JobBulletins_cleaned/MARINE ENVIRONMENTAL SUPERVISOR 9433 071114 (1).txt\n",
      "CityofLA/JobBulletins_cleaned/MECHANICAL REPAIR GENERAL SUPERVISOR 3731 040116 REV 041416.txt\n",
      "CityofLA/JobBulletins_cleaned/METER READER 1611 080715.txt\n",
      "CityofLA/JobBulletins_cleaned/MOTION PICTURE AND TELEVISION MANAGER 1789 111717.txt\n",
      "CityofLA/JobBulletins_cleaned/MOTOR SWEEPER OPERATOR 3585 031618.txt\n",
      "CityofLA/JobBulletins_cleaned/PARK MAINTENANCE SUPERVISOR 3145 102618.txt\n",
      "CityofLA/JobBulletins_cleaned/PARK RANGER 1966 072718 REV 073118 (1).txt\n",
      "CityofLA/JobBulletins_cleaned/PARK SERVICES SUPERVISOR 2426 072018.txt\n",
      "CityofLA/JobBulletins_cleaned/PARKING ATTENDANT 3530 042718 (4).txt\n",
      "CityofLA/JobBulletins_cleaned/PARKING ENFORCEMENT MANAGER 9025 021916 rev022516.txt\n",
      "CityofLA/JobBulletins_cleaned/PARKING METER TECHNICIAN 3738 110615 (1).txt\n",
      "CityofLA/JobBulletins_cleaned/PARKING METER TECHNICIAN SUPERVISOR 3757 2017.txt\n",
      "CityofLA/JobBulletins_cleaned/PERFORMING ARTS DIRECTOR 2449 020317 REV 020817.txt\n",
      "CityofLA/JobBulletins_cleaned/PILE DRIVER WORKER 3553 041417.txt\n",
      "CityofLA/JobBulletins_cleaned/PIPEFITTER SUPERVISOR 3438 081216.txt\n",
      "CityofLA/JobBulletins_cleaned/PLUMBER SUPERVISOR 3446 100518.txt\n",
      "CityofLA/JobBulletins_cleaned/PLUMBING INSPECTOR 4231 042817 REV 051117.txt\n",
      "CityofLA/JobBulletins_cleaned/POLICE ADMINISTRATOR 9196 100617.txt\n",
      "CityofLA/JobBulletins_cleaned/POLICE OFFICER 2214 110906 Rev 060115.txt\n",
      "CityofLA/JobBulletins_cleaned/POLICE SPECIALIST 2217 110906 Rev 060115.txt\n",
      "CityofLA/JobBulletins_cleaned/POLICE SURVEILLANCE SPECIALIST 3687 052215.txt\n",
      "CityofLA/JobBulletins_cleaned/PORT ELECTRICAL MECHANIC 3758 022616.txt\n",
      "CityofLA/JobBulletins_cleaned/PORT ELECTRICAL MECHANIC SUPERVISOR 3759 031816.txt\n",
      "CityofLA/JobBulletins_cleaned/PORT MAINTENANCE SUPERVISOR 3128 052016 REV 060216.txt\n",
      "CityofLA/JobBulletins_cleaned/PORT PILOT 5151 081817 REV 090717.txt\n",
      "CityofLA/JobBulletins_cleaned/PORT POLICE CAPTAIN 3224 110416.txt\n",
      "CityofLA/JobBulletins_cleaned/PORT POLICE LIEUTENANT 3223 120916.txt\n",
      "CityofLA/JobBulletins_cleaned/PORT POLICE OFFICER 3221 110906 Rev 060115.txt\n",
      "CityofLA/JobBulletins_cleaned/PORT POLICE SERGEANT 3222 121616.txt\n",
      "CityofLA/JobBulletins_cleaned/PORTFOLIO MANAGER 9143 082517.txt\n",
      "CityofLA/JobBulletins_cleaned/PRINCIPAL ANIMAL KEEPER 4312 070618.txt\n",
      "CityofLA/JobBulletins_cleaned/PRINCIPAL PROPERTY OFFICER 3210 121517.txt\n",
      "CityofLA/JobBulletins_cleaned/PRINCIPAL RECREATION SUPERVISOR 2464 021618.txt\n",
      "CityofLA/JobBulletins_cleaned/PRINCIPAL TAX COMPLIANCE OFFICER 1195 030218.txt\n",
      "CityofLA/JobBulletins_cleaned/PROPERTY OFFICER 3207 071417 (1).txt\n",
      "CityofLA/JobBulletins_cleaned/PUBLIC SAFETY RISK MANAGER 7976 102618.txt\n",
      "CityofLA/JobBulletins_cleaned/RECREATION FACILITY DIRECTOR 2434 051217.txt\n",
      "CityofLA/JobBulletins_cleaned/REFUSE COLLECTION TRUCK OPERATOR 3580 021717.txt\n",
      "CityofLA/JobBulletins_cleaned/REHABILITATION CONSTRUCTION SPECIALIST 1569 072718.txt\n",
      "CityofLA/JobBulletins_cleaned/REINFORCING STEEL WORKER 3483 022318.txt\n",
      "CityofLA/JobBulletins_cleaned/RIDESHARE PROGRAM ADMINISTRATOR 2485 020918.txt\n",
      "CityofLA/JobBulletins_cleaned/RISK MANAGEMENT AND PREVENTION PROGRAM SPECIALIST 7980 030317.txt\n",
      "CityofLA/JobBulletins_cleaned/RISK MANAGER 1530 2016 061716_REVISED.txt\n",
      "CityofLA/JobBulletins_cleaned/SAFETY ENGINEER 1727 021717.txt\n",
      "CityofLA/JobBulletins_cleaned/SAFETY ENGINEER ELEVATORS 4263 112015 REV 120215.txt\n",
      "CityofLA/JobBulletins_cleaned/SAFETY ENGINEER PRESSURE VESSELS 4261 050313 REV 120417.txt\n",
      "CityofLA/JobBulletins_cleaned/SAFETY ENGINEERING ASSOCIATE 1726 052518.txt\n",
      "CityofLA/JobBulletins_cleaned/SENIOR ANIMAL CONTROL OFFICER 4316 111618.txt\n",
      "CityofLA/JobBulletins_cleaned/SENIOR ANIMAL KEEPER 4305 022616.txt\n",
      "CityofLA/JobBulletins_cleaned/SENIOR BUILDING INSPECTOR 4213 010816.txt\n",
      "CityofLA/JobBulletins_cleaned/SENIOR BUILDING MECHANICAL INSPECTOR 4253 2017 REV (1).txt\n",
      "CityofLA/JobBulletins_cleaned/SENIOR CHEMIST 7830 030416.txt\n",
      "CityofLA/JobBulletins_cleaned/SENIOR CLAIMS REPRESENTATIVE 1770 070717 (1).txt\n",
      "CityofLA/JobBulletins_cleaned/SENIOR COMMERCIAL FIELD REPRESENTATIVE 1602 042817 REV 051117.txt\n",
      "CityofLA/JobBulletins_cleaned/SENIOR COMMUNICATIONS CABLE WORKER 3801 102116 draft.txt\n",
      "CityofLA/JobBulletins_cleaned/SENIOR COMMUNICATIONS ELECTRICIAN SUPERVISOR 3691 041318.txt\n",
      "CityofLA/JobBulletins_cleaned/SENIOR COMMUNICATIONS ENGINEER 7614 060917.txt\n",
      "CityofLA/JobBulletins_cleaned/SENIOR CONSTRUCTION ESTIMATOR 3347 041318.txt\n",
      "CityofLA/JobBulletins_cleaned/SENIOR ELECTRIC SERVICE REPRESENTATIVE 7521 092917 (2).txt\n",
      "CityofLA/JobBulletins_cleaned/SENIOR ELECTRICAL MECHANIC 3834 060217 (2) REVISED.txt\n",
      "CityofLA/JobBulletins_cleaned/SENIOR ELECTRICAL MECHANIC SUPERVISOR 3836 080417.txt\n",
      "CityofLA/JobBulletins_cleaned/SENIOR ELECTRICAL REPAIR SUPERVISOR 3856 060118.txt\n",
      "CityofLA/JobBulletins_cleaned/SENIOR ENVIRONMENTAL COMPLIANCE INSPECTOR 4293 042916 REV 051916.txt\n",
      "CityofLA/JobBulletins_cleaned/SENIOR EXAMINER OF QUESTIONED DOCUMENTS 3231 072216 REVISED 072716.txt\n",
      "CityofLA/JobBulletins_cleaned/SENIOR FIRE PROTECTION ENGINEER 7981 021916 rev022516.txt\n",
      "CityofLA/JobBulletins_cleaned/SENIOR FORENSIC PRINT SPECIALIST 2201 090718.txt\n",
      "CityofLA/JobBulletins_cleaned/SENIOR HEATING AND REFRIGERATION INSPECTOR 4247 121115.txt\n",
      "CityofLA/JobBulletins_cleaned/SENIOR HEAVY DUTY EQUIPMENT MECHANIC 3745 012017.txt\n",
      "CityofLA/JobBulletins_cleaned/SENIOR HOUSING INSPECTOR 4244 042718.txt\n",
      "CityofLA/JobBulletins_cleaned/SENIOR HOUSING INVESTIGATOR 8517 020317 REVISED 021617.txt\n",
      "CityofLA/JobBulletins_cleaned/SENIOR INDUSTRIAL HYGIENIST 2331 022318.txt\n",
      "CityofLA/JobBulletins_cleaned/SENIOR MACHINIST SUPERVISOR 3768 051016.txt\n",
      "CityofLA/JobBulletins_cleaned/SENIOR MECHANICAL REPAIRER 3772 030416.txt\n",
      "CityofLA/JobBulletins_cleaned/SENIOR PARK MAINTENANCE SUPERVISOR 3146 101416.txt\n",
      "CityofLA/JobBulletins_cleaned/SENIOR PARK RANGER 1967 091815.txt\n",
      "CityofLA/JobBulletins_cleaned/SENIOR PARK SERVICES ATTENDANT 2422 102717.txt\n",
      "CityofLA/JobBulletins_cleaned/SENIOR PARKING ATTENDANT 3529 032417.txt\n",
      "CityofLA/JobBulletins_cleaned/SENIOR PLUMBER 3444 020516.txt\n",
      "CityofLA/JobBulletins_cleaned/SENIOR PLUMBING INSPECTOR 4233 051818.txt\n",
      "CityofLA/JobBulletins_cleaned/SENIOR PORT ELECTRICAL MECHANIC 3847 072916 REV 081116 (1).txt\n",
      "CityofLA/JobBulletins_cleaned/SENIOR RECREATION DIRECTOR 2446 050517 REV 051117.txt\n",
      "CityofLA/JobBulletins_cleaned/SENIOR ROOFER 3477 101708 REV 110608.txt\n",
      "CityofLA/JobBulletins_cleaned/SENIOR SAFETY ENGINEER ELEVATORS 4264  042718.txt\n",
      "CityofLA/JobBulletins_cleaned/SENIOR SAFETY ENGINEER PRESSURE VESSELS 4262 101218.txt\n",
      "CityofLA/JobBulletins_cleaned/SENIOR SURVEY SUPERVISOR 7288 081718.txt\n",
      "CityofLA/JobBulletins_cleaned/SENIOR TAX AUDITOR 1519 062317.txt\n",
      "CityofLA/JobBulletins_cleaned/SENIOR TITLE EXAMINER 1947 121517.txt\n",
      "CityofLA/JobBulletins_cleaned/SENIOR TRAFFIC SUPERVISOR 3218 121517.txt\n",
      "CityofLA/JobBulletins_cleaned/SENIOR TRANSPORTATION INVESTIGATOR 4273 070717 (2).txt\n",
      "CityofLA/JobBulletins_cleaned/SENIOR UTILITY BUYER 1862 052518.txt\n",
      "CityofLA/JobBulletins_cleaned/SENIOR UTILITY SERVICES SPECIALIST 3573 113018.txt\n",
      "CityofLA/JobBulletins_cleaned/SENIOR UTILITY SERVICES SPECIALIST 3753 121815 (1).txt\n",
      "CityofLA/JobBulletins_cleaned/SENIOR WINDOW CLEANER 3174 013114 Rev021314.txt\n",
      "CityofLA/JobBulletins_cleaned/SHEET METAL WORKER 3775 093016.txt\n",
      "CityofLA/JobBulletins_cleaned/SHIFT SUPERINTENDENT WASTEWATER TREATMENT 7242 072415.txt\n",
      "CityofLA/JobBulletins_cleaned/SIGNAL SYSTEMS ELECTRICIAN 3819 042018.txt\n",
      "CityofLA/JobBulletins_cleaned/SIGNAL SYSTEMS SUPERINTENDENT 3832 110416.txt\n",
      "CityofLA/JobBulletins_cleaned/SOLID RESOURCES SUPERINTENDENT 4102 031017 REV 032317 (2).txt\n",
      "CityofLA/JobBulletins_cleaned/STAFF ASSISTANT TO GENERAL MANAGER WATER AND POWER 9185 032715.txt\n",
      "CityofLA/JobBulletins_cleaned/STEAM PLANT ASSISTANT 5622 051118 (1).txt\n",
      "CityofLA/JobBulletins_cleaned/STEAM PLANT MAINTENANCE MECHANIC 5630 0902116.txt\n",
      "CityofLA/JobBulletins_cleaned/STEAM PLANT MAINTENANCE SUPERVISOR 3786 033117.txt\n",
      "CityofLA/JobBulletins_cleaned/STREET LIGHTING CONSTRUCTION AND MAINTENANCE SUPERINTENDENT 3820 051818.txt\n",
      "CityofLA/JobBulletins_cleaned/STREET LIGHTING ELECTRICIAN SUPERVISOR 3840 031717.txt\n",
      "CityofLA/JobBulletins_cleaned/STREET SERVICES GENERAL SUPERINTENDENT 4160 042916.txt\n",
      "CityofLA/JobBulletins_cleaned/STREET SERVICES INVESTIGATOR 4283 102315 REV 110315.txt\n",
      "CityofLA/JobBulletins_cleaned/STREET SERVICES SUPERVISOR 4152 082815.txt\n",
      "CityofLA/JobBulletins_cleaned/SUPERINTENDENT OF RECREATION AND PARKS OPERATIONS 2472 012618.txt\n",
      "CityofLA/JobBulletins_cleaned/SUPERVISING CRIMINALIST 2235 030416.txt\n",
      "CityofLA/JobBulletins_cleaned/SUPERVISING WATER SERVICE REPRESENTATIVE 1697 081318.txt\n",
      "CityofLA/JobBulletins_cleaned/SURVEY SUPERVISOR 7287 110918.txt\n",
      "CityofLA/JobBulletins_cleaned/TAX AUDITOR 1514 062218.txt\n",
      "CityofLA/JobBulletins_cleaned/TAX COMPLIANCE AIDE 1173 061215 (1).txt\n",
      "CityofLA/JobBulletins_cleaned/TITLE EXAMINER 1943 032318 REV 040518.txt\n",
      "CityofLA/JobBulletins_cleaned/TRAFFIC MARKING AND SIGN SUPERINTENDENT 3430 032219.txt\n",
      "CityofLA/JobBulletins_cleaned/TRAFFIC OFFICER 3214 040116.txt\n",
      "CityofLA/JobBulletins_cleaned/TRAFFIC PAINTER AND SIGN POSTER 3421 033117.txt\n",
      "CityofLA/JobBulletins_cleaned/TRANSMISSION AND DISTRIBUTION DISTRICT SUPERVISOR 3875 050418 REV 051718.txt\n",
      "CityofLA/JobBulletins_cleaned/TREE SURGEON 3114 081916 REV 080818.txt\n",
      "CityofLA/JobBulletins_cleaned/TREE SURGEON ASSISTANT 3151 060316.txt\n",
      "CityofLA/JobBulletins_cleaned/TRUCK AND EQUIPMENT DISPATCHER 3586 052617 (4) REVISED.txt\n",
      "CityofLA/JobBulletins_cleaned/TRUCK OPERATOR 3583 012618.txt\n",
      "CityofLA/JobBulletins_cleaned/UNDERGROUND DISTRIBUTION CONSTRUCTION MECHANIC 3812 101918.txt\n",
      "CityofLA/JobBulletins_cleaned/UNDERGROUND DISTRIBUTION CONSTRUCTION SUPERVISOR 3814 121418 REV 122718 (1).txt\n",
      "CityofLA/JobBulletins_cleaned/UTILITIES SERVICE INVESTIGATOR 1631 101615 (1).txt\n",
      "CityofLA/JobBulletins_cleaned/UTILITY BUYER 1861 090718.txt\n",
      "CityofLA/JobBulletins_cleaned/WASTEWATER COLLECTION WORKER 4110 102612 REV 092817.txt\n",
      "CityofLA/JobBulletins_cleaned/WATER SERVICE REPRESENTATIVE 1693 111717.txt\n",
      "CityofLA/JobBulletins_cleaned/WATER SERVICE SUPERVISOR 3930 012717.txt\n",
      "CityofLA/JobBulletins_cleaned/WATER SERVICE WORKER 3931 040618 (1).txt\n",
      "CityofLA/JobBulletins_cleaned/WATER TREATMENT OPERATOR 5885 122118.txt\n",
      "CityofLA/JobBulletins_cleaned/WATER UTILITY OPERATOR 5854 080516.txt\n",
      "CityofLA/JobBulletins_cleaned/WATER UTILITY OPERATOR SUPERVISOR 5857 062918.txt\n",
      "CityofLA/JobBulletins_cleaned/WATER UTILITY SUPERINTENDENT 3980 121418.txt\n",
      "CityofLA/JobBulletins_cleaned/WATER UTILITY SUPERVISOR 3976 050418 (1).txt\n",
      "CityofLA/JobBulletins_cleaned/WATERSHED RESOURCES SPECIALIST  7862 080516 (1).txt\n",
      "CityofLA/JobBulletins_cleaned/WATERWORKS MECHANIC SUPERVISOR 3987 051614 (1).txt\n"
     ]
    }
   ],
   "source": [
    "# Second, make sure the word 'REQUIREMENTS/MINIMUM QUALIFICATIONS' can be found in the job postings.\n",
    "# Do an index() in the try clause, not find(), to catch the errors\n",
    "for file_name in cleaned_jobs:\n",
    "    job_path = cleaned_path + file_name        # define path to file_name\n",
    "    cleaned_job  = open(job_path, 'rt').read() # read in job as a string\n",
    "    try:\n",
    "        if len(drivers_license_req(job=cleaned_job)) > 0:\n",
    "            if (drivers_license_req(job=cleaned_job))[0]=='R':\n",
    "                print(job_path)\n",
    "    except:                                # do some pretty printings here to help our eyes from pain\n",
    "        ## define some useful variables\n",
    "        border_line = '##############################################################################################'\n",
    "        how_many    = int((len(border_line) - len(job_path))/2)\n",
    "        print(border_line)\n",
    "        ## do pretty printings\n",
    "        print('#'*how_many + job_path + '#'*how_many)\n",
    "        print(border_line)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Finally, we can write a helper function to complete the task!"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": [
    "# This is a helper function\n",
    "def _get_dl_info(job):\n",
    "    '''\n",
    "    Helper function for DRIVERS_LICENSE_REQ and DRIV_LIC_TYPE fields. \n",
    "    Should not be used alone.\n",
    "    '''\n",
    "    # Locate the information\n",
    "    start = job.index('PROCESS NOTES') \n",
    "    temp  = job[start:]\n",
    "\n",
    "    # Determine if information about driver license is required for the job\n",
    "    temp  = temp.split('\\n')                                    # Ex: ['PROCESS NOTES', '', etc.]\n",
    "    dl   = []                                                   # dl=information about driver's license\n",
    "    for possibly_contains_dl in temp:\n",
    "        if 'driver' in possibly_contains_dl:\n",
    "            DL_info = ([e for e in \n",
    "                        possibly_contains_dl.split('.')         # Ex: 4., Some positions, etc.\n",
    "                        if len(e) > 3])                         # split at period and kill itemizers\n",
    "            for sentence in DL_info:\n",
    "                if 'may' in sentence:                           # 'may' is a clear indicator for not required\n",
    "                    dl.append(('P', np.nan))\n",
    "                    break\n",
    "                else:                                           # else, DL is required\n",
    "                    start = possibly_contains_dl.index('^^^') + len('^^^')\n",
    "                    end   = possibly_contains_dl.index('@@@')\n",
    "                    info  = possibly_contains_dl[start:end]\n",
    "                    if len(info) > 2:                           # ' ' has length 1. put 2 just to make sure\n",
    "                        dl.append(('R', info))                  # Ex: ' A ', already 3 characters\n",
    "                    else:\n",
    "                        dl.append(('R', np.nan))\n",
    "                    break\n",
    "            break\n",
    "    \n",
    "    dl = pd.DataFrame(data=dl, columns=['DRIVERS_LICENSE_REQ', 'DRIV_LIC_TYPE'])\n",
    "    \n",
    "    # Returns\n",
    "    return dl"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 1,
   "metadata": {},
   "outputs": [],
   "source": [
    "def drivers_license_req():\n",
    "    '''Returns DRIVERS_LICENSE_REQ (dlr)'''\n",
    "    dlr = list(baseline['DRIVERS_LICENSE_REQ'])\n",
    "    return dlr"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Get DRIV_LIC_TYPE"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 2,
   "metadata": {},
   "outputs": [],
   "source": [
    "def driv_lic_type():\n",
    "    '''Returns DRIV_LIC_TYPE (dlt)'''\n",
    "    dlt = list(baseline['DRIV_LIC_TYPE'])\n",
    "    return dlt"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Get ENTRY_SALARY_GEN (esg)\n",
    "Since the helper function for this field is closely related to the helper function for ENTRY_SALARY_DWP, we'll write a sub-helper function (starts with an underscore _ ) to assist the process. Now, recall above that we have the following section order: ... ANNUAL SALARY - NOTES: - NOTES - DUTIES, where the first NOTES: has a colon in it, which most of the time is used for explaining salary information, while the second NOTES doesn't have a colon in it, which is used for explaining specifics of DUTIES (e.g., night shift is required, etc.). Since the salary information is in between ANNUAL SALARY - NOTES:, our first job is to make sure that NOTES: is in every job. Thus, we wonder how many jobs that don't have NOTES: in between ANNUAL SALARY and DUTIES. Then, for such a job, we'll manually add NOTES: in the order mentioned.\n",
    "\n",
    "We should also take advantage of this opportunity to check for any inconsistency that we haven't encountered so far, for the above functions. This is true power of the normalization approach: Jobs are crossed check in so many ways that the chance that we miss a job with an inconsistency we haven't known is extremely unlikely, which makes the final .csv output contains very accurate information."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 15,
   "metadata": {
    "scrolled": true
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "CityofLA/Job Bulletins/311 DIRECTOR  9206 041814.txt\n",
      "CityofLA/Job Bulletins/ACCOUNTING CLERK 1223 071318.txt\n",
      "CityofLA/Job Bulletins/ADMINISTRATIVE HEARING EXAMINER 9135 100915.txt\n",
      "CityofLA/Job Bulletins/ADVANCE PRACTICE PROVIDER CORRECTIONAL CARE 2325 020808 REV 111214.txt\n",
      "CityofLA/Job Bulletins/AIRPORT AIDE 1540 081018.txt\n",
      "CityofLA/Job Bulletins/AIRPORT CHIEF INFORMATION SECURITY OFFICER 1404 120415_Modified.txt\n",
      "CityofLA/Job Bulletins/AIRPORT LABOR RELATIONS ADVOCATE 9210 020119.txt\n",
      "CityofLA/Job Bulletins/AIRPORT POLICE CAPTAIN 3228 021618.txt\n",
      "CityofLA/Job Bulletins/AIRPORT POLICE LIEUTENANT 3227 091616.txt\n",
      "CityofLA/Job Bulletins/AIRPORT POLICE OFFICER 3225 110906 Rev 060115.txt\n",
      "CityofLA/Job Bulletins/AIRPORT POLICE SPECIALIST 3236 063017 (2).txt\n",
      "CityofLA/Job Bulletins/AIRPORTS MAINTENANCE SUPERINTENDENT 3331 021518.txt\n",
      "CityofLA/Job Bulletins/AIRPORTS PUBLIC AND COMMUNITY RELATIONS DIRECTOR 1788 120817.txt\n",
      "CityofLA/Job Bulletins/ANIMAL CARE ASSISTANT 4323 020119.txt\n",
      "CityofLA/Job Bulletins/ANIMAL CONTROL OFFICER  4311 061518.txt\n",
      "CityofLA/Job Bulletins/ANIMAL KEEPER 4304 083118.txt\n",
      "##############################################################################################\n",
      "################CityofLA/Job Bulletins/APPARATUS OPERATOR 2121 071417 (1).txt################\n",
      "##############################################################################################\n",
      "CityofLA/Job Bulletins/AQUARIST 2400 050214.txt\n",
      "CityofLA/Job Bulletins/AQUATIC DIRECTOR 2419  082517 REV 0090717.txt\n",
      "CityofLA/Job Bulletins/AQUATIC FACILITY MANAGER 2423 052915 REVISED 060915.txt\n",
      "CityofLA/Job Bulletins/ART CENTER DIRECTOR 2478 053014.txt\n",
      "CityofLA/Job Bulletins/ART CURATOR 2448 071516 REV 072816.txt\n",
      "CityofLA/Job Bulletins/ASPHALT PLANT OPERATOR 4143 102414.txt\n",
      "CityofLA/Job Bulletins/ASSISTANT AIRPORT MANAGER 7259 012618.txt\n",
      "CityofLA/Job Bulletins/ASSISTANT COMMUNICATIONS ELECTRICIAN 3684 090916.txt\n",
      "CityofLA/Job Bulletins/ASSISTANT SIGNAL SYSTEMS ELECTRICIAN 3818 073115_REVISED.txt\n",
      "CityofLA/Job Bulletins/ASSISTANT STREET LIGHTING ELECTRICIAN 3809 072117 REV 080818.txt\n",
      "CityofLA/Job Bulletins/ASSOCIATE ZONING ADMINISTRATOR 7998 102618 REV 110818.txt\n",
      "CityofLA/Job Bulletins/AUDIO VISUAL TECHNICIAN 6147 062014.txt\n",
      "CityofLA/Job Bulletins/AVIONICS SPECIALIST 3565 103114revised.txt\n",
      "CityofLA/Job Bulletins/BOILERMAKER SUPERVISOR 3737 101714.txt\n",
      "CityofLA/Job Bulletins/BUILDING CONSTRUCTION AND MAINTENANCE SUPERINTENDENT 3124 122818.txt\n",
      "CityofLA/Job Bulletins/BUILDING INSPECTOR 4211 101918.txt\n",
      "CityofLA/Job Bulletins/BUILDING MAINTENANCE DISTRICT SUPERVISOR 3190 042817 (1).txt\n",
      "CityofLA/Job Bulletins/BUILDING MECHANICAL INSPECTOR 4251 082815 REV 080818.txt\n",
      "CityofLA/Job Bulletins/BUS OPERATOR SUPERVISOR 3589 012216.txt\n",
      "CityofLA/Job Bulletins/CARPET LAYER 3418 061915.txt\n",
      "CityofLA/Job Bulletins/CEMENT FINISHER WORKER 3351 103015.txt\n",
      "CityofLA/Job Bulletins/CHIEF BENEFITS ANALYST 9151 092316 REV 100616.txt\n",
      "CityofLA/Job Bulletins/CHIEF BUILDING OPERATING ENGINEER 5927 080516.txt\n",
      "CityofLA/Job Bulletins/CHIEF CLERK POLICE 1219 061215.txt\n",
      "CityofLA/Job Bulletins/CHIEF CLERK POLICE 1249 083118.txt\n",
      "CityofLA/Job Bulletins/CHIEF CONSTRUCTION INSPECTOR 7296 122818.txt\n",
      "CityofLA/Job Bulletins/CHIEF CUSTODIAN SUPERVISOR 3182 041015.txt\n",
      "CityofLA/Job Bulletins/CHIEF FINANCIAL OFFICER 9230 041114.txt\n",
      "CityofLA/Job Bulletins/CHIEF HARBOR ENGINEER 9286 112015.txt\n",
      "CityofLA/Job Bulletins/CHIEF INTERNAL AUDITOR 1619 090916 (5).txt\n",
      "CityofLA/Job Bulletins/CHIEF MANAGEMENT ANALYST 9182 020918.txt\n",
      "CityofLA/Job Bulletins/CHIEF PARK RANGER 1968 120106 REV 121306.txt\n",
      "CityofLA/Job Bulletins/CHIEF TAX COMPLIANCE OFFICER 1211 041814.txt\n",
      "CityofLA/Job Bulletins/CHIEF TRANSPORTATION INVESTIGATOR 4275 103114.txt\n",
      "CityofLA/Job Bulletins/CITY PLANNER 7944 120718.txt\n",
      "CityofLA/Job Bulletins/COMMUNITY HOUSING PROGRAMS MANAGER 8500 072018 REV 080918 (2).txt\n",
      "CityofLA/Job Bulletins/CUSTODIAN 3156 111618.txt\n",
      "CityofLA/Job Bulletins/DIRECTOR OF AIRPORT OPERATIONS 9304 062317 (3).txt\n",
      "CityofLA/Job Bulletins/DIRECTOR OF COMMUNICATIONS SERVICES 7625 042718.txt\n",
      "CityofLA/Job Bulletins/DIRECTOR OF ENFORCEMENT OPERATIONS 4266 012618.txt\n",
      "CityofLA/Job Bulletins/DIRECTOR OF FIELD OPERATIONS 4321 040618.txt\n",
      "CityofLA/Job Bulletins/DIRECTOR OF HOUSING 1568 062317.txt\n",
      "CityofLA/Job Bulletins/DIRECTOR OF PRINTING SERVICES 1488 101218 REV 102418 (3).txt\n",
      "CityofLA/Job Bulletins/DIVISION LIBRARIAN 6157 012717 REV 022217.txt\n",
      "CityofLA/Job Bulletins/DRILL RIG OPERATOR 3521 033018.txt\n",
      "CityofLA/Job Bulletins/ELECTRICAL INSPECTOR 4221 030218.txt\n",
      "CityofLA/Job Bulletins/ELECTRICIAN SUPERVISOR 3865 091616  REV 092916.txt\n",
      "CityofLA/Job Bulletins/ELEVATOR MECHANIC HELPER 3860 071417.txt\n",
      "CityofLA/Job Bulletins/EMS ADVANCED PROVIDER 2341 111618 REV 122018.txt\n",
      "CityofLA/Job Bulletins/EMS NURSE PRACTITIONER SUPERVISOR 2340 031116 REV 032316 (1).txt\n",
      "##############################################################################################\n",
      "##############CityofLA/Job Bulletins/ENGINEER OF FIRE DEPARTMENT 2131 111116.txt##############\n",
      "##############################################################################################\n",
      "CityofLA/Job Bulletins/ENGINEER OF SURVEYS 9486 101615.txt\n",
      "CityofLA/Job Bulletins/EQUIPMENT SUPERINTENDENT 3750 121914.txt\n",
      "CityofLA/Job Bulletins/EXAMINER OF QUESTIONED DOCUMENTS 3229 120415.txt\n",
      "CityofLA/Job Bulletins/EXHIBIT PREPARATOR 2444 062416.txt\n",
      "CityofLA/Job Bulletins/FINGERPRINT IDENTIFICATION EXPERT 1157 052915.txt\n",
      "##############################################################################################\n",
      "#################CityofLA/Job Bulletins/FIRE ASSISTANT CHIEF 2166 011218.txt#################\n",
      "##############################################################################################\n",
      "##############################################################################################\n",
      "#################CityofLA/Job Bulletins/FIRE BATTALION CHIEF 2152 030918.txt#################\n",
      "##############################################################################################\n",
      "CityofLA/Job Bulletins/FIRE CAPTAIN 2142 033018.txt\n",
      "##############################################################################################\n",
      "###########CityofLA/Job Bulletins/FIRE HELICOPTER PILOT 3563 081415 REV. 081815.txt###########\n",
      "##############################################################################################\n",
      "##############################################################################################\n",
      "####################CityofLA/Job Bulletins/FIRE INSPECTOR 2128 031717.txt####################\n",
      "##############################################################################################\n",
      "CityofLA/Job Bulletins/FIRE SPRINKLER INSPECTOR 4240 062317 REVISED 070617 (2).txt\n",
      "CityofLA/Job Bulletins/FIREBOAT MATE 5125 102315 rev110515.txt\n",
      "CityofLA/Job Bulletins/FIREBOAT PILOT 5127 102315 rev110515 (1).txt\n",
      "CityofLA/Job Bulletins/FIREFIGHTER 2112 011918.txt\n",
      "CityofLA/Job Bulletins/FORENSIC  PRINT SPECIALIST 2200 062218.txt\n",
      "CityofLA/Job Bulletins/GALLERY ATTENDANT 2442 092515.txt\n",
      "CityofLA/Job Bulletins/GARAGE ASSISTANT 3538 012017.txt\n",
      "CityofLA/Job Bulletins/GENERAL AUTOMOTIVE SUPERVISOR 3718 061915.txt\n",
      "CityofLA/Job Bulletins/GEOGRAPHIC INFORMATION SYSTEMS CHIEF  7211 030416.txt\n",
      "CityofLA/Job Bulletins/GEOGRAPHIC INFORMATION SYSTEMS SPECIALIST 7213 012414 revised.txt\n",
      "CityofLA/Job Bulletins/GOLF STARTER 2453 121115.txt\n",
      "CityofLA/Job Bulletins/HELICOPTER MECHANIC 3742 072206 REV 020818.txt\n",
      "CityofLA/Job Bulletins/HELICOPTER MECHANIC SUPERVISOR 3749 121616 REV 122216.txt\n",
      "CityofLA/Job Bulletins/HOUSING PLANNING AND ECONOMIC ANALYST 8504 Bulletin FINAL DRAFT.txt\n",
      "CityofLA/Job Bulletins/HUMAN RELATIONS ADVOCATE 9207 122217.txt\n",
      "CityofLA/Job Bulletins/INDUSTRIAL CHEMIST 7834 020714.txt\n",
      "CityofLA/Job Bulletins/IRRIGATION SPECIALIST 3913 020615.txt\n",
      "CityofLA/Job Bulletins/LICENSED VOCATIONAL NURSE  2332 042415.txt\n",
      "CityofLA/Job Bulletins/MAINTENANCE LABORER 3112 111618.txt\n",
      "CityofLA/Job Bulletins/MARINE AQUARIUM PROGRAM DIRECTOR 2403 082517.txt\n",
      "CityofLA/Job Bulletins/MARINE ENVIRONMENTAL MANAGER 9437 060614.txt\n",
      "CityofLA/Job Bulletins/MECHANICAL REPAIR SUPERVISOR 3795 051818.txt\n",
      "CityofLA/Job Bulletins/MEDICAL ASSISTANT 2310 030918.txt\n",
      "CityofLA/Job Bulletins/PARK RANGER 1966 072718 REV 073118 (1).txt\n",
      "CityofLA/Job Bulletins/PARK SERVICES SUPERVISOR 2426 072018.txt\n",
      "CityofLA/Job Bulletins/PARKING MANAGER 9170 020714.txt\n",
      "CityofLA/Job Bulletins/PARKING METER TECHNICIAN SUPERVISOR 3757 2017.txt\n",
      "CityofLA/Job Bulletins/PERFORMING ARTS DIRECTOR 2449 020317 REV 020817.txt\n",
      "CityofLA/Job Bulletins/PLANNING ASSISTANT 7939 071417 REV 072617 (1).txt\n",
      "CityofLA/Job Bulletins/PLUMBING INSPECTOR 4231 042817 REV 051117.txt\n",
      "CityofLA/Job Bulletins/POLICE COMMANDER 2251 092917.txt\n",
      "CityofLA/Job Bulletins/POLICE LIEUTENANT 2232 020918.txt\n",
      "CityofLA/Job Bulletins/POLICE OFFICER 2214 110906 Rev 060115.txt\n",
      "CityofLA/Job Bulletins/POLICE SERGEANT 2227 102116.txt\n",
      "CityofLA/Job Bulletins/POLICE SPECIALIST 2217 110906 Rev 060115.txt\n",
      "CityofLA/Job Bulletins/POLICE SURVEILLANCE SPECIALIST 3687 052215.txt\n",
      "CityofLA/Job Bulletins/PORT PILOT 5151 081817 REV 090717.txt\n",
      "CityofLA/Job Bulletins/PORT POLICE CAPTAIN 3224 110416.txt\n",
      "CityofLA/Job Bulletins/PORT POLICE LIEUTENANT 3223 120916.txt\n",
      "CityofLA/Job Bulletins/PORT POLICE OFFICER 3221 110906 Rev 060115.txt\n",
      "CityofLA/Job Bulletins/PORT POLICE SERGEANT 3222 121616.txt\n",
      "CityofLA/Job Bulletins/PORTFOLIO MANAGER 9143 082517.txt\n",
      "CityofLA/Job Bulletins/PRINCIPAL ANIMAL KEEPER 4312 070618.txt\n",
      "CityofLA/Job Bulletins/PRINCIPAL CITY PLANNER 7946 030218.txt\n",
      "CityofLA/Job Bulletins/PRINCIPAL CIVIL ENGINEER 9489 022318.txt\n",
      "CityofLA/Job Bulletins/PRINCIPAL CLERK 1201 021618.txt\n",
      "CityofLA/Job Bulletins/PRINCIPAL DEPUTY CONTROLLER 7260 032814.txt\n",
      "CityofLA/Job Bulletins/PRINCIPAL DETENTION OFFICER 3215 101218.txt\n",
      "CityofLA/Job Bulletins/PRINCIPAL ENVIRONMENTAL ENGINEER 7875 092118.txt\n",
      "CityofLA/Job Bulletins/PRINCIPAL GROUNDS MAINTENANCE SUPERVISOR  3147 111315.txt\n",
      "CityofLA/Job Bulletins/PRINCIPAL INSPECTOR 4226 061617.txt\n",
      "CityofLA/Job Bulletins/PRINCIPAL LIBRARIAN 6155 032417 REV 040417.txt\n",
      "CityofLA/Job Bulletins/PRINCIPAL TRANSPORTATION ENGINEER 9266 101317.txt\n",
      "CityofLA/Job Bulletins/PRINTING PRESS OPERATOR 1494 092515.txt\n",
      "CityofLA/Job Bulletins/PROPERTY OFFICER 3207 071417 (1).txt\n",
      "CityofLA/Job Bulletins/PUBLIC SAFETY RISK MANAGER 7976 102618.txt\n",
      "CityofLA/Job Bulletins/REFUSE COLLECTION SUPERVISOR 4101 033117.txt\n",
      "CityofLA/Job Bulletins/RETIREMENT PLAN MANAGER 9149 052314 (1).txt\n",
      "CityofLA/Job Bulletins/RIDESHARE PROGRAM ADMINISTRATOR 2485 020918.txt\n",
      "CityofLA/Job Bulletins/RISK AND INSURANCE ASSISTANT 1645 072718.txt\n",
      "CityofLA/Job Bulletins/RISK MANAGEMENT AND PREVENTION PROGRAM SPECIALIST 7980 030317.txt\n",
      "CityofLA/Job Bulletins/ROOFER SUPERVISOR 3478 062218.txt\n",
      "CityofLA/Job Bulletins/SAFETY ENGINEER ELEVATORS 4263 112015 REV 120215.txt\n",
      "CityofLA/Job Bulletins/SECRETARY 1116 030317.txt\n",
      "CityofLA/Job Bulletins/SENIOR ANIMAL CONTROL OFFICER 4316 111618.txt\n",
      "CityofLA/Job Bulletins/SENIOR AUDITOR 1518 102618.txt\n",
      "CityofLA/Job Bulletins/SENIOR AUTOMOTIVE SUPERVISOR 3716 112015.txt\n",
      "CityofLA/Job Bulletins/SENIOR BUILDING INSPECTOR 4213 010816.txt\n",
      "CityofLA/Job Bulletins/SENIOR BUILDING MECHANICAL INSPECTOR 4253 2017 REV (1).txt\n",
      "CityofLA/Job Bulletins/SENIOR BUILDING OPERATING ENGINEER 5925 011615 (1).txt\n",
      "CityofLA/Job Bulletins/SENIOR CHEMIST 7830 030416.txt\n",
      "CityofLA/Job Bulletins/SENIOR CONSTRUCTION ENGINEER 7289 042514.txt\n",
      "CityofLA/Job Bulletins/SENIOR CONSTRUCTION ESTIMATOR 3347 041318.txt\n",
      "CityofLA/Job Bulletins/SENIOR DETENTION OFFICER 3212 012017.txt\n",
      "CityofLA/Job Bulletins/SENIOR ELECTRICAL INSPECTOR 4223 042718.txt\n",
      "CityofLA/Job Bulletins/SENIOR ELECTRICIAN  3864 102116 Rev 110216.txt\n",
      "CityofLA/Job Bulletins/SENIOR ENVIRONMENTAL ENGINEER 7874 121815.txt\n",
      "CityofLA/Job Bulletins/SENIOR HOUSING INSPECTOR 4244 042718.txt\n",
      "CityofLA/Job Bulletins/SENIOR HYDROGRAPHER 7264 030714.txt\n",
      "CityofLA/Job Bulletins/SENIOR LIBRARIAN 6153 033117.txt\n",
      "CityofLA/Job Bulletins/SENIOR PARK RANGER 1967 091815.txt\n",
      "CityofLA/Job Bulletins/SENIOR PARK SERVICES ATTENDANT 2422 102717.txt\n",
      "CityofLA/Job Bulletins/SENIOR PLUMBING INSPECTOR 4233 051818.txt\n",
      "CityofLA/Job Bulletins/SENIOR POLICE SERVICE REPRESENTATIVE 2209 020918.txt\n",
      "CityofLA/Job Bulletins/SENIOR PORT ELECTRICAL MECHANIC 3847 072916 REV 081116 (1).txt\n",
      "##############################################################################################\n",
      "############CityofLA/Job Bulletins/SENIOR REAL ESTATE OFFICER 1961 0413018 (2).txt############\n",
      "##############################################################################################\n",
      "CityofLA/Job Bulletins/SENIOR RECREATION DIRECTOR 2446 050517 REV 051117.txt\n",
      "CityofLA/Job Bulletins/SENIOR ROOFER 3477 101708 REV 110608.txt\n",
      "CityofLA/Job Bulletins/SENIOR SAFETY ENGINEER ELEVATORS 4264  042718.txt\n",
      "CityofLA/Job Bulletins/SENIOR TITLE EXAMINER 1947 121517.txt\n",
      "CityofLA/Job Bulletins/SENIOR TRANSPORTATION ENGINEER 9262 102017.txt\n",
      "CityofLA/Job Bulletins/SENIOR TRANSPORTATION INVESTIGATOR 4273 070717 (2).txt\n",
      "CityofLA/Job Bulletins/SENIOR WINDOW CLEANER 3174 013114 Rev021314.txt\n",
      "CityofLA/Job Bulletins/SHEET METAL SUPERVISOR 3777 061314.txt\n",
      "CityofLA/Job Bulletins/SHIP CARPENTER 3348 093016.txt\n",
      "CityofLA/Job Bulletins/SIGN SHOP SUPERVISOR 3419 030615.txt\n",
      "CityofLA/Job Bulletins/SIGNAL SYSTEMS ELECTRICIAN 3819 042018.txt\n",
      "CityofLA/Job Bulletins/SR CRIME _ INTELLIGENCE ANALYST 2241 011516.txt\n",
      "CityofLA/Job Bulletins/STREET LIGHTING ELECTRICIAN  3811 022318.txt\n",
      "CityofLA/Job Bulletins/STREET LIGHTING ENGINEER 7537 052617 (4).txt\n",
      "CityofLA/Job Bulletins/SUPERINTENDENT OF RECREATION AND PARKS OPERATIONS 2472 012618.txt\n",
      "CityofLA/Job Bulletins/SUPPLY SERVICES PAYMENT CLERK 1214 031017-.txt\n",
      "CityofLA/Job Bulletins/TAX COMPLIANCE AIDE 1173 061215 (1).txt\n",
      "CityofLA/Job Bulletins/TELECOMMUNICATIONS PLANNING AND UTILIZATION OFFICER 7640 122217.txt\n",
      "CityofLA/Job Bulletins/TILE SETTER 3493 090415.txt\n",
      "CityofLA/Job Bulletins/TRANSPORTATION ENGINEER 7278 092917.txt\n",
      "CityofLA/Job Bulletins/VETERINARY TECHNICIAN 2369 020599 REV 120417.txt\n",
      "CityofLA/Job Bulletins/VIDEO PRODUCTION COORDINATOR 1802 012717.txt\n",
      "CityofLA/Job Bulletins/VOLUNTEER COORDINATOR 2495 030218.txt\n",
      "CityofLA/Job Bulletins/WASTEWATER TREATMENT MECHANIC 5614 021712 REV 120417.txt\n",
      "CityofLA/Job Bulletins/WASTEWATER TREATMENT MECHANIC SUPERVISOR 5617 072117 (1).txt\n",
      "CityofLA/Job Bulletins/WATERWORKS MECHANIC SUPERVISOR 3987 051614 (1).txt\n",
      "CityofLA/Job Bulletins/WINDOW CLEANER 3173 032417.txt\n",
      "CityofLA/Job Bulletins/WORKERS_ COMPENSATION CLAIMS ASSISTANT 1775 041114.txt\n",
      "CityofLA/Job Bulletins/ZOO CURATOR 4297 040816.txt\n",
      "CityofLA/Job Bulletins/ZOO REGISTRAR 4290 070618.txt\n"
     ]
    }
   ],
   "source": [
    "# Find which job doesn't have NOTES: in between ANNUAL SALARY and DUTIES\n",
    "for file_name in raw_jobs:\n",
    "    job_path = raw_path + file_name        # define path to file_name\n",
    "    raw_job  = open(job_path, 'rt').read() # read in job as a string\n",
    "    try:\n",
    "        txt  = raw_job[raw_job.index('ANNUAL SALARY'):raw_job.index('DUTIES')]\n",
    "        if 'NOTES:' not in txt:\n",
    "            print(job_path)\n",
    "    except:                                # do some pretty printings here to help our eyes from pain\n",
    "        ## define some useful variables\n",
    "        border_line = '##############################################################################################'\n",
    "        how_many    = int((len(border_line) - len(job_path))/2)\n",
    "        print(border_line)\n",
    "        ## do pretty printings\n",
    "        print('#'*how_many + job_path + '#'*how_many)\n",
    "        print(border_line)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "**Let's rerun the function and observe the changes. Note we use .txt files in the JobBulletins_cleaned folder.**\n",
    "\n",
    "Observing the printouts carefully this time, we see that all of the nuances above have been resolved."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 16,
   "metadata": {},
   "outputs": [],
   "source": [
    "# Rerun the code above to check if every job has NOTES: between ANNUAL SALARY and DUTIES\n",
    "# If nothing gets printed out, that means we pass the test.\n",
    "for file_name in cleaned_jobs:\n",
    "    job_path     = cleaned_path + file_name    # define path to file_name\n",
    "    cleaned_job  = open(job_path, 'rt').read() # read in job as a string\n",
    "    try:\n",
    "        txt  = cleaned_job[cleaned_job.index('ANNUAL SALARY'):cleaned_job.index('DUTIES')]\n",
    "        if 'NOTES:' not in txt:\n",
    "            print(job_path)\n",
    "    except:                                    # do some pretty printings here to help our eyes from pain\n",
    "        ## define some useful variables\n",
    "        border_line = '##############################################################################################'\n",
    "        how_many    = int((len(border_line) - len(job_path))/2)\n",
    "        print(border_line)\n",
    "        ## do pretty printings\n",
    "        print('#'*how_many + job_path + '#'*how_many)\n",
    "        print(border_line)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Next, we'll also need to see which job doesn't contain Department of Water and Power (DWP) salary. To normalize the data, for a job that doesn't contain such salary we'll add the phrase, *The salary in the Department of Water and Power is*, to the end of the ANNUAL SALARY section."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 17,
   "metadata": {},
   "outputs": [],
   "source": [
    "# Find jobs that don't contain DWP salary\n",
    "for file_name in cleaned_jobs:\n",
    "    job_path = cleaned_path + file_name        # define path to file_name\n",
    "    cleaned_job  = open(job_path, 'rt').read() # read in job as a string\n",
    "    try:\n",
    "        txt  = cleaned_job[cleaned_job.index('ANNUAL SALARY'):cleaned_job.index('NOTES:')]\n",
    "        if 'Department of Water and Power' not in txt:\n",
    "            print(job_path)\n",
    "    except:                                # do some pretty printings here to help our eyes from pain\n",
    "        ## define some useful variables\n",
    "        border_line = '##############################################################################################'\n",
    "        how_many    = int((len(border_line) - len(job_path))/2)\n",
    "        print(border_line)\n",
    "        ## do pretty printings\n",
    "        print('#'*how_many + job_path + '#'*how_many)\n",
    "        print(border_line)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "This was a huge list when it first printed out. Then since we modified the jobs, nothing will be printed out because the jobs were already cleaned. We include what seems to be a repetition for code consistency."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "**Let's rerun the function and observe the changes. Note we use .txt files in the JobBulletins_cleaned folder.**\n",
    "\n",
    "Observing the printouts carefully this time, we see that all of the nuances above have been resolved."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 18,
   "metadata": {},
   "outputs": [],
   "source": [
    "# Rerun the code above to check if every job has information regarding DWP salary\n",
    "# If nothing gets printed out, that means we pass the test.for file_name in cleaned_jobs:\n",
    "for file_name in cleaned_jobs:\n",
    "    job_path = cleaned_path + file_name        # define path to file_name\n",
    "    cleaned_job  = open(job_path, 'rt').read() # read in job as a string\n",
    "    try:\n",
    "        txt  = cleaned_job[cleaned_job.index('ANNUAL SALARY'):cleaned_job.index('NOTES:')]\n",
    "        if 'Department of Water and Power' not in txt:\n",
    "            print(job_path)\n",
    "    except:                                # do some pretty printings here to help our eyes from pain\n",
    "        ## define some useful variables\n",
    "        border_line = '##############################################################################################'\n",
    "        how_many    = int((len(border_line) - len(job_path))/2)\n",
    "        print(border_line)\n",
    "        ## do pretty printings\n",
    "        print('#'*how_many + job_path + '#'*how_many)\n",
    "        print(border_line)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "The salary field is actually very tricky because we have many salary ranges and also flat-rated salaries, blending in each other for some jobs. The requirement for our .csv file says that this field should contain only the first salary range, if multiples are available, or only the flat-rated salary. In order to satisfy this requirement, we have to clean up the ones with mixed salary information:\n",
    "1. If a job has a mix of salary range and flat-rated salary, we'll move flat-rated salary to the end of the line.\n",
    "2. If a job has more than one flat-rated salaries, keep the first and delete the rest. Otherwise, the code will be confused by these salaries as a salary range.\n",
    "3. Salary information regarding Los Angeles World Airport, Airports Department, or Harbor Department, will be moved to the end of the .txt file under a new section called ADDITIONAL SALARY INFORMATION. "
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 19,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "CityofLA/JobBulletins_cleaned/ADMINISTRATIVE CLERK 1358 033018 (2).txt\n",
      "CityofLA/JobBulletins_cleaned/AIR CONDITIONING MECHANIC 3774 041417.txt\n",
      "CityofLA/JobBulletins_cleaned/AIR CONDITIONING MECHANIC SUPERVISOR 3781 111618 2.txt\n",
      "CityofLA/JobBulletins_cleaned/ASBESTOS SUPERVISOR 3440 012916.txt\n",
      "CityofLA/JobBulletins_cleaned/ASBESTOS WORKER 3435 100518.txt\n",
      "CityofLA/JobBulletins_cleaned/ASSISTANT COMMUNICATIONS ELECTRICIAN 3684 090916.txt\n",
      "CityofLA/JobBulletins_cleaned/ASSISTANT SIGNAL SYSTEMS ELECTRICIAN 3818 073115_REVISED.txt\n",
      "CityofLA/JobBulletins_cleaned/ASSISTANT STREET LIGHTING ELECTRICIAN 3809 072117 REV 080818.txt\n",
      "CityofLA/JobBulletins_cleaned/AUTO BODY BUILDER AND REPAIRER 3704 101317 revised.txt\n",
      "CityofLA/JobBulletins_cleaned/AUTO BODY REPAIR SUPERVISOR 3706 051515.txt\n",
      "CityofLA/JobBulletins_cleaned/AUTO ELECTRICIAN 3707 052215.txt\n",
      "CityofLA/JobBulletins_cleaned/AUTOMOTIVE SUPERVISOR 3714 062416.txt\n",
      "CityofLA/JobBulletins_cleaned/AVIONICS SPECIALIST 3565 103114revised.txt\n",
      "CityofLA/JobBulletins_cleaned/BLACKSMITH 3733 082517 REV 090717.txt\n",
      "CityofLA/JobBulletins_cleaned/BOILERMAKER 3735 110714.txt\n",
      "CityofLA/JobBulletins_cleaned/BUILDING MAINTENANCE DISTRICT SUPERVISOR 3190 042817 (1).txt\n",
      "CityofLA/JobBulletins_cleaned/BUILDING OPERATING ENGINEER 5923 111618 REV 112818.txt\n",
      "CityofLA/JobBulletins_cleaned/CARPENTER 3344 011218.txt\n",
      "CityofLA/JobBulletins_cleaned/CARPENTER SUPERVISOR 3346 051316.txt\n",
      "CityofLA/JobBulletins_cleaned/CARPET LAYER 3418 061915.txt\n",
      "CityofLA/JobBulletins_cleaned/CEMENT FINISHER 3353 030918.txt\n",
      "CityofLA/JobBulletins_cleaned/CEMENT FINISHER SUPERVISOR 3354 120916.txt\n",
      "CityofLA/JobBulletins_cleaned/CHIEF BUILDING OPERATING ENGINEER 5927 080516.txt\n",
      "CityofLA/JobBulletins_cleaned/COMMUNICATIONS CABLE WORKER 3802 11816.txt\n",
      "CityofLA/JobBulletins_cleaned/COMMUNICATIONS ELECTRICIAN 3686 052518.txt\n",
      "CityofLA/JobBulletins_cleaned/CONSTRUCTION AND MAINTENANCE SUPERVISOR 3127 030416.txt\n",
      "CityofLA/JobBulletins_cleaned/DECK HAND 5131 093016.txt\n",
      "CityofLA/JobBulletins_cleaned/ELECTRIC DISTRIBUTION MECHANIC 3879 040717.txt\n",
      "CityofLA/JobBulletins_cleaned/ELECTRIC METER SETTER 3822 012017.txt\n",
      "CityofLA/JobBulletins_cleaned/ELECTRIC STATION OPERATOR  5224 070717 (3).txt\n",
      "CityofLA/JobBulletins_cleaned/ELECTRICAL CRAFT HELPER 3799 092818.txt\n",
      "CityofLA/JobBulletins_cleaned/ELECTRICAL REPAIRER 3853 122917 updated.txt\n",
      "CityofLA/JobBulletins_cleaned/ELECTRICIAN 3863 101317.txt\n",
      "CityofLA/JobBulletins_cleaned/ELECTRICIAN SUPERVISOR 3865 091616  REV 092916.txt\n",
      "CityofLA/JobBulletins_cleaned/ELEVATOR MECHANIC 3866 012717 REV 080718.txt\n",
      "CityofLA/JobBulletins_cleaned/ELEVATOR MECHANIC HELPER 3860 071417.txt\n",
      "CityofLA/JobBulletins_cleaned/ELEVATOR REPAIR SUPERVISOR 032516 REVISED 040516.txt\n",
      "CityofLA/JobBulletins_cleaned/EQUIPMENT MECHANIC 3711 051818.txt\n",
      "CityofLA/JobBulletins_cleaned/EQUIPMENT OPERATOR 3525 041417 REV 042717.txt\n",
      "CityofLA/JobBulletins_cleaned/EQUIPMENT REPAIR SUPERVISOR 3746 012717.txt\n",
      "CityofLA/JobBulletins_cleaned/GENERAL AUTOMOTIVE SUPERVISOR 3718 061915.txt\n",
      "CityofLA/JobBulletins_cleaned/HEAVY DUTY EQUIPMENT MECHANIC 3743 021717.txt\n",
      "CityofLA/JobBulletins_cleaned/HEAVY DUTY TRUCK OPERATOR 3584 122316.txt\n",
      "CityofLA/JobBulletins_cleaned/HELICOPTER MECHANIC 3742 072206 REV 020818.txt\n",
      "CityofLA/JobBulletins_cleaned/HELICOPTER MECHANIC SUPERVISOR 3749 121616 REV 122216.txt\n",
      "CityofLA/JobBulletins_cleaned/INSTRUMENT MECHANIC 3843 060818 2.txt\n",
      "CityofLA/JobBulletins_cleaned/INSTRUMENT MECHANIC SUPERVISOR 3844 051917 final.txt\n",
      "CityofLA/JobBulletins_cleaned/LOCKSMITH 3393 113018.txt\n",
      "CityofLA/JobBulletins_cleaned/MACHINIST 3763 061016.txt\n",
      "CityofLA/JobBulletins_cleaned/MACHINIST SUPERVISOR 3766 121815.txt\n",
      "CityofLA/JobBulletins_cleaned/MASONRY WORKER 3451 011918.txt\n",
      "CityofLA/JobBulletins_cleaned/MECHANICAL REPAIR GENERAL SUPERVISOR 3731 040116 REV 041416.txt\n",
      "CityofLA/JobBulletins_cleaned/MECHANICAL REPAIR SUPERVISOR 3795 051818.txt\n",
      "CityofLA/JobBulletins_cleaned/MECHANICAL REPAIRER 3773 092118.txt\n",
      "CityofLA/JobBulletins_cleaned/OFFICE TRAINEE 1101 012017.txt\n",
      "CityofLA/JobBulletins_cleaned/PAINTER 3423 092118.txt\n",
      "CityofLA/JobBulletins_cleaned/PAINTER SUPERVISOR 3426 120514.txt\n",
      "CityofLA/JobBulletins_cleaned/PILE DRIVER WORKER 3553 041417.txt\n",
      "CityofLA/JobBulletins_cleaned/PIPEFITTER 3433 080318.txt\n",
      "CityofLA/JobBulletins_cleaned/PIPEFITTER SUPERVISOR 3438 081216.txt\n",
      "CityofLA/JobBulletins_cleaned/PLUMBER 3443 113018.txt\n",
      "CityofLA/JobBulletins_cleaned/PLUMBER SUPERVISOR 3446 100518.txt\n",
      "CityofLA/JobBulletins_cleaned/POLICE SURVEILLANCE SPECIALIST 3687 052215.txt\n",
      "CityofLA/JobBulletins_cleaned/PORT ELECTRICAL MECHANIC 3758 022616.txt\n",
      "CityofLA/JobBulletins_cleaned/PORT ELECTRICAL MECHANIC SUPERVISOR 3759 031816.txt\n",
      "CityofLA/JobBulletins_cleaned/POWER SHOVEL OPERATOR 3558 062416.txt\n",
      "CityofLA/JobBulletins_cleaned/REINFORCING STEEL WORKER 3483 022318.txt\n",
      "CityofLA/JobBulletins_cleaned/ROOFER 3476 121214.txt\n",
      "CityofLA/JobBulletins_cleaned/ROOFER SUPERVISOR 3478 062218.txt\n",
      "CityofLA/JobBulletins_cleaned/SENIOR AUTOMOTIVE SUPERVISOR 3716 112015.txt\n",
      "CityofLA/JobBulletins_cleaned/SENIOR BUILDING OPERATING ENGINEER 5925 011615 (1).txt\n",
      "CityofLA/JobBulletins_cleaned/SENIOR CARPENTER  3345 081117 REV 082417.txt\n",
      "CityofLA/JobBulletins_cleaned/SENIOR COMMUNICATIONS ELECTRICIAN 3638 030317 (1).txt\n",
      "CityofLA/JobBulletins_cleaned/SENIOR COMMUNICATIONS ELECTRICIAN SUPERVISOR 3691 041318.txt\n",
      "CityofLA/JobBulletins_cleaned/SENIOR ELECTRICAL MECHANIC 3834 060217 (2) REVISED.txt\n",
      "CityofLA/JobBulletins_cleaned/SENIOR ELECTRICIAN  3864 102116 Rev 110216.txt\n",
      "CityofLA/JobBulletins_cleaned/SENIOR EQUIPMENT MECHANIC 3712 010518 REV 080718.txt\n",
      "CityofLA/JobBulletins_cleaned/SENIOR HEAVY DUTY EQUIPMENT MECHANIC 3745 012017.txt\n",
      "CityofLA/JobBulletins_cleaned/SENIOR MECHANICAL REPAIRER 3772 030416.txt\n",
      "CityofLA/JobBulletins_cleaned/SENIOR PAINTER 3424 041318.txt\n",
      "CityofLA/JobBulletins_cleaned/SENIOR PLUMBER 3444 020516.txt\n",
      "CityofLA/JobBulletins_cleaned/SENIOR PORT ELECTRICAL MECHANIC 3847 072916 REV 081116 (1).txt\n",
      "CityofLA/JobBulletins_cleaned/SENIOR ROOFER 3477 101708 REV 110608.txt\n",
      "CityofLA/JobBulletins_cleaned/SENIOR WASTEWATER TREATMENT OPERATOR 4124 041417.txt\n",
      "CityofLA/JobBulletins_cleaned/SHEET METAL SUPERVISOR 3777 061314.txt\n",
      "CityofLA/JobBulletins_cleaned/SHEET METAL WORKER 3775 093016.txt\n",
      "CityofLA/JobBulletins_cleaned/SHIP CARPENTER 3348 093016.txt\n",
      "CityofLA/JobBulletins_cleaned/SIGN PAINTER 3428 121214.txt\n",
      "CityofLA/JobBulletins_cleaned/SIGN SHOP SUPERVISOR 3419 030615.txt\n",
      "CityofLA/JobBulletins_cleaned/SIGNAL SYSTEMS ELECTRICIAN 3819 042018.txt\n",
      "CityofLA/JobBulletins_cleaned/SIGNAL SYSTEMS SUPERVISOR 3839 092818.txt\n",
      "CityofLA/JobBulletins_cleaned/STEAM PLANT MAINTENANCE MECHANIC 5630 0902116.txt\n",
      "CityofLA/JobBulletins_cleaned/STEAM PLANT OPERATOR 5624 101416.txt\n",
      "CityofLA/JobBulletins_cleaned/STREET LIGHTING ELECTRICIAN  3811 022318.txt\n",
      "CityofLA/JobBulletins_cleaned/STREET LIGHTING ELECTRICIAN SUPERVISOR 3840 031717.txt\n",
      "CityofLA/JobBulletins_cleaned/STRUCTURAL STEEL FABRICATOR 3793 122316.txt\n",
      "CityofLA/JobBulletins_cleaned/TILE SETTER 3493 090415.txt\n",
      "CityofLA/JobBulletins_cleaned/TIRE REPAIRER 3727 091517 (1).txt\n",
      "CityofLA/JobBulletins_cleaned/UPHOLSTERER 3723 041715.txt\n",
      "CityofLA/JobBulletins_cleaned/WASTEWATER COLLECTION SUPERVISOR 4113 121616.txt\n",
      "CityofLA/JobBulletins_cleaned/WASTEWATER TREATMENT ELECTRICIAN 5615 060812 REV 011218.txt\n",
      "CityofLA/JobBulletins_cleaned/WASTEWATER TREATMENT ELECTRICIAN SUPERVISOR 5613 060515.txt\n",
      "CityofLA/JobBulletins_cleaned/WASTEWATER TREATMENT MECHANIC 5614 021712 REV 120417.txt\n",
      "CityofLA/JobBulletins_cleaned/WASTEWATER TREATMENT MECHANIC SUPERVISOR 5617 072117 (1).txt\n",
      "CityofLA/JobBulletins_cleaned/WASTEWATER TREATMENT OPERATOR 4123 120718.txt\n",
      "CityofLA/JobBulletins_cleaned/WELDER 3796 102816.txt\n",
      "CityofLA/JobBulletins_cleaned/WELDER SUPERVISOR 3798 120817.txt\n"
     ]
    }
   ],
   "source": [
    "# Check 1 and 2 by checking which job has the word, flat, in it.\n",
    "for file_name in cleaned_jobs:\n",
    "    job_path = cleaned_path + file_name        # define path to file_name\n",
    "    cleaned_job  = open(job_path, 'rt').read() # read in job as a string\n",
    "    try:\n",
    "        txt  = cleaned_job[cleaned_job.index('ANNUAL SALARY'):cleaned_job.index('NOTES:')]\n",
    "        if 'flat' in txt:\n",
    "            print(job_path)\n",
    "    except:                                # do some pretty printings here to help our eyes from pain\n",
    "        ## define some useful variables\n",
    "        border_line = '##############################################################################################'\n",
    "        how_many    = int((len(border_line) - len(job_path))/2)\n",
    "        print(border_line)\n",
    "        ## do pretty printings\n",
    "        print('#'*how_many + job_path + '#'*how_many)\n",
    "        print(border_line)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Once we finish task 1 and 2, we can move on to task 3."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 21,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "CityofLA/JobBulletins_cleaned/ARCHITECTURAL DRAFTING TECHNICIAN 7922 080417 REVISED 081717.txt\n",
      "CityofLA/JobBulletins_cleaned/CIVIL ENGINEER 7237 020918.txt\n",
      "CityofLA/JobBulletins_cleaned/CIVIL ENGINEERING DRAFTING TECHNICIAN 7232 080417 REVISED 081717.txt\n",
      "CityofLA/JobBulletins_cleaned/CONSTRUCTION INSPECTOR 7291 042117.txt\n",
      "CityofLA/JobBulletins_cleaned/CUSTODIAL SERVICES ASSISTANT 3149 012017.txt\n",
      "CityofLA/JobBulletins_cleaned/CUSTODIAN 3156 111618.txt\n",
      "CityofLA/JobBulletins_cleaned/CUSTODIAN SUPERVISOR 3176 042817 051117 REV.txt\n",
      "CityofLA/JobBulletins_cleaned/ELECTRICAL ENGINEERING DRAFTING TECHNICIAN 7532 113018.txt\n",
      "CityofLA/JobBulletins_cleaned/ENGINEERING DESIGNER 7217 082517 REV 090717.txt\n",
      "CityofLA/JobBulletins_cleaned/EQUIPMENT SUPERVISOR 3527 041318.txt\n",
      "CityofLA/JobBulletins_cleaned/GRAPHICS DESIGNER 1670 011218.txt\n",
      "CityofLA/JobBulletins_cleaned/HEAD CUSTODIAN SUPERVISOR  3178 050418.txt\n",
      "CityofLA/JobBulletins_cleaned/LEGISLATIVE REPRESENTATIVE 9482 122917.txt\n",
      "CityofLA/JobBulletins_cleaned/SENIOR CONSTRUCTION INSPECTOR 7294 090117 REV 091317.txt\n",
      "CityofLA/JobBulletins_cleaned/SENIOR CUSTODIAN 3157 062918.txt\n",
      "CityofLA/JobBulletins_cleaned/SENIOR WINDOW CLEANER 3174 013114 Rev021314.txt\n",
      "CityofLA/JobBulletins_cleaned/WINDOW CLEANER 3173 032417.txt\n"
     ]
    }
   ],
   "source": [
    "# Check if salary information regarding Los Angeles World Airport, Department of Airports, \n",
    "# or Harbor Department is within 'ANNUAL SALARY' and 'NOTES'.\n",
    "# If there is, manually move to the end and create a new section called ADDITIONAL SALARY INFORMATION\n",
    "for file_name in cleaned_jobs:\n",
    "    job_path = cleaned_path + file_name        # define path to file_name\n",
    "    cleaned_job  = open(job_path, 'rt').read() # read in job as a string\n",
    "    try:\n",
    "        txt  = cleaned_job[cleaned_job.index('ANNUAL SALARY'):cleaned_job.index('NOTES:')].lower()\n",
    "        if ('airport' in txt) or ('harbor' in txt):\n",
    "            print(job_path)\n",
    "    except:                                # do some pretty printings here to help our eyes from pain\n",
    "        ## define some useful variables\n",
    "        border_line = '##############################################################################################'\n",
    "        how_many    = int((len(border_line) - len(job_path))/2)\n",
    "        print(border_line)\n",
    "        ## do pretty printings\n",
    "        print('#'*how_many + job_path + '#'*how_many)\n",
    "        print(border_line)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 22,
   "metadata": {},
   "outputs": [],
   "source": [
    "# Rerun the code above to check if no other salary information is given except regular and DWP salary\n",
    "# If nothing gets printed out, that means we pass the test.for file_name in cleaned_jobs:\n",
    "for file_name in cleaned_jobs:\n",
    "    job_path = cleaned_path + file_name        # define path to file_name\n",
    "    cleaned_job  = open(job_path, 'rt').read() # read in job as a string\n",
    "    try:\n",
    "        txt  = cleaned_job[cleaned_job.index('ANNUAL SALARY'):cleaned_job.index('NOTES:')].lower()\n",
    "        if ('airport' in txt) or ('harbor' in txt):\n",
    "            print(job_path)\n",
    "    except:                                # do some pretty printings here to help our eyes from pain\n",
    "        ## define some useful variables\n",
    "        border_line = '##############################################################################################'\n",
    "        how_many    = int((len(border_line) - len(job_path))/2)\n",
    "        print(border_line)\n",
    "        ## do pretty printings\n",
    "        print('#'*how_many + job_path + '#'*how_many)\n",
    "        print(border_line)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Finally, we can get salary information."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 23,
   "metadata": {},
   "outputs": [],
   "source": [
    "# This is a sub-helper function\n",
    "def _get_salary(salary_text):\n",
    "    '''Returns job's salary in the form of $#####-$#####, $##### (flat-rated)'''\n",
    "    # The idea is to use isdigit() function to recognize a number. So need to strip off everthing that fails this.\n",
    "    # Replace '.' with white space. This resolves '#####.' (dot at the end)\n",
    "    # Replace '$' with white space. This resolves '$#####' (dollar sign in the beginning)\n",
    "    # Replace ',' with empty space. This resolves '$##,###' (comma in the middle of the number)\n",
    "    # Empty space because we will split at white space later\n",
    "    temp = (salary_text.replace('.', '')\n",
    "                       .replace('$', '')\n",
    "                       .replace(',', '')\n",
    "                       .replace(';', '')\n",
    "                       .replace('*',''))\n",
    "    \n",
    "    # Get salaries in temp by using the isdigit() function. \n",
    "    salary_range = []\n",
    "    for word in temp.split():      # split here\n",
    "        if len(salary_range) >= 2: # break to make sure that only the first listed salary range is included\n",
    "            break\n",
    "        else:                      # otherwise, put it in the salary_range list\n",
    "            if word.isdigit():\n",
    "                salary_range.append(word)\n",
    "    \n",
    "    # Returns the required format\n",
    "    return '-'.join(salary_range)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 25,
   "metadata": {},
   "outputs": [],
   "source": [
    "# This is a helper function\n",
    "def entry_salary_gen(job):\n",
    "    '''Returns ENTRY_SALARY_GEN (esg)'''\n",
    "    # From ANNUAL SALARY to Department of Water and Power is where the information located\n",
    "    # Instead of find, I switch to index to take advantage of try/except later.\n",
    "    temp = job[job.index('ANNUAL SALARY'):job.index('Department of Water and Power')]\n",
    "    \n",
    "    # Returns\n",
    "    esg = _get_salary(salary_text=temp)\n",
    "    return esg"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 31,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "125175-155514\n",
      "49903-72996\n",
      "49005-71618\n",
      "55332-80930\n",
      "60489-88468\n",
      "37584-54935\n",
      "54726-80012\n",
      "78487-97530\n",
      "90118\n",
      "103841\n",
      "43242-63203\n",
      "125551-183576\n",
      "105005-153509\n",
      "31946-44265\n",
      "42991-62869\n",
      "93918-137327\n",
      "99326-141378\n",
      "142568-187001\n",
      "102186-134028\n",
      "51448-83019\n",
      "\n",
      "53682-78467\n",
      "90369-132108\n",
      "66523-97321\n",
      "86777-123463\n",
      "39337-57545\n",
      "38565-56396\n",
      "65646-81536\n",
      "46374-67818\n",
      "45810-66983\n",
      "93792-110455\n",
      "58986-86255\n",
      "63036-81056\n",
      "69655-89544\n",
      "55624-69133\n",
      "50342-62536\n",
      "74082-89596\n",
      "44933-65688\n",
      "55415-68841\n",
      "94419-99681\n",
      "89637-131063\n",
      "64916-92394\n",
      "50759-74228\n",
      "57273-83728\n",
      "51281-63725\n",
      "50342-73581\n",
      "43493-63579\n",
      "48797-71326\n",
      "59842-87508\n",
      "100829\n",
      "98971\n",
      "46165-57336\n",
      "72767-103564\n",
      "106404-155556\n",
      "52096-74103\n",
      "70094\n",
      "114088-162362\n",
      "145199-180382\n",
      "37813-55332\n",
      "44996-47502\n",
      "111749-159022\n",
      "70094\n",
      "73466\n",
      "35746-52241\n",
      "70845-88030\n",
      "116928-170986\n",
      "62076-77130\n",
      "54455-79594\n",
      "78801\n",
      "79406\n",
      "71221\n",
      "77256-83561\n",
      "40987-58276\n",
      "89470\n",
      "90660\n",
      "102165-149375\n",
      "62514-91370\n",
      "54120-79156\n",
      "83352\n",
      "\n",
      "88009-109348\n",
      "94858-138643\n",
      "110726-161945\n",
      "94858-134927\n",
      "83144-100516\n",
      "121166\n",
      "94858-134927\n",
      "83144-100516\n",
      "92352\n",
      "84585-102291\n",
      "44411-64915\n",
      "48608-69175\n",
      "54392-77381\n",
      "78279-114443\n",
      "86312\n",
      "94607\n",
      "81682\n",
      "79244\n",
      "90744\n",
      "48211-64999\n",
      "61491-87508\n",
      "122732-179442\n",
      "117972-146577\n",
      "120644-171654\n",
      "119997\n",
      "63182-92394\n",
      "65751-96131\n",
      "67400-98553\n",
      "73163-106968\n",
      "60489-88468\n",
      "106049-155034\n",
      "52408-65124\n",
      "107511-133569\n",
      "90326-132066\n",
      "148206-184140\n",
      "106362-155493\n",
      "145867-196585\n",
      "106050-150879\n",
      "111750-159022\n",
      "123667-179944\n",
      "105736-150398\n",
      "135302-168084\n",
      "90473-132274\n",
      "123067-179944\n",
      "88197-109599\n",
      "245758-281462\n",
      "102646-127493\n",
      "55227-80763\n",
      "93250-132671\n",
      "105172-130687\n",
      "69864-102166\n",
      "87236-127555\n",
      "72432-105903\n",
      "89638-131064\n",
      "66231-94252\n",
      "50759-74228\n",
      "106801-112752\n",
      "68027-84543\n",
      "86025-106884\n",
      "74437-78592\n",
      "55332-80930\n",
      "72745-87988\n",
      "58401-85420\n",
      "90645\n",
      "99347\n",
      "89638-127556\n",
      "66231-96841\n",
      "41697-59340\n",
      "105966-131648\n",
      "101664-148665\n",
      "49903-72996\n",
      "90640-132546\n",
      "122377-197670\n",
      "114485\n",
      "42741-60823\n",
      "70428-102980\n",
      "80283-97092\n",
      "102729-150210\n",
      "64456-94252\n",
      "65250-83290\n",
      "59487-86965\n",
      "65584-95901\n",
      "29733-43451\n",
      "31173-45560\n",
      "36477-51907\n",
      "57148-71012\n",
      "50237-73476\n",
      "43639-63809\n",
      "97781-142944\n",
      "60823\n",
      "36519-53390\n",
      "91913-130771\n",
      "46625-70052\n",
      "123066-179943\n",
      "141858-201867\n",
      "141859-201868\n",
      "123066-179943\n",
      "123066-179943\n",
      "101831-148853\n",
      "120644-171654\n",
      "108576-154512\n",
      "100370-124695\n",
      "108576-154512\n",
      "117596-171946\n",
      "101643-126282\n",
      "120644-171654\n",
      "76128-111332\n",
      "120645-171654\n",
      "61554-89993\n",
      "37416-54705\n",
      "74666-96006\n",
      "126783-133861\n",
      "70386-74311\n",
      "70804-87988\n",
      "55415-68841\n",
      "64352-79949\n",
      "63686\n",
      "66231-94252\n",
      "51907-75898\n",
      "81494-98553\n",
      "69655-99514\n",
      "96277-119621\n",
      "115570-122022\n",
      "\n",
      "63579-78989\n",
      "164764-204707\n",
      "54079-67170\n",
      "88218\n",
      "99347\n",
      "100866\n",
      "68883\n",
      "103001\n",
      "82789-121020\n",
      "77715-104734\n",
      "83645-122273\n",
      "93083-136074\n",
      "91955-108283\n",
      "127347-171612\n",
      "60385-88260\n",
      "94857-138643\n",
      "66231-94252\n",
      "101664-148665\n",
      "62661-91642\n",
      "89637-127555\n",
      "64916-92394\n",
      "60281-85796\n",
      "82496-120582\n",
      "78675\n",
      "90201\n",
      "94523\n",
      "62744-91746\n",
      "107385-133423\n",
      "84918-99931\n",
      "45956-67191\n",
      "60656-88698\n",
      "129873-184788\n",
      "42595-62285\n",
      "71451-91224\n",
      "68159-100370\n",
      "87654-128140\n",
      "87361-127702\n",
      "50153-62305\n",
      "175141-206148\n",
      "145909-171800\n",
      "119016-132650\n",
      "88426-104128\n",
      "102520-114380\n",
      "66231-96841\n",
      "83373-121897\n",
      "80283-97092\n",
      "81160-118661\n",
      "88426-104128\n",
      "109974-122586\n",
      "65521-69008\n",
      "87883-128516\n",
      "100203-124507\n",
      "58986-86255\n",
      "36874-49694\n",
      "36665-53598\n",
      "39776-49402\n",
      "39672-57983\n",
      "118577\n",
      "199905-248367\n",
      "85127-124423\n",
      "60447-75084\n",
      "75585-110538\n",
      "94857-138643\n",
      "42428-57169\n",
      "45644-66732\n",
      "46708-68319\n",
      "80806-118160\n",
      "123024-179860\n",
      "70908-103648\n",
      "91913-134362\n",
      "45163-66043\n",
      "76420-85169\n",
      "84188\n",
      "54037-65333\n",
      "96074\n",
      "108095\n",
      "83144-100516\n",
      "59487-86965\n",
      "72954-106675\n",
      "62226-93918\n",
      "67818-84250\n",
      "63057-92185\n",
      "87048-127242\n",
      "116736-145032\n",
      "102458-108179\n",
      "85900-125593\n",
      "59675-87258\n",
      "111373-158500\n",
      "103382\n",
      "119036\n",
      "58171-85044\n",
      "93354-136471\n",
      "49631-61679\n",
      "44474-65020\n",
      "41530-60760\n",
      "66440-97133\n",
      "89638-131064\n",
      "66231-94252\n",
      "76379-111624\n",
      "91851-134300\n",
      "62347-77464\n",
      "46374-67818\n",
      "46812-58150\n",
      "74666-92748\n",
      "84075\n",
      "81703\n",
      "85962-96444\n",
      "39672-56438\n",
      "37458-54789\n",
      "47732-69760\n",
      "70156-102562\n",
      "48796-71326\n",
      "148561-184579\n",
      "52304-76462\n",
      "64686-94586\n",
      "110371-137139\n",
      "92769-115278\n",
      "89852\n",
      "66231-96841\n",
      "50718-74145\n",
      "119078-147934\n",
      "66231-94252\n",
      "51845-75794\n",
      "39839-58234\n",
      "121166\n",
      "96528\n",
      "82000\n",
      "39797-58150\n",
      "56041-69634\n",
      "120080-175559\n",
      "55185-80659\n",
      "72309-88635\n",
      "45121-65959\n",
      "35809-52408\n",
      "35809\n",
      "71263-101393\n",
      "82726\n",
      "83645\n",
      "51448-75188\n",
      "52158-76274\n",
      "32635-42824\n",
      "66147-96757\n",
      "30923-38419\n",
      "86610-123255\n",
      "73936-91830\n",
      "48963-66001\n",
      "53390-75982\n",
      "63767-93229\n",
      "63579-92957\n",
      "74854-109432\n",
      "70156-102562\n",
      "110225-161151\n",
      "57691-84334\n",
      "73080-106842\n",
      "47752-69822\n",
      "85190\n",
      "94455\n",
      "107886\n",
      "61659-90181\n",
      "94445\n",
      "108482\n",
      "78696-95171\n",
      "119767-175120\n",
      "150649-177271\n",
      "183472-215899\n",
      "95672-112626\n",
      "125572-139916\n",
      "57420-88427\n",
      "56898-83165\n",
      "102562-114318\n",
      "50550-71911\n",
      "90473-132274\n",
      "57420-88427\n",
      "92524\n",
      "62953-92018\n",
      "102687\n",
      "119172\n",
      "45706-65020\n",
      "173554-193432\n",
      "128766-168898\n",
      "102541-134488\n",
      "48713-81474\n",
      "88886-116593\n",
      "127910-187022\n",
      "145638-180966\n",
      "91036\n",
      "68528-82852\n",
      "77840-113816\n",
      "53411-78112\n",
      "123066-179943\n",
      "123067-179944\n",
      "67964-99347\n",
      "54120-79156\n",
      "51114-74729\n",
      "83520-88176\n",
      "54100-55583\n",
      "88322-129142\n",
      "145867-181217\n",
      "64812-94733\n",
      "110664-116844\n",
      "88447-109870\n",
      "123066-179943\n",
      "70010-94335\n",
      "86380-126303\n",
      "83938-119413\n",
      "88447-109870\n",
      "75335-110142\n",
      "58777-83645\n",
      "66899-95212\n",
      "73163-106947\n",
      "49882-72975\n",
      "70177-102625\n",
      "87863-128495\n",
      "85482-124966\n",
      "123066-175120\n",
      "121312-150711\n",
      "80284-117346\n",
      "67171-74855\n",
      "69968-102291\n",
      "58171-85044\n",
      "79239-115863\n",
      "65124-92665\n",
      "95088-135282\n",
      "45310-64457\n",
      "86234\n",
      "85086-121041\n",
      "47731-69760\n",
      "109787-160483\n",
      "126365-156975\n",
      "46687-68298\n",
      "70490-103084\n",
      "46708-68319\n",
      "47314-67317\n",
      "51657-73518\n",
      "63266-92498\n",
      "72432-103084\n",
      "47042-66920\n",
      "60886-86631\n",
      "85545-103439\n",
      "82267-120289\n",
      "88030\n",
      "40486-50279\n",
      "47752-69822\n",
      "157393-195541\n",
      "103669-151567\n",
      "54977-80388\n",
      "87236-127555\n",
      "81161-115487\n",
      "67797\n",
      "88698\n",
      "112355-151421\n",
      "83290-121772\n",
      "84731-94440\n",
      "89074-107678\n",
      "74623-90222\n",
      "114610-142380\n",
      "91392-130082\n",
      "49423-70323\n",
      "57148-71012\n",
      "34660-43075\n",
      "41342-60405\n",
      "62535-91391\n",
      "86338-126198\n",
      "46374-67818\n",
      "49882-74917\n",
      "48964-69656\n",
      "105444-149981\n",
      "57816-84543\n",
      "74374-108763\n",
      "103126\n",
      "84731-94440\n",
      "89074-107678\n",
      "94836\n",
      "92347\n",
      "74709-106279\n",
      "98261-143633\n",
      "105444-154115\n",
      "57816-84543\n",
      "76984-95651\n",
      "68110-84626\n",
      "89784-111540\n",
      "94941\n",
      "109223\n",
      "105444-149981\n",
      "52742-77130\n",
      "52304-76462\n",
      "109098-135553\n",
      "80575-117784\n",
      "89345-108012\n",
      "34034-49736\n",
      "52304-76463\n",
      "51699-73560\n",
      "108805-114881\n",
      "85545-106279\n",
      "55290-80868\n",
      "90410-109306\n",
      "111540\n",
      "125154-132128\n",
      "130875-138162\n",
      "81703-101497\n",
      "94920\n",
      "67338-98449\n",
      "109098-135552\n",
      "83337\n",
      "119433-148394\n",
      "103606-151484\n",
      "87883-128516\n",
      "44411-63182\n",
      "84731-94440\n",
      "88865\n",
      "90410-109306\n",
      "79239-115863\n",
      "\n",
      "95714-139917\n",
      "106842-156182\n",
      "100370-146744\n",
      "71889-102291\n",
      "144573-179609\n",
      "122670-136075\n",
      "81035-118473\n",
      "73894-103460\n",
      "78195\n",
      "90995\n",
      "69279-98574\n",
      "61512-82872\n",
      "46625-68173\n",
      "36310-51657\n",
      "86338-126198\n",
      "60969-89136\n",
      "99012\n",
      "90410-109306\n",
      "68089-99576\n",
      "112955\n",
      "51803-75732\n",
      "83352-121876\n",
      "54455-77506\n",
      "68006\n",
      "83415-121939\n",
      "85086-124382\n",
      "44745-65458\n",
      "52806-77172\n",
      "105444-154115\n",
      "111373-158500\n",
      "103982-152048\n",
      "81160-118661\n",
      "79511-116259\n",
      "61658-90180\n",
      "51970-75982\n",
      "105444-149981\n",
      "66294-96904\n",
      "119454-126115\n",
      "82517-102520\n",
      "107364-113357\n",
      "117199-145596\n",
      "106780-132671\n",
      "114234\n",
      "44223-54956\n",
      "67066-98073\n",
      "92039\n",
      "86777\n",
      "96444-119830\n",
      "82350\n",
      "155660-193390\n",
      "72766\n",
      "81578\n",
      "90645\n",
      "92707-131919\n",
      "104123\n",
      "58171-85044\n",
      "88218-125551\n",
      "81161-118661\n",
      "64665-94502\n",
      "76379-111624\n",
      "144218-179171\n",
      "60405-75042\n",
      "\n",
      "115570-122022\n",
      "92665\n",
      "45309-66231\n",
      "84376-120039\n",
      "91558-133882\n",
      "90645\n",
      "99347\n",
      "89637-127555\n",
      "64916-92394\n",
      "103356-147078\n",
      "62347-77464\n",
      "85816-125447\n",
      "71409-88719\n",
      "41760-61053\n",
      "81828-119684\n",
      "94857-138643\n",
      "66231-94252\n",
      "95191\n",
      "\n",
      "123066-179943\n",
      "95672-136138\n",
      "65417-81285\n",
      "88114-128809\n",
      "76734-95317\n",
      "102353-149667\n",
      "50654-72098\n",
      "72621-106175\n",
      "91496-133716\n",
      "49841-61930\n",
      "68611-100307\n",
      "89575-130980\n",
      "59361-86819\n",
      "45956-67191\n",
      "55874-81703\n",
      "99618-141775\n",
      "83290\n",
      "50279-60823\n",
      "56793-80826\n",
      "56835-83144\n",
      "45017-48838\n",
      "44578-63412\n",
      "127200-158061\n",
      "89637-127555\n",
      "49255-72036\n",
      "68549-85149\n",
      "55019-80472\n",
      "63078-92206\n",
      "59904-87591\n",
      "47898-70052\n",
      "36728-52242\n",
      "59215-84250\n",
      "72036-89470\n",
      "52262-64915\n",
      "70783-87946\n",
      "110476-116635\n",
      "75335\n",
      "91892-114150\n",
      "71868-89303\n",
      "97363-120957\n",
      "83352-103564\n",
      "75188-79385\n",
      "99305-123379\n",
      "74750-92895\n",
      "50425-73706\n",
      "52951-77402\n",
      "52951-77402\n",
      "58171-85044\n",
      "39672-57983\n",
      "90034\n",
      "43973-62556\n",
      "96423\n",
      "106080\n",
      "91684-134049\n",
      "92326\n",
      "118843\n",
      "94361\n",
      "61491-87508\n",
      "63663-79073\n",
      "70177-87194\n",
      "89888-94899\n",
      "64310-79886\n",
      "196000-243502\n",
      "65646-81536\n",
      "109411-115508\n",
      "54308-67484\n",
      "93041-98219\n",
      "131084-162864\n",
      "97697-103147\n",
      "\n",
      "76608-95191\n",
      "116740-145032\n",
      "94001-116781\n",
      "81703\n",
      "97895\n",
      "55854-81640\n",
      "38857-55332\n",
      "56898-83165\n",
      "51385-63830\n",
      "52200-76295\n",
      "78300-94712\n",
      "57628-84229\n",
      "55666-81390\n"
     ]
    }
   ],
   "source": [
    "# Print out results of entry_salary_gen\n",
    "for file_name in cleaned_jobs:\n",
    "    job_path = cleaned_path + file_name        # define path to file_name\n",
    "    cleaned_job  = open(job_path, 'rt').read() # read in job as a string\n",
    "    try:\n",
    "        print(entry_salary_gen(job=cleaned_job))\n",
    "    except:                                # do some pretty printings here to help our eyes from pain\n",
    "        ## define some useful variables\n",
    "        border_line = '##############################################################################################'\n",
    "        how_many    = int((len(border_line) - len(job_path))/2)\n",
    "        print(border_line)\n",
    "        ## do pretty printings\n",
    "        print('#'*how_many + job_path + '#'*how_many)\n",
    "        print(border_line)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "This looks good. We repeat that if a job only has one number (actually a number string) printed out, then that job doesn't have a salary range but only flat rate (and only the first flat rate is captured, just like salary range). On the other hand, it seems that some jobs don't have any entry level general salary. Let's print them out and cross check this information with the **pdf** files."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 30,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "CityofLA/JobBulletins_cleaned/AIRPORT POLICE SPECIALIST 3236 063017 (2).txt\n",
      "CityofLA/JobBulletins_cleaned/BOILERMAKER 3735 110714.txt\n",
      "CityofLA/JobBulletins_cleaned/ELECTRICAL REPAIRER 3853 122917 updated.txt\n",
      "CityofLA/JobBulletins_cleaned/SENIOR HYDROGRAPHER 7264 030714.txt\n",
      "CityofLA/JobBulletins_cleaned/STEAM PLANT MAINTENANCE MECHANIC 5630 0902116.txt\n",
      "CityofLA/JobBulletins_cleaned/STRUCTURAL STEEL FABRICATOR SUPERVISOR 3794 060217.txt\n",
      "CityofLA/JobBulletins_cleaned/WATER UTILITY WORKER 3912 120817.txt\n"
     ]
    }
   ],
   "source": [
    "for file_name in cleaned_jobs:\n",
    "    job_path = cleaned_path + file_name        # define path to file_name\n",
    "    cleaned_job  = open(job_path, 'rt').read() # read in job as a string\n",
    "    try:\n",
    "        if len(entry_salary_gen(job=cleaned_job)) < 1:\n",
    "            print(job_path)\n",
    "    except:                                # do some pretty printings here to help our eyes from pain\n",
    "        ## define some useful variables\n",
    "        border_line = '##############################################################################################'\n",
    "        how_many    = int((len(border_line) - len(job_path))/2)\n",
    "        print(border_line)\n",
    "        ## do pretty printings\n",
    "        print('#'*how_many + job_path + '#'*how_many)\n",
    "        print(border_line)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "A check with the above jobs' pdf files show that this salary information was actually left missing, **not because of a bug in our code**. Thus, we are confident to move on the next field: ENTRY_SALARY_DWP. Now, we can see that our hardword above really pays off. We can run the code below without worrying about inaccurate information because data cleaning was already done. Again, if the printout result is empty for a job, it means that it doesn't have DWP salary."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Get ENTRY_SALARY_DWP"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 32,
   "metadata": {},
   "outputs": [],
   "source": [
    "# This is a helper function\n",
    "def entry_salary_dwp(job):\n",
    "    '''Returns ENTRY_SALARY_DWP (esd)'''\n",
    "    # From Department of Water and Power to NOTES is where the information located\n",
    "    # Instead of find, switch to index to take advantage of try/except later.\n",
    "    temp = job[job.index('Department of Water and Power'):job.index('NOTES:')]\n",
    "    \n",
    "    # Returns\n",
    "    esd = _get_salary(salary_text=temp)\n",
    "    return esd"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 33,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "43263-53766\n",
      "\n",
      "\n",
      "99054\n",
      "127388-134488\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "65417-81285\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "124486-154658\n",
      "77360-96110\n",
      "66607-82747\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "71326-88593\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "151902-188713\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "55612-68465\n",
      "\n",
      "94607\n",
      "92665-97822\n",
      "68924-85628\n",
      "58965-88405\n",
      "78237-82601\n",
      "90034-95045\n",
      "\n",
      "\n",
      "\n",
      "63099-78383\n",
      "76608-95191\n",
      "96695\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "82977-103105\n",
      "70845-88030\n",
      "\n",
      "\n",
      "\n",
      "93542\n",
      "96465-101852\n",
      "\n",
      "83373-88030\n",
      "91830-96945\n",
      "\n",
      "78132-97092\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "81912-86484\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "81724-101518\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "124486-154658\n",
      "78905-98031\n",
      "66607-82747\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "115570-122022\n",
      "99639\n",
      "94899-100182\n",
      "115570-122022\n",
      "\n",
      "\n",
      "46729-58067\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "107845-113858\n",
      "57148-71012\n",
      "80910-100516\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "69029-72871\n",
      "\n",
      "\n",
      "54663-67922\n",
      "113670-141211\n",
      "\n",
      "36769-45685\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "52847-65646\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "58839-73100\n",
      "77360-96110\n",
      "71660-89011\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "74332-95567\n",
      "\n",
      "\n",
      "\n",
      "78049-96945\n",
      "\n",
      "101351\n",
      "\n",
      "\n",
      "97739-121438\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "77172-95901\n",
      "103335-128391\n",
      "78905-98031\n",
      "124716-154950\n",
      "\n",
      "\n",
      "77360-96110\n",
      "71722-89094\n",
      "102353-127180\n",
      "91350\n",
      "88405\n",
      "100495-106091\n",
      "76713-95296\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "78801-97906\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "49673-61721\n",
      "44474-64957\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "70908-88092\n",
      "95901-119120\n",
      "\n",
      "\n",
      "\n",
      "73539-86526\n",
      "\n",
      "\n",
      "67985-71785\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "84104-104483\n",
      "73581-91391\n",
      "121500-150962\n",
      "105840\n",
      "115570-122022\n",
      "\n",
      "124340-154491\n",
      "\n",
      "63287-97822\n",
      "52116-64748\n",
      "85858-106675\n",
      "\n",
      "\n",
      "\n",
      "105757-131376\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "97488-102917\n",
      "99514\n",
      "113294-119621\n",
      "57503-71451\n",
      "\n",
      "57774-71785\n",
      "85044-105652\n",
      "51343-63788\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "82496-102499\n",
      "63558-78968\n",
      "\n",
      "78905-98031\n",
      "71660-89011\n",
      "44402-54935\n",
      "99722-123881\n",
      "\n",
      "82204\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "56710-70449\n",
      "57900-71931\n",
      "\n",
      "\n",
      "104775-130165\n",
      "91976\n",
      "93396-98595\n",
      "83728-88405\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "64665-80325\n",
      "\n",
      "101622\n",
      "\n",
      "\n",
      "104587\n",
      "115048\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "76692-95275\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "97071-120602\n",
      "\n",
      "\n",
      "\n",
      "61324-76212\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "128934-136116\n",
      "\n",
      "69780-86693\n",
      "95463-118598\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "105297-130813\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "79406-98658\n",
      "112543-139833\n",
      "\n",
      "\n",
      "\n",
      "67191-83457\n",
      "\n",
      "\n",
      "62368-77506\n",
      "88823-110329\n",
      "61324-76212\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "50174-62326\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "96277-119621\n",
      "61032\n",
      "\n",
      "118535-147287\n",
      "112118-139394\n",
      "\n",
      "101685-113357\n",
      "92978-115508\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "42762-65959\n",
      "\n",
      "\n",
      "53494-66461\n",
      "\n",
      "\n",
      "125760-156245\n",
      "78801-97906\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "78801-97906\n",
      "\n",
      "\n",
      "\n",
      "114568\n",
      "113232-140668\n",
      "\n",
      "55895-69446\n",
      "65103-80910\n",
      "\n",
      "\n",
      "\n",
      "63913-67484\n",
      "74437-95651\n",
      "\n",
      "\n",
      "\n",
      "75376-93625\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "98073\n",
      "\n",
      "\n",
      "\n",
      "63663-79072\n",
      "\n",
      "96945\n",
      "\n",
      "\n",
      "80241-99681\n",
      "114526-142297\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "97906\n",
      "73414-91224\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "102186\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "105172-130687\n",
      "\n",
      "76044\n",
      "\n",
      "104671-130061\n",
      "74291-78425\n",
      "83373-88030\n",
      "\n",
      "\n",
      "132504-164617\n",
      "98198-122001\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "106174-112104\n",
      "80095-99514\n",
      "76692-95275\n",
      "\n",
      "\n",
      "\n",
      "67630-84042\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "97092\n",
      "\n",
      "\n",
      "55540-69008\n",
      "101247-125760\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "122273-151922\n",
      "124486-154658\n",
      "78905-98031\n",
      "\n",
      "102959-108701\n",
      "\n",
      "\n",
      "72474-90055\n",
      "\n",
      "\n",
      "128077-159105\n",
      "\n",
      "89282-121229\n",
      "119413-148352\n",
      "55874-69426\n",
      "70908-88092\n",
      "95964-119245\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "54538-67755\n",
      "75648-93980\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "72328-89864\n",
      "43117-53557\n",
      "94231-99493\n",
      "\n",
      "53264-66168\n",
      "\n",
      "\n",
      "53766-66816\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "55895-69446\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "73142-90869\n",
      "74896-93041\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "67275-83582\n",
      "\n",
      "\n",
      "\n",
      "76608-99848\n",
      "108805-114881\n",
      "\n",
      "\n",
      "76984-95651\n",
      "58860-73121\n",
      "56605-70323\n",
      "\n",
      "\n",
      "\n"
     ]
    }
   ],
   "source": [
    "# Print out results of entry_salary_gen\n",
    "for file_name in cleaned_jobs:\n",
    "    job_path = cleaned_path + file_name        # define path to file_name\n",
    "    cleaned_job  = open(job_path, 'rt').read() # read in job as a string\n",
    "    try:\n",
    "        print(entry_salary_dwp(job=cleaned_job))\n",
    "    except:                                # do some pretty printings here to help our eyes from pain\n",
    "        ## define some useful variables\n",
    "        border_line = '##############################################################################################'\n",
    "        how_many    = int((len(border_line) - len(job_path))/2)\n",
    "        print(border_line)\n",
    "        ## do pretty printings\n",
    "        print('#'*how_many + job_path + '#'*how_many)\n",
    "        print(border_line)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Get OPEN_DATE (od)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Since SYSTEMS ANALYST 1596 102717.txt has the order: Open Date-(Exam Open to All, including Current City Employees)-ANNUAL SALARY, we'll get the open date by extracting information from Open Date to (, i.e., the openning parenthesis. If a job posting doesn't have such one, we'll manually add it to the its .txt file.\n",
    "\n",
    "On the other hand, to test if the openning parenthesis exists, we search for it by looking at the text from Open Date to ANNUAL SALARY."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 34,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "CityofLA/Job Bulletins/311 DIRECTOR  9206 041814.txt\n",
      "CityofLA/Job Bulletins/ADVANCE PRACTICE PROVIDER CORRECTIONAL CARE 2325 020808 REV 111214.txt\n",
      "CityofLA/Job Bulletins/AQUARIST 2400 050214.txt\n",
      "CityofLA/Job Bulletins/ART CENTER DIRECTOR 2478 053014.txt\n",
      "CityofLA/Job Bulletins/ASPHALT PLANT OPERATOR 4143 102414.txt\n",
      "CityofLA/Job Bulletins/AUDIO VISUAL TECHNICIAN 6147 062014.txt\n",
      "CityofLA/Job Bulletins/AVIONICS SPECIALIST 3565 103114revised.txt\n",
      "CityofLA/Job Bulletins/BOILERMAKER 3735 110714.txt\n",
      "CityofLA/Job Bulletins/BOILERMAKER SUPERVISOR 3737 101714.txt\n",
      "CityofLA/Job Bulletins/CHIEF FINANCIAL OFFICER 9230 041114.txt\n",
      "CityofLA/Job Bulletins/CHIEF PARK RANGER 1968 120106 REV 121306.txt\n",
      "CityofLA/Job Bulletins/CHIEF TAX COMPLIANCE OFFICER 1211 041814.txt\n",
      "CityofLA/Job Bulletins/CHIEF TRANSPORTATION INVESTIGATOR 4275 103114.txt\n",
      "CityofLA/Job Bulletins/COMMUNITY AFFAIRS ADVOCATE 2496 111414.txt\n",
      "CityofLA/Job Bulletins/GEOGRAPHIC INFORMATION SYSTEMS SPECIALIST 7213 012414 revised.txt\n",
      "CityofLA/Job Bulletins/INDUSTRIAL CHEMIST 7834 020714.txt\n",
      "CityofLA/Job Bulletins/MARINE ENVIRONMENTAL MANAGER 9437 060614.txt\n",
      "CityofLA/Job Bulletins/MARINE ENVIRONMENTAL SUPERVISOR 9433 071114 (1).txt\n",
      "CityofLA/Job Bulletins/PAINTER SUPERVISOR 3426 120514.txt\n",
      "CityofLA/Job Bulletins/PARKING MANAGER 9170 020714.txt\n",
      "CityofLA/Job Bulletins/PRINCIPAL COMMUNICATIONS OPERATOR 1458 072514.txt\n",
      "CityofLA/Job Bulletins/PRINCIPAL DEPUTY CONTROLLER 7260 032814.txt\n",
      "CityofLA/Job Bulletins/PRINCIPAL WORKERS_ COMPENSATION ANALYST 1777 071814.txt\n",
      "##############################################################################################\n",
      "##############CityofLA/Job Bulletins/PUBLIC INFORMATION DIRECTOR 1800 030317.txt##############\n",
      "##############################################################################################\n",
      "CityofLA/Job Bulletins/RETIREMENT PLAN MANAGER 9149 052314 (1).txt\n",
      "CityofLA/Job Bulletins/ROOFER 3476 121214.txt\n",
      "CityofLA/Job Bulletins/SENIOR CONSTRUCTION ENGINEER 7289 042514.txt\n",
      "CityofLA/Job Bulletins/SENIOR HYDROGRAPHER 7264 030714.txt\n",
      "##############################################################################################\n",
      "############CityofLA/Job Bulletins/SENIOR REAL ESTATE OFFICER 1961 0413018 (2).txt############\n",
      "##############################################################################################\n",
      "CityofLA/Job Bulletins/SENIOR ROOFER 3477 101708 REV 110608.txt\n",
      "CityofLA/Job Bulletins/SENIOR WINDOW CLEANER 3174 013114 Rev021314.txt\n",
      "CityofLA/Job Bulletins/SHEET METAL SUPERVISOR 3777 061314.txt\n",
      "CityofLA/Job Bulletins/SIGN PAINTER 3428 121214.txt\n",
      "CityofLA/Job Bulletins/SUPERVISING OCCUPATIONAL HEALTH  2315 111414.txt\n",
      "CityofLA/Job Bulletins/WATER MICROBIOLOGIST  7857 072514 rev073114.txt\n",
      "CityofLA/Job Bulletins/WATERWORKS MECHANIC SUPERVISOR 3987 051614 (1).txt\n",
      "CityofLA/Job Bulletins/WORKERS_ COMPENSATION CLAIMS ASSISTANT 1775 041114.txt\n"
     ]
    }
   ],
   "source": [
    "# Test whether the oppenning parenthesis is in the text from Open Date to ANNUAL SALARY\n",
    "for file_name in raw_jobs:\n",
    "    job_path = raw_path + file_name        # define path to file_name\n",
    "    raw_job  = open(job_path, 'rt').read() # read in job as a string\n",
    "    try:\n",
    "        txt = raw_job[raw_job.index('Open Date'):raw_job.index('ANNUAL SALARY')]\n",
    "        if '(' not in txt:\n",
    "            print(job_path)\n",
    "    except:                                # do some pretty printings here to help our eyes from pain\n",
    "        ## define some useful variables\n",
    "        border_line = '##############################################################################################'\n",
    "        how_many    = int((len(border_line) - len(job_path))/2)\n",
    "        print(border_line)\n",
    "        ## do pretty printings\n",
    "        print('#'*how_many + job_path + '#'*how_many)\n",
    "        print(border_line)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "A few things to notice here:\n",
    "1. There are two jobs that were caught with errors:\n",
    "    * CityofLA/Job Bulletins/PUBLIC INFORMATION DIRECTOR 1800 030317.txt. It has the word Open date (lower case d) instead of Open Date (upper case D)\n",
    "    * CityofLA/Job Bulletins/SENIOR REAL ESTATE OFFICER 1961 0413018 (2).txt. It has word ANNUALSALARY instead of ANNUAL SALARY.\n",
    "2. The following jobs don't have the openning parenthesis in them:\n",
    "    * CityofLA/Job Bulletins/311 DIRECTOR  9206 041814.txt\n",
    "    * CityofLA/Job Bulletins/ADVANCE PRACTICE PROVIDER CORRECTIONAL CARE 2325 020808 REV 111214.txt\n",
    "    * CityofLA/Job Bulletins/AQUARIST 2400 050214.txt\n",
    "    * CityofLA/Job Bulletins/ART CENTER DIRECTOR 2478 053014.txt\n",
    "    * CityofLA/Job Bulletins/ASPHALT PLANT OPERATOR 4143 102414.txt\n",
    "    * CityofLA/Job Bulletins/AUDIO VISUAL TECHNICIAN 6147 062014.txt\n",
    "    * CityofLA/Job Bulletins/AVIONICS SPECIALIST 3565 103114revised.txt\n",
    "    * CityofLA/Job Bulletins/BOILERMAKER 3735 110714.txt\n",
    "    * CityofLA/Job Bulletins/BOILERMAKER SUPERVISOR 3737 101714.txt\n",
    "    * CityofLA/Job Bulletins/CHIEF FINANCIAL OFFICER 9230 041114.txt\n",
    "    * CityofLA/Job Bulletins/CHIEF PARK RANGER 1968 120106 REV 121306.txt\n",
    "    * CityofLA/Job Bulletins/CHIEF TAX COMPLIANCE OFFICER 1211 041814.txt\n",
    "    * CityofLA/Job Bulletins/CHIEF TRANSPORTATION INVESTIGATOR 4275 103114.txt\n",
    "    * CityofLA/Job Bulletins/COMMUNITY AFFAIRS ADVOCATE 2496 111414.txt\n",
    "    * CityofLA/Job Bulletins/GEOGRAPHIC INFORMATION SYSTEMS SPECIALIST 7213 012414 revised.txt\n",
    "    * CityofLA/Job Bulletins/INDUSTRIAL CHEMIST 7834 020714.txt\n",
    "    * CityofLA/Job Bulletins/MARINE ENVIRONMENTAL MANAGER 9437 060614.txt\n",
    "    * CityofLA/Job Bulletins/MARINE ENVIRONMENTAL SUPERVISOR 9433 071114 (1).txt\n",
    "    * CityofLA/Job Bulletins/PAINTER SUPERVISOR 3426 120514.txt\n",
    "    * CityofLA/Job Bulletins/PARKING MANAGER 9170 020714.txt\n",
    "    * CityofLA/Job Bulletins/PRINCIPAL COMMUNICATIONS OPERATOR 1458 072514.txt\n",
    "    * CityofLA/Job Bulletins/PRINCIPAL DEPUTY CONTROLLER 7260 032814.txt\n",
    "    * CityofLA/Job Bulletins/PRINCIPAL WORKERS_ COMPENSATION ANALYST 1777 071814.txt\n",
    "    * CityofLA/Job Bulletins/RETIREMENT PLAN MANAGER 9149 052314 (1).txt\n",
    "    * CityofLA/Job Bulletins/ROOFER 3476 121214.txt\n",
    "    * CityofLA/Job Bulletins/SENIOR CONSTRUCTION ENGINEER 7289 042514.txt\n",
    "    * CityofLA/Job Bulletins/SENIOR HYDROGRAPHER 7264 030714.txt\n",
    "    * CityofLA/Job Bulletins/SENIOR ROOFER 3477 101708 REV 110608.txt\n",
    "    * CityofLA/Job Bulletins/SENIOR WINDOW CLEANER 3174 013114 Rev021314.txt\n",
    "    * CityofLA/Job Bulletins/SHEET METAL SUPERVISOR 3777 061314.txt\n",
    "    * CityofLA/Job Bulletins/SIGN PAINTER 3428 121214.txt\n",
    "    * CityofLA/Job Bulletins/SUPERVISING OCCUPATIONAL HEALTH  2315 111414.txt\n",
    "    * CityofLA/Job Bulletins/WATER MICROBIOLOGIST  7857 072514 rev073114.txt\n",
    "    * CityofLA/Job Bulletins/WATERWORKS MECHANIC SUPERVISOR 3987 051614 (1).txt\n",
    "    * CityofLA/Job Bulletins/WORKERS_ COMPENSATION CLAIMS ASSISTANT 1775 041114.txt"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "**Let's rerun the function and observe the changes. Note we use .txt files in the JobBulletins_cleaned folder.**\n",
    "\n",
    "Observing the printouts carefully this time, we see that all of the nuances above have been resolved."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 35,
   "metadata": {},
   "outputs": [],
   "source": [
    "# Rerun the code above to check if every job has the pharase 'REQUIREMENTS/MINIMUM QUALIFICATIONS' in it.\n",
    "# If nothing gets printed out, that means we pass the test.\n",
    "for file_name in cleaned_jobs:\n",
    "    job_path     = cleaned_path + file_name    # define path to file_name\n",
    "    cleaned_job  = open(job_path, 'rt').read() # read in job as a string\n",
    "    try:\n",
    "        txt = cleaned_job[cleaned_job.index('Open Date'):cleaned_job.index('ANNUAL SALARY')]\n",
    "        if '(' not in txt:\n",
    "            print(job_path)\n",
    "    except:                                    # do some pretty printings here to help our eyes from pain\n",
    "        ## define some useful variables\n",
    "        border_line = '##############################################################################################'\n",
    "        how_many    = int((len(border_line) - len(job_path))/2)\n",
    "        print(border_line)\n",
    "        ## do pretty printings\n",
    "        print('#'*how_many + job_path + '#'*how_many)\n",
    "        print(border_line)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Now, while fixing the jobs listed above, we noted that the phrase, Revised: ##-##-##, comes before the openning parenthesis, which can break our code. Let's fix this by listing all the jobs that has the word Revised in between Open Date and ANNUAL SALARY. If there is, we'll move it to the **end** of the job."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 36,
   "metadata": {},
   "outputs": [],
   "source": [
    "for file_name in cleaned_jobs:\n",
    "    job_path     = cleaned_path + file_name    # define path to file_name\n",
    "    cleaned_job  = open(job_path, 'rt').read() # read in job as a string\n",
    "    try:\n",
    "        txt = cleaned_job[cleaned_job.index('Open Date'):cleaned_job.index('ANNUAL SALARY')].lower()\n",
    "        txt = txt.replace(':', ' ')            # strip off colons\n",
    "        if 'revised' in txt:\n",
    "            print(job_path)\n",
    "    except:                                    # do some pretty printings here to help our eyes from pain\n",
    "        ## define some useful variables\n",
    "        border_line = '##############################################################################################'\n",
    "        how_many    = int((len(border_line) - len(job_path))/2)\n",
    "        print(border_line)\n",
    "        ## do pretty printings\n",
    "        print('#'*how_many + job_path + '#'*how_many)\n",
    "        print(border_line)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Finally, we can extract Open Date by using the helper function defined below."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 37,
   "metadata": {},
   "outputs": [],
   "source": [
    "# This is a helper function\n",
    "def open_date(job):\n",
    "    '''Returns OPEN_DATE (od)'''\n",
    "    # Open Date: 10-27-17\\n(Exam Open to All\n",
    "    # From Open Date to the first '(' is where the information located\n",
    "    temp = job[job.index('Open Date'):job.index('(')]\n",
    "    # Get the last element\n",
    "    od   = temp.split()[-1]\n",
    "    \n",
    "    return od"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 38,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "04-18-14\n",
      "06-22-18\n",
      "07-13-18\n",
      "07-27-18\n",
      "06-01-18\n",
      "03-30-18\n",
      "10-09-15\n",
      "02-08-08\n",
      "04-14-17\n",
      "11-16-18\n",
      "08-10-18\n",
      "12-04-15\n",
      "07-06-18\n",
      "4-20-18\n",
      "12-11-15\n",
      "02-01-19\n",
      "12-02-16\n",
      "02-16-18\n",
      "09-16-16\n",
      "11-09-06\n",
      "06-30-17\n",
      "12-18-15\n",
      "02-16-18\n",
      "11-16-18\n",
      "12-08-17\n",
      "02-01-19\n",
      "04-01-16\n",
      "12-21-18\n",
      "06-15-18\n",
      "08-31-18\n",
      "07-14-17\n",
      "06-29-18\n",
      "07-08-16\n",
      "07-15-16\n",
      "05-02-14\n",
      "01-08-16\n",
      "08-25-17\n",
      "05-29-15\n",
      "06-30-17\n",
      "09-11-15\n",
      "03-30-18\n",
      "01-31-14\n",
      "08-04-17\n",
      "02-09-18\n",
      "05-30-14\n",
      "07-15-16\n",
      "05-13-16\n",
      "07-21-17\n",
      "09-28-18\n",
      "01-29-16\n",
      "10-05-18\n",
      "10-24-14\n",
      "11-03-17\n",
      "01-26-18\n",
      "08-04-17\n",
      "09-09-16\n",
      "04-28-17\n",
      "03-02-18\n",
      "01-20-17\n",
      "11-13-15\n",
      "05-06-16\n",
      "07-31-15\n",
      "07-21-17\n",
      "01-20-17\n",
      "05-18-18\n",
      "10-26-18\n",
      "06-20-14\n",
      "03-18-16\n",
      "10-13-17\n",
      "05-15-15\n",
      "05-22-15\n",
      "02-24-17\n",
      "10-20-17\n",
      "06-24-16\n",
      "10-31-14\n",
      "06-09-17\n",
      "10-26-18\n",
      "01-19-18\n",
      "08-25-17\n",
      "11-07-14\n",
      "10-17-14\n",
      "03-23-18\n",
      "12-28-18\n",
      "07-15-16\n",
      "10-19-18\n",
      "04-28-17\n",
      "04-07-17\n",
      "08-28-15\n",
      "11-16-18\n",
      "11-18-16\n",
      "03-02-18\n",
      "09-02-16\n",
      "01-22-16\n",
      "12-14-18\n",
      "01-12-18\n",
      "05-13-16\n",
      "06-19-15\n",
      "03-09-18\n",
      "12-09-16\n",
      "10-30-15\n",
      "10-20-17\n",
      "06-24-16\n",
      "05-15-15\n",
      "09-23-16\n",
      "08-05-16\n",
      "01-20-17\n",
      "04-21-17\n",
      "06-12-15\n",
      "08-31-18\n",
      "12-22-17\n",
      "12-28-18\n",
      "04-10-15\n",
      "12-11-2015\n",
      "03-30-18\n",
      "04-11-14\n",
      "09-28-18\n",
      "11-20-15\n",
      "08-25-17\n",
      "09-09-16\n",
      "02-09-18\n",
      "3-24-17\n",
      "04-20-18\n",
      "04-20-18\n",
      "03-16-18\n",
      "12-01-06\n",
      "03-18-16\n",
      "12-09-16\n",
      "09-28-18\n",
      "11-17-17\n",
      "04-18-14\n",
      "10-31-14\n",
      "12-07-18\n",
      "11-03-17\n",
      "02-09-18\n",
      "06-16-17\n",
      "08-04-17\n",
      "02-03-17\n",
      "12-07-18\n",
      "12-16-16\n",
      "06-16-17\n",
      "09-21-18\n",
      "05-19-17\n",
      "11-18-16\n",
      "05-25-18\n",
      "01-27-17\n",
      "07-28-17\n",
      "08-10-18\n",
      "10-13-17\n",
      "11-14-14\n",
      "07-20-18\n",
      "06-22-18\n",
      "11-16-18\n",
      "08-26-16\n",
      "03-04-16\n",
      "01-26-18\n",
      "07-08-16\n",
      "04-21-17\n",
      "03-10-17\n",
      "09-08-17\n",
      "10-16-15\n",
      "06-29-18\n",
      "03-09-18\n",
      "01-20-17\n",
      "11-16-18\n",
      "04-28-17\n",
      "02-09-18\n",
      "10-12-18\n",
      "05-12-17\n",
      "08-31-18\n",
      "09-30-16\n",
      "03-23-18\n",
      "11-17-17\n",
      "11-30-18\n",
      "04-27-18\n",
      "06-23-17\n",
      "01-27-17\n",
      "04-27-18\n",
      "01-26-18\n",
      "04-06-18\n",
      "06-23-17\n",
      "04-15-16\n",
      "06-19-15\n",
      "03-04-16\n",
      "10-12-18\n",
      "04-07-17\n",
      "04-21-17\n",
      "02-23-18\n",
      "01-27-17\n",
      "03-30-18\n",
      "12-14-18\n",
      "04-07-17\n",
      "10-28-16\n",
      "01-20-17\n",
      "02-03-17\n",
      "07-07-17\n",
      "06-30-17\n",
      "09-28-18\n",
      "09-30-16\n",
      "11-30-18\n",
      "03-02-18\n",
      "01-20-17\n",
      "07-22-16\n",
      "09-22-17\n",
      "12-29-17\n",
      "09-09-16\n",
      "09-28-18\n",
      "10-28-16\n",
      "10-13-17\n",
      "09-16-16\n",
      "01-27-17\n",
      "07-14-17\n",
      "03-25-16\n",
      "10-26-18\n",
      "11-06-15\n",
      "11-16-18\n",
      "03-11-16\n",
      "11-11-16\n",
      "10-16-15\n",
      "08-25-17\n",
      "02-23-18\n",
      "08-25-17\n",
      "06-15-18\n",
      "08-05-16\n",
      "08-26-16\n",
      "02-01-13\n",
      "01-29-16\n",
      "05-25-18\n",
      "05-18-18\n",
      "04-14-17\n",
      "01-27-17\n",
      "11-17-17\n",
      "12-19-14\n",
      "04-13-18\n",
      "12-04-15\n",
      "08-31-18\n",
      "06-09-17\n",
      "06-24-16\n",
      "09-23-16\n",
      "02-02-18\n",
      "10-20-17\n",
      "07-01-16\n",
      "05-29-15\n",
      "01-12-18\n",
      "3-09-18\n",
      "03-30-18\n",
      "08-14-15\n",
      "03-17-17\n",
      "04-13-18\n",
      "02-12-16\n",
      "06-23-17\n",
      "06-24-16\n",
      "10-23-15\n",
      "10-23-15\n",
      "01-19-18\n",
      "10-19-18\n",
      "04-21-17\n",
      "06-22-18\n",
      "09-25-15\n",
      "01-20-17\n",
      "01-30-15\n",
      "10-05-18\n",
      "06-19-15\n",
      "04-21-17\n",
      "03-04-16\n",
      "01-24-14\n",
      "03-17-17\n",
      "09-07-18\n",
      "12-11-15\n",
      "12-08-17\n",
      "01-12-18\n",
      "05-26-17\n",
      "12-07-18\n",
      "11-18-16\n",
      "08-10-18\n",
      "05-04-18\n",
      "12-11-15\n",
      "02-17-17\n",
      "12-23-16\n",
      "07-22-05\n",
      "12-16-16\n",
      "07-06-18\n",
      "06-29-18\n",
      "08-10-18\n",
      "12-22-17\n",
      "01-27-17\n",
      "10-02-15\n",
      "05-15-15\n",
      "02-07-14\n",
      "05-25-18\n",
      "01-26-18\n",
      "08-04-17\n",
      "09-01-17\n",
      "06-08-18\n",
      "05-19-17\n",
      "01-19-18\n",
      "06-15-18\n",
      "02-06-15\n",
      "12-18-15\n",
      "03-04-16\n",
      "12-08-17\n",
      "09-07-18\n",
      "07-22-16\n",
      "09-18-15\n",
      "12-29-17\n",
      "05-12-17\n",
      "05-11-18\n",
      "04-24-15\n",
      "12-28-18\n",
      "11-30-18\n",
      "06-10-16\n",
      "12-18-15\n",
      "12-08-17\n",
      "11-16-18\n",
      "03-31-17\n",
      "09-21-18\n",
      "03-23-18\n",
      "03-24-17\n",
      "09-15-17\n",
      "08-25-17\n",
      "06-06-14\n",
      "07-11-14\n",
      "01-19-18\n",
      "05-18-18\n",
      "08-03-18\n",
      "10-06-17\n",
      "06-16-17\n",
      "12-14-18\n",
      "01-13-17\n",
      "04-01-16\n",
      "05-18-18\n",
      "09-21-18\n",
      "03-09-18\n",
      "08-07-15\n",
      "11-17-17\n",
      "03-16-18\n",
      "02-03-17\n",
      "11-02-18\n",
      "02-10-17\n",
      "01-20-17\n",
      "11-03-17\n",
      "09-21-18\n",
      "12-05-14\n",
      "10-26-18\n",
      "07-27-18\n",
      "03-22-19\n",
      "07-20-18\n",
      "04-27-18\n",
      "02-19-16\n",
      "02-07-14\n",
      "11-06-15\n",
      "10-06-17\n",
      "03-18-16\n",
      "10-26-18\n",
      "02-03-17\n",
      "09-21-18\n",
      "05-04-18\n",
      "04-13-18\n",
      "11-30-18\n",
      "04-15-16\n",
      "04-14-17\n",
      "08-03-18\n",
      "08-12-16\n",
      "07-14-17\n",
      "11-30-18\n",
      "10-05-18\n",
      "04-28-17\n",
      "10-06-17\n",
      "08-17-18\n",
      "09-29-17\n",
      "03-30-18\n",
      "02-09-18\n",
      "11-09-06\n",
      "12-02-16\n",
      "10-21-16\n",
      "05-13-16\n",
      "07-20-18\n",
      "11-09-06\n",
      "05-22-15\n",
      "12-15-17\n",
      "02-26-16\n",
      "03-18-16\n",
      "05-20-16\n",
      "08-18-17\n",
      "11-04-16\n",
      "12-09-16\n",
      "11-09-06\n",
      "12-16-16\n",
      "08-25-17\n",
      "04-28-17\n",
      "06-24-16\n",
      "07-28-17\n",
      "12-15-17\n",
      "07-06-18\n",
      "03-02-18\n",
      "02-23-18\n",
      "11-02-18\n",
      "02-16-18\n",
      "12-18-15\n",
      "10-05-18\n",
      "07-25-14\n",
      "02-16-18\n",
      "03-28-14\n",
      "10-12-18\n",
      "02-26-16\n",
      "09-09-16\n",
      "09-21-18\n",
      "11-13-15\n",
      "06-16-17\n",
      "03-24-17\n",
      "08-14-15\n",
      "04-01-16\n",
      "12-15-17\n",
      "03-17-17\n",
      "02-16-18\n",
      "11-02-18\n",
      "07-27-18\n",
      "11-04-16\n",
      "03-02-18\n",
      "10-13-17\n",
      "03-02-18\n",
      "07-18-14\n",
      "09-25-15\n",
      "10-14-16\n",
      "02-23-18\n",
      "05-05-17\n",
      "09-22-17\n",
      "09-09-16\n",
      "07-14-17\n",
      "08-21-15\n",
      "03-03-17\n",
      "01-20-17\n",
      "10-26-18\n",
      "01-20-17\n",
      "05-27-16\n",
      "05-11-18\n",
      "12-29-17\n",
      "09-15-17\n",
      "05-12-17\n",
      "10-14-16\n",
      "03-31-17\n",
      "02-17-17\n",
      "08-12-16\n",
      "07-27-18\n",
      "03-27-15\n",
      "02-23-18\n",
      "11-06-15\n",
      "09-15-17\n",
      "05-23-14\n",
      "02-09-18\n",
      "07-27-18\n",
      "03-03-17\n",
      "06-17-16\n",
      "12-12-14\n",
      "06-22-18\n",
      "10-16-15\n",
      "02-17-17\n",
      "11-20-15\n",
      "05-03-13\n",
      "05-25-18\n",
      "06-05-15\n",
      "09-09-16\n",
      "03-03-17\n",
      "08-31-18\n",
      "09-04-15\n",
      "04-07-17\n",
      "03-02-18\n",
      "07-06-18\n",
      "06-29-18\n",
      "11-16-18\n",
      "02-26-16\n",
      "02-03-17\n",
      "09-14-18\n",
      "10-26-18\n",
      "11-20-15\n",
      "01-08-16\n",
      "08-18-17\n",
      "01-16-15\n",
      "08-11-17\n",
      "03-04-16\n",
      "05-12-17\n",
      "1-26-18\n",
      "08-17-18\n",
      "07-07-17\n",
      "04-28-17\n",
      "10-21-16\n",
      "03-03-17\n",
      "04-13-18\n",
      "06-09-17\n",
      "12-21-18\n",
      "10-20-17\n",
      "04-25-14\n",
      "04-13-18\n",
      "09-01-17\n",
      "06-29-18\n",
      "08-11-17\n",
      "01-20-17\n",
      "09-29-17\n",
      "10-07-16\n",
      "04-28-17\n",
      "04-27-18\n",
      "06-02-17\n",
      "08-04-17\n",
      "06-01-18\n",
      "09-29-17\n",
      "10-21-16\n",
      "04-29-16\n",
      "12-18-15\n",
      "01-05-18\n",
      "07-29-16\n",
      "02-19-16\n",
      "09-07-18\n",
      "12-15-17\n",
      "12-11-15\n",
      "01-20-17\n",
      "04-27-18\n",
      "02-03-17\n",
      "03-07-14\n",
      "02-23-18\n",
      "11-16-18\n",
      "05-04-18\n",
      "03-31-17\n",
      "06-01-18\n",
      "04-29-16\n",
      "04-06-18\n",
      "11-04-16\n",
      "03-04-16\n",
      "04-13-18\n",
      "10-14-16\n",
      "09-18-15\n",
      "10-27-17\n",
      "03-24-17\n",
      "12-07-18\n",
      "04-15-16\n",
      "02-05-16\n",
      "05-18-18\n",
      "02-09-18\n",
      "07-29-16\n",
      "1-26-18\n",
      "04-13-18\n",
      "05-05-17\n",
      "10-17-08\n",
      "04-27-18\n",
      "10-12-18\n",
      "12-28-18\n",
      "05-25-18\n",
      "06-22-18\n",
      "04-07-17\n",
      "08-17-18\n",
      "10-06-17\n",
      "06-23-17\n",
      "12-15-17\n",
      "12-15-17\n",
      "10-20-17\n",
      "07-07-17\n",
      "07-28-17\n",
      "10-07-16\n",
      "05-25-18\n",
      "11-30-18\n",
      "12-18-15\n",
      "04-14-17\n",
      "01-31-14\n",
      "04-14-17\n",
      "06-13-14\n",
      "09-30-16\n",
      "07-24-15\n",
      "09-30-16\n",
      "05-11-18\n",
      "12-12-14\n",
      "03-06-15\n",
      "04-20-18\n",
      "11-04-16\n",
      "09-28-18\n",
      "10-27-17\n",
      "03-10-17\n",
      "02-02-18\n",
      "04-22-16\n",
      "1-15-16\n",
      "03-27-15\n",
      "05-11-18\n",
      "09-02-16\n",
      "03-31-17\n",
      "10-14-16\n",
      "05-11-18\n",
      "12-29-17\n",
      "05-18-18\n",
      "02-23-18\n",
      "03-17-17\n",
      "05-26-17\n",
      "10-11-02\n",
      "04-29-16\n",
      "10-23-15\n",
      "10-19-18\n",
      "08-28-2015\n",
      "03-23-18\n",
      "06-09-17\n",
      "10-19-18\n",
      "06-16-17\n",
      "12-23-16\n",
      "06-02-17\n",
      "01-26-18\n",
      "03-04-16\n",
      "11-14-14\n",
      "07-22-16\n",
      "08-03-18\n",
      "09-28-18\n",
      "03-10-17\n",
      "09-30-16\n",
      "11-09-18\n",
      "07-01-16\n",
      "10-27-17\n",
      "09-16-16\n",
      "06-22-18\n",
      "06-12-15\n",
      "11-18-16\n",
      "12-22-17\n",
      "09-04-15\n",
      "09-15-17\n",
      "03-23-18\n",
      "03-22-19\n",
      "04-01-16\n",
      "03-31-17\n",
      "05-04-18\n",
      "09-29-17\n",
      "10-09-15\n",
      "07-24-15\n",
      "06-10-16\n",
      "07-20-18\n",
      "10-28-16\n",
      "08-19-16\n",
      "06-03-16\n",
      "03-03-17\n",
      "05-26-17\n",
      "01-26-18\n",
      "10-19-18\n",
      "12-14-18\n",
      "04-17-15\n",
      "10-16-15\n",
      "09-28-18\n",
      "06-02-17\n",
      "09-07-18\n",
      "04-28-17\n",
      "11-04-16\n",
      "07-21-17\n",
      "02-05-99\n",
      "01-27-17\n",
      "01-27-17\n",
      "03-02-18\n",
      "09-14-18\n",
      "12-16-16\n",
      "10-26-12\n",
      "06-08-12\n",
      "06-05-15\n",
      "11-09-18\n",
      "02-17-12\n",
      "07-21-17\n",
      "12-07-18\n",
      "12-02-16\n",
      "07-25-14\n",
      "11-17-17\n",
      "01-27-17\n",
      "04-06-18\n",
      "08-12-16\n",
      "12-21-18\n",
      "07-20-18\n",
      "08-05-16\n",
      "06-29-18\n",
      "12-14-18\n",
      "05-04-18\n",
      "12-08-17\n",
      "08-05-16\n",
      "07-15-16\n",
      "05-16-14\n",
      "10-28-16\n",
      "12-08-17\n",
      "09-21-18\n",
      "03-24-17\n",
      "03-24-17\n",
      "04-11-14\n",
      "01-29-16\n",
      "04-08-16\n",
      "09-14-18\n",
      "07-06-18\n"
     ]
    }
   ],
   "source": [
    "for file_name in cleaned_jobs:\n",
    "    job_path = cleaned_path + file_name        # define path to file_name\n",
    "    cleaned_job  = open(job_path, 'rt').read() # read in job as a string\n",
    "    try:\n",
    "        print(open_date(job=cleaned_job))\n",
    "    except:                                # do some pretty printings here to help our eyes from pain\n",
    "        ## define some useful variables\n",
    "        border_line = '##############################################################################################'\n",
    "        how_many    = int((len(border_line) - len(job_path))/2)\n",
    "        print(border_line)\n",
    "        ## do pretty printings\n",
    "        print('#'*how_many + job_path + '#'*how_many)\n",
    "        print(border_line)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Note that there were two jobs that threw an error while reading in:\n",
    "* EMERGENCY MEDICAL SERVICES EDUCATOR  2322 110615 REV 112515.txt\n",
    "* EQUIPMENT MECHANIC 3711 051818.txt\n",
    "\n",
    "The reason is that these two jobs have parentheses in their titles, thus causing the IndexError. For the moment, we'll fix these jobs by replacing the parentheses in their titles with squared brackets."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "**Let's rerun the function and observe the changes. Note we use .txt files in the JobBulletins_cleaned folder.**\n",
    "\n",
    "Observing the printouts carefully this time, we see that all of the nuances above have been resolved."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 39,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "04-18-14\n",
      "06-22-18\n",
      "07-13-18\n",
      "07-27-18\n",
      "06-01-18\n",
      "03-30-18\n",
      "10-09-15\n",
      "02-08-08\n",
      "04-14-17\n",
      "11-16-18\n",
      "08-10-18\n",
      "12-04-15\n",
      "07-06-18\n",
      "4-20-18\n",
      "12-11-15\n",
      "02-01-19\n",
      "12-02-16\n",
      "02-16-18\n",
      "09-16-16\n",
      "11-09-06\n",
      "06-30-17\n",
      "12-18-15\n",
      "02-16-18\n",
      "11-16-18\n",
      "12-08-17\n",
      "02-01-19\n",
      "04-01-16\n",
      "12-21-18\n",
      "06-15-18\n",
      "08-31-18\n",
      "07-14-17\n",
      "06-29-18\n",
      "07-08-16\n",
      "07-15-16\n",
      "05-02-14\n",
      "01-08-16\n",
      "08-25-17\n",
      "05-29-15\n",
      "06-30-17\n",
      "09-11-15\n",
      "03-30-18\n",
      "01-31-14\n",
      "08-04-17\n",
      "02-09-18\n",
      "05-30-14\n",
      "07-15-16\n",
      "05-13-16\n",
      "07-21-17\n",
      "09-28-18\n",
      "01-29-16\n",
      "10-05-18\n",
      "10-24-14\n",
      "11-03-17\n",
      "01-26-18\n",
      "08-04-17\n",
      "09-09-16\n",
      "04-28-17\n",
      "03-02-18\n",
      "01-20-17\n",
      "11-13-15\n",
      "05-06-16\n",
      "07-31-15\n",
      "07-21-17\n",
      "01-20-17\n",
      "05-18-18\n",
      "10-26-18\n",
      "06-20-14\n",
      "03-18-16\n",
      "10-13-17\n",
      "05-15-15\n",
      "05-22-15\n",
      "02-24-17\n",
      "10-20-17\n",
      "06-24-16\n",
      "10-31-14\n",
      "06-09-17\n",
      "10-26-18\n",
      "01-19-18\n",
      "08-25-17\n",
      "11-07-14\n",
      "10-17-14\n",
      "03-23-18\n",
      "12-28-18\n",
      "07-15-16\n",
      "10-19-18\n",
      "04-28-17\n",
      "04-07-17\n",
      "08-28-15\n",
      "11-16-18\n",
      "11-18-16\n",
      "03-02-18\n",
      "09-02-16\n",
      "01-22-16\n",
      "12-14-18\n",
      "01-12-18\n",
      "05-13-16\n",
      "06-19-15\n",
      "03-09-18\n",
      "12-09-16\n",
      "10-30-15\n",
      "10-20-17\n",
      "06-24-16\n",
      "05-15-15\n",
      "09-23-16\n",
      "08-05-16\n",
      "01-20-17\n",
      "04-21-17\n",
      "06-12-15\n",
      "08-31-18\n",
      "12-22-17\n",
      "12-28-18\n",
      "04-10-15\n",
      "12-11-2015\n",
      "03-30-18\n",
      "04-11-14\n",
      "09-28-18\n",
      "11-20-15\n",
      "08-25-17\n",
      "09-09-16\n",
      "02-09-18\n",
      "3-24-17\n",
      "04-20-18\n",
      "04-20-18\n",
      "03-16-18\n",
      "12-01-06\n",
      "03-18-16\n",
      "12-09-16\n",
      "09-28-18\n",
      "11-17-17\n",
      "04-18-14\n",
      "10-31-14\n",
      "12-07-18\n",
      "11-03-17\n",
      "02-09-18\n",
      "06-16-17\n",
      "08-04-17\n",
      "02-03-17\n",
      "12-07-18\n",
      "12-16-16\n",
      "06-16-17\n",
      "09-21-18\n",
      "05-19-17\n",
      "11-18-16\n",
      "05-25-18\n",
      "01-27-17\n",
      "07-28-17\n",
      "08-10-18\n",
      "10-13-17\n",
      "11-14-14\n",
      "07-20-18\n",
      "06-22-18\n",
      "11-16-18\n",
      "08-26-16\n",
      "03-04-16\n",
      "01-26-18\n",
      "07-08-16\n",
      "04-21-17\n",
      "03-10-17\n",
      "09-08-17\n",
      "10-16-15\n",
      "06-29-18\n",
      "03-09-18\n",
      "01-20-17\n",
      "11-16-18\n",
      "04-28-17\n",
      "02-09-18\n",
      "10-12-18\n",
      "05-12-17\n",
      "08-31-18\n",
      "09-30-16\n",
      "03-23-18\n",
      "11-17-17\n",
      "11-30-18\n",
      "04-27-18\n",
      "06-23-17\n",
      "01-27-17\n",
      "04-27-18\n",
      "01-26-18\n",
      "04-06-18\n",
      "06-23-17\n",
      "04-15-16\n",
      "06-19-15\n",
      "03-04-16\n",
      "10-12-18\n",
      "04-07-17\n",
      "04-21-17\n",
      "02-23-18\n",
      "01-27-17\n",
      "03-30-18\n",
      "12-14-18\n",
      "04-07-17\n",
      "10-28-16\n",
      "01-20-17\n",
      "02-03-17\n",
      "07-07-17\n",
      "06-30-17\n",
      "09-28-18\n",
      "09-30-16\n",
      "11-30-18\n",
      "03-02-18\n",
      "01-20-17\n",
      "07-22-16\n",
      "09-22-17\n",
      "12-29-17\n",
      "09-09-16\n",
      "09-28-18\n",
      "10-28-16\n",
      "10-13-17\n",
      "09-16-16\n",
      "01-27-17\n",
      "07-14-17\n",
      "03-25-16\n",
      "10-26-18\n",
      "11-06-15\n",
      "11-16-18\n",
      "03-11-16\n",
      "11-11-16\n",
      "10-16-15\n",
      "08-25-17\n",
      "02-23-18\n",
      "08-25-17\n",
      "06-15-18\n",
      "08-05-16\n",
      "08-26-16\n",
      "02-01-13\n",
      "01-29-16\n",
      "05-25-18\n",
      "05-18-18\n",
      "04-14-17\n",
      "01-27-17\n",
      "11-17-17\n",
      "12-19-14\n",
      "04-13-18\n",
      "12-04-15\n",
      "08-31-18\n",
      "06-09-17\n",
      "06-24-16\n",
      "09-23-16\n",
      "02-02-18\n",
      "10-20-17\n",
      "07-01-16\n",
      "05-29-15\n",
      "01-12-18\n",
      "3-09-18\n",
      "03-30-18\n",
      "08-14-15\n",
      "03-17-17\n",
      "04-13-18\n",
      "02-12-16\n",
      "06-23-17\n",
      "06-24-16\n",
      "10-23-15\n",
      "10-23-15\n",
      "01-19-18\n",
      "10-19-18\n",
      "04-21-17\n",
      "06-22-18\n",
      "09-25-15\n",
      "01-20-17\n",
      "01-30-15\n",
      "10-05-18\n",
      "06-19-15\n",
      "04-21-17\n",
      "03-04-16\n",
      "01-24-14\n",
      "03-17-17\n",
      "09-07-18\n",
      "12-11-15\n",
      "12-08-17\n",
      "01-12-18\n",
      "05-26-17\n",
      "12-07-18\n",
      "11-18-16\n",
      "08-10-18\n",
      "05-04-18\n",
      "12-11-15\n",
      "02-17-17\n",
      "12-23-16\n",
      "07-22-05\n",
      "12-16-16\n",
      "07-06-18\n",
      "06-29-18\n",
      "08-10-18\n",
      "12-22-17\n",
      "01-27-17\n",
      "10-02-15\n",
      "05-15-15\n",
      "02-07-14\n",
      "05-25-18\n",
      "01-26-18\n",
      "08-04-17\n",
      "09-01-17\n",
      "06-08-18\n",
      "05-19-17\n",
      "01-19-18\n",
      "06-15-18\n",
      "02-06-15\n",
      "12-18-15\n",
      "03-04-16\n",
      "12-08-17\n",
      "09-07-18\n",
      "07-22-16\n",
      "09-18-15\n",
      "12-29-17\n",
      "05-12-17\n",
      "05-11-18\n",
      "04-24-15\n",
      "12-28-18\n",
      "11-30-18\n",
      "06-10-16\n",
      "12-18-15\n",
      "12-08-17\n",
      "11-16-18\n",
      "03-31-17\n",
      "09-21-18\n",
      "03-23-18\n",
      "03-24-17\n",
      "09-15-17\n",
      "08-25-17\n",
      "06-06-14\n",
      "07-11-14\n",
      "01-19-18\n",
      "05-18-18\n",
      "08-03-18\n",
      "10-06-17\n",
      "06-16-17\n",
      "12-14-18\n",
      "01-13-17\n",
      "04-01-16\n",
      "05-18-18\n",
      "09-21-18\n",
      "03-09-18\n",
      "08-07-15\n",
      "11-17-17\n",
      "03-16-18\n",
      "02-03-17\n",
      "11-02-18\n",
      "02-10-17\n",
      "01-20-17\n",
      "11-03-17\n",
      "09-21-18\n",
      "12-05-14\n",
      "10-26-18\n",
      "07-27-18\n",
      "03-22-19\n",
      "07-20-18\n",
      "04-27-18\n",
      "02-19-16\n",
      "02-07-14\n",
      "11-06-15\n",
      "10-06-17\n",
      "03-18-16\n",
      "10-26-18\n",
      "02-03-17\n",
      "09-21-18\n",
      "05-04-18\n",
      "04-13-18\n",
      "11-30-18\n",
      "04-15-16\n",
      "04-14-17\n",
      "08-03-18\n",
      "08-12-16\n",
      "07-14-17\n",
      "11-30-18\n",
      "10-05-18\n",
      "04-28-17\n",
      "10-06-17\n",
      "08-17-18\n",
      "09-29-17\n",
      "03-30-18\n",
      "02-09-18\n",
      "11-09-06\n",
      "12-02-16\n",
      "10-21-16\n",
      "05-13-16\n",
      "07-20-18\n",
      "11-09-06\n",
      "05-22-15\n",
      "12-15-17\n",
      "02-26-16\n",
      "03-18-16\n",
      "05-20-16\n",
      "08-18-17\n",
      "11-04-16\n",
      "12-09-16\n",
      "11-09-06\n",
      "12-16-16\n",
      "08-25-17\n",
      "04-28-17\n",
      "06-24-16\n",
      "07-28-17\n",
      "12-15-17\n",
      "07-06-18\n",
      "03-02-18\n",
      "02-23-18\n",
      "11-02-18\n",
      "02-16-18\n",
      "12-18-15\n",
      "10-05-18\n",
      "07-25-14\n",
      "02-16-18\n",
      "03-28-14\n",
      "10-12-18\n",
      "02-26-16\n",
      "09-09-16\n",
      "09-21-18\n",
      "11-13-15\n",
      "06-16-17\n",
      "03-24-17\n",
      "08-14-15\n",
      "04-01-16\n",
      "12-15-17\n",
      "03-17-17\n",
      "02-16-18\n",
      "11-02-18\n",
      "07-27-18\n",
      "11-04-16\n",
      "03-02-18\n",
      "10-13-17\n",
      "03-02-18\n",
      "07-18-14\n",
      "09-25-15\n",
      "10-14-16\n",
      "02-23-18\n",
      "05-05-17\n",
      "09-22-17\n",
      "09-09-16\n",
      "07-14-17\n",
      "08-21-15\n",
      "03-03-17\n",
      "01-20-17\n",
      "10-26-18\n",
      "01-20-17\n",
      "05-27-16\n",
      "05-11-18\n",
      "12-29-17\n",
      "09-15-17\n",
      "05-12-17\n",
      "10-14-16\n",
      "03-31-17\n",
      "02-17-17\n",
      "08-12-16\n",
      "07-27-18\n",
      "03-27-15\n",
      "02-23-18\n",
      "11-06-15\n",
      "09-15-17\n",
      "05-23-14\n",
      "02-09-18\n",
      "07-27-18\n",
      "03-03-17\n",
      "06-17-16\n",
      "12-12-14\n",
      "06-22-18\n",
      "10-16-15\n",
      "02-17-17\n",
      "11-20-15\n",
      "05-03-13\n",
      "05-25-18\n",
      "06-05-15\n",
      "09-09-16\n",
      "03-03-17\n",
      "08-31-18\n",
      "09-04-15\n",
      "04-07-17\n",
      "03-02-18\n",
      "07-06-18\n",
      "06-29-18\n",
      "11-16-18\n",
      "02-26-16\n",
      "02-03-17\n",
      "09-14-18\n",
      "10-26-18\n",
      "11-20-15\n",
      "01-08-16\n",
      "08-18-17\n",
      "01-16-15\n",
      "08-11-17\n",
      "03-04-16\n",
      "05-12-17\n",
      "1-26-18\n",
      "08-17-18\n",
      "07-07-17\n",
      "04-28-17\n",
      "10-21-16\n",
      "03-03-17\n",
      "04-13-18\n",
      "06-09-17\n",
      "12-21-18\n",
      "10-20-17\n",
      "04-25-14\n",
      "04-13-18\n",
      "09-01-17\n",
      "06-29-18\n",
      "08-11-17\n",
      "01-20-17\n",
      "09-29-17\n",
      "10-07-16\n",
      "04-28-17\n",
      "04-27-18\n",
      "06-02-17\n",
      "08-04-17\n",
      "06-01-18\n",
      "09-29-17\n",
      "10-21-16\n",
      "04-29-16\n",
      "12-18-15\n",
      "01-05-18\n",
      "07-29-16\n",
      "02-19-16\n",
      "09-07-18\n",
      "12-15-17\n",
      "12-11-15\n",
      "01-20-17\n",
      "04-27-18\n",
      "02-03-17\n",
      "03-07-14\n",
      "02-23-18\n",
      "11-16-18\n",
      "05-04-18\n",
      "03-31-17\n",
      "06-01-18\n",
      "04-29-16\n",
      "04-06-18\n",
      "11-04-16\n",
      "03-04-16\n",
      "04-13-18\n",
      "10-14-16\n",
      "09-18-15\n",
      "10-27-17\n",
      "03-24-17\n",
      "12-07-18\n",
      "04-15-16\n",
      "02-05-16\n",
      "05-18-18\n",
      "02-09-18\n",
      "07-29-16\n",
      "1-26-18\n",
      "04-13-18\n",
      "05-05-17\n",
      "10-17-08\n",
      "04-27-18\n",
      "10-12-18\n",
      "12-28-18\n",
      "05-25-18\n",
      "06-22-18\n",
      "04-07-17\n",
      "08-17-18\n",
      "10-06-17\n",
      "06-23-17\n",
      "12-15-17\n",
      "12-15-17\n",
      "10-20-17\n",
      "07-07-17\n",
      "07-28-17\n",
      "10-07-16\n",
      "05-25-18\n",
      "11-30-18\n",
      "12-18-15\n",
      "04-14-17\n",
      "01-31-14\n",
      "04-14-17\n",
      "06-13-14\n",
      "09-30-16\n",
      "07-24-15\n",
      "09-30-16\n",
      "05-11-18\n",
      "12-12-14\n",
      "03-06-15\n",
      "04-20-18\n",
      "11-04-16\n",
      "09-28-18\n",
      "10-27-17\n",
      "03-10-17\n",
      "02-02-18\n",
      "04-22-16\n",
      "1-15-16\n",
      "03-27-15\n",
      "05-11-18\n",
      "09-02-16\n",
      "03-31-17\n",
      "10-14-16\n",
      "05-11-18\n",
      "12-29-17\n",
      "05-18-18\n",
      "02-23-18\n",
      "03-17-17\n",
      "05-26-17\n",
      "10-11-02\n",
      "04-29-16\n",
      "10-23-15\n",
      "10-19-18\n",
      "08-28-2015\n",
      "03-23-18\n",
      "06-09-17\n",
      "10-19-18\n",
      "06-16-17\n",
      "12-23-16\n",
      "06-02-17\n",
      "01-26-18\n",
      "03-04-16\n",
      "11-14-14\n",
      "07-22-16\n",
      "08-03-18\n",
      "09-28-18\n",
      "03-10-17\n",
      "09-30-16\n",
      "11-09-18\n",
      "07-01-16\n",
      "10-27-17\n",
      "09-16-16\n",
      "06-22-18\n",
      "06-12-15\n",
      "11-18-16\n",
      "12-22-17\n",
      "09-04-15\n",
      "09-15-17\n",
      "03-23-18\n",
      "03-22-19\n",
      "04-01-16\n",
      "03-31-17\n",
      "05-04-18\n",
      "09-29-17\n",
      "10-09-15\n",
      "07-24-15\n",
      "06-10-16\n",
      "07-20-18\n",
      "10-28-16\n",
      "08-19-16\n",
      "06-03-16\n",
      "03-03-17\n",
      "05-26-17\n",
      "01-26-18\n",
      "10-19-18\n",
      "12-14-18\n",
      "04-17-15\n",
      "10-16-15\n",
      "09-28-18\n",
      "06-02-17\n",
      "09-07-18\n",
      "04-28-17\n",
      "11-04-16\n",
      "07-21-17\n",
      "02-05-99\n",
      "01-27-17\n",
      "01-27-17\n",
      "03-02-18\n",
      "09-14-18\n",
      "12-16-16\n",
      "10-26-12\n",
      "06-08-12\n",
      "06-05-15\n",
      "11-09-18\n",
      "02-17-12\n",
      "07-21-17\n",
      "12-07-18\n",
      "12-02-16\n",
      "07-25-14\n",
      "11-17-17\n",
      "01-27-17\n",
      "04-06-18\n",
      "08-12-16\n",
      "12-21-18\n",
      "07-20-18\n",
      "08-05-16\n",
      "06-29-18\n",
      "12-14-18\n",
      "05-04-18\n",
      "12-08-17\n",
      "08-05-16\n",
      "07-15-16\n",
      "05-16-14\n",
      "10-28-16\n",
      "12-08-17\n",
      "09-21-18\n",
      "03-24-17\n",
      "03-24-17\n",
      "04-11-14\n",
      "01-29-16\n",
      "04-08-16\n",
      "09-14-18\n",
      "07-06-18\n"
     ]
    }
   ],
   "source": [
    "for file_name in cleaned_jobs:\n",
    "    job_path = cleaned_path + file_name        # define path to file_name\n",
    "    cleaned_job  = open(job_path, 'rt').read() # read in job as a string\n",
    "    try:\n",
    "        print(open_date(job=cleaned_job))\n",
    "    except:                                # do some pretty printings here to help our eyes from pain\n",
    "        ## define some useful variables\n",
    "        border_line = '##############################################################################################'\n",
    "        how_many    = int((len(border_line) - len(job_path))/2)\n",
    "        print(border_line)\n",
    "        ## do pretty printings\n",
    "        print('#'*how_many + job_path + '#'*how_many)\n",
    "        print(border_line)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": []
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": []
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": []
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": []
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": []
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": []
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": []
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": []
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": []
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": []
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": []
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": []
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": []
  }
 ],
 "metadata": {
  "kernelspec": {
   "display_name": "Python 3",
   "language": "python",
   "name": "python3"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.7.3"
  }
 },
 "nbformat": 4,
 "nbformat_minor": 2
}