HT1_README.ipynb

{
 "cells": [
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# Outline\n",
    "1. City of Los Angeles\n",
    "2. Current Challenges\n",
    "3. Data Cleaning Approach\n",
    "4. Data Normalization Demo\n",
    "5. Current Stage of Data Cleaning\n",
    "6. Recommendations to the City of LA"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# 1. City of Los Angeles\n",
    "![Downtown Los Angeles Skyline](downtownLA.jpg)\n",
    "\n",
    "Magnificent is the best word I can think of to describe the City of Los Angeles. Established in 1781, Los Angeles has done a great job to become one of the most substantial economic engines within the United States, with a diverse economy in a broad range of professional and cultural fields. Eight years ago, when my family was still in Vietnam, we didn’t know anything about America, but there were two cities we had heard of many times: San Francisco and Los Angeles. We took a 24 hour flight to San Francisco International Airport (SFO) and started our lives from scratch in San Jose. Fast forward, six years later, I ended up in Los Angeles. Of course, it was no coincidence at all! I had made it to the two cities I’ve always wanted to visit and build my lifelong career in.\n",
    "\n",
    "To keep being **the** cultural, financial, and commercial center of Southern California, the City of LA will need to hire a lot of talented people, especially when 1/3 of its 50,000 workers are eligible to retire by July of 2020—which is one year from now. The City has partnered with Kaggle to create a competition to improve the job bulletins that will fill all of those open positions and we Kagglers are very willing to lend a hand in order to contribute to the City’s mission.\n",
    "\n",
    "![You Got Hired by City of LA](CityofLAhiring.png)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# 2. Current Challenges\n",
    "There have been quite a few kernels in this competition focusing on data mining tasks using various types of Python string manipulations, most notably regular expression or regex, for short. While these kernels have achieved highly satisfactory outcomes and created directions for future research or inquiries, they quickly encounter their limit due to the limited quality of the given datasets. Recall that we are given a collection of text files that describe past city’s job postings along with their pdf versions. While the City has done an excellent job of composing these text files, the source that generated these text files is not revealed, which makes it incredibly hard for participants to anticipate all possible inconsistencies in the data. One example of such is FIRE ASSISTANT CHIEF 2166 011218.txt, which doesn’t have the JOB_DUTIES field. This is very questionable, since the `kaggle_data_dictionary.csv` file explicitly states that every job must have this field (see *Accepts Null Values?* column).\n",
    "\n",
    "Hopefully we can see by now that such inconsistencies will certainly inhibit any attempt to writing code for data mining purposes **before** appropriate data cleaning is done. Take the mentioned FIRE ASSISTANT CHIEF 2166 011218.txt, for example. If the field JOB_DUTIES shows a missing value, is it caused by a bug in the code or a problem with the source file? If the latter is the case, how can we write **checkpoints** that flag this problem when it occurs **again**?  Without a scientific approach to data cleaning, these questions cannot be answered and any subsequent analyses will surely be inaccurate (GIGO = Garbage in, Garbage Out). Thus, I’ve written a few kernels along with three user-defined modules that are dedicated solely to data cleaning. My goal is to produce the very first, complete and accurate csv file, which advanced analysis can be built upon!\n",
    "\n",
    "![GIGO](GIGO.gif)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# 3. Data Cleaning Approach\n",
    "To this end, I followed a somewhat novel approach.\n",
    "1). I focused on writing code for parsing SYSTEMS ANALYST 1596 102717.txt so that my final output looked exactly like the provided `sample job class export template.csv`. There are 25 functions (with some other helper functions) that correspond to 25 field names in the final csv file.\n",
    "2). I tried applying these functions to other job postings and quickly got stuck. No matter how hard I tweaked my code, there was always a job posting that failed it. That was when I thought about data normalization, i.e, bringing all job postings to the same structure as SYSTEMS ANALYST 1596 102717.txt, whose contents I had become familiar with after spending more than a month doing task 1. Once data normalization is done, we are worry-free since it is guaranteed that the data mining functions that work for SYSTEMS ANALYST 1596 102717.txt also work for other job postings. To make data cleaning more efficient, three user-defined modules were written. Details regarding the development of these modules can be found in technical memorandum. \n",
    "\n",
    "<font size=3, color='green'>The cleaned data is stored in **CityofLA/JobBulletins_cleaned**.</font>\n",
    "\n",
    "In the next section, we use these user-defined modules to demonstrate the process of data normalization when **new** job postings are available in the future."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# 4. Data Cleaning Demo\n",
    "## Get JOB_CLASS_TITLE Field\n",
    "This demo extracts data for the JOB_CLASS_TITLE Field (9 other functions are avaiable in _________)."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 1,
   "metadata": {},
   "outputs": [],
   "source": [
    "# Import relevant modules\n",
    "import provenir                  # access to job bulletins and customized printing\n",
    "import individual_toolkit as itk # access to unit functions that operate on one job at a time\n",
    "import multiple_toolkit as mtk   # access to aggregate functions that operate on multiple jobs at a time"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 2,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "311 Director\n",
      "Accountant\n",
      "Accounting Clerk\n",
      "Accounting Records Supervisor\n",
      "Administrative Analyst\n",
      "Administrative Clerk\n",
      "Administrative Hearing Examiner\n",
      "Advance Practice Provider Correctional Care\n",
      "Air Conditioning Mechanic\n",
      "Air Conditioning Mechanic Supervisor\n",
      "Airport Aide\n",
      "Airport Chief Information Security Officer\n",
      "Airport Engineer\n",
      "Airport Guide\n",
      "Airport Information Specialist\n",
      "Airport Labor Relations Advocate\n",
      "Airport Manager\n",
      "Airport Police Captain\n",
      "Airport Police Lieutenant\n",
      "Airport Police Officer\n",
      "Airport Police Specialist\n",
      "Airport Superintendent Of Operations\n",
      "Airports Maintenance Superintendent\n",
      "Airports Maintenance Supervisor\n",
      "Airports Public And Community Relations Director\n",
      "Animal Care Assistant\n",
      "Animal Care Technician\n",
      "Water Treatment Operator\n",
      "Animal Control Officer\n",
      "Animal Keeper\n",
      "Apparatus Operator\n",
      "Applications Programmer\n",
      "Apprentice - Metal Trades\n",
      "Apprentice Machinist\n",
      "Aquarist\n",
      "Aquarium Educator\n",
      "Aquatic Director\n",
      "Aquatic Facility Manager\n",
      "Aqueduct And Reservoir Keeper\n",
      "Aqueduct And Reservoir Supervisor\n",
      "Architect\n",
      "Campus Interviews Only Architectural Associate\n",
      "Architectural Drafting Technician\n",
      "Archivist\n",
      "Art Center Director\n",
      "Art Curator\n",
      "Art Instructor\n",
      "Arts Associate\n",
      "Arts Manager\n",
      "Asbestos Supervisor\n",
      "Asbestos Worker\n",
      "Asphalt Plant Operator\n",
      "Asphalt Plant Supervisor\n",
      "Assistant Airport Manager\n",
      "Assistant Communications Cable Worker\n",
      "Assistant Communications Electrician\n",
      "Assistant Deputy Superintendent Of Building\n",
      "Assistant Director Information Systems\n",
      "Assistant Gardener\n",
      "Assistant Inspector\n",
      "Assistant Retirement Plan Manager\n",
      "Assistant Signal Systems Electrician\n",
      "Assistant Street Lighting Electrician\n",
      "Assistant Tree Surgeon\n",
      "Assistant Utility Buyer\n",
      "Associate Zoning Administrator\n",
      "Audio Visual Technician\n",
      "Auditor\n",
      "Auto Body Builder And Repairer\n",
      "Auto Body Repair Supervisor\n",
      "Auto Electrician\n",
      "Auto Painter\n",
      "Automotive Dispatcher\n",
      "Automotive Supervisor\n",
      "Avionics Specialist\n",
      "Background Investigation Manager\n",
      "Background Investigator\n",
      "Benefits Specialist\n",
      "Blacksmith\n",
      "Boilermaker\n",
      "Boilermaker Supervisor\n",
      "Building Civil Engineer\n",
      "Building Construction And Maintenance Superintendent\n",
      "Building Electrical Engineer\n",
      "Building Inspector\n",
      "Building Maintenance District Supervisor\n",
      "Building Mechanical Engineer\n",
      "Building Mechanical Inspector\n",
      "Building Operating Engineer\n",
      "Building Repair Supervisor\n",
      "Building Repairer\n",
      "Bus Operator\n",
      "Bus Operator Supervisor\n",
      "Cable Television Production Manager\n",
      "Carpenter\n",
      "Carpenter Supervisor\n",
      "Carpet Layer\n",
      "Cement Finisher\n",
      "Cement Finisher Supervisor\n",
      "Cement Finisher Worker\n",
      "Chemist\n",
      "Chief Administrative Analyst\n",
      "Chief Airports Engineer\n",
      "Chief Benefits Analyst\n",
      "Chief Building Operating Engineer\n",
      "Chief Clerk\n",
      "Chief Clerk Personnel\n",
      "Chief Clerk Police\n",
      "Chief Clerk Police\n",
      "Chief Communications Operator\n",
      "Chief Construction Inspector\n",
      "Chief Custodian Supervisor\n",
      "Chief Electric Plant Operator\n",
      "Chief Environmental Compliance Inspector\n",
      "Chief Financial Officer\n",
      "Chief Forensic Chemist\n",
      "Chief Harbor Engineer\n",
      "Chief Inspector\n",
      "Chief Internal Auditor\n",
      "Chief Management Analyst\n",
      "Chief Of Airport Planning\n",
      "Chief Of Drafting Operations\n",
      "Chief Of Operations\n",
      "Chief Of Parking Enforcement Operations\n",
      "Chief Park Ranger\n",
      "Chief Port Pilot\n",
      "Chief Safety Engineer Pressure Vessels\n",
      "Chief Security Officer\n",
      "Chief Street Services Investigator\n",
      "Chief Tax Compliance Officer\n",
      "Chief Transportation Investigator\n",
      "City Planner\n",
      "City Planning Associate\n",
      "Civil Engineer\n",
      "Civil Engineering Associate\n",
      "Civil Engineering Drafting Technician\n",
      "Claims Agent\n",
      "Commercial Field Representative\n",
      "Commercial Field Supervisor\n",
      "Commercial Service Supervisor\n",
      "Commission Executive Assistant\n",
      "Communications Cable Supervisor\n",
      "Communications Cable Worker\n",
      "Communications Electrician\n",
      "Communications Electrician Supervisor\n",
      "Communications Engineer\n",
      "Communications Engineering Associate\n",
      "Communications Information Representative\n",
      "Community Affairs Advocate\n",
      "Community Housing Programs Manager\n",
      "Community Program Assistant\n",
      "Compliance Program Manager\n",
      "Construction And Maintenance Superintendent\n",
      "Construction And Maintenance Supervisor\n",
      "Construction Equipment Service Worker\n",
      "Construction Estimator\n",
      "Construction Inspector\n",
      "Contract Administrator\n",
      "Control Systems Engineering Associate\n",
      "Correctional Nurse\n",
      "Crime And Intelligence Analyst\n",
      "Criminalist\n",
      "Custodial Services Assistant\n",
      "Custodian\n",
      "Custodian Supervisor\n",
      "Customer Service Representative\n",
      "Customer Service Specialist\n",
      "Data Processing Technician\n",
      "Database Architect\n",
      "Deck Hand\n",
      "Delivery Driver\n",
      "Departmental Chief Accountant\n",
      "Detention Officer\n",
      "Director Of Airport Marketing\n",
      "Director Of Airport Operations\n",
      "Director Of Airports Administration Revised\n",
      "Director Of Communications Services\n",
      "Director Of Enforcement Operations\n",
      "Director Of Field Operations\n",
      "Director Of Housing\n",
      "Director Of Maintenance Airports\n",
      "Director Of Police Transportation\n",
      "Director Of Port Construction And Maintenance\n",
      "Director Of Printing Services\n",
      "Director Of Security Services\n",
      "Director Of Systems\n",
      "District Supervisor Animal Services (Class Title Of District Supervisor Animal Regulation)\n",
      "Division Librarian\n",
      "Drill Rig Operator\n",
      "Duplicating Machine Operator\n",
      "Electric Distribution Mechanic\n",
      "Electric Distribution Mechanic Supervisor\n",
      "Electric Meter Setter\n",
      "Electric Service Representative\n",
      "Electric Station Operator\n",
      "Electric Trouble Dispatcher\n",
      "Electrical Craft Helper\n",
      "Electrical Engineering Associate\n",
      "Electrical Engineering Drafting Technician\n",
      "Electrical Inspector\n",
      "Electrical Mechanic\n",
      "Electrical Mechanic Supervisor\n",
      "Electrical Repair Supervisor\n",
      "Electrical Repairer\n",
      "Electrical Service Worker\n",
      "Electrical Services Manager\n",
      "Electrical Tester\n",
      "Electrician\n",
      "Electrician Supervisor\n",
      "Elevator Mechanic\n",
      "Elevator Mechanic Helper\n",
      "Elevator Repair Supervisor\n",
      "Emergency Management Coordinator\n",
      "Emergency Medical Services (Ems) Educator\n",
      "Ems Advanced Provider\n",
      "Ems Nurse Practitioner Supervisor\n",
      "Engineer Of Fire Department\n",
      "Engineer Of Surveys\n",
      "Engineering Designer\n",
      "Engineering Geologist\n",
      "Engineering Geologist Associate\n",
      "Environmental Affairs Officer\n",
      "Environmental Compliance Inspector\n",
      "Environmental Engineer\n",
      "Campus Interviews Only Environmental Engineering Associate\n",
      "Environmental Specialist\n",
      "Environmental Supervisor\n",
      "Equipment Mechanic (Automotive Mechanic)\n",
      "Equipment Operator\n",
      "Equipment Repair Supervisor\n",
      "Equipment Specialist\n",
      "Equipment Superintendent\n",
      "Equipment Supervisor\n",
      "Examiner Of Questioned Documents\n",
      "Executive Administrative Assistant\n",
      "Executive Assistant Airports\n",
      "Exhibit Preparator\n",
      "Field Engineering Aide\n",
      "Financial Analyst\n",
      "Financial Development Officer\n",
      "Financial Manager\n",
      "Fingerprint Identification Expert\n",
      "Fire Assistant Chief\n",
      "Fire Battalion Chief\n",
      "Fire Captain\n",
      "Fire Helicopter Pilot\n",
      "Fire Inspector\n",
      "Fire Protection Engineering Associate\n",
      "Fire Special Investigator\n",
      "Fire Sprinkler Inspector\n",
      "Firearms Examiner\n",
      "Fireboat Mate\n",
      "Fireboat Pilot\n",
      "Firefighter\n",
      "Fiscal Systems Specialist\n",
      "Fleet Services Manager\n",
      "Forensic Print Specialist\n",
      "Gallery Attendant\n",
      "Garage Assistant\n",
      "Garage Attendant\n",
      "Gardener Caretaker\n",
      "General Automotive Supervisor\n",
      "General Services Manager\n",
      "Geographic Information Systems Chief\n",
      "Geographic Information Systems Specialist\n",
      "Geographic Information Systems Supervisor\n",
      "Geotechnical Engineer\n",
      "Golf Starter\n",
      "Golf Starter Supervisor\n",
      "Graphics Designer\n",
      "Graphics Supervisor\n",
      "Harbor Engineer\n",
      "Harbor Planning And Economic Analyst\n",
      "Harbor Planning And Research Director\n",
      "Head Custodian Supervisor\n",
      "Heating And Refrigeration Inspector\n",
      "Heavy Duty Equipment Mechanic\n",
      "Heavy Duty Truck Operator\n",
      "Helicopter Mechanic\n",
      "Helicopter Mechanic Supervisor\n",
      "Housing Inspector\n",
      "Housing Investigator\n",
      "Housing Planning And Economic Analyst\n",
      "Human Relations Advocate\n",
      "Hydrographer\n",
      "Improvement Assessor Supervisor\n",
      "Industrial And Commercial Finance Officer\n",
      "Industrial Chemist\n",
      "Industrial Graphics Supervisor\n",
      "Industrial Hygienist\n",
      "Information Services Specialist\n",
      "Information Systems Manager\n",
      "Instrument Mechanic\n",
      "Instrument Mechanic Supervisor\n",
      "Internal Auditor\n",
      "Investment Officer\n",
      "Irrigation Specialist\n",
      "Labor Supervisor\n",
      "Laboratory Technician\n",
      "Land Surveying Assistant\n",
      "Landscape Architect\n",
      "Landscape Architectural Associate\n",
      "Legislative Assistant\n",
      "Legislative Representative\n",
      "Librarian\n",
      "Library Assistant\n",
      "Licensed Vocational Nurse\n",
      "Line Maintenance Assistant\n",
      "Locksmith\n",
      "Machinist\n",
      "Machinist Supervisor\n",
      "Maintenance And Construction Helper\n",
      "Maintenance Laborer\n",
      "Management Aide\n",
      "Management Analyst\n",
      "Management Assistant\n",
      "Managing Water Utility Engineer\n",
      "Marine Aquarium Curator\n",
      "Marine Aquarium Program Director\n",
      "Marine Environmental Manager\n",
      "Marine Environmental Supervisor Class Code: 9433 Open Date: 07-11-14 Annual Salary $92,769 To $115,278 *$85,503 To $106,216 Notes: *1. Individuals Hired On Or After July 2, 2013 Shall Be Hired At Three (3) Premium Levels (One Premium Level Equals 2.75%) Below The Salary Range. 2. Candidates From The Eligible List Are Normally Appointed To Vacancies In The Lower Pay Grade Positions. 3. The Current Salary Range Is Subject To Change. You May Confirm The Starting Salary With The Hiring Department Before Accepting A Job Offer. Duties A Marine Environmental Supervisor Oversees The Preparation Of Studies Of The Los Angeles Harbor, Hazardous Materials Site Assessments, Characterization And Remedial Action Plans, Air And Water Quality Programs, Environmental Assessments, Environmental Impact Reports, And Statements Relative To The Effect Of Port Development On The Environment; Supervises The Preparation And Administration Of Contracts For Technical Environmental Services And Research; Supervises The Analysis Of Proposed Environmental Legislation; Applies Sound Supervisory Principles And Techniques In Building And Maintaining An Effective Work Force; And Fulfills Equal Employment Opportunity Responsibilities. Requirements 1. Three Years Full-Time Paid Professional Experience At The Level Of Environmental Specialist, Responsible For Performing Technical Marine Environmental Activities, Such As Designing And Implementing Comprehensive Studies Of Water Or Sediment Quality In Coastal Zones And Preparing Comprehensive Environmental Assessments Of Coastal Marine Development Projects; Or 2. A Master'S Degree In Environmental, Ecological, Or Biological Science, Or Oceanography, Geology, Environmental Planning, Environmental Law, Or A Related Field And Two Years Of Full-Time Paid Professional Experience At The Level Of Environmental Specialist As Described In Requirement #1. Notes: 1. In Addition To The Regular City Application Form, Each Applicant Is Required To Complete The Marine Environmental Supervisor Qualifications Questionnaire At The Time Of Filing. The Marine Environmental Supervisor Qualifications Questionnaire Is Located Within The Supplemental Question Section Of The City Application. Applicants Who Fail To Complete The Qualifications Questionnaire Will Not Be Considered Further In This Examination, And Their Application Will Not Be Processed. 2. Applicants Who Lack Six Months Or Less Of The Required Experience May File For This Examination. However, They Cannot Be Appointed Until The Full Experience Requirement Is Met. 3. For Qualifying Work Experience Gained Outside Of The City Of Los Angeles, The Term \"Professional Experience\" Applies To Positions That Require Possession Of A Degree From A Recognized Four-Year College Or University In Order To Obtain That Position. Therefore, To Be Considered \"Professional,\" Non-City Qualifying Experience Must Be Gained In Positions After Obtaining A Four-Year Degree. 4. Minimum Requirements For An Environmental Specialist Is Either (A) Graduation From A Recognized Four-Year College With A Degree In Environmental, Ecological, Biological, Chemical, Atmospheric, Environmental Health, Environmental Planning, Or Related Field With At Least 15 Semester Units Or 20 Quarter Units In Environmental Studies; Or (B) Graduation From A Recognized Four-Year College And One Year Of Full-Time Paid Professional Experience Performing Technical Environmental Review And Analysis. 5. A Valid California Driver'S License Is Required. Candidates Will Be Disqualified And Not Eligible For Hire If Within The Past 36 Months They Were Convicted Of A Major Moving Violation, Such As Driving Under The Influence Of Alcohol And/Or Drugs, And May Be Disqualified If There Are Three Or More Moving Violations And/Or At-Fault Accidents Within The Past 36 Months. Selective Certification In Accordance With Charter Section 1010 (B) And Civil Service Rule 5.31, Selective Certification Will Be Used For Some Positions That Require Special Skills And/Or Training In One Or More Of The Following Areas. Only Persons Possessing The Following At The Time Of Filing May Be Considered For Appointment To Fill Such Positions: 1. One Year Of Full-Time Paid Professional Experience In Managing And Preparing Environmental Assessments, Including Environmental Impact Reports And Statements Pursuant To Ceqa/Nepa Requirements For Port Or Coastal Marine Developmental Projects. Where To Apply Applications Will Only Be Accepted Online. When You Are Viewing The Online Job Bulletin Of Your Choice, Simply Scroll To The Top Of The Page And Select The \"Apply\" Icon. Online Job Bulletins Are Also Available At Http://Agency.Governmentjobs.Com/Lacity/Default.Cfm For Open Competitive Examinations And At Http://Agency.Governmentjobs.Com/Lacity/Default.Cfm?Promotionaljobs=1 For Promotional Examinations. Note: Applicants Are Urged To Apply Early To Ensure You Have Time To Resolve Any Technical Issues You May Encounter. In Accordance With Civil Service Rule 4.2, All Applicants Who Apply May Not Be Tested In This Examination. To Meet Anticipated Hiring Needs, Only A Limited Number Of Qualified Applicants Will Be Invited To Participate In The Written Test In The Following Order: 1) Los Angeles City Promotional Applicants Who Meet The Minimum Requirements. You Must Have Received A Regular Appointment To A City Position Or Be On A Reserve List To Apply For This Examination As A Promotional Candidate; 2) Applicants Currently Employed By The City Of Los Angeles On A Part-Time Or Exempt Basis Who Meet The Minimum Requirements; 3) Remaining Applicants Who Meet The Minimum Requirements In Sufficient Numbers To Meet Hiring Needs In The Order That Applications Were Received. Applications Submitted During The Filing Period Will Be Kept On File For Two Years From July 11, 2014 In The Event That Additional Applicants Need To Be Tested To Meet Hiring Needs. Expert Review Committee Should A Large Number Of Qualified Candidates File For This Examination, An Expert Review Committee May Be Assembled To Evaluate Each Candidate'S Qualifications For The Position Of Marine Environmental Supervisor. In This Evaluation, The Expert Review Committee Will Assess Each Candidate'S Training And Experience Based Upon The Information In The Candidate'S City Employment Application And The Qualifications Questionnaire. Those Candidates Considered By The Expert Review Committee As Possessing The Greatest Likelihood Of Successfully Performing The Duties Of A Marine Environmental Supervisor, Based Solely On The Information Presented To The Committee, Will Be Invited To Participate In The Interview. Application Deadline Applications And Qualifications Questionnaires Must Be Received By Thursday, July 24, 2014. Selection Process Examination Weight: Interview. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 100% The Examination Will Consist Entirely Of An Evaluation Of Professional And Personal Qualifications By Interview. In The Interview, Emphasis May Be Placed On The Adequacy Of The Candidate'S Education, Training, And Experience As They Relate To The Knowledge Of: Effects Of Pollutants On Marine And Terrestrial Ecosystems; Existing And Proposed Laws And Regulations On Port And Coastline Pollution; Methods Of Combating And Controlling Pollution Problems; Technological Advances That Minimize The Environmental Impact Of Development Projects; Instruments And Techniques For Testing The Quality Of Ocean And Ground Waters, Air, Soil, And Sediments; Environmental Regulatory Agencies And Their Responsibilities; Safety Principles And Practices Used In Handling Hazardous Materials And Laboratory Testing At Contamination Sites; Principles And Practices Of Supervision Including: Directing, Assigning, Motivating, Training, Counseling, Disciplining, Commending, And Evaluating The Work Of Subordinates; Pertinent City And Personnel Department Rules, Policies, And Procedures, Including Equal Employment Opportunity And Memoranda Of Understanding; And The Ability To Analyze Environmental Problems And Prepare Comprehensive Programs For Solution; Direct And Coordinate The Work Of Groups Of Employees And Consultants Engaged In Environmental Activities; Deal Tactfully And Effectively With Others; Effectively Communicate Orally And In Writing, In A Clear, Concise Manner; And Other Necessary Skills, Knowledge, And Abilities. The Qualifications Questionnaire Will Not Be Separately Scored, But Will Be Considered By The Interview Board In Evaluating Each Candidate'S Qualifications. Candidates May Expect The Panel Members To Discuss This Information During The Interview. Qualifications Questionnaires Submitted By Candidates On The Day Of The Interview Will Not Be Accepted For Presentation To The Interview Board. Candidates Will Be Notified By Mail Of The Date, Time, And Location Of The Interview, Which Will Be Held In Los Angeles. It Is Anticipated That Interviews Will Begin During The Period Of October 20, 2014 To October 31, 2014. Notes: 1. As A Covered Entity Under The Fair Employment And Housing Act And Title Ii Of The Americans With Disabilities Act, The City Of Los Angeles Does Not Discriminate On The Basis Of Disability And Upon Request, Will Provide Reasonable Accommodations To Ensure Equal Access To Its Programs, Services, And Activities. To Request A Disability Accommodation, Please Complete The Disability Accommodation Form Within 14 Calendar Days Of The Submittal Of The City Application. The Disability Accommodation Form Can Be Obtained At Http://Per.Lacity.Org/Exams/Verify_Disability.Pdf. 2. Applications Are Accepted Subject To Review To Ensure That Minimum Qualifications Are Met. Candidates May Be Disqualified At Any Time If It Is Determined That They Do Not Possess The Minimum Qualifications Stated On This Bulletin. 3. The Promotional List Will Ordinarily Be Used Ahead Of The Open Competitive List. However, If Open Competitive Candidates Receive A Higher Score, Without Military Credits, Than The Highest Available Promotional Candidate, After Adding 0.25 Of A Point Seniority Credit For Each Year Of Service, The Civil Service Commission, Upon Request Of The Appointing Authority, May Approve Certification Of Such Open Competitive Candidates Ahead Of The Promotional Candidates. 4. A Final Average Score Of 70% Is Required To Be Placed On The Eligible List. 5. In Conjunction With Civil Service Rules, Applicants Who Are Current Eligible City Employees Or Are On A Reserve List Will Be Considered Promotional Candidates While All Other Applicants Will Be Considered Open Candidates. 6. You Must Have Received A Regular Appointment To A City Position Or Be On A Reserve List To File On A Promotional Basis. 7. If, In Accordance With The Rule Of Three Whole Scores, All Applicants Are Eligible For Appointment Consideration, The Examination Will Consist Entirely Of An Evaluation Of The Candidate'S City Application By Personnel Department Staff To Ensure That The Minimum Qualifications Have Been Met. Notice: If You Receive And Accept An Offer Of Employment To A Regular Position With The City Of Los Angeles, Your Employee Benefit Coverage (Including Health And Dental Coverage As Well As Life Insurance) Will Commence Approximately Six Weeks After Your Original Regular Appointment. Not All Positions In The City Receive Benefit Coverage; You Should Inquire Regarding The Availability Of Employee Benefits Prior To Accepting A Position. Glossary 9 - City Council Review Statement This Examination Is To Be Given Both On An Interdepartmental Promotional And An Open Competitive Basis The City Of Los Angeles Does Not Discriminate On The Basis Of Race, Religion, National Origin, Sex, Age, Marital Status, Sexual Orientation, Gender Identity, Gender Expression, Disability, Creed, Color, Ancestry, Medical Condition (Cancer), Or Acquired Immune Deficiency Syndrome.\n",
      "Masonry Worker\n",
      "Materials Testing Engineering Associate\n",
      "Materials Testing Technician\n",
      "Mechanical Engineer\n",
      "Mechanical Engineering Associate\n",
      "Mechanical Engineering Drafting Technician\n",
      "Mechanical Helper\n",
      "Mechanical Repair General Supervisor\n",
      "Mechanical Repair Supervisor\n",
      "Mechanical Repairer\n",
      "Medical Assistant\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Meter Reader\n",
      "Motion Picture And Television Manager\n",
      "Motor Sweeper Operator\n",
      "Occupational Health Nurse\n",
      "Office Engineering Technician\n",
      "Office Services Assistant\n",
      "Office Trainee\n",
      "Operations And Statistical Research Analyst\n",
      "Painter\n",
      "Painter Supervisor\n",
      "Park Maintenance Supervisor\n",
      "Park Ranger\n",
      "Park Services Attendant\n",
      "Park Services Supervisor\n",
      "Parking Attendant\n",
      "Parking Enforcement Manager\n",
      "Parking Manager\n",
      "Parking Meter Technician\n",
      "Parking Meter Technician Supervisor\n",
      "Payroll Analyst\n",
      "Payroll Supervisor\n",
      "Performing Arts Director\n",
      "Personnel Analyst\n",
      "Personnel Director\n",
      "Personnel Records Supervisor\n",
      "Personnel Research Analyst\n",
      "Photographer\n",
      "Pile Driver Worker\n",
      "Pipefitter\n",
      "Pipefitter Supervisor\n",
      "Planning Assistant\n",
      "Plumber\n",
      "Plumber Supervisor\n",
      "Plumbing Inspector\n",
      "Police Administrator\n",
      "Police Captain\n",
      "Police Commander\n",
      "Police Detective\n",
      "Police Lieutenant\n",
      "Police Officer\n",
      "Police Performance Auditor\n",
      "Police Sergeant\n",
      "Police Service Representative\n",
      "Police Special Investigator\n",
      "Police Specialist\n",
      "Police Surveillance Specialist\n",
      "Polygraph Examiner\n",
      "Port Electrical Mechanic\n",
      "Port Electrical Mechanic Supervisor\n",
      "Port Maintenance Supervisor\n",
      "Port Pilot\n",
      "Port Police Captain\n",
      "Port Police Lieutenant\n",
      "Port Police Officer\n",
      "Port Police Sergeant\n",
      "Portfolio Manager\n",
      "Power Engineering Manager\n",
      "Power Shovel Operator\n",
      "Pre-Press Operator\n",
      "Principal Accountant\n",
      "Principal Animal Keeper\n",
      "Principal City Planner\n",
      "Principal Civil Engineer\n",
      "Principal Civil Engineering Drafting Technician\n",
      "Principal Clerk\n",
      "Principal Clerk Police\n",
      "Principal Clerk Utility\n",
      "Principal Communications Operator\n",
      "Principal Construction Inspector\n",
      "Principal Deputy Controller\n",
      "Principal Detention Officer\n",
      "Principal Electric Trouble Dispatcher\n",
      "Principal Electrical Engineering Drafting Technician\n",
      "Principal Environmental Engineer\n",
      "Principal Grounds Maintenance Supervisor\n",
      "Principal Inspector\n",
      "Principal Librarian\n",
      "Principal Mechanical Engineering Drafting Technician\n",
      "Principal Photographer\n",
      "Principal Property Officer\n",
      "Principal Public Relations Representative\n",
      "Principal Recreation Supervisor\n",
      "Principal Security Officer\n",
      "Principal Storekeeper\n",
      "Principal Tax Auditor\n",
      "Principal Tax Compliance Officer\n",
      "Principal Transportation Engineer\n",
      "Principal Utility Accountant\n",
      "Principal Workers' Compensation Analyst\n",
      "Printing Press Operator\n",
      "Printing Services Superintendent\n",
      "Procurement Analyst\n",
      "Procurement Supervisor\n",
      "Programmer Analyst\n",
      "Property Manager\n",
      "Property Officer\n",
      "Protective Coating Worker\n",
      "Public Information Director\n",
      "Public Relations Specialist\n",
      "Public Safety Risk Manager\n",
      "Rates Manager\n",
      "Real Estate Associate\n",
      "Real Estate Officer\n",
      "Real Estate Trainee\n",
      "Recreation Coordinator\n",
      "Recreation Facility Director\n",
      "Recreation Supervisor\n",
      "Refuse Collection Supervisor\n",
      "Refuse Collection Truck Operator\n",
      "Refuse Crew Field Instructor\n",
      "Rehabilitation Construction Specialist\n",
      "Rehabilitation Project Coordinator\n",
      "Reinforcing Steel Worker\n",
      "Reprographics Operator\n",
      "Reprographics Supervisor\n",
      "Retirement Plan Manager\n",
      "Rideshare Program Administrator\n",
      "Risk And Insurance Assistant\n",
      "Risk Management And Prevention Program Specialist\n",
      "Risk Manager\n",
      "Roofer\n",
      "Roofer Supervisor\n",
      "Safety Administrator\n",
      "Safety Engineer\n",
      "Safety Engineer Elevators\n",
      "Safety Engineer Pressure Vessels\n",
      "Safety Engineering Associate\n",
      "Sanitation Solid Resources Manager\n",
      "Sanitation Wastewater Manager\n",
      "Secretary\n",
      "Secretary Legal\n",
      "Security Aide\n",
      "Security Officer\n",
      "Senior Accountant\n",
      "Senior Administrative Analyst\n",
      "Senior Administrative Clerk\n",
      "Senior Animal Control Officer\n",
      "Senior Animal Keeper\n",
      "Senior Architect\n",
      "Senior Architectural Drafting Technician\n",
      "Senior Auditor\n",
      "Senior Automotive Supervisor\n",
      "Senior Building Inspector\n",
      "Senior Building Mechanical Inspector\n",
      "Senior Building Operating Engineer\n",
      "Senior Carpenter\n",
      "Senior Chemist\n",
      "Senior City Planner\n",
      "Senior Civil Engineer\n",
      "Senior Civil Engineering Drafting Technician\n",
      "Senior Claims Representative\n",
      "Senior Commercial Field Representative\n",
      "Senior Communications Cable Worker\n",
      "Senior Communications Electrician\n",
      "Senior Communications Electrician Supervisor\n",
      "Senior Communications Engineer\n",
      "Senior Communications Operator\n",
      "Senior Computer Operator\n",
      "Senior Construction Engineer\n",
      "Senior Construction Estimator\n",
      "Senior Construction Inspector\n",
      "Senior Custodian\n",
      "Senior Data Processing Technician\n",
      "Senior Detention Officer\n",
      "Senior Electric Service Representative\n",
      "Senior Electric Trouble Dispatcher\n",
      "Senior Electrical Engineering Drafting Technician\n",
      "Senior Electrical Inspector\n",
      "Senior Electrical Mechanic\n",
      "Senior Electrical Mechanic Supervisor\n",
      "Senior Electrical Repair Supervisor\n",
      "Senior Electrical Test Technician\n",
      "Senior Electrician\n",
      "Senior Environmental Compliance Inspector\n",
      "Senior Environmental Engineer\n",
      "Senior Equipment Mechanic\n",
      "Water Utility Superintendent\n",
      "Senior Fire Protection Engineer\n",
      "Senior Forensic Print Specialist\n",
      "Senior Gardener\n",
      "Senior Heating And Refrigeration Inspector\n",
      "Senior Heavy Duty Equipment Mechanic\n",
      "Senior Housing Inspector\n",
      "Senior Housing Investigator\n",
      "Senior Hydrographer\n",
      "Senior Industrial Hygienist\n",
      "Senior Labor Relations Specialist\n",
      "Senior Legislative Assistant\n",
      "Senior Librarian\n",
      "Senior Load Dispatcher\n",
      "Senior Machinist Supervisor\n",
      "Senior Management Analyst\n",
      "Senior Mechanical Engineering Drafting Technician\n",
      "Senior Mechanical Repairer\n",
      "Senior Painter\n",
      "Senior Park Maintenance Supervisor\n",
      "Senior Park Ranger\n",
      "Senior Park Services Attendant\n",
      "Senior Parking Attendant\n",
      "Senior Personnel Analyst\n",
      "Senior Photographer\n",
      "Senior Plumber\n",
      "Senior Plumbing Inspector\n",
      "Senior Police Service Representative\n",
      "Senior Port Electrical Mechanic\n",
      "Senior Property Officer\n",
      "Senior Real Estate Officer\n",
      "Senior Recreation Director\n",
      "Senior Roofer\n",
      "Senior Safety Engineer Elevators\n",
      "Senior Safety Engineer Pressure Vessels\n",
      "Senior Security Officer\n",
      "Senior Storekeeper\n",
      "Senior Street Lighting Engineer\n",
      "Senior Structural Engineer\n",
      "Senior Survey Supervisor\n",
      "Senior Systems Analyst\n",
      "Senior Tax Auditor\n",
      "Senior Title Examiner\n",
      "Senior Traffic Supervisor\n",
      "Senior Transportation Engineer\n",
      "Senior Transportation Investigator\n",
      "Senior Underground Distribution Construction Supervisor\n",
      "Senior Utility Accountant\n",
      "Senior Utility Buyer\n",
      "Senior Utility Services Specialist\n",
      "Senior Utility Services Specialist\n",
      "Senior Wastewater Treatment Operator\n",
      "Senior Window Cleaner\n",
      "Senior Workers' Compensation Analyst\n",
      "Sheet Metal Supervisor\n",
      "Sheet Metal Worker\n",
      "Shift Superintendent Wastewater Treatment\n",
      "Ship Carpenter\n",
      "Shops Superintendent\n",
      "Sign Painter\n",
      "Sign Shop Supervisor\n",
      "Signal Systems Electrician\n",
      "Signal Systems Superintendent\n",
      "Signal Systems Supervisor\n",
      "Social Worker\n",
      "Solid Resources Superintendent\n",
      "Solid Waste Disposal Superintendent\n",
      "Special Investigator\n",
      "Senior Crime And Intelligence Analyst\n",
      "Staff Assistant To General Manager Water And Power\n",
      "Steam Plant Assistant\n",
      "Steam Plant Maintenance Mechanic\n",
      "Steam Plant Maintenance Supervisor\n",
      "Steam Plant Operator\n",
      "Storekeeper\n",
      "Stores Supervisor\n",
      "Street Lighting Construction And Maintenance Superintendent\n",
      "Street Lighting Electrician\n",
      "Street Lighting Electrician Supervisor\n",
      "Street Lighting Engineer\n",
      "Campus Interviews Only Street Lighting Engineering Associate\n",
      "Street Services General Superintendent\n",
      "Street Services Investigator\n",
      "Street Services Superintendent\n",
      "Street Services Supervisor\n",
      "Street Services Worker\n",
      "Street Tree Superintendent\n",
      "Structural Engineer\n",
      "Structural Engineering Associate\n",
      "Structural Steel Fabricator\n",
      "Structural Steel Fabricator Supervisor\n",
      "Superintendent Of Recreation And Parks Operations\n",
      "Supervising Criminalist\n",
      "Supervising Occupational Health Nurse\n",
      "Supervising Transportation Planner\n",
      "Supervising Water Service Representative\n",
      "Supply Services Manager\n",
      "Supply Services Payment Clerk\n",
      "Survey Party Chief\n",
      "Survey Supervisor\n",
      "Systems Aide\n",
      "Systems Analyst\n",
      "Systems Programmer\n",
      "Tax Auditor\n",
      "Tax Compliance Aide\n",
      "Tax Compliance Officer\n",
      "Telecommunications Planning And Utilization Officer\n",
      "Tile Setter\n",
      "Tire Repairer\n",
      "Title Examiner\n",
      "Traffic Marking And Sign Superintendent\n",
      "Traffic Officer\n",
      "Traffic Painter And Sign Poster\n",
      "Transmission And Distribution District Supervisor\n",
      "Transportation Engineer\n",
      "Transportation Engineering Aide\n",
      "Transportation Engineering Associate\n",
      "Transportation Investigator\n",
      "Transportation Planning Associate\n",
      "Treasury Accountant\n",
      "Tree Surgeon\n",
      "Tree Surgeon Assistant\n",
      "Tree Surgeon Supervisor\n",
      "Truck And Equipment Dispatcher\n",
      "Truck Operator\n",
      "Underground Distribution Construction Mechanic\n",
      "Underground Distribution Construction Supervisor\n",
      "Upholsterer\n",
      "Utilities Service Investigator\n",
      "Utility Accountant\n",
      "Utility Administrator\n",
      "Utility Buyer\n",
      "Utility Executive Secretary\n",
      "Utility Services Manager\n",
      "Utility Services Specialist\n",
      "Veterinary Technician\n",
      "Video Production Coordinator\n",
      "Video Technician\n",
      "Volunteer Coordinator\n",
      "Warehouse And Toolroom Worker\n",
      "Wastewater Treatment Operator\n",
      "Wastewater Collection Worker\n",
      "Wastewater Treatment Electrician\n",
      "Wastewater Treatment Electrician Supervisor\n",
      "Wastewater Treatment Laboratory Manager\n",
      "Wastewater Treatment Mechanic\n",
      "Wastewater Treatment Mechanic Supervisor\n",
      "Wastewater Treatment Operator\n",
      "Water Biologist\n",
      "Water Microbiologist\n",
      "Water Service Representative\n",
      "Water Service Supervisor\n",
      "Water Service Worker\n",
      "Water Services Manager\n",
      "Water Treatment Operator\n",
      "Water Treatment Supervisor\n",
      "Water Utility Operator\n",
      "Water Utility Operator Supervisor\n",
      "Water Utility Superintendent\n",
      "Water Utility Supervisor\n",
      "Water Utility Worker\n",
      "Watershed Resources Specialist\n",
      "Waterworks Engineer\n",
      "Waterworks Mechanic Supervisor\n",
      "Welder\n",
      "Welder Supervisor\n",
      "Wharfinger\n",
      "Window Cleaner\n",
      "Workers' Compensation Analyst\n",
      "Workers' Compensation Claims Assistant\n",
      "X-Ray And Laboratory Technician\n",
      "Zoo Curator\n",
      "Zoo Curator Of Education\n",
      "Zoo Registrar\n"
     ]
    }
   ],
   "source": [
    "# Overview of ALL job titles\n",
    "# To look at ALL job titles, use mtk.jct_print_results (jct = job_class_title)\n",
    "# To look at ALL job duties, use mtk.jd_print_results  (jd  = job_duties)\n",
    "# etc.\n",
    "mtk.jct_print_results(job_path=mtk.raw_path, job_type=mtk.raw_jobs)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## First Analysis\n",
    "680 out of 682 job class titles were successfully extracted. The remaining two have suspiciously long titles:\n",
    "* DISTRICT SUPERVISOR ANIMAL SERVICES 4320 022318.txt\n",
    "* MARINE ENVIRONMENTAL SUPERVISOR 9433 071114 (1).txt\n",
    "\n",
    "We'll use the `provenir.spotlight` function and the unit function `itk.jct_get_one` to inspect each job individually and show us their contents."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "**DISTRICT SUPERVISOR ANIMAL SERVICES 4320 022318.txt**"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 3,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "'DISTRICT SUPERVISOR ANIMAL SERVICES\\n(Class Title of District Supervisor Animal Regulation)\\n\\nClass Code:       4320\\nOpen Date:  02-23-18\\n(Exam Open to Current City Employees)\\n\\nANNUAL SALARY\\n\\n$76,128 to $111,332\\n\\nNOTES:\\n\\n1. Annual salary is at the start of the pay range. The current salary range is subject to change. Please confirm the starting salary with the hiring department before accepting a job offer.\\n2. Candidates from the eligible list are normally appointed to vacancies in the lower pay grade positions.\\n3. A District Supervisor Animal Services (District Supervisor Animal Regulation) must be available for assignment to various shifts, weekends and holidays, at any one of the animal shelters located in Central Los Angeles, South Central Los Angeles, West Los Angeles, San Pedro, and the San Fernando Valley.\\n\\nDUTIES\\n\\nA District Supervisor Animal Services (District Supervisor Animal Regulation) plans, organizes, and directs the work of animal care and control personnel engaged in animal care and control activities within a large geographical urban area, including overall field enforcement, animal licensing, housing for wild, domestic, and dangerous animals, and kennel and office operations of one or more District Animal Care and Control Centers; performs various budgetary, administrative, and animal care and control duties, including providing information to the public regarding animals, directing the district administrative hearing program, and appearing before legislative bodies on matters pertaining to animal care and control; applies sound supervisory principles and techniques in building and maintaining an effective work force and fulfills affirmative action responsibilities.\\n\\nREQUIREMENTS/MINIMUM QUALIFICATIONS\\n\\n1. Two years of full-time paid experience with the City of Los Angeles as a Senior Animal Control Officer; or\\n2. Four years of full-time paid experience with the City of Los Angeles as an Animal Care Technician Supervisor.\\n\\nPROCESS NOTES\\n\\n1. Applicants who lack six months or less of the required experience may file for this examination. However, they cannot be appointed until the full experience requirement is met.\\n2. A valid California driver\\'s license is required. Applicants will be disqualified and not eligible for hire if their record within the last 36 months reflects three or more moving violations and/or at-fault accidents, or a conviction of a major moving violation (such as DUI).\\n\\nWHERE TO APPLY\\n\\nApplications will only be accepted on-line. When you are viewing the on-line job bulletin of your choice, simply scroll to the top of the page and select the \"Apply\" icon. On-line job bulletins are also available at https://www.governmentjobs.com/careers/lacity/promotionaljobs for Promotional Examinations. \\n\\nNOTE:\\n\\nApplicants are urged to apply early to ensure you have time to resolve any technical issues you may encounter. \\n\\n\\nAPPLICATION DEADLINE\\n\\nApplications must be received by THURSDAY, MARCH 8, 2018. \\n\\n\\nSELECTION PROCESS\\n\\nAfter meeting minimum qualifications candidates will be scheduled for the following:\\n\\nExamination Weight:  Essay . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Advisory\\n\\t\\t\\t     Oral Presentation Exercise . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .Advisory\\n                                      Interview . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .  100%\\n\\nThe examination will consist entirely of an evaluation of the candidate\\'s personal and professional qualifications by interview. In the interview, emphasis may be placed on the candidate\\'s experience, background, and personal qualifications as they have prepared the candidate to perform the duties of a District Supervisor Animal Services (District Supervisor Animal Regulation), including the knowledge of: various animal care and control activities, including the operation of and services provided by district shelters, and the needs of various animals sufficient to effectively oversee the operation of such shelters and ensure that proper animal care is provided; equipment and methods of wildlife abatement and control sufficient to determine that appropriate methods have been used when evaluating reports or incidents involving wild animals; voucher system for assisting City residents in having animals spayed or neutered; frequently used provisions of City and State laws, ordinances, codes, and regulations relating to the keeping, licensing, care, and control of animals, including the reference sources used to locate such provisions; procedures, laws of evidence, and documentation required when conducting hearings sufficient to give testimony when required; major projects and goals of the Department of Animal Services sufficient to successfully prepare for the budgeting and/or administration of projects; purchasing and inventory control procedures sufficient to ensure that supplies and equipment are maintained at appropriate levels; other City departments and outside agencies which use, serve, or interact with the Department of Animal Services, including appropriate channels of communication and City practices and procedures for transmitting information between such parties; safety procedures and regulations related to the care and control of various animals; pertinent City and Personnel Department rules, policies and procedures including Equal Employment Opportunity (EEO) responsibilities and Memoranda of Understanding (MOUs) provisions as they relate to subordinate personnel; disciplinary steps and procedures as set by Department of Animal Services policies sufficient to discipline subordinates, keep appropriate documentation, and make decisions and recommendations regarding employee discipline; and the ability to prepare time and cost estimates for the completion of various programs and projects; use a personal computer (PC) to retrieve information from established databases; supervise the animal care and control activities within a large geographical urban area; identify and develop appropriate, innovative, and practical solutions to problems; use good judgment; identify situations in which the complexity of the issue or sensitive nature of the subject may require management level decisions sufficient to escalate such issues in a timely manner; provide effective leadership and apply sound supervisory principles and practices including assigning, prioritizing, delegating, reviewing and evaluating the work of subordinates, providing training, counseling, and discipline as needed, and enhancing employee morale and productivity; communicate effectively both orally and in writing; deal tactfully and effectively with public officials, outside agencies and the public; and other necessary skills, knowledge and abilities.\\n\\nAs part of the interview, candidates will be required to make an oral presentation to the interview board about an animal care and control related issue. While the interviewers will not assign a separate score to the oral presentation, the interviewers will consider the appropriateness, practicality, and effectiveness of the oral presentation in their overall evaluations of the candidate\\'s qualifications. Candidates should expect the interviewers to discuss the oral presentation with them during their interviews.  \\n\\nSpecific information regarding the oral presentation to be made to the interview board will be e-mailed to those candidates invited to participate in the interview.  \\n\\nCandidates will be notified later by e-mail of the date, time and location of the interview and oral presentation, which will be held in Los Angeles. It is anticipated that the interviews and oral presentation will begin during the period of MAY 14, 2018 to MAY 25, 2018.\\n\\nPrior to the interview, candidates will be required to prepare some written material related to the duties and responsibilities of a District Supervisor Animal Services (District Supervisor Animal Regulation). This essay material will not be separately scored, but will be presented to the interview board for discussion with the candidate and for consideration in the overall evaluation of the candidate. Candidates who fail to complete the Advisory Essay as instructed may be disqualified. \\n\\nThe Advisory Essay will be administered online. Candidates invited to participate in the examination will receive an e-mail from the City of Los Angeles outlining the specific steps needed to complete the online Advisory Essay. Candidates will be required to complete the online Advisory Essay on SATURDAY, APRIL 21, 2018. Additional instructions will be sent via e-mail. \\n\\nNOTES:\\t\\n\\n1. This examination is based on a validation study.\\n2. As a covered entity under the Fair Employment and Housing Act and Title II of the Americans with Disabilities Act, the City of Los Angeles does not discriminate on the basis of disability and upon request, will provide reasonable accommodations to ensure equal access to its programs, services, and activities. To request a disability accommodation, please complete the Disability Accommodation Form within 14 calendar days of the submittal of the City application. The Disability Accommodation Form can be obtained at http://per.lacity.org/exams/verify_disability.pdf.\\n3. Applications are accepted subject to review to ensure minimum qualifications are met. Candidates may be disqualified at any time if it is determined that they do not possess the minimum qualifications stated on this bulletin.\\n4. A final average score of 70% is required to be placed on the eligible list.\\n5. You must have received a regular appointment to a City position or be on a reserve list to file on a promotional basis.\\n6. Seniority credit at the rate of 0.25 of a point for each year of continuous service will be added to the weighted test score of each candidate.\\n7. If in accordance with the Rule of Three Whole Scores all applicants are eligible for appointment consideration, the examination will consist entirely of an evaluation of the candidates\\' City applications by Personnel Department staff to ensure that the minimum qualifications have been met.\\n8. In accordance with Civil Service Rule, Sec. 4.24, review periods may be combined. Candidates in the examination process may file protests as provided in Sec. 4.20, 4.22 and 4.23 as applicable and within the required time frame; however, the Personnel Department may respond to and resolve protests prior to the establishment of the eligible list.\\n\\nTHIS EXAMINATION IS TO BE GIVEN ON AN\\nINTERDEPARTMENTAL PROMOTIONAL BASIS\\n\\nThe City of Los Angeles does not discriminate on the basis of race, religion, national origin, sex, age, marital status, sexual orientation, gender identity, gender expression, disability, creed, color, ancestry, medical condition (cancer), or Acquired Immune Deficiency Syndrome.\\nClass Code 4320 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 02-23-18\\n\\nAN EQUAL EMPLOYMENT OPPORTUNITY EMPLOYER\\nFor additional information and FAQs regarding the City\\'s hiring process, please go to:  http://per.lacity.org/index.cfm?content=employmenttestingprocess\\n\\n'"
      ]
     },
     "execution_count": 3,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# Get the content of this job\n",
    "# provenir.spotlight allows us to get the content of each job posting as a string\n",
    "job = provenir.spotlight(job_name='DISTRICT SUPERVISOR ANIMAL SERVICES 4320 022318.txt',\n",
    "                         job_path=mtk.raw_path,\n",
    "                         job_type=mtk.raw_jobs)\n",
    "job"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 4,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "'District Supervisor Animal Services (Class Title Of District Supervisor Animal Regulation)'"
      ]
     },
     "execution_count": 4,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# Get job title\n",
    "# To get job's duties for this job, use itk.jd_get_one(job)\n",
    "# etc.\n",
    "itk.jct_get_one(job)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "By looking at the content, it's clear why our unit function gives such a result. It considers anything that comes before <font color='red'>Class Code</font> contributing to a job title. Since the phrase, *(Class Title of District Supervisor Animal Regulation)*, is not related to the job title (not all capitalized) we should consider removing it."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "**MARINE ENVIRONMENTAL SUPERVISOR 9433 071114 (1).txt**"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 5,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "'\\n\\n\\n\\n\\n\\n\\nMARINE ENVIRONMENTAL SUPERVISOR    \\n                           \\n \\t\\t\\t\\t\\t\\t\\t\\t\\t\\tClass  Code:      9433    \\n                                                                                                       Open Date:  07-11-14\\n\\nANNUAL SALARY\\n\\n $92,769 to $115,278\\n*$85,503 to $106,216\\n\\nNOTES:\\n\\n*1.  Individuals hired on or after July 2, 2013 shall be hired at three (3) premium levels (one premium level equals 2.75%) \\n      below the salary range.\\n 2.  Candidates from the eligible list are normally appointed to vacancies in the lower pay grade positions.\\n 3.  The current salary range is subject to change. You may confirm the starting salary with the hiring department before accepting a job offer. \\n\\nDUTIES\\n\\nA Marine Environmental Supervisor oversees the preparation of studies of the Los Angeles Harbor, hazardous materials site assessments, characterization and remedial action plans, air and water quality programs, environmental assessments, environmental impact reports, and statements relative to the effect of port development on the environment; supervises the preparation and administration of contracts for technical environmental services and research; supervises the analysis of proposed environmental legislation; applies sound supervisory principles and techniques in building and maintaining an effective work force; and fulfills equal employment opportunity responsibilities.\\n\\nREQUIREMENTS\\n\\n1.\\tThree years full-time paid professional experience at the level of Environmental Specialist, responsible for performing technical marine environmental activities, such as designing and implementing comprehensive studies of water or sediment quality in coastal zones and preparing comprehensive environmental assessments of coastal marine development projects; or\\n2. A Master\\'s degree in environmental, ecological, or biological science, or oceanography, geology, environmental planning, environmental law, or a related field and two years of full-time paid professional experience at the level of Environmental Specialist as described in requirement #1.\\n\\nNOTES:\\n\\n1. In addition to the regular City application form, each applicant is required to complete the Marine Environmental Supervisor Qualifications Questionnaire at the time of filing. The Marine Environmental Supervisor Qualifications Questionnaire is located within the Supplemental Question Section of the City application. Applicants who fail to complete the Qualifications Questionnaire will not be considered further in this examination, and their application will not be processed. \\n2. Applicants who lack six months or less of the required experience may file for this examination.  However, they cannot be appointed until the full experience requirement is met.\\n3. For qualifying work experience gained outside of the City of Los Angeles, the term \"professional experience\" applies to positions that require possession of a degree from a recognized four-year college or university in order to obtain that position. Therefore, to be considered \"professional,\" non-City qualifying experience must be gained in positions after obtaining a four-year degree.\\n4. Minimum requirements for an Environmental Specialist is either (a) graduation from a recognized four-year college with a degree in environmental, ecological, biological, chemical, atmospheric, environmental health,  environmental planning, or related field with at least 15 semester units or 20 quarter units in environmental studies; or (b) graduation from a recognized four-year college and one year of full-time paid professional experience performing technical environmental review and analysis.\\n5. A valid California driver\\'s license is required. Candidates will be disqualified and not eligible for hire if within the past 36 months they were convicted of a major moving violation, such as driving under the influence of alcohol and/or drugs, and may be disqualified if there are three or more moving violations and/or at-fault accidents within the past 36 months.\\n\\nSELECTIVE CERTIFICATION\\n\\nIn accordance with Charter Section 1010 (b) and Civil Service Rule 5.31, selective certification will be used for some positions that require special skills and/or training in one or more of the following areas.  Only persons possessing the following at the time of filing may be considered for appointment to fill such positions:\\n\\n1. One year of full-time paid professional experience in managing and preparing environmental assessments, including Environmental Impact Reports and Statements pursuant to CEQA/NEPA requirements for port or coastal marine developmental projects.\\n\\n\\n\\n\\nWHERE TO APPLY\\n\\nApplications will only be accepted online. When you are viewing the online job bulletin of your choice, simply scroll to the top of the page and select the \"Apply\" icon. Online job bulletins are also available at http://agency.governmentjobs.com/lacity/default.cfm for Open Competitive Examinations and at http://agency.governmentjobs.com/lacity/default.cfm?promotionaljobs=1 for Promotional Examinations.\\n\\nNOTE:\\n\\nApplicants are urged to apply early to ensure you have time to resolve any technical issues you may encounter.\\n\\nIn accordance with Civil Service Rule 4.2, all applicants who apply may not be tested in this examination. To meet anticipated hiring needs, only a limited number of qualified applicants will be invited to participate in the written test in the following order: 1) Los Angeles City Promotional applicants who meet the minimum requirements. You must have received a regular appointment to a City position or be on a reserve list to apply for this examination as a promotional candidate; 2) Applicants currently employed by the City of Los Angeles on a part-time or exempt basis who meet the minimum requirements; 3) Remaining applicants who meet the minimum requirements in sufficient numbers to meet hiring needs in the order that applications were received. Applications submitted during the filing period will be kept on file for two years from July 11, 2014 in the event that additional applicants need to be tested to meet hiring needs.\\n\\nEXPERT REVIEW COMMITTEE\\n\\nShould a large number of qualified candidates file for this examination, an expert review committee may be assembled to evaluate each candidate\\'s qualifications for the position of Marine Environmental Supervisor. In this evaluation, the expert review committee will assess each candidate\\'s training and experience based upon the information in the candidate\\'s City employment application and the Qualifications Questionnaire. Those candidates considered by the expert review committee as possessing the greatest likelihood of successfully performing the duties of a Marine Environmental Supervisor, based solely on the information presented to the committee, will be invited to participate in the interview.\\n\\nAPPLICATION DEADLINE\\n\\nApplications and Qualifications Questionnaires must be received by THURSDAY, JULY 24, 2014. \\n\\n\\nSELECTION PROCESS \\n\\nExamination Weight:  Interview. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 100%\\n\\nThe examination will consist entirely of an evaluation of professional and personal qualifications by interview.  In the interview, emphasis may be placed on the adequacy of the candidate\\'s education, training, and experience as they relate to the knowledge of: effects of pollutants on marine and terrestrial ecosystems; existing and proposed laws and regulations on port and coastline pollution; methods of combating and controlling pollution problems; technological advances that minimize the environmental impact of development projects; instruments and techniques for testing the quality of ocean and ground waters, air, soil, and sediments; environmental regulatory agencies and their responsibilities; safety principles and practices used in handling hazardous materials and laboratory testing at contamination sites; principles and practices of supervision including: directing, assigning, motivating, training, counseling, disciplining, commending, and evaluating the work of subordinates; pertinent City and Personnel Department rules, policies, and procedures, including Equal Employment Opportunity and Memoranda of Understanding; and the ability to analyze environmental problems and prepare comprehensive programs for solution; direct and coordinate the work of groups of employees and consultants engaged in environmental activities; deal tactfully and effectively with others; effectively communicate orally and in writing, in a clear, concise manner; and other necessary skills, knowledge, and abilities.\\n\\nThe Qualifications Questionnaire will not be separately scored, but will be considered by the interview board in evaluating each candidate\\'s qualifications. Candidates may expect the panel members to discuss this information during the interview. Qualifications Questionnaires submitted by candidates on the day of the interview will not be accepted for presentation to the interview board.\\n\\nCandidates will be notified by mail of the date, time, and location of the interview, which will be held in Los Angeles. It is anticipated that interviews will begin during the period of OCTOBER 20, 2014 to OCTOBER 31, 2014.\\n\\nNOTES: \\n\\n1. As a covered entity under the Fair Employment and Housing Act and Title II of the Americans with Disabilities Act, the City of Los Angeles does not discriminate on the basis of disability and upon request, will provide reasonable accommodations to ensure equal access to its programs, services, and activities.  To request a disability accommodation, please complete the Disability Accommodation Form within 14 calendar days of the submittal of the City application.  The Disability Accommodation Form can be obtained at http://per.lacity.org/exams/verify_disability.pdf.\\n2. Applications are accepted subject to review to ensure that minimum qualifications are met.  Candidates may be disqualified at any time if it is determined that they do not possess the minimum qualifications stated on this bulletin.\\n3. The promotional list will ordinarily be used ahead of the open competitive list.  However, if open competitive candidates receive a higher score, without military credits, than the highest available promotional candidate, after adding 0.25 of a point seniority credit for each year of service, the Civil Service Commission, upon request of the appointing authority, may approve certification of such open competitive candidates ahead of the promotional candidates.\\n4. A final average score of 70% is required to be placed on the eligible list.\\n5. In conjunction with Civil Service rules, applicants who are current eligible City employees or are on a reserve list will be considered Promotional candidates while all other applicants will be considered Open candidates.\\n6. You must have received a regular appointment to a City position or be on a reserve list to file on a promotional basis.\\n7. If, in accordance with the Rule of Three Whole Scores, all applicants are eligible for appointment consideration,  the examination will consist entirely of an evaluation of the candidate\\'s City application by Personnel Department staff to ensure that the minimum qualifications have been met.\\n\\nNotice:  \\n\\nIf you receive and accept an offer of employment to a regular position with the City of Los Angeles, your employee benefit coverage (including health and dental coverage as well as life insurance) will commence approximately six weeks after your original regular appointment. Not all positions in the City receive benefit coverage; you should inquire regarding the availability of employee benefits prior to accepting a position.\\n\\nGLOSSARY 9 - CITY COUNCIL REVIEW STATEMENT\\tTHIS EXAMINATION IS TO BE GIVEN BOTH ON AN\\nINTERDEPARTMENTAL PROMOTIONAL AND AN OPEN COMPETITIVE BASIS\\n\\nThe City of Los Angeles does not discriminate on the basis of race, religion, national origin, sex, age, marital status, sexual orientation, gender identity, gender expression, disability, creed, color, ancestry, medical condition (cancer), or Acquired Immune Deficiency Syndrome.\\n\\nClass Code 9433................................................................................................................................................07-11-14\\n\\nAN EQUAL EMPLOYMENT OPPORTUNITY EMPLOYER\\n\\n\\n\\n'"
      ]
     },
     "execution_count": 5,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# Get the content of this job\n",
    "job = provenir.spotlight(job_name='MARINE ENVIRONMENTAL SUPERVISOR 9433 071114 (1).txt',\n",
    "                         job_path=mtk.raw_path,\n",
    "                         job_type=mtk.raw_jobs)\n",
    "job"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 6,
   "metadata": {
    "collapsed": true
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "'Marine Environmental Supervisor Class Code: 9433 Open Date: 07-11-14 Annual Salary $92,769 To $115,278 *$85,503 To $106,216 Notes: *1. Individuals Hired On Or After July 2, 2013 Shall Be Hired At Three (3) Premium Levels (One Premium Level Equals 2.75%) Below The Salary Range. 2. Candidates From The Eligible List Are Normally Appointed To Vacancies In The Lower Pay Grade Positions. 3. The Current Salary Range Is Subject To Change. You May Confirm The Starting Salary With The Hiring Department Before Accepting A Job Offer. Duties A Marine Environmental Supervisor Oversees The Preparation Of Studies Of The Los Angeles Harbor, Hazardous Materials Site Assessments, Characterization And Remedial Action Plans, Air And Water Quality Programs, Environmental Assessments, Environmental Impact Reports, And Statements Relative To The Effect Of Port Development On The Environment; Supervises The Preparation And Administration Of Contracts For Technical Environmental Services And Research; Supervises The Analysis Of Proposed Environmental Legislation; Applies Sound Supervisory Principles And Techniques In Building And Maintaining An Effective Work Force; And Fulfills Equal Employment Opportunity Responsibilities. Requirements 1. Three Years Full-Time Paid Professional Experience At The Level Of Environmental Specialist, Responsible For Performing Technical Marine Environmental Activities, Such As Designing And Implementing Comprehensive Studies Of Water Or Sediment Quality In Coastal Zones And Preparing Comprehensive Environmental Assessments Of Coastal Marine Development Projects; Or 2. A Master\\'S Degree In Environmental, Ecological, Or Biological Science, Or Oceanography, Geology, Environmental Planning, Environmental Law, Or A Related Field And Two Years Of Full-Time Paid Professional Experience At The Level Of Environmental Specialist As Described In Requirement #1. Notes: 1. In Addition To The Regular City Application Form, Each Applicant Is Required To Complete The Marine Environmental Supervisor Qualifications Questionnaire At The Time Of Filing. The Marine Environmental Supervisor Qualifications Questionnaire Is Located Within The Supplemental Question Section Of The City Application. Applicants Who Fail To Complete The Qualifications Questionnaire Will Not Be Considered Further In This Examination, And Their Application Will Not Be Processed. 2. Applicants Who Lack Six Months Or Less Of The Required Experience May File For This Examination. However, They Cannot Be Appointed Until The Full Experience Requirement Is Met. 3. For Qualifying Work Experience Gained Outside Of The City Of Los Angeles, The Term \"Professional Experience\" Applies To Positions That Require Possession Of A Degree From A Recognized Four-Year College Or University In Order To Obtain That Position. Therefore, To Be Considered \"Professional,\" Non-City Qualifying Experience Must Be Gained In Positions After Obtaining A Four-Year Degree. 4. Minimum Requirements For An Environmental Specialist Is Either (A) Graduation From A Recognized Four-Year College With A Degree In Environmental, Ecological, Biological, Chemical, Atmospheric, Environmental Health, Environmental Planning, Or Related Field With At Least 15 Semester Units Or 20 Quarter Units In Environmental Studies; Or (B) Graduation From A Recognized Four-Year College And One Year Of Full-Time Paid Professional Experience Performing Technical Environmental Review And Analysis. 5. A Valid California Driver\\'S License Is Required. Candidates Will Be Disqualified And Not Eligible For Hire If Within The Past 36 Months They Were Convicted Of A Major Moving Violation, Such As Driving Under The Influence Of Alcohol And/Or Drugs, And May Be Disqualified If There Are Three Or More Moving Violations And/Or At-Fault Accidents Within The Past 36 Months. Selective Certification In Accordance With Charter Section 1010 (B) And Civil Service Rule 5.31, Selective Certification Will Be Used For Some Positions That Require Special Skills And/Or Training In One Or More Of The Following Areas. Only Persons Possessing The Following At The Time Of Filing May Be Considered For Appointment To Fill Such Positions: 1. One Year Of Full-Time Paid Professional Experience In Managing And Preparing Environmental Assessments, Including Environmental Impact Reports And Statements Pursuant To Ceqa/Nepa Requirements For Port Or Coastal Marine Developmental Projects. Where To Apply Applications Will Only Be Accepted Online. When You Are Viewing The Online Job Bulletin Of Your Choice, Simply Scroll To The Top Of The Page And Select The \"Apply\" Icon. Online Job Bulletins Are Also Available At Http://Agency.Governmentjobs.Com/Lacity/Default.Cfm For Open Competitive Examinations And At Http://Agency.Governmentjobs.Com/Lacity/Default.Cfm?Promotionaljobs=1 For Promotional Examinations. Note: Applicants Are Urged To Apply Early To Ensure You Have Time To Resolve Any Technical Issues You May Encounter. In Accordance With Civil Service Rule 4.2, All Applicants Who Apply May Not Be Tested In This Examination. To Meet Anticipated Hiring Needs, Only A Limited Number Of Qualified Applicants Will Be Invited To Participate In The Written Test In The Following Order: 1) Los Angeles City Promotional Applicants Who Meet The Minimum Requirements. You Must Have Received A Regular Appointment To A City Position Or Be On A Reserve List To Apply For This Examination As A Promotional Candidate; 2) Applicants Currently Employed By The City Of Los Angeles On A Part-Time Or Exempt Basis Who Meet The Minimum Requirements; 3) Remaining Applicants Who Meet The Minimum Requirements In Sufficient Numbers To Meet Hiring Needs In The Order That Applications Were Received. Applications Submitted During The Filing Period Will Be Kept On File For Two Years From July 11, 2014 In The Event That Additional Applicants Need To Be Tested To Meet Hiring Needs. Expert Review Committee Should A Large Number Of Qualified Candidates File For This Examination, An Expert Review Committee May Be Assembled To Evaluate Each Candidate\\'S Qualifications For The Position Of Marine Environmental Supervisor. In This Evaluation, The Expert Review Committee Will Assess Each Candidate\\'S Training And Experience Based Upon The Information In The Candidate\\'S City Employment Application And The Qualifications Questionnaire. Those Candidates Considered By The Expert Review Committee As Possessing The Greatest Likelihood Of Successfully Performing The Duties Of A Marine Environmental Supervisor, Based Solely On The Information Presented To The Committee, Will Be Invited To Participate In The Interview. Application Deadline Applications And Qualifications Questionnaires Must Be Received By Thursday, July 24, 2014. Selection Process Examination Weight: Interview. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 100% The Examination Will Consist Entirely Of An Evaluation Of Professional And Personal Qualifications By Interview. In The Interview, Emphasis May Be Placed On The Adequacy Of The Candidate\\'S Education, Training, And Experience As They Relate To The Knowledge Of: Effects Of Pollutants On Marine And Terrestrial Ecosystems; Existing And Proposed Laws And Regulations On Port And Coastline Pollution; Methods Of Combating And Controlling Pollution Problems; Technological Advances That Minimize The Environmental Impact Of Development Projects; Instruments And Techniques For Testing The Quality Of Ocean And Ground Waters, Air, Soil, And Sediments; Environmental Regulatory Agencies And Their Responsibilities; Safety Principles And Practices Used In Handling Hazardous Materials And Laboratory Testing At Contamination Sites; Principles And Practices Of Supervision Including: Directing, Assigning, Motivating, Training, Counseling, Disciplining, Commending, And Evaluating The Work Of Subordinates; Pertinent City And Personnel Department Rules, Policies, And Procedures, Including Equal Employment Opportunity And Memoranda Of Understanding; And The Ability To Analyze Environmental Problems And Prepare Comprehensive Programs For Solution; Direct And Coordinate The Work Of Groups Of Employees And Consultants Engaged In Environmental Activities; Deal Tactfully And Effectively With Others; Effectively Communicate Orally And In Writing, In A Clear, Concise Manner; And Other Necessary Skills, Knowledge, And Abilities. The Qualifications Questionnaire Will Not Be Separately Scored, But Will Be Considered By The Interview Board In Evaluating Each Candidate\\'S Qualifications. Candidates May Expect The Panel Members To Discuss This Information During The Interview. Qualifications Questionnaires Submitted By Candidates On The Day Of The Interview Will Not Be Accepted For Presentation To The Interview Board. Candidates Will Be Notified By Mail Of The Date, Time, And Location Of The Interview, Which Will Be Held In Los Angeles. It Is Anticipated That Interviews Will Begin During The Period Of October 20, 2014 To October 31, 2014. Notes: 1. As A Covered Entity Under The Fair Employment And Housing Act And Title Ii Of The Americans With Disabilities Act, The City Of Los Angeles Does Not Discriminate On The Basis Of Disability And Upon Request, Will Provide Reasonable Accommodations To Ensure Equal Access To Its Programs, Services, And Activities. To Request A Disability Accommodation, Please Complete The Disability Accommodation Form Within 14 Calendar Days Of The Submittal Of The City Application. The Disability Accommodation Form Can Be Obtained At Http://Per.Lacity.Org/Exams/Verify_Disability.Pdf. 2. Applications Are Accepted Subject To Review To Ensure That Minimum Qualifications Are Met. Candidates May Be Disqualified At Any Time If It Is Determined That They Do Not Possess The Minimum Qualifications Stated On This Bulletin. 3. The Promotional List Will Ordinarily Be Used Ahead Of The Open Competitive List. However, If Open Competitive Candidates Receive A Higher Score, Without Military Credits, Than The Highest Available Promotional Candidate, After Adding 0.25 Of A Point Seniority Credit For Each Year Of Service, The Civil Service Commission, Upon Request Of The Appointing Authority, May Approve Certification Of Such Open Competitive Candidates Ahead Of The Promotional Candidates. 4. A Final Average Score Of 70% Is Required To Be Placed On The Eligible List. 5. In Conjunction With Civil Service Rules, Applicants Who Are Current Eligible City Employees Or Are On A Reserve List Will Be Considered Promotional Candidates While All Other Applicants Will Be Considered Open Candidates. 6. You Must Have Received A Regular Appointment To A City Position Or Be On A Reserve List To File On A Promotional Basis. 7. If, In Accordance With The Rule Of Three Whole Scores, All Applicants Are Eligible For Appointment Consideration, The Examination Will Consist Entirely Of An Evaluation Of The Candidate\\'S City Application By Personnel Department Staff To Ensure That The Minimum Qualifications Have Been Met. Notice: If You Receive And Accept An Offer Of Employment To A Regular Position With The City Of Los Angeles, Your Employee Benefit Coverage (Including Health And Dental Coverage As Well As Life Insurance) Will Commence Approximately Six Weeks After Your Original Regular Appointment. Not All Positions In The City Receive Benefit Coverage; You Should Inquire Regarding The Availability Of Employee Benefits Prior To Accepting A Position. Glossary 9 - City Council Review Statement This Examination Is To Be Given Both On An Interdepartmental Promotional And An Open Competitive Basis The City Of Los Angeles Does Not Discriminate On The Basis Of Race, Religion, National Origin, Sex, Age, Marital Status, Sexual Orientation, Gender Identity, Gender Expression, Disability, Creed, Color, Ancestry, Medical Condition (Cancer), Or Acquired Immune Deficiency Syndrome.'"
      ]
     },
     "execution_count": 6,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# Get job title\n",
    "itk.jct_get_one(job)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "From the printout of this job, we see that <font color='red'>Class Code </font> has two white spaces instead of one. Since this is a violation of section heading, we fix it by removing one white space."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Conclusion 1\n",
    "* It is recommended to keep a Change Log (CL) in an Excel file (See CL_UnitFunctions/JOB_CLASS_TITLE/Issue1-Miscellaneous). It is very interesting to note that this action generates the **new data source**, which one can use for advanced analysis. For example, to investigate the consistency of the source used to generate these text files.\n",
    "* It is also recommended to make a copy of the raw data and process data cleaning on this copy. I have two folders, **Job Bulletins** and **JobBulletins_cleaned**, where the former contains pre-cleaning data while the latter contains post-cleaning data."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Second Analysis\n",
    "If we look carefully at the results above [1], some jobs have strange titles, as they start with the phrase, *CAMPUS INTERVIEWS ONLY*:\n",
    "* CityofLA/JobBulletins_cleaned/ARCHITECTURAL ASSOCIATE 7926 013114 REV 032916.txt\n",
    "* CityofLA/JobBulletins_cleaned/ENVIRONMENTAL ENGINEERING ASSOCIATE  7871 020113 REV 032916.txt\n",
    "* CityofLA/JobBulletins_cleaned/STREET LIGHTING ENGINEERING ASSOCIATE 7527 101102 REV 032916.txt\n",
    "\n",
    "Such inconsistency is due to the job postings themselves. Rather than deleting the phrase, we move it to a section called <font color='red'>NOTES:</font> (with colon) and surround it with the forward and backward Python prompt symbol, i.e., >>>CAMPUS INTERVIEWS ONLY<<<, so we know where it is and how to retrieve if we need it later. As always, we note any changes we made in our Change Log.\n",
    "\n",
    "You may ask what happens if I don't notice the problem with *CAMPUS INTERVIEWS ONLY* job postings because it's so hard to detect such issue. That's where the power of `multiple_toolkit` comes in. This module contains all the **checkpoints** that must be passed so you can confidently trust the final results. If a checkpoint fails, Python will raise an AssertionError, showing which one did not pass and why. These checkpoints are based on my own experience studying the patterns in these job postings. Thus, the code and in particular, user-defined modules, are written in a way that fosters data cleaning rather than code tweaking when a bug is found. Experience has shown that code tweaking is not suitable for the goal we're aiming at, creating a csv file based on job postings (more details in README file).\n",
    "\n",
    "Later on if you find any issue that are not covered in one of my checkpoints, all you need to do is add a checkpoint and one assert statement in the main function of JOB_CLASS_TITLE in `multiple_toolkit` (more details in README file). It is very easy to do so and you will have very reliable results.\n",
    "\n",
    "[1] Actually, the results above don't have this issue because I already cleaned **my** data. However, if you run my code for the first time using **your** own data, you will see this issue. Furthermore, one of my user-defined modules will raise an AssertionError until you normalize the data as suggested."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 8,
   "metadata": {
    "collapsed": true
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>JOB_CLASS_TITLE</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>311 Director</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>Accountant</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>Accounting Clerk</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>Accounting Records Supervisor</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>Administrative Analyst</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>5</th>\n",
       "      <td>Administrative Clerk</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>6</th>\n",
       "      <td>Administrative Hearing Examiner</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>7</th>\n",
       "      <td>Advance Practice Provider Correctional Care</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>8</th>\n",
       "      <td>Air Conditioning Mechanic</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>9</th>\n",
       "      <td>Air Conditioning Mechanic Supervisor</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>10</th>\n",
       "      <td>Airport Aide</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>11</th>\n",
       "      <td>Airport Chief Information Security Officer</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>12</th>\n",
       "      <td>Airport Engineer</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>13</th>\n",
       "      <td>Airport Guide</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>14</th>\n",
       "      <td>Airport Information Specialist</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>15</th>\n",
       "      <td>Airport Labor Relations Advocate</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>16</th>\n",
       "      <td>Airport Manager</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>17</th>\n",
       "      <td>Airport Police Captain</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>18</th>\n",
       "      <td>Airport Police Lieutenant</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>19</th>\n",
       "      <td>Airport Police Officer</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>20</th>\n",
       "      <td>Airport Police Specialist</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>21</th>\n",
       "      <td>Airport Superintendent Of Operations</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>22</th>\n",
       "      <td>Airports Maintenance Superintendent</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>23</th>\n",
       "      <td>Airports Maintenance Supervisor</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>24</th>\n",
       "      <td>Airports Public And Community Relations Director</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>25</th>\n",
       "      <td>Animal Care Assistant</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>26</th>\n",
       "      <td>Animal Care Technician</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>27</th>\n",
       "      <td>Water Treatment Operator</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>28</th>\n",
       "      <td>Animal Control Officer</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>29</th>\n",
       "      <td>Animal Keeper</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>...</th>\n",
       "      <td>...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>652</th>\n",
       "      <td>Wastewater Treatment Laboratory Manager</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>653</th>\n",
       "      <td>Wastewater Treatment Mechanic</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>654</th>\n",
       "      <td>Wastewater Treatment Mechanic Supervisor</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>655</th>\n",
       "      <td>Wastewater Treatment Operator</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>656</th>\n",
       "      <td>Water Biologist</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>657</th>\n",
       "      <td>Water Microbiologist</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>658</th>\n",
       "      <td>Water Service Representative</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>659</th>\n",
       "      <td>Water Service Supervisor</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>660</th>\n",
       "      <td>Water Service Worker</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>661</th>\n",
       "      <td>Water Services Manager</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>662</th>\n",
       "      <td>Water Treatment Operator</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>663</th>\n",
       "      <td>Water Treatment Supervisor</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>664</th>\n",
       "      <td>Water Utility Operator</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>665</th>\n",
       "      <td>Water Utility Operator Supervisor</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>666</th>\n",
       "      <td>Water Utility Superintendent</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>667</th>\n",
       "      <td>Water Utility Supervisor</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>668</th>\n",
       "      <td>Water Utility Worker</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>669</th>\n",
       "      <td>Watershed Resources Specialist</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>670</th>\n",
       "      <td>Waterworks Engineer</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>671</th>\n",
       "      <td>Waterworks Mechanic Supervisor</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>672</th>\n",
       "      <td>Welder</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>673</th>\n",
       "      <td>Welder Supervisor</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>674</th>\n",
       "      <td>Wharfinger</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>675</th>\n",
       "      <td>Window Cleaner</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>676</th>\n",
       "      <td>Workers' Compensation Analyst</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>677</th>\n",
       "      <td>Workers' Compensation Claims Assistant</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>678</th>\n",
       "      <td>X-Ray And Laboratory Technician</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>679</th>\n",
       "      <td>Zoo Curator</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>680</th>\n",
       "      <td>Zoo Curator Of Education</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>681</th>\n",
       "      <td>Zoo Registrar</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "<p>682 rows × 1 columns</p>\n",
       "</div>"
      ],
      "text/plain": [
       "                                      JOB_CLASS_TITLE\n",
       "0                                        311 Director\n",
       "1                                          Accountant\n",
       "2                                    Accounting Clerk\n",
       "3                       Accounting Records Supervisor\n",
       "4                              Administrative Analyst\n",
       "5                                Administrative Clerk\n",
       "6                     Administrative Hearing Examiner\n",
       "7         Advance Practice Provider Correctional Care\n",
       "8                           Air Conditioning Mechanic\n",
       "9                Air Conditioning Mechanic Supervisor\n",
       "10                                       Airport Aide\n",
       "11         Airport Chief Information Security Officer\n",
       "12                                   Airport Engineer\n",
       "13                                      Airport Guide\n",
       "14                     Airport Information Specialist\n",
       "15                   Airport Labor Relations Advocate\n",
       "16                                    Airport Manager\n",
       "17                             Airport Police Captain\n",
       "18                          Airport Police Lieutenant\n",
       "19                             Airport Police Officer\n",
       "20                          Airport Police Specialist\n",
       "21               Airport Superintendent Of Operations\n",
       "22                Airports Maintenance Superintendent\n",
       "23                    Airports Maintenance Supervisor\n",
       "24   Airports Public And Community Relations Director\n",
       "25                              Animal Care Assistant\n",
       "26                             Animal Care Technician\n",
       "27                           Water Treatment Operator\n",
       "28                             Animal Control Officer\n",
       "29                                      Animal Keeper\n",
       "..                                                ...\n",
       "652           Wastewater Treatment Laboratory Manager\n",
       "653                     Wastewater Treatment Mechanic\n",
       "654          Wastewater Treatment Mechanic Supervisor\n",
       "655                     Wastewater Treatment Operator\n",
       "656                                   Water Biologist\n",
       "657                              Water Microbiologist\n",
       "658                      Water Service Representative\n",
       "659                          Water Service Supervisor\n",
       "660                              Water Service Worker\n",
       "661                            Water Services Manager\n",
       "662                          Water Treatment Operator\n",
       "663                        Water Treatment Supervisor\n",
       "664                            Water Utility Operator\n",
       "665                 Water Utility Operator Supervisor\n",
       "666                      Water Utility Superintendent\n",
       "667                          Water Utility Supervisor\n",
       "668                              Water Utility Worker\n",
       "669                    Watershed Resources Specialist\n",
       "670                               Waterworks Engineer\n",
       "671                    Waterworks Mechanic Supervisor\n",
       "672                                            Welder\n",
       "673                                 Welder Supervisor\n",
       "674                                        Wharfinger\n",
       "675                                    Window Cleaner\n",
       "676                     Workers' Compensation Analyst\n",
       "677            Workers' Compensation Claims Assistant\n",
       "678                   X-Ray And Laboratory Technician\n",
       "679                                       Zoo Curator\n",
       "680                          Zoo Curator Of Education\n",
       "681                                     Zoo Registrar\n",
       "\n",
       "[682 rows x 1 columns]"
      ]
     },
     "execution_count": 8,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# Get an n-by-1 dataframe of ALL job titles\n",
    "# If a checkpoint fails, AssertionError will be raised\n",
    "mtk.jct_get_many()\n",
    "\n",
    "# To get an n-by-1 dataframe of ALL job duties, use mtk.jd_get_many()\n",
    "# etc."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "<font size=8, color='green'>END DEMO</font>"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# 5. Current Stage of Data Cleaning\n",
    "* The cell below displays the current stage of my data cleaning process. Ten fields have been extracted with a confident result. In other words, **if a value is missing, then I can confidently say that the information was not provided**, not because of a bug in the code. For example, by observing missing-value summary in the table below, we see that there are six job postings without JOB_DUTIES field:\n",
    "    * CityofLA/Job Bulletins/APPARATUS OPERATOR 2121 071417 (1).txt\n",
    "    * CityofLA/Job Bulletins/ENGINEER OF FIRE DEPARTMENT 2131 111116.txt\n",
    "    * CityofLA/Job Bulletins/FIRE ASSISTANT CHIEF 2166 011218.txt\n",
    "    * CityofLA/Job Bulletins/FIRE BATTALION CHIEF 2152 030918.txt\n",
    "    * CityofLA/Job Bulletins/FIRE HELICOPTER PILOT 3563 081415 REV. 081815.txt\n",
    "    * CityofLA/Job Bulletins/FIRE INSPECTOR 2128 031717.txt\n",
    "* This is very questionable as mentioned in the Current Challenges section. However, as I already **checked these jobs with their pdf versions**, it turns out that they truly don't have job duties mentioned within them. For this kind of problem, I suggest that a consultation with the competition host be required for clarification.\n",
    "* The user-dialog boxes are part of what I call **checkpoints**. They are really requests that users need to comply with to get the most accurate results. Otherwise, results won't be guaranteed.\n",
    "* There are still 15 fields needed to be filled out and I suspect they are all related in order to each other. For example, EDUCATION_MAJORS may depend on how accurately we can obtain REQUIREMENT_SET_ID. However, the approach to mining these fields is exactly the same as outlined in the demo. If you are interested in, please see this underdevelopment kernel. The point is that the **three user-defined modules provide the framework for data cleaning/data normalization for any future job postings** and I will keep working until a complete csv file is achieved."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 12,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Results for DRIVERS_LICENSE_REQ field needs to be checked manually to ensure accuracy. Enter Yes to confirm: y\n",
      "Checkpoint for EXAM_TYPE field needs to be constructed in the future. Enter Yes to confirm: y\n",
      "Confirm that if a job has a mix of salary range and flat-rated salary, then flat-rated salary is moved to the end of the line. Enter Yes: y\n",
      "Confirm that if a job has more than one flat-rated salary, then only the first is kept and the rest is removed. Enter Yes: y\n"
     ]
    },
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>FILE_NAME</th>\n",
       "      <th>JOB_CLASS_TITLE</th>\n",
       "      <th>JOB_CLASS_NO</th>\n",
       "      <th>JOB_DUTIES</th>\n",
       "      <th>DRIVERS_LICENSE_REQ</th>\n",
       "      <th>DRIV_LIC_TYPE</th>\n",
       "      <th>EXAM_TYPE</th>\n",
       "      <th>ENTRY_SALARY_GEN</th>\n",
       "      <th>ENTRY_SALARY_DWP</th>\n",
       "      <th>OPEN_DATE</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>311 DIRECTOR  9206 041814.txt</td>\n",
       "      <td>311 Director</td>\n",
       "      <td>9206</td>\n",
       "      <td>A 311 Director is responsible for the successf...</td>\n",
       "      <td>None</td>\n",
       "      <td>None</td>\n",
       "      <td>INT_DEPT_PROM</td>\n",
       "      <td>125175-155514</td>\n",
       "      <td>None</td>\n",
       "      <td>04-18-14</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>ACCOUNTANT 1513 062218.txt</td>\n",
       "      <td>Accountant</td>\n",
       "      <td>1513</td>\n",
       "      <td>An Accountant does professional accounting wor...</td>\n",
       "      <td>P</td>\n",
       "      <td>None</td>\n",
       "      <td>OPEN</td>\n",
       "      <td>49903-72996</td>\n",
       "      <td>None</td>\n",
       "      <td>06-22-18</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>ACCOUNTING CLERK 1223 071318.txt</td>\n",
       "      <td>Accounting Clerk</td>\n",
       "      <td>1223</td>\n",
       "      <td>An Accounting Clerk performs difficult and res...</td>\n",
       "      <td>None</td>\n",
       "      <td>None</td>\n",
       "      <td>OPEN_INT_PROM</td>\n",
       "      <td>49005-71618</td>\n",
       "      <td>None</td>\n",
       "      <td>07-13-18</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>ACCOUNTING RECORDS SUPERVISOR 1119 072718.txt</td>\n",
       "      <td>Accounting Records Supervisor</td>\n",
       "      <td>1119</td>\n",
       "      <td>An Accounting Records Supervisor assigns, revi...</td>\n",
       "      <td>None</td>\n",
       "      <td>None</td>\n",
       "      <td>INT_DEPT_PROM</td>\n",
       "      <td>55332-80930</td>\n",
       "      <td>None</td>\n",
       "      <td>07-27-18</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>ADMINISTRATIVE ANALYST 1590 060118.txt</td>\n",
       "      <td>Administrative Analyst</td>\n",
       "      <td>1590</td>\n",
       "      <td>An Administrative Analyst performs professiona...</td>\n",
       "      <td>P</td>\n",
       "      <td>None</td>\n",
       "      <td>INT_DEPT_PROM</td>\n",
       "      <td>60489-88468</td>\n",
       "      <td>None</td>\n",
       "      <td>06-01-18</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>5</th>\n",
       "      <td>ADMINISTRATIVE CLERK 1358 033018 (2).txt</td>\n",
       "      <td>Administrative Clerk</td>\n",
       "      <td>1358</td>\n",
       "      <td>An Administrative Clerk performs general offic...</td>\n",
       "      <td>P</td>\n",
       "      <td>None</td>\n",
       "      <td>OPEN</td>\n",
       "      <td>37584-54935</td>\n",
       "      <td>43263-53766</td>\n",
       "      <td>03-30-18</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>6</th>\n",
       "      <td>ADMINISTRATIVE HEARING EXAMINER 9135 100915.txt</td>\n",
       "      <td>Administrative Hearing Examiner</td>\n",
       "      <td>9135</td>\n",
       "      <td>An Administrative Hearing Examiner conducts qu...</td>\n",
       "      <td>P</td>\n",
       "      <td>None</td>\n",
       "      <td>OPEN_INT_PROM</td>\n",
       "      <td>54726-80012</td>\n",
       "      <td>None</td>\n",
       "      <td>10-09-15</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>7</th>\n",
       "      <td>ADVANCE PRACTICE PROVIDER CORRECTIONAL CARE 23...</td>\n",
       "      <td>Advance Practice Provider Correctional Care</td>\n",
       "      <td>2325</td>\n",
       "      <td>An Advance Practice Provider Correctional Care...</td>\n",
       "      <td>None</td>\n",
       "      <td>None</td>\n",
       "      <td>OPEN</td>\n",
       "      <td>78487-97530</td>\n",
       "      <td>None</td>\n",
       "      <td>02-08-08</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>8</th>\n",
       "      <td>AIR CONDITIONING MECHANIC 3774 041417.txt</td>\n",
       "      <td>Air Conditioning Mechanic</td>\n",
       "      <td>3774</td>\n",
       "      <td>An Air Conditioning Mechanic installs, modifie...</td>\n",
       "      <td>R</td>\n",
       "      <td>None</td>\n",
       "      <td>OPEN_INT_PROM</td>\n",
       "      <td>90118</td>\n",
       "      <td>99054</td>\n",
       "      <td>04-14-17</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>9</th>\n",
       "      <td>AIR CONDITIONING MECHANIC SUPERVISOR 3781 1116...</td>\n",
       "      <td>Air Conditioning Mechanic Supervisor</td>\n",
       "      <td>3781</td>\n",
       "      <td>An Air Conditioning Mechanic Supervisor assign...</td>\n",
       "      <td>R</td>\n",
       "      <td>None</td>\n",
       "      <td>INT_DEPT_PROM</td>\n",
       "      <td>103841</td>\n",
       "      <td>127388-134488</td>\n",
       "      <td>11-16-18</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>10</th>\n",
       "      <td>AIRPORT AIDE 1540 081018.txt</td>\n",
       "      <td>Airport Aide</td>\n",
       "      <td>1540</td>\n",
       "      <td>An Airport Aide provides services and transpor...</td>\n",
       "      <td>None</td>\n",
       "      <td>None</td>\n",
       "      <td>INT_DEPT_PROM</td>\n",
       "      <td>43242-63203</td>\n",
       "      <td>None</td>\n",
       "      <td>08-10-18</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>11</th>\n",
       "      <td>AIRPORT CHIEF INFORMATION SECURITY OFFICER 140...</td>\n",
       "      <td>Airport Chief Information Security Officer</td>\n",
       "      <td>1404</td>\n",
       "      <td>Airport Chief Information Security Officer man...</td>\n",
       "      <td>None</td>\n",
       "      <td>None</td>\n",
       "      <td>OPEN_INT_PROM</td>\n",
       "      <td>125551-183576</td>\n",
       "      <td>None</td>\n",
       "      <td>12-04-15</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>12</th>\n",
       "      <td>AIRPORT ENGINEER 7256 070618.txt</td>\n",
       "      <td>Airport Engineer</td>\n",
       "      <td>7256</td>\n",
       "      <td>An Airport Engineer performs professional engi...</td>\n",
       "      <td>R</td>\n",
       "      <td>None</td>\n",
       "      <td>OPEN_INT_PROM</td>\n",
       "      <td>105005-153509</td>\n",
       "      <td>None</td>\n",
       "      <td>07-06-18</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>13</th>\n",
       "      <td>AIRPORT GUIDE 0845 042018.txt</td>\n",
       "      <td>Airport Guide</td>\n",
       "      <td>0845</td>\n",
       "      <td>An Airport Guide directs arriving passengers t...</td>\n",
       "      <td>P</td>\n",
       "      <td>None</td>\n",
       "      <td>OPEN</td>\n",
       "      <td>31946-44265</td>\n",
       "      <td>None</td>\n",
       "      <td>4-20-18</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>14</th>\n",
       "      <td>AIRPORT INFORMATION SPECIALIST 1783 121115.txt</td>\n",
       "      <td>Airport Information Specialist</td>\n",
       "      <td>1783</td>\n",
       "      <td>An Airport Information Specialist provides and...</td>\n",
       "      <td>R</td>\n",
       "      <td>None</td>\n",
       "      <td>OPEN_INT_PROM</td>\n",
       "      <td>42991-62869</td>\n",
       "      <td>None</td>\n",
       "      <td>12-11-15</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>15</th>\n",
       "      <td>AIRPORT LABOR RELATIONS ADVOCATE 9210 020119.txt</td>\n",
       "      <td>Airport Labor Relations Advocate</td>\n",
       "      <td>9210</td>\n",
       "      <td>The Airport Labor Relations Advocate advises s...</td>\n",
       "      <td>P</td>\n",
       "      <td>None</td>\n",
       "      <td>OPEN_INT_PROM</td>\n",
       "      <td>93918-137327</td>\n",
       "      <td>None</td>\n",
       "      <td>02-01-19</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>16</th>\n",
       "      <td>AIRPORT MANAGER 7260 120216.txt</td>\n",
       "      <td>Airport Manager</td>\n",
       "      <td>7260</td>\n",
       "      <td>An Airport Manager manages, through subordinat...</td>\n",
       "      <td>P</td>\n",
       "      <td>None</td>\n",
       "      <td>OPEN_INT_PROM</td>\n",
       "      <td>99326-141378</td>\n",
       "      <td>None</td>\n",
       "      <td>12-02-16</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>17</th>\n",
       "      <td>AIRPORT POLICE CAPTAIN 3228 021618.txt</td>\n",
       "      <td>Airport Police Captain</td>\n",
       "      <td>3228</td>\n",
       "      <td>An Airport Police Captain plans, supervises, d...</td>\n",
       "      <td>R</td>\n",
       "      <td>None</td>\n",
       "      <td>DEPT_PROM</td>\n",
       "      <td>142568-187001</td>\n",
       "      <td>None</td>\n",
       "      <td>02-16-18</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>18</th>\n",
       "      <td>AIRPORT POLICE LIEUTENANT 3227 091616.txt</td>\n",
       "      <td>Airport Police Lieutenant</td>\n",
       "      <td>3227</td>\n",
       "      <td>An Airport Police Lieutenant plans, supervises...</td>\n",
       "      <td>R</td>\n",
       "      <td>None</td>\n",
       "      <td>INT_DEPT_PROM</td>\n",
       "      <td>102186-134028</td>\n",
       "      <td>None</td>\n",
       "      <td>09-16-16</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>19</th>\n",
       "      <td>AIRPORT POLICE OFFICER 3225 110906 Rev 060115.txt</td>\n",
       "      <td>Airport Police Officer</td>\n",
       "      <td>3225</td>\n",
       "      <td>An Airport Police Officer is a sworn peace off...</td>\n",
       "      <td>R</td>\n",
       "      <td>None</td>\n",
       "      <td>OPEN</td>\n",
       "      <td>51448-83019</td>\n",
       "      <td>None</td>\n",
       "      <td>11-09-06</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>20</th>\n",
       "      <td>AIRPORT POLICE SPECIALIST 3236 063017 (2).txt</td>\n",
       "      <td>Airport Police Specialist</td>\n",
       "      <td>3236</td>\n",
       "      <td>As a sworn member of the Los Angeles World Air...</td>\n",
       "      <td>R</td>\n",
       "      <td>None</td>\n",
       "      <td>OPEN</td>\n",
       "      <td>None</td>\n",
       "      <td>None</td>\n",
       "      <td>06-30-17</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>21</th>\n",
       "      <td>AIRPORT SUPERINTENDENT OF OPERATIONS 7268 1218...</td>\n",
       "      <td>Airport Superintendent Of Operations</td>\n",
       "      <td>7268</td>\n",
       "      <td>An Airport Superintendent of Operations inspec...</td>\n",
       "      <td>R</td>\n",
       "      <td>None</td>\n",
       "      <td>OPEN</td>\n",
       "      <td>53682-78467</td>\n",
       "      <td>None</td>\n",
       "      <td>12-18-15</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>22</th>\n",
       "      <td>AIRPORTS MAINTENANCE SUPERINTENDENT 3331 02151...</td>\n",
       "      <td>Airports Maintenance Superintendent</td>\n",
       "      <td>3331</td>\n",
       "      <td>An Airports Maintenance Superintendent plans, ...</td>\n",
       "      <td>P</td>\n",
       "      <td>None</td>\n",
       "      <td>INT_DEPT_PROM</td>\n",
       "      <td>90369-132108</td>\n",
       "      <td>None</td>\n",
       "      <td>02-16-18</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>23</th>\n",
       "      <td>AIRPORTS MAINTENANCE SUPERVISOR 3336 111618.txt</td>\n",
       "      <td>Airports Maintenance Supervisor</td>\n",
       "      <td>3336</td>\n",
       "      <td>An Airports Maintenance Supervisor plans, orga...</td>\n",
       "      <td>P</td>\n",
       "      <td>None</td>\n",
       "      <td>INT_DEPT_PROM</td>\n",
       "      <td>66523-97321</td>\n",
       "      <td>None</td>\n",
       "      <td>11-16-18</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>24</th>\n",
       "      <td>AIRPORTS PUBLIC AND COMMUNITY RELATIONS DIRECT...</td>\n",
       "      <td>Airports Public And Community Relations Director</td>\n",
       "      <td>1788</td>\n",
       "      <td>An Airports Public and Community Relations Dir...</td>\n",
       "      <td>P</td>\n",
       "      <td>None</td>\n",
       "      <td>OPEN_INT_PROM</td>\n",
       "      <td>86777-123463</td>\n",
       "      <td>None</td>\n",
       "      <td>12-08-17</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>25</th>\n",
       "      <td>ANIMAL CARE ASSISTANT 4323 020119.txt</td>\n",
       "      <td>Animal Care Assistant</td>\n",
       "      <td>4323</td>\n",
       "      <td>Animal Care Assistants perform work in the rec...</td>\n",
       "      <td>R</td>\n",
       "      <td>None</td>\n",
       "      <td>OPEN</td>\n",
       "      <td>39337-57545</td>\n",
       "      <td>None</td>\n",
       "      <td>02-01-19</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>26</th>\n",
       "      <td>ANIMAL CARE TECHNICIAN 4310 040116 REV 041416.txt</td>\n",
       "      <td>Animal Care Technician</td>\n",
       "      <td>4310</td>\n",
       "      <td>An Animal Care Technician receives and cares f...</td>\n",
       "      <td>R</td>\n",
       "      <td>None</td>\n",
       "      <td>OPEN</td>\n",
       "      <td>38565-56396</td>\n",
       "      <td>None</td>\n",
       "      <td>04-01-16</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>27</th>\n",
       "      <td>ANIMAL CARE TECHNICIAN SUPERVISOR 4313 122118.txt</td>\n",
       "      <td>Water Treatment Operator</td>\n",
       "      <td>5885</td>\n",
       "      <td>A Water Treatment Operator does skilled work i...</td>\n",
       "      <td>R</td>\n",
       "      <td>None</td>\n",
       "      <td>OPEN</td>\n",
       "      <td>65646-81536</td>\n",
       "      <td>None</td>\n",
       "      <td>12-21-18</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>28</th>\n",
       "      <td>ANIMAL CONTROL OFFICER  4311 061518.txt</td>\n",
       "      <td>Animal Control Officer</td>\n",
       "      <td>4311</td>\n",
       "      <td>An Animal Control Officer enforces State and C...</td>\n",
       "      <td>R</td>\n",
       "      <td>None</td>\n",
       "      <td>OPEN</td>\n",
       "      <td>46374-67818</td>\n",
       "      <td>None</td>\n",
       "      <td>06-15-18</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>29</th>\n",
       "      <td>ANIMAL KEEPER 4304 083118.txt</td>\n",
       "      <td>Animal Keeper</td>\n",
       "      <td>4304</td>\n",
       "      <td>An Animal Keeper cares for exotic mammals, bir...</td>\n",
       "      <td>P</td>\n",
       "      <td>None</td>\n",
       "      <td>OPEN</td>\n",
       "      <td>45810-66983</td>\n",
       "      <td>None</td>\n",
       "      <td>08-31-18</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>...</th>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>652</th>\n",
       "      <td>WASTEWATER TREATMENT LABORATORY MANAGER 7840 1...</td>\n",
       "      <td>Wastewater Treatment Laboratory Manager</td>\n",
       "      <td>7840</td>\n",
       "      <td>A Wastewater Treatment Laboratory Manager plan...</td>\n",
       "      <td>P</td>\n",
       "      <td>None</td>\n",
       "      <td>INT_DEPT_PROM</td>\n",
       "      <td>91684-134049</td>\n",
       "      <td>None</td>\n",
       "      <td>11-09-18</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>653</th>\n",
       "      <td>WASTEWATER TREATMENT MECHANIC 5614 021712 REV ...</td>\n",
       "      <td>Wastewater Treatment Mechanic</td>\n",
       "      <td>5614</td>\n",
       "      <td>A Wastewater Treatment Mechanic performs a var...</td>\n",
       "      <td>P</td>\n",
       "      <td>None</td>\n",
       "      <td>OPEN_INT_PROM</td>\n",
       "      <td>92326</td>\n",
       "      <td>None</td>\n",
       "      <td>02-17-12</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>654</th>\n",
       "      <td>WASTEWATER TREATMENT MECHANIC SUPERVISOR 5617 ...</td>\n",
       "      <td>Wastewater Treatment Mechanic Supervisor</td>\n",
       "      <td>5617</td>\n",
       "      <td>A Wastewater Treatment Mechanic Supervisor ass...</td>\n",
       "      <td>P</td>\n",
       "      <td>None</td>\n",
       "      <td>INT_DEPT_PROM</td>\n",
       "      <td>118843</td>\n",
       "      <td>None</td>\n",
       "      <td>07-21-17</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>655</th>\n",
       "      <td>WASTEWATER TREATMENT OPERATOR 4123 120718.txt</td>\n",
       "      <td>Wastewater Treatment Operator</td>\n",
       "      <td>4123</td>\n",
       "      <td>A Wastewater Treatment Operator operates waste...</td>\n",
       "      <td>P</td>\n",
       "      <td>None</td>\n",
       "      <td>OPEN</td>\n",
       "      <td>94361</td>\n",
       "      <td>None</td>\n",
       "      <td>12-07-18</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>656</th>\n",
       "      <td>WATER BIOLOGIST 7856 120216.txt</td>\n",
       "      <td>Water Biologist</td>\n",
       "      <td>7856</td>\n",
       "      <td>A Water Biologist performs oceanographic, mari...</td>\n",
       "      <td>P</td>\n",
       "      <td>None</td>\n",
       "      <td>OPEN_INT_PROM</td>\n",
       "      <td>61491-87508</td>\n",
       "      <td>73142-90869</td>\n",
       "      <td>12-02-16</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>657</th>\n",
       "      <td>WATER MICROBIOLOGIST  7857 072514 rev073114.txt</td>\n",
       "      <td>Water Microbiologist</td>\n",
       "      <td>7857</td>\n",
       "      <td>A Water Microbiologist uses a variety of micro...</td>\n",
       "      <td>P</td>\n",
       "      <td>None</td>\n",
       "      <td>OPEN</td>\n",
       "      <td>63663-79073</td>\n",
       "      <td>74896-93041</td>\n",
       "      <td>07-25-14</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>658</th>\n",
       "      <td>WATER SERVICE REPRESENTATIVE 1693 111717.txt</td>\n",
       "      <td>Water Service Representative</td>\n",
       "      <td>1693</td>\n",
       "      <td>A Water Service Representative makes field inv...</td>\n",
       "      <td>R</td>\n",
       "      <td>None</td>\n",
       "      <td>INT_DEPT_PROM</td>\n",
       "      <td>70177-87194</td>\n",
       "      <td>None</td>\n",
       "      <td>11-17-17</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>659</th>\n",
       "      <td>WATER SERVICE SUPERVISOR 3930 012717.txt</td>\n",
       "      <td>Water Service Supervisor</td>\n",
       "      <td>3930</td>\n",
       "      <td>A Water Service Supervisor assigns, reviews an...</td>\n",
       "      <td>R</td>\n",
       "      <td>None</td>\n",
       "      <td>INT_DEPT_PROM</td>\n",
       "      <td>89888-94899</td>\n",
       "      <td>None</td>\n",
       "      <td>01-27-17</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>660</th>\n",
       "      <td>WATER SERVICE WORKER 3931 040618 (1).txt</td>\n",
       "      <td>Water Service Worker</td>\n",
       "      <td>3931</td>\n",
       "      <td>A Water Service Worker inspects, repairs, rebu...</td>\n",
       "      <td>R</td>\n",
       "      <td>None</td>\n",
       "      <td>INT_DEPT_PROM</td>\n",
       "      <td>64310-79886</td>\n",
       "      <td>None</td>\n",
       "      <td>04-06-18</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>661</th>\n",
       "      <td>WATER SERVICES MANAGER 9602 081216.txt</td>\n",
       "      <td>Water Services Manager</td>\n",
       "      <td>9602</td>\n",
       "      <td>A Water Services Manager serves as a Director ...</td>\n",
       "      <td>P</td>\n",
       "      <td>None</td>\n",
       "      <td>INT_DEPT_PROM</td>\n",
       "      <td>196000-243502</td>\n",
       "      <td>None</td>\n",
       "      <td>08-12-16</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>662</th>\n",
       "      <td>WATER TREATMENT OPERATOR 5885 122118.txt</td>\n",
       "      <td>Water Treatment Operator</td>\n",
       "      <td>5885</td>\n",
       "      <td>A Water Treatment Operator does skilled work i...</td>\n",
       "      <td>R</td>\n",
       "      <td>None</td>\n",
       "      <td>OPEN</td>\n",
       "      <td>65646-81536</td>\n",
       "      <td>None</td>\n",
       "      <td>12-21-18</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>663</th>\n",
       "      <td>WATER TREATMENT SUPERVISOR 5887 072018.txt</td>\n",
       "      <td>Water Treatment Supervisor</td>\n",
       "      <td>5887</td>\n",
       "      <td>A Water Treatment Supervisor assigns, reviews,...</td>\n",
       "      <td>P</td>\n",
       "      <td>None</td>\n",
       "      <td>INT_DEPT_PROM</td>\n",
       "      <td>109411-115508</td>\n",
       "      <td>None</td>\n",
       "      <td>07-20-18</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>664</th>\n",
       "      <td>WATER UTILITY OPERATOR 5854 080516.txt</td>\n",
       "      <td>Water Utility Operator</td>\n",
       "      <td>5854</td>\n",
       "      <td>A Water Utility Operator inspects, operates, a...</td>\n",
       "      <td>R</td>\n",
       "      <td>None</td>\n",
       "      <td>OPEN_INT_PROM</td>\n",
       "      <td>54308-67484</td>\n",
       "      <td>None</td>\n",
       "      <td>08-05-16</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>665</th>\n",
       "      <td>WATER UTILITY OPERATOR SUPERVISOR 5857 062918.txt</td>\n",
       "      <td>Water Utility Operator Supervisor</td>\n",
       "      <td>5857</td>\n",
       "      <td>A Water Utility Operator Supervisor supervises...</td>\n",
       "      <td>R</td>\n",
       "      <td>None</td>\n",
       "      <td>INT_DEPT_PROM</td>\n",
       "      <td>93041-98219</td>\n",
       "      <td>None</td>\n",
       "      <td>06-29-18</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>666</th>\n",
       "      <td>WATER UTILITY SUPERINTENDENT 3980 121418.txt</td>\n",
       "      <td>Water Utility Superintendent</td>\n",
       "      <td>3980</td>\n",
       "      <td>A Water Utility Superintendent plans, organize...</td>\n",
       "      <td>R</td>\n",
       "      <td>None</td>\n",
       "      <td>INT_DEPT_PROM</td>\n",
       "      <td>131084-162864</td>\n",
       "      <td>None</td>\n",
       "      <td>12-14-18</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>667</th>\n",
       "      <td>WATER UTILITY SUPERVISOR 3976 050418 (1).txt</td>\n",
       "      <td>Water Utility Supervisor</td>\n",
       "      <td>3976</td>\n",
       "      <td>A Water Utility Supervisor assigns, reviews an...</td>\n",
       "      <td>R</td>\n",
       "      <td>None</td>\n",
       "      <td>INT_DEPT_PROM</td>\n",
       "      <td>97697-103147</td>\n",
       "      <td>None</td>\n",
       "      <td>05-04-18</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>668</th>\n",
       "      <td>WATER UTILITY WORKER 3912 120817.txt</td>\n",
       "      <td>Water Utility Worker</td>\n",
       "      <td>3912</td>\n",
       "      <td>A Water Utility Worker installs, maintains, op...</td>\n",
       "      <td>P</td>\n",
       "      <td>None</td>\n",
       "      <td>OPEN_INT_PROM</td>\n",
       "      <td>None</td>\n",
       "      <td>67275-83582</td>\n",
       "      <td>12-08-17</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>669</th>\n",
       "      <td>WATERSHED RESOURCES SPECIALIST  7862 080516 (1...</td>\n",
       "      <td>Watershed Resources Specialist</td>\n",
       "      <td>7862</td>\n",
       "      <td>A Watershed Resources Specialist performs envi...</td>\n",
       "      <td>R</td>\n",
       "      <td>None</td>\n",
       "      <td>OPEN_INT_PROM</td>\n",
       "      <td>76608-95191</td>\n",
       "      <td>None</td>\n",
       "      <td>08-05-16</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>670</th>\n",
       "      <td>WATERWORKS ENGINEER 7248 071516 (1).txt</td>\n",
       "      <td>Waterworks Engineer</td>\n",
       "      <td>7248</td>\n",
       "      <td>A Waterworks Engineer plans, organizes, and di...</td>\n",
       "      <td>P</td>\n",
       "      <td>None</td>\n",
       "      <td>INT_DEPT_PROM</td>\n",
       "      <td>116740-145032</td>\n",
       "      <td>None</td>\n",
       "      <td>07-15-16</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>671</th>\n",
       "      <td>WATERWORKS MECHANIC SUPERVISOR 3987 051614 (1)...</td>\n",
       "      <td>Waterworks Mechanic Supervisor</td>\n",
       "      <td>3987</td>\n",
       "      <td>A Waterworks Mechanic Supervisor assigns, revi...</td>\n",
       "      <td>R</td>\n",
       "      <td>None</td>\n",
       "      <td>INT_DEPT_PROM</td>\n",
       "      <td>94001-116781</td>\n",
       "      <td>None</td>\n",
       "      <td>05-16-14</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>672</th>\n",
       "      <td>WELDER 3796 102816.txt</td>\n",
       "      <td>Welder</td>\n",
       "      <td>3796</td>\n",
       "      <td>A Welder performs skilled heating, welding, pl...</td>\n",
       "      <td>P</td>\n",
       "      <td>None</td>\n",
       "      <td>OPEN_INT_PROM</td>\n",
       "      <td>81703</td>\n",
       "      <td>76608-99848</td>\n",
       "      <td>10-28-16</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>673</th>\n",
       "      <td>WELDER SUPERVISOR 3798 120817.txt</td>\n",
       "      <td>Welder Supervisor</td>\n",
       "      <td>3798</td>\n",
       "      <td>A Welder Supervisor assigns, reviews and evalu...</td>\n",
       "      <td>P</td>\n",
       "      <td>None</td>\n",
       "      <td>INT_DEPT_PROM</td>\n",
       "      <td>97895</td>\n",
       "      <td>108805-114881</td>\n",
       "      <td>12-08-17</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>674</th>\n",
       "      <td>WHARFINGER 1190 092118.txt</td>\n",
       "      <td>Wharfinger</td>\n",
       "      <td>1190</td>\n",
       "      <td>A Wharfinger tracks cargo by terminal, vessel,...</td>\n",
       "      <td>P</td>\n",
       "      <td>None</td>\n",
       "      <td>OPEN_INT_PROM</td>\n",
       "      <td>55854-81640</td>\n",
       "      <td>None</td>\n",
       "      <td>09-21-18</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>675</th>\n",
       "      <td>WINDOW CLEANER 3173 032417.txt</td>\n",
       "      <td>Window Cleaner</td>\n",
       "      <td>3173</td>\n",
       "      <td>A Window Cleaner washes and cleans windows, wh...</td>\n",
       "      <td>P</td>\n",
       "      <td>None</td>\n",
       "      <td>INT_DEPT_PROM</td>\n",
       "      <td>38857-55332</td>\n",
       "      <td>None</td>\n",
       "      <td>03-24-17</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>676</th>\n",
       "      <td>WORKERS_ COMPENSATION ANALYST 1774 032417R.txt</td>\n",
       "      <td>Workers' Compensation Analyst</td>\n",
       "      <td>1774</td>\n",
       "      <td>A Workers' Compensation Analyst administers Wo...</td>\n",
       "      <td>P</td>\n",
       "      <td>None</td>\n",
       "      <td>OPEN_INT_PROM</td>\n",
       "      <td>56898-83165</td>\n",
       "      <td>76984-95651</td>\n",
       "      <td>03-24-17</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>677</th>\n",
       "      <td>WORKERS_ COMPENSATION CLAIMS ASSISTANT 1775 04...</td>\n",
       "      <td>Workers' Compensation Claims Assistant</td>\n",
       "      <td>1775</td>\n",
       "      <td>A Workers' Compensation Claims Assistant perfo...</td>\n",
       "      <td>P</td>\n",
       "      <td>None</td>\n",
       "      <td>INT_DEPT_PROM</td>\n",
       "      <td>51385-63830</td>\n",
       "      <td>58860-73121</td>\n",
       "      <td>04-11-14</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>678</th>\n",
       "      <td>X-RAY AND LABORATORY TECHNICIAN 2358 012916.txt</td>\n",
       "      <td>X-Ray And Laboratory Technician</td>\n",
       "      <td>2358</td>\n",
       "      <td>Takes and develops radiographic images accordi...</td>\n",
       "      <td>P</td>\n",
       "      <td>None</td>\n",
       "      <td>OPEN</td>\n",
       "      <td>52200-76295</td>\n",
       "      <td>56605-70323</td>\n",
       "      <td>01-29-16</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>679</th>\n",
       "      <td>ZOO CURATOR 4297 040816.txt</td>\n",
       "      <td>Zoo Curator</td>\n",
       "      <td>4297</td>\n",
       "      <td>A Zoo Curator is responsible for the health an...</td>\n",
       "      <td>P</td>\n",
       "      <td>None</td>\n",
       "      <td>OPEN_INT_PROM</td>\n",
       "      <td>78300-94712</td>\n",
       "      <td>None</td>\n",
       "      <td>04-08-16</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>680</th>\n",
       "      <td>ZOO CURATOR OF EDUCATION 4300 091418.txt</td>\n",
       "      <td>Zoo Curator Of Education</td>\n",
       "      <td>4300</td>\n",
       "      <td>A Zoo Curator of Education plans, develops, im...</td>\n",
       "      <td>P</td>\n",
       "      <td>None</td>\n",
       "      <td>OPEN_INT_PROM</td>\n",
       "      <td>57628-84229</td>\n",
       "      <td>None</td>\n",
       "      <td>09-14-18</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>681</th>\n",
       "      <td>ZOO REGISTRAR 4290 070618.txt</td>\n",
       "      <td>Zoo Registrar</td>\n",
       "      <td>4290</td>\n",
       "      <td>A Zoo Registrar assists in the development and...</td>\n",
       "      <td>None</td>\n",
       "      <td>None</td>\n",
       "      <td>OPEN_INT_PROM</td>\n",
       "      <td>55666-81390</td>\n",
       "      <td>None</td>\n",
       "      <td>07-06-18</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "<p>682 rows × 10 columns</p>\n",
       "</div>"
      ],
      "text/plain": [
       "                                             FILE_NAME  \\\n",
       "0                        311 DIRECTOR  9206 041814.txt   \n",
       "1                           ACCOUNTANT 1513 062218.txt   \n",
       "2                     ACCOUNTING CLERK 1223 071318.txt   \n",
       "3        ACCOUNTING RECORDS SUPERVISOR 1119 072718.txt   \n",
       "4               ADMINISTRATIVE ANALYST 1590 060118.txt   \n",
       "5             ADMINISTRATIVE CLERK 1358 033018 (2).txt   \n",
       "6      ADMINISTRATIVE HEARING EXAMINER 9135 100915.txt   \n",
       "7    ADVANCE PRACTICE PROVIDER CORRECTIONAL CARE 23...   \n",
       "8            AIR CONDITIONING MECHANIC 3774 041417.txt   \n",
       "9    AIR CONDITIONING MECHANIC SUPERVISOR 3781 1116...   \n",
       "10                        AIRPORT AIDE 1540 081018.txt   \n",
       "11   AIRPORT CHIEF INFORMATION SECURITY OFFICER 140...   \n",
       "12                    AIRPORT ENGINEER 7256 070618.txt   \n",
       "13                       AIRPORT GUIDE 0845 042018.txt   \n",
       "14      AIRPORT INFORMATION SPECIALIST 1783 121115.txt   \n",
       "15    AIRPORT LABOR RELATIONS ADVOCATE 9210 020119.txt   \n",
       "16                     AIRPORT MANAGER 7260 120216.txt   \n",
       "17              AIRPORT POLICE CAPTAIN 3228 021618.txt   \n",
       "18           AIRPORT POLICE LIEUTENANT 3227 091616.txt   \n",
       "19   AIRPORT POLICE OFFICER 3225 110906 Rev 060115.txt   \n",
       "20       AIRPORT POLICE SPECIALIST 3236 063017 (2).txt   \n",
       "21   AIRPORT SUPERINTENDENT OF OPERATIONS 7268 1218...   \n",
       "22   AIRPORTS MAINTENANCE SUPERINTENDENT 3331 02151...   \n",
       "23     AIRPORTS MAINTENANCE SUPERVISOR 3336 111618.txt   \n",
       "24   AIRPORTS PUBLIC AND COMMUNITY RELATIONS DIRECT...   \n",
       "25               ANIMAL CARE ASSISTANT 4323 020119.txt   \n",
       "26   ANIMAL CARE TECHNICIAN 4310 040116 REV 041416.txt   \n",
       "27   ANIMAL CARE TECHNICIAN SUPERVISOR 4313 122118.txt   \n",
       "28             ANIMAL CONTROL OFFICER  4311 061518.txt   \n",
       "29                       ANIMAL KEEPER 4304 083118.txt   \n",
       "..                                                 ...   \n",
       "652  WASTEWATER TREATMENT LABORATORY MANAGER 7840 1...   \n",
       "653  WASTEWATER TREATMENT MECHANIC 5614 021712 REV ...   \n",
       "654  WASTEWATER TREATMENT MECHANIC SUPERVISOR 5617 ...   \n",
       "655      WASTEWATER TREATMENT OPERATOR 4123 120718.txt   \n",
       "656                    WATER BIOLOGIST 7856 120216.txt   \n",
       "657    WATER MICROBIOLOGIST  7857 072514 rev073114.txt   \n",
       "658       WATER SERVICE REPRESENTATIVE 1693 111717.txt   \n",
       "659           WATER SERVICE SUPERVISOR 3930 012717.txt   \n",
       "660           WATER SERVICE WORKER 3931 040618 (1).txt   \n",
       "661             WATER SERVICES MANAGER 9602 081216.txt   \n",
       "662           WATER TREATMENT OPERATOR 5885 122118.txt   \n",
       "663         WATER TREATMENT SUPERVISOR 5887 072018.txt   \n",
       "664             WATER UTILITY OPERATOR 5854 080516.txt   \n",
       "665  WATER UTILITY OPERATOR SUPERVISOR 5857 062918.txt   \n",
       "666       WATER UTILITY SUPERINTENDENT 3980 121418.txt   \n",
       "667       WATER UTILITY SUPERVISOR 3976 050418 (1).txt   \n",
       "668               WATER UTILITY WORKER 3912 120817.txt   \n",
       "669  WATERSHED RESOURCES SPECIALIST  7862 080516 (1...   \n",
       "670            WATERWORKS ENGINEER 7248 071516 (1).txt   \n",
       "671  WATERWORKS MECHANIC SUPERVISOR 3987 051614 (1)...   \n",
       "672                             WELDER 3796 102816.txt   \n",
       "673                  WELDER SUPERVISOR 3798 120817.txt   \n",
       "674                         WHARFINGER 1190 092118.txt   \n",
       "675                     WINDOW CLEANER 3173 032417.txt   \n",
       "676     WORKERS_ COMPENSATION ANALYST 1774 032417R.txt   \n",
       "677  WORKERS_ COMPENSATION CLAIMS ASSISTANT 1775 04...   \n",
       "678    X-RAY AND LABORATORY TECHNICIAN 2358 012916.txt   \n",
       "679                        ZOO CURATOR 4297 040816.txt   \n",
       "680           ZOO CURATOR OF EDUCATION 4300 091418.txt   \n",
       "681                      ZOO REGISTRAR 4290 070618.txt   \n",
       "\n",
       "                                      JOB_CLASS_TITLE JOB_CLASS_NO  \\\n",
       "0                                        311 Director         9206   \n",
       "1                                          Accountant         1513   \n",
       "2                                    Accounting Clerk         1223   \n",
       "3                       Accounting Records Supervisor         1119   \n",
       "4                              Administrative Analyst         1590   \n",
       "5                                Administrative Clerk         1358   \n",
       "6                     Administrative Hearing Examiner         9135   \n",
       "7         Advance Practice Provider Correctional Care         2325   \n",
       "8                           Air Conditioning Mechanic         3774   \n",
       "9                Air Conditioning Mechanic Supervisor         3781   \n",
       "10                                       Airport Aide         1540   \n",
       "11         Airport Chief Information Security Officer         1404   \n",
       "12                                   Airport Engineer         7256   \n",
       "13                                      Airport Guide         0845   \n",
       "14                     Airport Information Specialist         1783   \n",
       "15                   Airport Labor Relations Advocate         9210   \n",
       "16                                    Airport Manager         7260   \n",
       "17                             Airport Police Captain         3228   \n",
       "18                          Airport Police Lieutenant         3227   \n",
       "19                             Airport Police Officer         3225   \n",
       "20                          Airport Police Specialist         3236   \n",
       "21               Airport Superintendent Of Operations         7268   \n",
       "22                Airports Maintenance Superintendent         3331   \n",
       "23                    Airports Maintenance Supervisor         3336   \n",
       "24   Airports Public And Community Relations Director         1788   \n",
       "25                              Animal Care Assistant         4323   \n",
       "26                             Animal Care Technician         4310   \n",
       "27                           Water Treatment Operator         5885   \n",
       "28                             Animal Control Officer         4311   \n",
       "29                                      Animal Keeper         4304   \n",
       "..                                                ...          ...   \n",
       "652           Wastewater Treatment Laboratory Manager         7840   \n",
       "653                     Wastewater Treatment Mechanic         5614   \n",
       "654          Wastewater Treatment Mechanic Supervisor         5617   \n",
       "655                     Wastewater Treatment Operator         4123   \n",
       "656                                   Water Biologist         7856   \n",
       "657                              Water Microbiologist         7857   \n",
       "658                      Water Service Representative         1693   \n",
       "659                          Water Service Supervisor         3930   \n",
       "660                              Water Service Worker         3931   \n",
       "661                            Water Services Manager         9602   \n",
       "662                          Water Treatment Operator         5885   \n",
       "663                        Water Treatment Supervisor         5887   \n",
       "664                            Water Utility Operator         5854   \n",
       "665                 Water Utility Operator Supervisor         5857   \n",
       "666                      Water Utility Superintendent         3980   \n",
       "667                          Water Utility Supervisor         3976   \n",
       "668                              Water Utility Worker         3912   \n",
       "669                    Watershed Resources Specialist         7862   \n",
       "670                               Waterworks Engineer         7248   \n",
       "671                    Waterworks Mechanic Supervisor         3987   \n",
       "672                                            Welder         3796   \n",
       "673                                 Welder Supervisor         3798   \n",
       "674                                        Wharfinger         1190   \n",
       "675                                    Window Cleaner         3173   \n",
       "676                     Workers' Compensation Analyst         1774   \n",
       "677            Workers' Compensation Claims Assistant         1775   \n",
       "678                   X-Ray And Laboratory Technician         2358   \n",
       "679                                       Zoo Curator         4297   \n",
       "680                          Zoo Curator Of Education         4300   \n",
       "681                                     Zoo Registrar         4290   \n",
       "\n",
       "                                            JOB_DUTIES DRIVERS_LICENSE_REQ  \\\n",
       "0    A 311 Director is responsible for the successf...                None   \n",
       "1    An Accountant does professional accounting wor...                   P   \n",
       "2    An Accounting Clerk performs difficult and res...                None   \n",
       "3    An Accounting Records Supervisor assigns, revi...                None   \n",
       "4    An Administrative Analyst performs professiona...                   P   \n",
       "5    An Administrative Clerk performs general offic...                   P   \n",
       "6    An Administrative Hearing Examiner conducts qu...                   P   \n",
       "7    An Advance Practice Provider Correctional Care...                None   \n",
       "8    An Air Conditioning Mechanic installs, modifie...                   R   \n",
       "9    An Air Conditioning Mechanic Supervisor assign...                   R   \n",
       "10   An Airport Aide provides services and transpor...                None   \n",
       "11   Airport Chief Information Security Officer man...                None   \n",
       "12   An Airport Engineer performs professional engi...                   R   \n",
       "13   An Airport Guide directs arriving passengers t...                   P   \n",
       "14   An Airport Information Specialist provides and...                   R   \n",
       "15   The Airport Labor Relations Advocate advises s...                   P   \n",
       "16   An Airport Manager manages, through subordinat...                   P   \n",
       "17   An Airport Police Captain plans, supervises, d...                   R   \n",
       "18   An Airport Police Lieutenant plans, supervises...                   R   \n",
       "19   An Airport Police Officer is a sworn peace off...                   R   \n",
       "20   As a sworn member of the Los Angeles World Air...                   R   \n",
       "21   An Airport Superintendent of Operations inspec...                   R   \n",
       "22   An Airports Maintenance Superintendent plans, ...                   P   \n",
       "23   An Airports Maintenance Supervisor plans, orga...                   P   \n",
       "24   An Airports Public and Community Relations Dir...                   P   \n",
       "25   Animal Care Assistants perform work in the rec...                   R   \n",
       "26   An Animal Care Technician receives and cares f...                   R   \n",
       "27   A Water Treatment Operator does skilled work i...                   R   \n",
       "28   An Animal Control Officer enforces State and C...                   R   \n",
       "29   An Animal Keeper cares for exotic mammals, bir...                   P   \n",
       "..                                                 ...                 ...   \n",
       "652  A Wastewater Treatment Laboratory Manager plan...                   P   \n",
       "653  A Wastewater Treatment Mechanic performs a var...                   P   \n",
       "654  A Wastewater Treatment Mechanic Supervisor ass...                   P   \n",
       "655  A Wastewater Treatment Operator operates waste...                   P   \n",
       "656  A Water Biologist performs oceanographic, mari...                   P   \n",
       "657  A Water Microbiologist uses a variety of micro...                   P   \n",
       "658  A Water Service Representative makes field inv...                   R   \n",
       "659  A Water Service Supervisor assigns, reviews an...                   R   \n",
       "660  A Water Service Worker inspects, repairs, rebu...                   R   \n",
       "661  A Water Services Manager serves as a Director ...                   P   \n",
       "662  A Water Treatment Operator does skilled work i...                   R   \n",
       "663  A Water Treatment Supervisor assigns, reviews,...                   P   \n",
       "664  A Water Utility Operator inspects, operates, a...                   R   \n",
       "665  A Water Utility Operator Supervisor supervises...                   R   \n",
       "666  A Water Utility Superintendent plans, organize...                   R   \n",
       "667  A Water Utility Supervisor assigns, reviews an...                   R   \n",
       "668  A Water Utility Worker installs, maintains, op...                   P   \n",
       "669  A Watershed Resources Specialist performs envi...                   R   \n",
       "670  A Waterworks Engineer plans, organizes, and di...                   P   \n",
       "671  A Waterworks Mechanic Supervisor assigns, revi...                   R   \n",
       "672  A Welder performs skilled heating, welding, pl...                   P   \n",
       "673  A Welder Supervisor assigns, reviews and evalu...                   P   \n",
       "674  A Wharfinger tracks cargo by terminal, vessel,...                   P   \n",
       "675  A Window Cleaner washes and cleans windows, wh...                   P   \n",
       "676  A Workers' Compensation Analyst administers Wo...                   P   \n",
       "677  A Workers' Compensation Claims Assistant perfo...                   P   \n",
       "678  Takes and develops radiographic images accordi...                   P   \n",
       "679  A Zoo Curator is responsible for the health an...                   P   \n",
       "680  A Zoo Curator of Education plans, develops, im...                   P   \n",
       "681  A Zoo Registrar assists in the development and...                None   \n",
       "\n",
       "    DRIV_LIC_TYPE      EXAM_TYPE ENTRY_SALARY_GEN ENTRY_SALARY_DWP OPEN_DATE  \n",
       "0            None  INT_DEPT_PROM    125175-155514             None  04-18-14  \n",
       "1            None           OPEN      49903-72996             None  06-22-18  \n",
       "2            None  OPEN_INT_PROM      49005-71618             None  07-13-18  \n",
       "3            None  INT_DEPT_PROM      55332-80930             None  07-27-18  \n",
       "4            None  INT_DEPT_PROM      60489-88468             None  06-01-18  \n",
       "5            None           OPEN      37584-54935      43263-53766  03-30-18  \n",
       "6            None  OPEN_INT_PROM      54726-80012             None  10-09-15  \n",
       "7            None           OPEN      78487-97530             None  02-08-08  \n",
       "8            None  OPEN_INT_PROM            90118            99054  04-14-17  \n",
       "9            None  INT_DEPT_PROM           103841    127388-134488  11-16-18  \n",
       "10           None  INT_DEPT_PROM      43242-63203             None  08-10-18  \n",
       "11           None  OPEN_INT_PROM    125551-183576             None  12-04-15  \n",
       "12           None  OPEN_INT_PROM    105005-153509             None  07-06-18  \n",
       "13           None           OPEN      31946-44265             None   4-20-18  \n",
       "14           None  OPEN_INT_PROM      42991-62869             None  12-11-15  \n",
       "15           None  OPEN_INT_PROM     93918-137327             None  02-01-19  \n",
       "16           None  OPEN_INT_PROM     99326-141378             None  12-02-16  \n",
       "17           None      DEPT_PROM    142568-187001             None  02-16-18  \n",
       "18           None  INT_DEPT_PROM    102186-134028             None  09-16-16  \n",
       "19           None           OPEN      51448-83019             None  11-09-06  \n",
       "20           None           OPEN             None             None  06-30-17  \n",
       "21           None           OPEN      53682-78467             None  12-18-15  \n",
       "22           None  INT_DEPT_PROM     90369-132108             None  02-16-18  \n",
       "23           None  INT_DEPT_PROM      66523-97321             None  11-16-18  \n",
       "24           None  OPEN_INT_PROM     86777-123463             None  12-08-17  \n",
       "25           None           OPEN      39337-57545             None  02-01-19  \n",
       "26           None           OPEN      38565-56396             None  04-01-16  \n",
       "27           None           OPEN      65646-81536             None  12-21-18  \n",
       "28           None           OPEN      46374-67818             None  06-15-18  \n",
       "29           None           OPEN      45810-66983             None  08-31-18  \n",
       "..            ...            ...              ...              ...       ...  \n",
       "652          None  INT_DEPT_PROM     91684-134049             None  11-09-18  \n",
       "653          None  OPEN_INT_PROM            92326             None  02-17-12  \n",
       "654          None  INT_DEPT_PROM           118843             None  07-21-17  \n",
       "655          None           OPEN            94361             None  12-07-18  \n",
       "656          None  OPEN_INT_PROM      61491-87508      73142-90869  12-02-16  \n",
       "657          None           OPEN      63663-79073      74896-93041  07-25-14  \n",
       "658          None  INT_DEPT_PROM      70177-87194             None  11-17-17  \n",
       "659          None  INT_DEPT_PROM      89888-94899             None  01-27-17  \n",
       "660          None  INT_DEPT_PROM      64310-79886             None  04-06-18  \n",
       "661          None  INT_DEPT_PROM    196000-243502             None  08-12-16  \n",
       "662          None           OPEN      65646-81536             None  12-21-18  \n",
       "663          None  INT_DEPT_PROM    109411-115508             None  07-20-18  \n",
       "664          None  OPEN_INT_PROM      54308-67484             None  08-05-16  \n",
       "665          None  INT_DEPT_PROM      93041-98219             None  06-29-18  \n",
       "666          None  INT_DEPT_PROM    131084-162864             None  12-14-18  \n",
       "667          None  INT_DEPT_PROM     97697-103147             None  05-04-18  \n",
       "668          None  OPEN_INT_PROM             None      67275-83582  12-08-17  \n",
       "669          None  OPEN_INT_PROM      76608-95191             None  08-05-16  \n",
       "670          None  INT_DEPT_PROM    116740-145032             None  07-15-16  \n",
       "671          None  INT_DEPT_PROM     94001-116781             None  05-16-14  \n",
       "672          None  OPEN_INT_PROM            81703      76608-99848  10-28-16  \n",
       "673          None  INT_DEPT_PROM            97895    108805-114881  12-08-17  \n",
       "674          None  OPEN_INT_PROM      55854-81640             None  09-21-18  \n",
       "675          None  INT_DEPT_PROM      38857-55332             None  03-24-17  \n",
       "676          None  OPEN_INT_PROM      56898-83165      76984-95651  03-24-17  \n",
       "677          None  INT_DEPT_PROM      51385-63830      58860-73121  04-11-14  \n",
       "678          None           OPEN      52200-76295      56605-70323  01-29-16  \n",
       "679          None  OPEN_INT_PROM      78300-94712             None  04-08-16  \n",
       "680          None  OPEN_INT_PROM      57628-84229             None  09-14-18  \n",
       "681          None  OPEN_INT_PROM      55666-81390             None  07-06-18  \n",
       "\n",
       "[682 rows x 10 columns]"
      ]
     },
     "execution_count": 12,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# Import relevant modules\n",
    "import provenir                  # access to job bulletins and customized printing\n",
    "import individual_toolkit as itk # access to unit functions that operate on one job at a time\n",
    "import multiple_toolkit as mtk   # access to aggregate functions that operate on multiple jobs at a time\n",
    "\n",
    "# Use mtk module to retrieve a data frame for EACH field name. u# stands for the position of the field.\n",
    "# For example, u1 is the FILE_NAME field. This field is the first one listed in `kaggle_data_dictionary.csv`\n",
    "# Similarly,  u25 is the OPEN_DATE field because it's at the 25th position in the above csv file\n",
    "u1  = mtk.fn_get_many()\n",
    "u2  = mtk.jct_get_many()   # jct = job_class_title\n",
    "u3  = mtk.jcn_get_many()   # jcn = job_class_no, etc.\n",
    "u6  = mtk.jd_get_many()\n",
    "u19 = mtk.dlr_get_many()\n",
    "u20 = mtk.dlt_get_many()\n",
    "u22 = mtk.et_get_many()\n",
    "u23 = mtk.esg_get_many()\n",
    "u24 = mtk.esdwp_get_many()\n",
    "u25 = mtk.od_get_many()\n",
    "\n",
    "# Put all of the above 1D dataframes in a list for easier concatenation\n",
    "grp = [u1, u2, u3, u6, u19, u20, u22, u23, u24, u25] \n",
    "\n",
    "# Concate all 1D dataframes into one big, final dataframe\n",
    "import pandas as pd\n",
    "df = pd.concat(grp, axis=1)\n",
    "df"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Let's look at the missing values in these columns."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 10,
   "metadata": {},
   "outputs": [],
   "source": [
    "# Function for summarizing missing values in columns\n",
    "def missing_values_table(df):\n",
    "    \"\"\"\n",
    "    missing_values_table counts the total number of missing values and their percentages\n",
    "    in each column.\n",
    "    Inputs:\n",
    "    - df--pandas dataframe: a data frame of which its missing values are under investigation.\n",
    "    \n",
    "    Outputs:\n",
    "    - missing_values_tab--pandas dataframe: table of total number of missing values together \n",
    "    with their percentages in each column and some printout details.\n",
    "    \n",
    "    Acknowledgement: Based on Will Koehrsen's Kaggle kernel with slight simplifications.\n",
    "    \"\"\"\n",
    "    # Count the number of missing values in each column\n",
    "    missing_value_counts = df.isnull().sum() # pandas series\n",
    "    \n",
    "    # Find the percentages of missing values within each column\n",
    "    missing_value_percentage = (100 * missing_value_counts/len(df)).round(1) # pandas series\n",
    "    \n",
    "    # Make a table of missing values with keys to acces. \n",
    "    # pd.concat helps concatenate two pandas series.\n",
    "    missing_values_tab = pd.concat([missing_value_counts, missing_value_percentage], \n",
    "                                   axis = 1, keys=['Missing Values','% of Total Values'])\n",
    "    \n",
    "    # Sort the table by percentage of missing descending. There are tons of methods.\n",
    "    # One method is sort_values(inplace=True). Here, try a new method just learned\n",
    "    missing_values_tab = missing_values_tab.loc[missing_values_tab['Missing Values'] != 0, :].sort_values(\n",
    "                         '% of Total Values', ascending=False)\n",
    "    \n",
    "    # Print some summary information\n",
    "    print(\"Your selected data frame has %d columns.\" %(df.shape[1]))\n",
    "    print(\"There are %d columns that have missing values.\" %(missing_values_tab.shape[0]))\n",
    "    \n",
    "    return missing_values_tab"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 11,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Your selected data frame has 11 columns.\n",
      "There are 6 columns that have missing values.\n"
     ]
    },
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>Missing Values</th>\n",
       "      <th>% of Total Values</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>DRIV_LIC_TYPE</th>\n",
       "      <td>663</td>\n",
       "      <td>97.2</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>DRIV_LIC_TYPE</th>\n",
       "      <td>663</td>\n",
       "      <td>97.2</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>ENTRY_SALARY_DWP</th>\n",
       "      <td>498</td>\n",
       "      <td>73.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>DRIVERS_LICENSE_REQ</th>\n",
       "      <td>67</td>\n",
       "      <td>9.8</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>ENTRY_SALARY_GEN</th>\n",
       "      <td>7</td>\n",
       "      <td>1.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>JOB_DUTIES</th>\n",
       "      <td>6</td>\n",
       "      <td>0.9</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "                     Missing Values  % of Total Values\n",
       "DRIV_LIC_TYPE                   663               97.2\n",
       "DRIV_LIC_TYPE                   663               97.2\n",
       "ENTRY_SALARY_DWP                498               73.0\n",
       "DRIVERS_LICENSE_REQ              67                9.8\n",
       "ENTRY_SALARY_GEN                  7                1.0\n",
       "JOB_DUTIES                        6                0.9"
      ]
     },
     "execution_count": 11,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# Check missing values\n",
    "missing_values_table(df)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# 6. Recommendations to the City of LA\n",
    "*In most of data-related fields, the cost of collecting the data far outweighs the cost of hiring analysts*\n",
    "—Frank E. Harrell. \n",
    "\n",
    "In hindsight, I can see that this statement is very accurate after pulling myself through this competition for two months. Therefore, the best recommendation I can give to the City is to consult with an expert in order to define a well-posed problem. Such problem can then be broken into many steps, each is solvable in a reasonable amount of time. \n",
    "\n",
    "For example, a question I’ve always asked myself is whether converting all of these text files into a single csv file really helps in solving the hiring challenge? Organizing text data, which is of inherently unstructured data type, into a csv format, which is of structured data type, certainly requires careful thoughts due to loss of information and major conflicts down the road. The scraping of ENTRY_SALARY_GEN and ENTRY_SALARY_DWP is one such example. There are some jobs with (many) salary ranges while some other jobs have (many) flat-rated salaries. Then does it really make sense to put them into one column? Furthermore, why do we only need the first listed salary range as required? What will happen to the rest? Also, in my opinion, the code for achieving this task is extremely tricky and results are not reliable if there is no manual check (similar to my approach).\n",
    "\n",
    "Now, let’s say that a csv format is needed to organize the text data. The next question to be asked is what are some plans for using this file? If the goal is to display simple statistics such as word cloud, then tools like nltk or spaCy can do a much better job without the need of generating a csv format, as they specialize in such a task.\n",
    "\n",
    "Only after a well-posed problem has been defined then outsourcing like partnering with Kaggle is needed. **The order is very important here**: The City shouldn’t approach an expert **after** the data have been collected as it will bias his thinking. This is also what Harrell recommended for most data-related projects in his recent lecture at California State University, Long Beach.\n",
    "\n",
    "I hope the City of Los Angeles will find many kernels here helpful in resolving the hiring challenge. Thank you very much for considering my approach to this data challenge. I hope you will find it useful."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": []
  }
 ],
 "metadata": {
  "kernelspec": {
   "display_name": "Python 3",
   "language": "python",
   "name": "python3"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.6.5"
  }
 },
 "nbformat": 4,
 "nbformat_minor": 2
}