Project 3

Objectives:

  • To be able to answer the question “What is the most valuable skills for data scientist?” through research, use of surveys and visualization.

Approach:

  • We looked at three different sets of data related to data science skills. We start with a discussion of the results of a recent look at data science job listings.

  • Next, two members of our team sliced and diced data from a large survey of data scientists gathered by Kaggle, the machine learning contest and education site.

  • Finally, we built our own survey using a free online tool and elicited responses from data science leaders at companies at which we are interested in eventually seeking employment.

Analysis of the survey gathered by Kaggle

Kaggle conducted a survey of more than 16,000 data scientists in 2017. Data used in the following analysis is pulled from https://www.kaggle.com/kaggle/kaggle-survey-2017.

Time Spent on Top 5 Important Tasks

plot of chunk unnamed-chunk-2

Analysis of the survey gathered by Kaggle

Time Spent on the Other Important Tasks

plot of chunk unnamed-chunk-3

Analysis of our Own survey

Survey Respondents Team Size

plot of chunk unnamed-chunk-4

Analysis of our Own survey

Team Size of those that didn't Respond

plot of chunk unnamed-chunk-5

Analysis of our Own survey

Survey Respondent Team Roles

plot of chunk unnamed-chunk-6

Analysis of our Own survey

Survey Respondent Top Skills Desired

plot of chunk unnamed-chunk-7

Data Related to Data Science Skills

Data Scientist Job Listing (What are employers looking for?)

Searched job listings on LinkedIn, Indeed, SimplyHired, Monster, and AngelList using the keyword data scientist.

plot of chunk unnamed-chunk-8

Data Related to Data Science Skills

General Skills The most frequent general data scientist skills the employers are looking for.

Used the author's provided data set in google sheet and loaded them in MySQL database in a normalized table. Summed the keywords occurrences and averaged them across the job listing sites.

plot of chunk unnamed-chunk-9

Data Related to Data Science Skills

Technology Skills

The top 20 specific languages, libraries, and tech tools employers are looking for data scientists to have experience with.

plot of chunk unnamed-chunk-10

Reference: https://towardsdatascience.com/the-most-in-demand-skills-for-data-scientists-4a4a8db896db

Conclusion

We see numerous possibilities for further exploration. A deeper look at the dearth of entry-level data science positions. Perhaps we could even use a combination of web scraping and machine learning to identify entry-level positions automatically. Additionally, a survey of recent graduates of the CUNY program would be of much interest.

Team Members:

  • Alice Friedman
  • Jeff Littlejohn
  • Deepak Mongia
  • Eleanor Romero

Thank You!