Skip to content

Commit eb0499b

Browse files
author
RMOTR Data Science Curriculum
committed
initial commit
0 parents  commit eb0499b

11 files changed

+8617
-0
lines changed

‎.ipynb_checkpoints/1. Introduction to Data Science-checkpoint.ipynb

+123
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,123 @@
1+
{
2+
"cells": [
3+
{
4+
"cell_type": "markdown",
5+
"metadata": {},
6+
"source": [
7+
"![rmotr](https://user-images.githubusercontent.com/7065401/52071918-bda15380-2562-11e9-828c-7f95297e4a82.png)\n",
8+
"<hr style=\"margin-bottom: 40px;\">\n",
9+
"\n",
10+
"<img src=\"https://user-images.githubusercontent.com/7065401/39118201-1d71c8a2-46e9-11e8-8546-256f5a655290.jpg\"\n",
11+
" style=\"width:300px; float: right; margin: 0 40px 40px 40px;\"></img>\n",
12+
" \n",
13+
"# Intro to Data Science\n",
14+
"\n",
15+
"What is _Data Science_? The only thing we know for sure is that, _Data Science_ is a broad term. It depends on the organization/company, the people involved, etc. This is an good representation:\n",
16+
"\n",
17+
"<img width=\"400\" src=\"https://static1.squarespace.com/static/5150aec6e4b0e340ec52710a/t/51525c33e4b0b3e0d10f77ab/1364352052403/Data_Science_VD.png\" />\n",
18+
"\n",
19+
"> [Source](http://drewconway.com/zia/2013/3/26/the-data-science-venn-diagram)\n"
20+
]
21+
},
22+
{
23+
"cell_type": "markdown",
24+
"metadata": {},
25+
"source": [
26+
"\n",
27+
"Although, this one might be a little bit more accurate:\n",
28+
"\n",
29+
"<img src=\"https://user-images.githubusercontent.com/7065401/75162470-5ff72080-56fc-11ea-86b5-60c2ea03f005.png\" />\n",
30+
"\n",
31+
"As a \"Data Scientist\" you'll be combining your domain knowledge \"science\", with large amounts of data, using programming and computers. Your tasks as Data Scientists will involve, highly technical tasks like Machine Learning to boring and repetitive operative tasks like scraping a website from data and importing it in a Database.\n"
32+
]
33+
},
34+
{
35+
"cell_type": "markdown",
36+
"metadata": {},
37+
"source": [
38+
"![green-divider](https://user-images.githubusercontent.com/7065401/52071924-c003ad80-2562-11e9-8297-1c6595f8a7ff.png)\n",
39+
"\n",
40+
"### What does a Data Scientist do?\n",
41+
"\n",
42+
"It's probably easier to define the tasks that are most common to Data Scientists that to give a general definition that applies to everybody.\n",
43+
"\n",
44+
"<img src=\"https://cacm.acm.org/system/assets/0001/3678/rp-overview.jpg\" />\n",
45+
"\n",
46+
"> [Source from recommended article](https://cacm.acm.org/blogs/blog-cacm/169199-data-science-workflow-overview-and-challenges/fulltext)\n"
47+
]
48+
},
49+
{
50+
"cell_type": "markdown",
51+
"metadata": {},
52+
"source": [
53+
"\n",
54+
"**Getting the data**\n",
55+
"\n",
56+
"Depending on your company/organization, getting the data can be as simple as a SQL query or as difficult as scraping entire websites. The problem with this task is that it's not standardized.\n",
57+
"\n",
58+
"**Parsing and Cleaning the Data**\n",
59+
"\n",
60+
"Depending on your sources, you'll need to do a little bit of preparation. Excluding outliers, filling null values, translating values, etc.\n",
61+
"\n",
62+
"**Merging, combining data**\n",
63+
"\n",
64+
"If the data comes from different sources, merging it can be tedious. Specially if it's hard to define that piece of information that relates different data sources.\n",
65+
"\n",
66+
"**Doing the analysis**\n",
67+
"\n",
68+
"This involves your own domain expertise + the tools available for the job. For example, you need to know the principles of statistics and you can also use [`statsmodels`](https://www.statsmodels.org) to simplify your job. The analysis part is usually iterative and involves other subtasks as visualizations, validation testing, etc.\n",
69+
"\n",
70+
"**Building models**\n",
71+
"\n",
72+
"The whole point of the analysis part is finding patterns in particular cases to build general models. Your models can be predictions, clusterings, or just automated reports. In a general sense, it's the result of all the previous phases.\n",
73+
"\n",
74+
"**Deploying it**\n",
75+
"\n",
76+
"Perfect analyses and models are useless if they're not repeatable and scalable. This phase depends on your own models, but it'll usually imply a cloud provider. From simple reports (emailed every day at 3AM from an AWS Lambda) to a Machine Learning Model (built on top of Tensor Flow and deployed on Google's cloud infrastructure)."
77+
]
78+
},
79+
{
80+
"cell_type": "markdown",
81+
"metadata": {},
82+
"source": [
83+
"![green-divider](https://user-images.githubusercontent.com/7065401/52071924-c003ad80-2562-11e9-8297-1c6595f8a7ff.png)\n",
84+
"\n",
85+
"### The only thing that's certain\n",
86+
"\n",
87+
"We're sorry we can't give you better answers to the question \"What is Data Science?\", but this is a new discipline and we're putting together definitions, scopes and responsibilities of different actors. But there's one thing that's certain: **You need to know how to code...**\n",
88+
"\n",
89+
"<img src=\"https://user-images.githubusercontent.com/872296/38268832-6af6d610-3755-11e8-9d2f-733134ef1418.png\" />\n",
90+
"\n",
91+
"> [Source](https://twitter.com/josh_wills/status/198093512149958656?lang=en)\n"
92+
]
93+
},
94+
{
95+
"cell_type": "markdown",
96+
"metadata": {},
97+
"source": [
98+
"![purple-divider](https://user-images.githubusercontent.com/7065401/52071927-c1cd7100-2562-11e9-908a-dde91ba14e59.png)"
99+
]
100+
}
101+
],
102+
"metadata": {
103+
"kernelspec": {
104+
"display_name": "Python 3",
105+
"language": "python",
106+
"name": "python3"
107+
},
108+
"language_info": {
109+
"codemirror_mode": {
110+
"name": "ipython",
111+
"version": 3
112+
},
113+
"file_extension": ".py",
114+
"mimetype": "text/x-python",
115+
"name": "python",
116+
"nbconvert_exporter": "python",
117+
"pygments_lexer": "ipython3",
118+
"version": "3.7.4"
119+
}
120+
},
121+
"nbformat": 4,
122+
"nbformat_minor": 2
123+
}

0 commit comments

Comments
 (0)