Python for Big Data
Course Objective
· Master the fundamentals of writing Python scripts
· Learn Python programming elements such as variables and flow control structures
· Discover how to work with Python data structure lists and dictionary data
· Write Python functions to facilitate code reuse
· Use Python to handle data in files, xml, json and databases
· Make their code robust by handling errors and exceptions properly
· Work with the Python libraries
· Explore Python's object-oriented features
· Search text using regular expressions
· Data visualization
· Hands on Practice Web scrapping to collection data
· Hands on Practice Web development to represent information
· Learn Data engineer roadmap
Outline
Python programming
· Introduction to Python
· Setup development IDE
· Debug
· Strings
· Numbers
· Control Structure
· List
· Dictionary
· Flat file
· JSON
· XML
· RDBMS
· Matching
· Searching
· Searching and modifying
Common used Libraries
· numPy
· pandas
· sciPy
Application Design
· Requirements Collection
· Configuration Design
· Log mechanism
· Data Migration and validation Practice
Web Scrapping
· Web Scrapping basics
· Web Scrapping advanced
· The Yahoo! Finance Stock Quote Server
Data Visualization
· Introduction
o Data
o Information
o Knowledge
o Data analysis and insight
· Data Analysis and Visualization
o Planning visualization
o Visualization tools
· Visualization Practice
o Health Care
o Sports
o Trends over time
o Financial and Statistical
Web Apps Development
· Web Frameworks
· Building a Social Website
· Sharing Content in Website
· Tracking User Actions
Data Engineer roadmap
