Practical Python for Data Analytics: Arrays, DataFrames, Cleaning, GroupBy, Pivot Tables & More
This repository contains my Week 2 internship assignment from InternNova, focused on NumPy and Pandas for Data Analytics.
The project demonstrates practical use of Python libraries for numerical computing, data manipulation, data cleaning, data inspection, filtering, sorting, aggregation, and basic data analysis.
The assignment includes 10 tasks covering NumPy fundamentals, Pandas operations, missing-value handling, data combination, GroupBy analysis, Pivot Tables, CSV processing, and a mini data analysis project.
- Understand NumPy arrays and their properties
- Perform indexing, slicing, and reshaping using NumPy
- Perform mathematical and statistical operations
- Understand Pandas Series and DataFrames
- Load and inspect CSV datasets
- Select, filter, and sort data
- Identify and handle missing values
- Merge and concatenate datasets
- Perform GroupBy and aggregation operations
- Create Pivot Tables
- Export processed data to CSV files
- Apply NumPy and Pandas concepts in a basic data analysis project
| Tool | Purpose |
|---|---|
| 🐍 Python | Core programming language |
| 🔢 NumPy | Numerical computing & arrays |
| 🐼 Pandas | Data manipulation & analysis |
| 📄 CSV | Data storage format |
| 💻 Visual Studio Code | Development environment |
Task 1 — NumPy Introduction & Arrays
Created NumPy arrays and examined their basic properties.
Topics covered: Creating NumPy arrays · One-dimensional arrays · Two-dimensional arrays · Array shape · Array size · Data type
Task 2 — NumPy Indexing, Slicing & Reshaping
Worked with NumPy arrays using indexing, slicing, and reshaping techniques.
Topics covered: Array indexing · Array slicing · Accessing rows · Accessing columns · Reshaping arrays
Task 3 — NumPy Mathematical & Statistical Operations
Performed mathematical and statistical operations on numerical data.
Operations covered: Addition · Subtraction · Multiplication · Division · Mean · Median · Minimum · Maximum · Standard deviation · Sum
Task 4 — Pandas Series & DataFrame
Created and manipulated Pandas Series and DataFrames.
Topics covered: Creating Pandas Series · Creating DataFrames · Viewing column names · Viewing indexes · Adding new columns · Updating DataFrames
Task 5 — Reading & Inspecting Data
Loaded a student dataset from a CSV file and inspected its structure.
Operations covered: Reading CSV files · head() · tail() · shape · columns · dtypes · info() · describe()
Task 6 — Selecting, Filtering & Sorting Data
Performed data selection, filtering, and sorting using Pandas.
Operations covered: Selecting specific columns · Selecting specific rows · Conditional filtering · Multiple filtering conditions · Ascending sorting · Descending sorting
Task 7 — Handling Missing Values
Worked with a dataset containing missing values and applied different methods to handle them.
Operations covered: Identifying missing values · Counting missing values · Removing missing records · Filling missing numerical values · Filling missing categorical values
Task 8 — Merge, Concatenate, GroupBy & Pivot Table
Performed important data manipulation and summarization operations.
Operations covered: Merging DataFrames · Concatenating DataFrames · GroupBy analysis · Aggregate calculations · Pivot Tables
Task 9 — Exporting Data
Processed the student dataset and exported the resulting DataFrame to a CSV file.
Operations covered: Data processing · Sorting · CSV export · Verifying exported data
📊 Task 10 — Mini Data Analysis Project
The mini project applies the concepts learned throughout the assignment to a student dataset.
Analysis Steps
- Loaded the student dataset
- Inspected the dataset
- Checked for missing values
- Cleaned the dataset
- Selected relevant columns
- Filtered students based on marks
- Sorted students by marks
- Performed GroupBy analysis
- Created a Pivot Table
- Identified key insights
- Exported the cleaned dataset
Key Insights
- Highest marks
- Lowest marks
- Average marks
- Top-performing student
- Average marks by department
- Average marks by city
Internnova-Week-2-Numpy-Pandas/
│
├── README.md
│
├── Tasks/
│ ├── Task_1_Numpy_Arrays.py
│ ├── Task_2-Numpy_Indexing_Slicing.py
│ ├── Task_3_Numpy_Math_Statistics.py
│ ├── Task_4_Pandas_Series_DataFrame.py
│ ├── Task_5_Reading_Inspecting_Data.py
│ ├── Task_6_Select_Filter_Sort.py
│ ├── Task_7_Handling_Missing_Values.py
│ ├── Task_8_Merge_Concat_GroupBy_Pivot.py
│ ├── Task_9_Exporting_Data.py
│ └── Task_10_Mini_Data_Analysis.py
│
├── Mini_Project/
│ ├── Mini_Data_Analysis.py
│ ├── students.csv
│ └── cleaned_students.csv
│
└── screenshots/
├── Task_1_Output.png
├── Task_2_Output.png
├── Task_3_Output.png
├── Task_4_Output.png
├── Task_5_Output.png
├── Task_6_Output.png
├── Task_7_Output.png
├── Task_8_Output.png
├── Task_9_Output.png
└── Task_10_Output.png
1. Install Python Make sure Python is installed on your system.
2. Install Required Libraries
pip install numpy pandas3. Clone the Repository
git clone https://github.com/Gajanan-raje/Internnova-Week-2-Numpy-Pandas.git4. Open the Project
cd Internnova-Week-2-Numpy-Pandas5. Run a Task
python Tasks/Task_1_Numpy_Arrays.pyYou can run the other task files in the same way.
Python Programming NumPy Pandas Data Cleaning Data Inspection Data Manipulation Data Filtering Data Sorting Exploratory Data Analysis GroupBy Analysis Pivot Tables CSV Data Processing Basic Statistical Analysis
Program: InternNova Internship Assignment: Week 2 — NumPy & Pandas for Data Analytics
Gajanan Harinarayan Raje BCA 3rd Year Student · Aspiring Data Analyst
📄 This repository was created as part of my practical learning and internship assignment in Data Analytics using Python, NumPy, and Pandas.