ch16s2_AnalyzingAndVisualizingRealData

**Data analysis** is the process of exploring, cleaning, and interpreting data to extract actionable insights.

Chapter 16: Real‑World Projects — Analyzing and Visualizing Real Data

📊 Introduction to Data Analysis and Visualization

Data analysis is the process of exploring, cleaning, and interpreting data to extract actionable insights.
Data visualization transforms those insights into clear, compelling visuals that help others understand and act on your findings.

Python provides powerful libraries for this workflow:

• Pandas → Data loading, cleaning, and transformation
• Matplotlib / Seaborn → Visualization and presentation
• NumPy → Numerical computation support
• Plotly → Interactive charts and dashboards

In this chapter, you’ll learn to analyze and visualize real‑world sales data using Pandas and Matplotlib — following a complete exploration to insight workflow.

🧩 1. Understanding the Dataset

Let’s say we have a dataset named sales_data.csv containing the following columns:

We’ll analyze trends, identify top categories, and visualize performance over time.

🧠 2. Loading and Inspecting Data

import pandas as pd

# Load dataset
data = pd.read_csv("sales_data.csv")

# Preview data
print(data.head())

# Check dataset shape and summary
print("Shape:", data.shape)
print(data.info())

# Basic statistics
print(data.describe())

Always inspect the first few rows and structure before analysis — it helps catch missing or inconsistent values early.

🧹 3. Data Cleaning

# Handle missing values
print("Missing values before cleaning:")
print(data.isnull().sum())

data = data.dropna(subset=['Sales'])  # remove rows with missing sales
data['Month'] = data['Month'].astype(str)

# Ensure numeric types
data['Sales'] = pd.to_numeric(data['Sales'], errors='coerce')

# Fill missing region values
data['Region'] = data['Region'].fillna('Unknown')

Data cleaning ensures consistency and reliability in insights.

📈 4. Analyzing Sales Trends

Monthly Sales Overview

import matplotlib.pyplot as plt

monthly_sales = data.groupby('Month')['Sales'].sum().sort_index()

plt.figure(figsize=(10,6))
plt.plot(monthly_sales.index, monthly_sales.values, marker='o', color='royalblue', linewidth=2)
plt.title('📅 Monthly Sales Trend')
plt.xlabel('Month')
plt.ylabel('Total Sales ($)')
plt.grid(alpha=0.3)
plt.show()

Insights

You can quickly see peak sales months — useful for inventory planning and marketing timing.

🛍️ 5. Category Performance Analysis

category_sales = data.groupby('Category')['Sales'].sum().sort_values(ascending=False)

plt.figure(figsize=(8,5))
category_sales.plot(kind='bar', color='teal')
plt.title('Top Performing Product Categories')
plt.xlabel('Category')
plt.ylabel('Total Sales ($)')
plt.xticks(rotation=30)
plt.show()

Categories with high sales can guide product focus or promotional campaigns.

🌍 6. Regional Distribution

region_sales = data.groupby('Region')['Sales'].sum()

plt.figure(figsize=(6,6))
plt.pie(region_sales, labels=region_sales.index, autopct='%1.1f%%', startangle=120, colors=plt.cm.Paired.colors)
plt.title('Regional Sales Contribution')
plt.show()

The pie chart shows how different regions contribute to total revenue — helping target underperforming markets.

🔥 7. Correlation Analysis

import seaborn as sns

# Compute correlation between numeric columns
corr = data.select_dtypes(include=['float64', 'int64']).corr()

plt.figure(figsize=(6,4))
sns.heatmap(corr, annot=True, cmap='coolwarm', fmt='.2f')
plt.title('Correlation Matrix')
plt.show()

The correlation heatmap helps identify relationships (e.g., sales may correlate with time or product count).

🧭 8. Advanced Visualization (Optional)

Interactive Plotly Example

import plotly.express as px

fig = px.line(data, x='Date', y='Sales', color='Region', title='Interactive Sales Trend by Region')
fig.show()

Plotly enables zooming, filtering, and hover interactions — ideal for dashboards and presentations.

🧩 9. Extracting Business Insights

🧠 10. Best Practices for Data Visualization

🚀 11. Complete Example Summary

import pandas as pd
import matplotlib.pyplot as plt
import seaborn as sns

# Load and clean
data = pd.read_csv('sales_data.csv').dropna(subset=['Sales'])

# Monthly trend
monthly_sales = data.groupby('Month')['Sales'].sum()

plt.figure(figsize=(10,5))
plt.plot(monthly_sales, marker='o', color='royalblue')
plt.title('Monthly Sales Trend')
plt.xlabel('Month')
plt.ylabel('Sales ($)')
plt.grid(alpha=0.3)
plt.show()

# Category sales
category_sales = data.groupby('Category')['Sales'].sum().sort_values(ascending=False)
sns.barplot(x=category_sales.index, y=category_sales.values, palette='viridis')
plt.title('Sales by Category')
plt.show()

🧭 Conclusion

Data analysis and visualization transform raw numbers into powerful stories.
By combining Pandas for analysis and Matplotlib / Seaborn for visualization, you can uncover patterns, trends, and actionable insights in any dataset.

“Without visualization, data is just noise — visualization turns it into knowledge.”