Python: Using Pandas to Read Data from CSV Files

This tutorial explains how to read data from CSV files in Python using the Pandas library with 7 unique examples. Pandas is a powerful data manipulation and analysis library that provides easy-to-use functions for working with structured data, such as CSV files. We will cover various methods for reading CSV files, and at the end, we’ll provide a comparison table to help you choose the most suitable method for your needs.

How to Read Data from CSV Files in Python Using Pandas

A CSV file (Comma-Separated Values) is a plain text file that stores tabular data. Each row in the file represents a record, and a comma separates each field in a row. CSV files are a popular format for exchanging data between applications and systems.

Introduction to Pandas

Pandas is an open-source data analysis and manipulation library for Python. It provides data structures like DataFrames and Series, which efficiently handle and analyze structured data. Reading and writing CSV files is a common task in data analysis, and Pandas simplifies this process.

Installing Pandas

Before you can use Pandas to read CSV files, you need to install the library if it’s not already installed. You can install Pandas using pip, a package manager for Python. Open your terminal or command prompt and run the following command:

pip install pandas

Reading a CSV File

Pandas offers several methods for reading CSV files. We’ll cover the three most commonly used methods: pd.read_csv(), pd.read_table(), and pd.read_excel(). We’ll use a sample CSV file named “sample_data.csv” for demonstration purposes.

Method 1: Using Pandas Read CSV File Method

The pd.read_csv() function is the most commonly used method for reading CSV files. It is flexible and can handle various CSV formats. Here’s how you can use it:

import pandas as pd

# Reading a CSV file using pd.read_csv()
df = pd.read_csv('sample_data.csv')

# Display the first 5 rows of the DataFrame
print(df.head())

In the code above, we first import the Pandas library as pd. Then, we use the pd.read_csv() function to read the “sample_data.csv” file and store the data in a data frame named df. Finally, we display the first 5 rows of the data frame using df.head().

Method 2: Using Pandas Read Table Method

pd.read_table() is similar to pd.read_csv() but can be used to read tab-delimited files or other separated value files. You can specify the delimiter using the sep parameter. Here’s how to use it:

import pandas as pd

# Reading a tab-delimited file using pd.read_table()
df = pd.read_table('sample_data.txt', sep='\t')

# Display the first 5 rows of the DataFrame
print(df.head())

In this example, we import Pandas and use it, i.e.,pd.read_table() to read a tab-delimited file, specifying the tab separator with the sep parameter.

Method 3: Using Pandas Read Excel File Method

If you have an Excel file (.xlsx) that you want to read, Pandas also provides the pd.read_excel() function. Here’s how you can use it:

import pandas as pd

# Reading an Excel file using pd.read_excel()
df = pd.read_excel('sample_data.xlsx')

# Display the first 5 rows of the DataFrame
print(df.head())

In this code snippet, we import Pandas and use it, i.e., pd.read_excel() to read an Excel file named “sample_data.xlsx.”

Aha! Didn’t we read an Excel file instead of the CSV? But worry not. Check out the syntax below to read the CSV using the Pandas read_table() method.

# Read a CSV file using read_excel with the 'csv' format
data = pd.read_excel('data.csv', sheet_name=None, engine='python', format='csv')

Comparing Different Pandas Methods

Now that we’ve covered the three methods for reading CSV files in Pandas, let’s compare them based on some key factors to help you choose the most suitable method for your needs. We’ll consider factors such as flexibility, supported file formats, and ease of use.

Flexibility: All three methods are relatively flexible, but pd.read_csv() and pd.read_table() provide high flexibility as they can handle a variety of delimiter-separated files. pd.read_excel() is less flexible as it is designed specifically for Excel files.

Supported File Formats:

• pd.read_csv() and pd.read_table() support CSV and TSV files.
• pd.read_excel() is suitable for Excel files in .xlsx format.

Ease of Use:

• pd.read_csv() and pd.read_table() are straightforward to use and are suitable for most CSV and tab-separated data.
• pd.read_excel() is also easy to use but tailored for Excel files, making it less versatile.

Also Read – How to Read Excel Files Using Pandas in Python

7 Unique Pandas Examples to Read CSV in Python

Sure, here are some more concrete and real-time examples of using Python and Pandas:

Sure, let’s explore a couple of real-time use cases for reading CSV files using Python’s pandas library, along with code examples and key points about each case.

Example#1: Analyzing Sales Data

Example Detail: You have a CSV file containing sales data from an online store. You want to read this data, perform some basic analysis, and extract insights.

# Add the Python pandas lib
import pandas as pd

# Load the CSV data into a DataFrame
sales_data = pd.read_csv('sales_data.csv')

# Display the first 5 rows of the DataFrame
print(sales_data.head())

# Calculate the total sales
total_sales = sales_data['Sales'].sum()
print("Total Sales: $", total_sales)

# Find the average sales per product category
avg_sales_by_cat = sales_data.groupby('Category')['Sales'].mean()
print("Average Sales by Category:\n", avg_sales_by_cat)

Key Points:

• Use pd.read_csv() to read a CSV file into a pandas DataFrame.
• You can perform various data analysis and manipulation operations on the DataFrame.
• In this example, we displayed the first 5 rows, calculated the total sales, and found the average sales by category.

Example#2: Data Preprocessing for Machine Learning

Example Detail: You have a CSV file with data for a machine learning project. You need to read the data, preprocess it, and prepare it for training a model.

# Add the Python pandas lib
import pandas as pd

# Fetching the CSV data into a DataFrame
data = pd.read_csv('ML_data.csv')

# Check for missing values
miss_values = data.isnull().sum()
print("Missing Values:\n", miss_values)

# Replace missing values with the mean of the respective column
data.fillna(data.mean(), inplace=True)

# Encode categorical variables using one-hot encoding
data = pd.get_dummies(data, columns=['Category'])

# Split the data into features (X) and target (y)
X = data.drop('Target', axis=1)
y = data['Target']

Key Points:

• Use pd.read_csv() to read the data into a data frame.
• Check for missing values with .isnull().sum().
• Replace missing values using .fillna().
• Use one-hot encoding with the pd.get_dummies() for categorical variables.
• Split the data into features (X) and the target variable (y).

These use cases demonstrate the versatility of pandas for reading CSV data. Depending on your needs, you can perform various operations to clean, analyze, and prepare your data for further analysis.

Here are five more real-time use cases for reading CSV files in Python using pandas, along with code examples for each case:

Example#3: Financial Data Analysis

Example Detail: You have a CSV file containing financial data, including stock prices and trading volumes. You want to read and analyze this data to identify trends.

# Initialize the Python pandas lib
import pandas as pd

# Read the comma-separated (CSV) file into a DataFrame
fin_data = pd.read_table('fin_data.csv', delimiter=',')

# Calculate the avg daily trading volume
avg_vol = financial_data['Volume'].mean()
print("Average Daily Trading Volume:", avg_vol)

# Find the date with the highest closing price
max_close_date = fin_data.loc[fin_data['Close'].idxmax(), 'Date']
print("Date with Highest Closing Price:", max_close_date)

Example#4: Customer Churn Prediction

Example Detail: You have a CSV file with customer data, including their interactions and whether they churned. You want to read this data, preprocess it, and build a machine-learning model to predict customer churn.

# Adding the Python pandas lib
import pandas as pd

# Read the given CSV doc into a DataFrame
cust_data = pd.read_csv('cust_data.csv')

# Preprocess the data (e.g., handle missing values, one-hot encoding)

# Split the data into features (X) and target (y)
X = cust_data.drop('Churn', axis=1)
y = cust_data['Churn']

# Build and train a machine learning model
# (not shown in this example, but scikit-learn can be used)

Example#5: Product Inventory Management

Example Detail: You have a CSV file representing a product inventory. You want to read the data, track product availability, and create an alert for low-stock items.

# Using the Python pandas lib
import pandas as pd

# Fetch the CSV into a DataFrame
inventory_data = pd.read_csv('inventory_data.csv')

# Find products with low stock levels (e.g., quantity less than 10)
low_stock_products = inventory_data[inventory_data['Quantity'] < 10]
print("Low-Stock Products:\n", low_stock_products)

Example#6: Social Media Analytics

Example Detail: You have a CSV file with social media posts and engagement metrics. You want to read and analyze this data to identify popular posts and trends.

# Setting the Python pandas lib to use
import pandas as pd

# Read the CSV file into a DataFrame
social_media_data = pd.read_csv('social_media_data.csv')

# Find the most liked and shared posts
top_liked_posts = social_media_data.nlargest(5, 'Likes')
top_shared_posts = social_media_data.nlargest(5, 'Shares')

print("Top Liked Posts:\n", top_liked_posts)
print("Top Shared Posts:\n", top_shared_posts)

Example#7: Student Performance Analysis

Example Detail: You have a CSV file with data on student performance, including grades and attendance. You want to read the data and identify factors influencing student performance.

# Load the Python pandas lib
import pandas as pd

# Read the student file into a DataFrame
std_data = pd.read_csv('std_perf_data.csv')

# Calculate the avg grade for each subject
avg_math_grade = std_data['Math Grade'].mean()
avg_science_grade = std_data['Science Grade'].mean()

print("Average Math Grade:", avg_math_grade)
print("Average Science Grade:", avg_science_grade)

These are just a few examples of how Python and Pandas can be used for real-time data analysis in different real-time use cases. In each case, Pandas provides powerful tools for reading, analyzing, and manipulating CSV data to extract valuable insights or perform specific tasks.

Conclusion

In this tutorial, we’ve learned how to read CSV files in Python using the Pandas library. We discussed three methods: pd.read_csv(), pd.read_table(), and pd.read_excel(). Each method has its own strengths and uses cases, as outlined in the comparison table.

If you need to read traditional CSV or TSV files, pd.read_csv() and pd.read_table() are the recommended methods due to their flexibility and ease of use. However, if you work with Excel files, pd.read_excel() is a suitable choice.

If you want us to continue writing such tutorials, support us by sharing this post on your social media accounts like Facebook / Twitter. This will encourage us and help us reach more people.

Happy Coding!