Checking the Number of Rows and Columns in Pandas

Pandas is a powerful data manipulation library in Python, widely used for data analysis and data cleaning tasks. One of the most fundamental operations when working with a Pandas DataFrame is to check the number of rows and columns. Understanding the dimensions of your data is crucial as it helps in validating data integrity, planning data processing steps, and ensuring that your analysis is performed on the correct dataset. In this blog post, we will explore different ways to check the number of rows and columns in a Pandas DataFrame, along with core concepts, typical usage, common practices, and best practices.

Table of Contents#

  1. Core Concepts
  2. Typical Usage Methods
  3. Common Practices
  4. Best Practices
  5. Code Examples
  6. Conclusion
  7. FAQ
  8. References

Core Concepts#

DataFrame#

A DataFrame in Pandas is a two-dimensional labeled data structure with columns of potentially different types. It is similar to a spreadsheet or a SQL table. Each column in a DataFrame can be thought of as a Pandas Series. When we talk about checking the number of rows and columns in a DataFrame, we are essentially looking at the shape of this two - dimensional structure.

Shape Attribute#

The shape attribute of a Pandas DataFrame is a tuple that contains two elements. The first element represents the number of rows, and the second element represents the number of columns. For example, if a DataFrame df has 100 rows and 5 columns, df.shape will return (100, 5).

Typical Usage Methods#

Using the shape Attribute#

The most straightforward way to check the number of rows and columns in a Pandas DataFrame is by using the shape attribute. Here is a simple example:

import pandas as pd
 
# Create a sample DataFrame
data = {'Name': ['Alice', 'Bob', 'Charlie'],
        'Age': [25, 30, 35]}
df = pd.DataFrame(data)
 
# Get the number of rows and columns
rows, columns = df.shape
 
print(f"Number of rows: {rows}")
print(f"Number of columns: {columns}")

In this code, we first create a sample DataFrame with two columns (Name and Age) and three rows. Then we unpack the shape tuple into two variables rows and columns and print them.

Using the len() Function#

We can also use the built - in len() function to get the number of rows. The len() function returns the number of elements in an object. When applied to a DataFrame, it returns the number of rows. To get the number of columns, we can use the columns attribute of the DataFrame and apply the len() function to it.

import pandas as pd
 
# Create a sample DataFrame
data = {'Name': ['Alice', 'Bob', 'Charlie'],
        'Age': [25, 30, 35]}
df = pd.DataFrame(data)
 
# Get the number of rows
rows = len(df)
 
# Get the number of columns
columns = len(df.columns)
 
print(f"Number of rows: {rows}")
print(f"Number of columns: {columns}")

Common Practices#

Data Validation#

Before performing any data analysis or processing, it is a common practice to check the number of rows and columns to ensure that the data has the expected dimensions. For example, if you are expecting a dataset with 1000 rows and 5 columns, you can add a validation step in your code to check if the actual DataFrame has these dimensions.

import pandas as pd
 
# Create a sample DataFrame
data = {'Name': ['Alice', 'Bob', 'Charlie'],
        'Age': [25, 30, 35]}
df = pd.DataFrame(data)
 
expected_rows = 3
expected_columns = 2
 
rows, columns = df.shape
 
if rows == expected_rows and columns == expected_columns:
    print("Data has the expected dimensions.")
else:
    print("Data does not have the expected dimensions.")

Monitoring Data Changes#

When performing data cleaning or transformation operations, it is important to monitor the changes in the number of rows and columns. For example, if you are removing rows with missing values, you can check the number of rows before and after the operation to see how many rows were removed.

import pandas as pd
import numpy as np
 
# Create a sample DataFrame with missing values
data = {'Name': ['Alice', 'Bob', np.nan],
        'Age': [25, np.nan, 35]}
df = pd.DataFrame(data)
 
rows_before = len(df)
df = df.dropna()
rows_after = len(df)
 
print(f"Number of rows before dropping missing values: {rows_before}")
print(f"Number of rows after dropping missing values: {rows_after}")

Best Practices#

Use the shape Attribute#

In most cases, using the shape attribute is the best practice as it is more concise and efficient. It provides both the number of rows and columns in a single operation.

Error Handling#

When validating data dimensions, it is a good practice to add appropriate error handling. For example, if the data does not have the expected dimensions, you can raise a custom exception or log an error message.

import pandas as pd
 
# Create a sample DataFrame
data = {'Name': ['Alice', 'Bob', 'Charlie'],
        'Age': [25, 30, 35]}
df = pd.DataFrame(data)
 
expected_rows = 3
expected_columns = 2
 
rows, columns = df.shape
 
if rows != expected_rows or columns != expected_columns:
    raise ValueError(f"Data does not have the expected dimensions. Expected {expected_rows} rows and {expected_columns} columns, but got {rows} rows and {columns} columns.")
else:
    print("Data has the expected dimensions.")

Code Examples#

Complete Example with Different Methods#

import pandas as pd
 
# Create a sample DataFrame
data = {'Name': ['Alice', 'Bob', 'Charlie'],
        'Age': [25, 30, 35],
        'City': ['New York', 'Los Angeles', 'Chicago']}
df = pd.DataFrame(data)
 
# Method 1: Using shape attribute
rows1, columns1 = df.shape
print(f"Method 1: Number of rows: {rows1}, Number of columns: {columns1}")
 
# Method 2: Using len() function
rows2 = len(df)
columns2 = len(df.columns)
print(f"Method 2: Number of rows: {rows2}, Number of columns: {columns2}")

Conclusion#

Checking the number of rows and columns in a Pandas DataFrame is a fundamental operation in data analysis. We can use the shape attribute or the len() function to achieve this. Understanding these methods and following best practices such as data validation and error handling can help us write more robust and reliable data analysis code.

FAQ#

Q1: Can I use the shape attribute on a Pandas Series?#

A1: Yes, you can use the shape attribute on a Pandas Series. However, a Series is a one - dimensional object, so the shape tuple will have only one element, which represents the number of elements in the Series.

Q2: Which method is faster, using the shape attribute or the len() function?#

A2: In general, using the shape attribute is faster as it is a direct attribute access operation. The len() function needs to call the __len__() method of the object, which may involve some additional overhead.

References#

2025-10