Check if String Contains Part of String in List with Pandas

In data analysis and manipulation using Python, the Pandas library is a powerful tool. One common task is to check if a string in a Pandas Series or DataFrame column contains any part of the strings in a given list. This operation can be useful in various scenarios, such as data cleaning, filtering, and categorization. For example, you might have a dataset of product names and want to filter out products that contain certain keywords from a predefined list.

Table of Contents#

  1. Core Concepts
  2. Typical Usage Method
  3. Common Practice
  4. Best Practices
  5. Code Examples
  6. Conclusion
  7. FAQ
  8. References

Core Concepts#

Pandas Series#

A Pandas Series is a one - dimensional labeled array capable of holding data of any type (integer, string, float, etc.). It is similar to a column in a spreadsheet. When working with string data, we can use various string methods provided by Pandas to perform operations on the series.

String Containment#

The idea of string containment is to check if a given string has another string as a substring. In our case, we want to check if each string in a Pandas Series contains any of the strings from a given list.

Regular Expressions#

Regular expressions are a sequence of characters that form a search pattern. Pandas provides the str.contains() method which can use regular expressions to perform more complex string matching. We can use regular expressions to combine the strings in the list and check for their presence in the series.

Typical Usage Method#

The main method used to check if a string contains part of a string in a list in Pandas is the str.contains() method. This method is available for Pandas Series objects.

The basic syntax is:

series.str.contains(pat, case=True, flags=0, na=nan, regex=True)
  • pat: The pattern to search for. This can be a simple string or a regular expression.
  • case: If True, the search is case - sensitive. If False, it is case - insensitive.
  • flags: Additional flags to pass to the regular expression engine.
  • na: Value to be set for missing values.
  • regex: If True, the pattern is treated as a regular expression.

Common Practice#

  1. Combining Strings in the List: To check if a string contains any part of the strings in a list, we first need to combine the strings in the list into a single regular expression pattern. We can use the | (or) operator in regular expressions to achieve this.
  2. Handling Missing Values: It is important to handle missing values (NaN) in the series. We can set the na parameter in the str.contains() method to handle these cases.

Best Practices#

  1. Case Sensitivity: Decide whether the search should be case - sensitive or not based on your requirements. If the case does not matter, set case=False to simplify the search.
  2. Testing Regular Expressions: Before applying a regular expression pattern to a large dataset, test it on a small sample to ensure it works as expected.
  3. Error Handling: Be aware of potential errors when working with regular expressions, such as invalid patterns.

Code Examples#

Example 1: Basic Usage#

import pandas as pd
 
# Create a sample series
series = pd.Series(['apple pie', 'banana smoothie', 'cherry tart'])
# List of strings to check for
check_list = ['apple', 'cherry']
 
# Combine the strings in the list into a regular expression pattern
pattern = '|'.join(check_list)
 
# Check if each string in the series contains any part of the strings in the list
result = series.str.contains(pattern)
 
print(result)

In this example, we first create a sample Pandas Series and a list of strings to check for. We then combine the strings in the list using the | operator to create a regular expression pattern. Finally, we use the str.contains() method to check if each string in the series contains any part of the strings in the list.

import pandas as pd
 
# Create a sample series
series = pd.Series(['Apple Pie', 'banana smoothie', 'Cherry Tart'])
# List of strings to check for
check_list = ['apple', 'cherry']
 
# Combine the strings in the list into a regular expression pattern
pattern = '|'.join(check_list)
 
# Perform a case - insensitive search
result = series.str.contains(pattern, case=False)
 
print(result)

Here, we set case=False in the str.contains() method to perform a case - insensitive search.

Example 3: Handling Missing Values#

import pandas as pd
import numpy as np
 
# Create a sample series with missing values
series = pd.Series(['apple pie', np.nan, 'cherry tart'])
# List of strings to check for
check_list = ['apple', 'cherry']
 
# Combine the strings in the list into a regular expression pattern
pattern = '|'.join(check_list)
 
# Handle missing values by setting na=False
result = series.str.contains(pattern, na=False)
 
print(result)

In this example, we have a series with a missing value. We set na=False in the str.contains() method to handle the missing value.

Conclusion#

Checking if a string contains part of a string in a list using Pandas is a common and useful operation in data analysis. By using the str.contains() method and regular expressions, we can efficiently perform this check on Pandas Series objects. It is important to handle case sensitivity and missing values appropriately to get accurate results.

FAQ#

Q: What if the list contains special characters? A: If the list contains special characters, you need to escape them properly in the regular expression pattern. You can use the re.escape() function to escape the special characters.

Q: Can I use this method on a DataFrame column? A: Yes, you can use the str.contains() method on a DataFrame column, which is essentially a Pandas Series. For example, df['column_name'].str.contains(pattern).

Q: What if I want to find the exact match instead of a partial match? A: You can modify the regular expression pattern to use word boundaries (\b). For example, if you want to find the exact match of 'apple', you can use the pattern r'\bapple\b'.

References#

2025-10