Return dataframe rows for a specific integer search

Question

I would like to return a filtered dataframe that does NOT contain a specific integer, like 2. However, it does need to return rows that have integers like 12, or 22, or 200...etc.

Example:

d = {'num_list': ["1,2,3,10,11,12,13","","4,5,6","11,12,13","2,3,4,12","12,13"]}
searchfor = "2"

df = pd.DataFrame(data=d)

filtered_df = df[~df['num_list'].str.contains(searchfor)]

The dataframe:

                num_list
0      1,2,3,10,11,12,13
1
2                  4,5,6
3               11,12,13
4               2,3,4,12
5                  12,13

Expected result:

                num_list
1
2                  4,5,6
3               11,12,13
5                  12,13

Actual result:

                num_list
1
2                  4,5,6

This code is matching the string "2" which also exists in row 3 and 5. Trying to find the right method to solve this. I'm thinking of changing colum num_list to a list, but I don't know how to filter a dataframe list.

d = {'num_list': [[1,2,3,10,11,12,13],[],[4,5,6],[11,12,13],[2,3,4,12],[12,13]]}
searchfor = 2

df = pd.DataFrome(data=d)

??

The dataframe:

                   num_list
0 [1, 2, 3, 10, 11, 12, 13]
1                        []
2                 [4, 5, 6]
3              [11, 12, 13]
4             [2, 3, 4, 12]
5                  [12, 13]

Is this the right approach? How do I return rows that does not have the specific integer 2 (i.e. return row 1,2,3,5)? Thanks in advance.

Grismar · Accepted Answer · 2019-08-28 00:34:33Z

1

As suggested in this great answer, you can use a mask and the apply function to solve your problem statement.

d = {'num_list': [[1,2,3,10,11,12,13],[],[4,5,6],[11,12,13],[2,3,4,12],[12,13]]}
searchfor = 2
df = pd.DataFrame(data=d)

# Here we create our mask that is essentially a list of True and False for
# each row on which the condition applies. 
mask = df.num_list.apply(lambda x: searchfor not in x)

# Now we can apply the mask to df
df_filtered = df[mask]

Unfiltered DataFrame:

>>> df
                    num_list
0  [1, 2, 3, 10, 11, 12, 13]
1                         []
2                  [4, 5, 6]
3               [11, 12, 13]
4              [2, 3, 4, 12]
5                   [12, 13]

And the result of df_filtered now contains all rows except the ones that consist of the value in searchfor:

>>> df_filtered
    num_list
1            []
2     [4, 5, 6]
3  [11, 12, 13]
5      [12, 13]

edited Aug 28, 2019 at 0:34

Grismar

32.4k6 gold badges42 silver badges68 bronze badges

answered Aug 27, 2019 at 23:28

m_____z

1,60115 silver badges23 bronze badges

Sign up to request clarification or add additional context in comments.

2 Comments

JonJonS Over a year ago

When reading in the dataframe from a file, I also had to convert num_list column from a string to a list and I found this handy. link

m_____z Over a year ago

Great, thanks for sharing! If my answer worked please don't forget to accept it :)

Collectives™ on Stack Overflow

Return dataframe rows for a specific integer search

1 Answer 1

2 Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

2 Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related