Filter similar rows based on timestamp as index in a dataframe

Question

I have a dataframe with timestamp as index. I want to filter out the rows with similar timestamp and print it out. For example,

                        Value_1  Value_2
timestamp                                           
2022-03-22 17:31:02     23        30    
2022-03-22 17:31:02     25        40
2022-03-22 17:31:04     24        0.2   
2022-03-22 17:31:05     21        90    
2022-03-22 17:31:05     20        0.1

I want to filter out the rows with similar timestamps as shown below.

                        Value_1  Value_2
timestamp                                           
2022-03-22 17:31:02     23        30    
2022-03-22 17:31:02     25        40
2022-03-22 17:31:05     21        90    
2022-03-22 17:31:05     20        0.1

I tried using melt and groupby. It does not give me the desired results. Could someone help me with it?

Thanks.

Shubham Sharma · Accepted Answer · 2022-03-22 16:32:26Z

2

We can use index.duplicated with parameter keep=False(meaning if there is a duplicate value then mark all occurrence of that duplicate value to True)

df[df.index.duplicated(keep=False)]

                     Value_1  Value_2
timestamp                            
2022-03-22 17:31:02       23     30.0
2022-03-22 17:31:02       25     40.0
2022-03-22 17:31:05       21     90.0
2022-03-22 17:31:05       20      0.1

answered Mar 22, 2022 at 16:32

Shubham Sharma

71.8k6 gold badges26 silver badges58 bronze badges

Sign up to request clarification or add additional context in comments.

Comments

user17242583 · Accepted Answer · 2022-03-22 16:40:57Z

0

You can also use groupby + filter:

filtered_df = df.groupby(level=0).filter(lambda x: len(x) > 1)

Output:

>>> filtered_df
                     Value_1  Value_2
timestamp                            
2022-03-22 17:31:02       23     30.0
2022-03-22 17:31:02       25     40.0
2022-03-22 17:31:05       21     90.0
2022-03-22 17:31:05       20      0.1

answered Mar 22, 2022 at 16:40

user17242583

Collectives™ on Stack Overflow

Filter similar rows based on timestamp as index in a dataframe

2 Answers 2

Comments

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

Comments

Comments

Your Answer

Sign up or log in

Post as a guest

Related