Category "pandas"

Add missing dates to pandas dataframe

My data can have multiple events on a given date or NO events on a date. I take these events, get a count by date and plot them. However, when I plot them, my

Find a pattern in middle of multiple sentences

I have a dataframe as below, data = [ [ 1, 'AR-123456' ], [ 1, '123456' ], [ 2, '345678' ], [ 3,'Application-12345678901'], [ 3, '1234567890

Trying to find a graph in matplotlib

I have data that show the difference of temperatures from 1955 to 2020 from an average. I want to make a graph in matplotlib that looks like this: It shows tem

How do I use pandas to compare a list of numbers to a column in an excel document?

I have this simple script that creates a list by taking the values out of the column of excel_1 and compares it to the values of a column in excel_2. I want it

Pandas group by one column and repeat the values of another column

I was trying to divide the month into two weeks. Basically for each month i am trying to create week numbers like 1,2,3,4 and repeat them. How to create the req

Append nanosecond to millisecond Python datetime object

I am trying to append nanoseconds to an already existing millisecond datetime pandas object. So, for instance, I already have 08:02:36.715647 which reports upti

Dataframe is Offset by -1 Days From Source Data

I am using a connector to query some tables in Dynamics 365 Business Central and when I view my dataframe all of my dates are offset by -1 days. I generated a l

Removing Non-English Words from CSV - NLTK

I am relatively new to Python and NLTK and have a hold of Flickr data stored in CSV and want to remove non-english words from the tags column. I keep getting er

How to obtain all gaps as start .. stop interval in pandas datetime index

I want to find all gaps in pandas DateTime index as a list of intervals. For example: '2022-05-06 00:01:00' '2022-05-06 00:02:00' <- Start of gap '2022-05

Split translation results with pandas in Google Colab

Hi everyone I'm doing a traslation of words in csv/excel files using Google Colab and Pandas here is my code: import pandas as pd from googletrans import Transl

Use rows values from a pandas dataframe as new columns label

If I have a pandas dataframe it's possible to get values from a row and use it as a label for a new column? I have something like this: | Team| DateTime| Score

How to count number of events in a dataframe before and after a given date?

I'm trying to identify individuals who have events before or after events of their first occurrence of an event of a specific type. For example, I'm interested

How to plot data in panda dateframe to histogram?

I have a dataset containing various fields of users, like dates, like count etc. I am trying to plot a histogram which shows like count with respect to date, ho

Pandas DataFrame : How to groupby and sort "by blocks"?

I'm working with a DataFrame containing data as follows, and group the data two different ways. >>> d = { "A": [100]*7 + [200]*7, "B": ["one"

to_string(index = False) results in non empty string even when dataframe is empty

I am doing the following in my python script and I want to hide the index column when I print the dataframe. So I used .to_string(index = False) and then use le

How to assert that sum of two series is equal to sum of another two series

Let's say I have 4 series objects: ser1=pd.Series(data={'a':1,'b':2,'c':NaN, 'd':5, 'e':50}) ser2=pd.Series(data={'a':4,'b':NaN,'c':NaN, 'd':10, 'e':100}) ser3=

slicing with .loc in pandas

I was reading the book - "Python for Data Analysis" and doing code side-by-side on Jupiter notebook. Here is my DataFrame named data : one t

How to join all columns in dataframe? [duplicate]

I would like one column to have all the other columns in the data frame combined. here is what the dataframe looks like 0 1 2 0 123 321

Append column of arrays in Pandas

I have a dataframe of arrays such as: | A | B | C | |:---- |:------:| -----:| | [0,1,2,3] | [1,2,5,6] | [0,1,4,5] | | [0,0,6,3] | [0,2,0,4] | [3,8,7,1]

Pandas: Creating multiple indicator columns after condition with dates

So I have a data set with about 70,000 data points, and I'm trying to test out some code on a sample data set to make sure it will work on the large one. The sa