Pandas: Return Hour from Datetime Column Directly

Question

Assume I have a DataFrame sales of timestamp values:

timestamp               sales_office
2014-01-01 09:01:00     Cincinnati
2014-01-01 09:11:00     San Francisco
2014-01-01 15:22:00     Chicago
2014-01-01 19:01:00     Chicago

I would like to create a new column time_hour. I can create it by writing a short function as so and using apply() to apply it iteratively:

def hr_func(ts):
    return ts.hour

sales['time_hour'] = sales['timestamp'].apply(hr_func)

I would then see this result:

timestamp               sales_office         time_hour
2014-01-01 09:01:00     Cincinnati           9
2014-01-01 09:11:00     San Francisco        9
2014-01-01 15:22:00     Chicago              15
2014-01-01 19:01:00     Chicago              19

What I’d like to achieve is some shorter transformation like this (which I know is erroneous but gets at the spirit):

sales['time_hour'] = sales['timestamp'].hour

Obviously the column is of type Series and as such doesn’t have those attributes, but it seems there’s a simpler way to make use of matrix operations.

Is there a more-direct approach?

Asked By: Daniel Black

||

Source

Answer 1

You can use a lambda expression, e.g:

sales['time_hour'] = sales.timestamp.apply(lambda x: x.hour)

Answered By: Bob Hannon

Answer 2

Assuming timestamp is the index of the data frame, you can just do the following:

hours = sales.index.hour

If you want to add that to your sales data frame, just do:

import pandas as pd
pd.concat([sales, pd.DataFrame(hours, index=sales.index)], axis = 1)

Edit:
If you have several columns of datetime objects, it’s the same process. If you have a column [‘date’] in your data frame, and assuming that ‘date’ has datetime values, you can access the hour from the ‘date’ as:

hours = sales['date'].hour

Edit2:
If you want to adjust a column in your data frame you have to include dt:

sales['datehour'] = sales['date'].dt.hour

Answered By: Sudipta Basak

Answer 3

For posterity: as of 0.15.0, there is a handy .dt accessor you can use to pull such values from a datetime/period series (in the above case, just sales.timestamp.dt.hour!

Answered By: iff_or

Answer 4

You can try this:

sales['time_hour'] = pd.to_datetime(sales['timestamp']).dt.hour

Answered By: TCO

Answer 5

Here is a simple solution:

import pandas as pd
# convert the timestamp column to datetime
df['timestamp'] = pd.to_datetime(df['timestamp'])

# extract hour from the timestamp column to create an time_hour column
df['time_hour'] = df['timestamp'].dt.hour

Answered By: DINA TAKLIT

Answer 6

Since the quickest, shortest answer is in a comment (from Jeff) and has a typo, here it is corrected and in full:

sales['time_hour'] = pd.DatetimeIndex(sales['timestamp']).hour

Answered By: Idiot Tom

Answer 7

Now we can use:

sales['time_hour'] = sales['timestamp'].apply(lambda x: x.hour)

Answered By: VICTOR ACOSTA

Answer 8

You could also create a function where, if needed, you could also extract month, year, etc. but ‘timestamp’ must be the index.

for i in range(len(sales)):
  position = sales.index[i]
  hour = position.hour
  month = position.month
  sales.loc[position, 'hour'] = hour
  sales.loc[position, 'month'] = month

Answered By: Trrmis

Pandas: Return Hour from Datetime Column Directly

Question:

Answers: