Python Pandas: dtypes not show column types for all columns
Question:
I have a csv data file with 101 columns and I would like to see the type for each column. I use
dat=pandas.read_csv("try.csv")
dat.dtypes
It returns only first and last 15 columns with types. All other columns are truncated. And there is … in between
I wonder how can I see types for all columns?
Thanks a lot!
Answers:
You are seeing a truncated output because pandas is protecting you from printing reams of information in the output. You can override this:
pd.set_option('display.max_rows', 120)
The default setting is 60
A list can be found here: http://pandas.pydata.org/pandas-docs/stable/options.html
and also related: List of pandas options for method set_option
I think a good way is this
dat.info(verbose=True)
as suggested in this post.
I think it is better than the solution of EdChum since it does not force you to change the default display setting
I think this is better way when in Jupyter notebook,
from IPython.display import HTML
HTML(pd.DataFrame(dat.dtypes).to_html()
I have a csv data file with 101 columns and I would like to see the type for each column. I use
dat=pandas.read_csv("try.csv")
dat.dtypes
It returns only first and last 15 columns with types. All other columns are truncated. And there is … in between
I wonder how can I see types for all columns?
Thanks a lot!
You are seeing a truncated output because pandas is protecting you from printing reams of information in the output. You can override this:
pd.set_option('display.max_rows', 120)
The default setting is 60
A list can be found here: http://pandas.pydata.org/pandas-docs/stable/options.html
and also related: List of pandas options for method set_option
I think a good way is this
dat.info(verbose=True)
as suggested in this post.
I think it is better than the solution of EdChum since it does not force you to change the default display setting
I think this is better way when in Jupyter notebook,
from IPython.display import HTML
HTML(pd.DataFrame(dat.dtypes).to_html()