Getting a long list of specific elements from a list of indexes and column coordinates in Pandas Question: data=pd.DataFrame([[1,2,3],[21,23,24],[31,32,33]]) i=[0,1,2] # this is same as the index y=[1,2,0] data.iloc[x,y] gives me a 3×3 df, which I do not need. I need to run this on a large df and would like to get the ELEMENTS …
How do I find out what parts of my code are inefficient in Python Question: On a previous question I was asking about multiprocessing, using multiple cores to make a program run faster, and someone told me this: More often than not, you can get a 100x+ optimization with better code compared to a 4x …
Why does concatenation of DataFrames get exponentially slower? Question: I have a function which processes a DataFrame, largely to process data into buckets create a binary matrix of features in a particular column using pd.get_dummies(df[col]). To avoid processing all of my data using this function at once (which goes out of memory and causes iPython …
