Unable to parse CSV files using pandas

Question

What I am trying to do is parse a lot of csv files using a for loop and append it into a single sheet. But the error related to pandas package keeps coming up after it parses a few files.

for file in files:
   data = pd.read_csv(file,encoding='iso-8859-1')
   print(data)
...

CSV File

Filesystem      Size  Used Avail Use% Mounted on
0          /dev/sda3       192G   24G  168G  13% /
1  /dev/sda1       512M  7.5M  505M   2% /boot/efi
  Filesystem      Size  Used Avail Use% Mounted on
0          /dev/sda1       200G  101G  100G  51% /
1       /dev/sdd1        50G   33M   50G   1% /u03
2        /dev/sdf1       400G   33M  400G   1% /wa
3       /dev/sde1       300G  230G   71G  77% /edi
4       /dev/sdb1        50G   33M   50G   1% /u01
5      /dev/sdg1        50G   11G   37G  22% /swap
6       /dev/sdc1        50G   33M   50G   1% /u02
  Filesystem      Size  Used Avail Use% Mounted on
0          /dev/sda1       200G   15G  186G   8% /
1       /dev/sdb1       300G  195G  106G  65% /u01
2   /dev/sdc1       100G   71G   30G  71% /opt/IBM
  Filesystem      Size  Used Avail Use% Mounted on
0          /dev/sda1       200G   14G  187G   7% /
1   /dev/sdb1       100G   66G   34G  66% /opt/IBM
2       /dev/sdc1       300G  158G  142G  53% /u01
  Filesystem      Size  Used Avail Use% Mounted on
0          /dev/sda1       200G  9.3G  191G   5% /
1       /dev/sdc1       100G   18G   83G  18% /u01
2   /dev/sdb1       150G   49G  102G  33% /opt/IBM

Output Error

Traceback (most recent call last):
  File "<pyshell#95>", line 2, in <module>
    data = pd.read_csv(file,encoding='iso-8859-1')
  File "C:Users102712AppDataLocalProgramsPythonPython311Libsite-packagespandasutil_decorators.py", line 211, in wrapper
    return func(*args, **kwargs)
  File "C:Users102712AppDataLocalProgramsPythonPython311Libsite-packagespandasutil_decorators.py", line 331, in wrapper
    return func(*args, **kwargs)
  File "C:Users102712AppDataLocalProgramsPythonPython311Libsite-packagespandasioparsersreaders.py", line 950, in read_csv
    return _read(filepath_or_buffer, kwds)
  File "C:Users102712AppDataLocalProgramsPythonPython311Libsite-packagespandasioparsersreaders.py", line 605, in _read
    parser = TextFileReader(filepath_or_buffer, **kwds)
  File "C:Users102712AppDataLocalProgramsPythonPython311Libsite-packagespandasioparsersreaders.py", line 1442, in __init__
    self._engine = self._make_engine(f, self.engine)
  File "C:Users102712AppDataLocalProgramsPythonPython311Libsite-packagespandasioparsersreaders.py", line 1753, in _make_engine
    return mapping[engine](f, **self.options)
  File "C:Users102712AppDataLocalProgramsPythonPython311Libsite-packagespandasioparsersc_parser_wrapper.py", line 79, in __init__
    self._reader = parsers.TextReader(src, **kwds)
  File "pandas_libsparsers.pyx", line 554, in pandas._libs.parsers.TextReader.__cinit__
pandas.errors.EmptyDataError: No columns to parse from file

So far, I have tried specifying the encoding while reading the csv file, but nothing has changed.

So far, I have tried specifying the encoding while reading the csv file as I found it to be the most common cause of these type of problems but it still failed after reading the first few files.

The data is similar to the first few files that were able to be parsed.

Asked By: soumya sahu

||

Source

Answer 1

There is an empty file you are trying to parse.

import os
#
#
#
for file in files:
   if os.path.getsize(file) > 0:
       data = pd.read_csv(file,encoding='iso-8859-1')
       print(data)

Answered By: geekay

Unable to parse CSV files using pandas

Question:

Answers: