Geek asks and answers

Pandas Lock Alerts

At startup:

mydf = pd.read_csv(p_file, sep=',', error_bad_lines=False, index_col=False)

I get a lot of lines as below:

...
Skipping line 77432: expected 15 fields, saw 16
Skipping line 77497: expected 15 fields, saw 16
Skipping line 77528: expected 15 fields, saw 16
Skipping line 77560: expected 15 fields, saw 16
Skipping line 77625: expected 15 fields, saw 16
Skipping line 77656: expected 15 fields, saw 16
...

How can I turn off these warnings? How to find a list of warning classes in Pandas?

+3
source share
1 answer

Looks like read_csv has a warning_bad_lines kwarg, so you should be able to do the following:

mydf = pd.read_csv(p_file, sep=',', error_bad_lines=False, index_col=False, warn_bad_lines=False)

http://pandas.pydata.org/pandas-docs/stable/generated/pandas.read_csv.html#pandas.read_csv

"If error_bad_lines is False and warn_bad_lines is True, a warning will be issued for each" bad line ". (Valid only with a C-parser).

+6
source

More articles:


All Articles