o d!@spddlmZddlmZddlmZddlmZddlZ ddlm Z ddl m Z ddl mZGd d d eZdS) ) annotations) ReadBuffer)import_optional_dependency) is_integerN) DataFrame)_arrow_dtype_mapping) ParserBasecsHeZdZdZdfdd Zdd Zdd d ZdddZdddZZ S)ArrowParserWrapperz7 Wrapper for the pyarrow engine for read_csv() srcReadBuffer[bytes]returnNonec s$t|||_||_|dS)N)super__init__kwdsr _parse_kwds)selfr r __class__k/var/www/html/visualizacion-main/env/lib/python3.10/site-packages/pandas/io/parsers/arrow_parser_wrapper.pyrs  zArrowParserWrapper.__init__cCsf|jd}|dur dn||_||jd\|_|_|jd}t|tr)tdt |jd|_ dS)z? Validates keywords before passing to pyarrow. encodingNzutf-8usecols na_valuesz?The pyarrow engine doesn't support passing a dict for na_values) rgetr_validate_usecols_argr usecols_dtype isinstancedict ValueErrorlistr)rrrrrrrs   zArrowParserWrapper._parse_kwdscCsdddddd}|D]\}}||jvr&|j|dur&|j||j|<q dd |jD|_d d |jD|_|jdu|jdurI|jn|jd |jd |_dS) z: Rename some arguments to pass to pyarrow include_columns null_values escape_charignore_empty_lines decimal_point)rr escapecharskip_blank_linesdecimalNcS&i|]\}}|dur|dvr||qS)N) delimiter quote_charr#r$r.0 option_name option_valuerrr ;z;ArrowParserWrapper._get_pyarrow_options..cSr))N)r!r" true_values false_valuesr%rr,rrrr0Br1skiprows)autogenerate_column_names skip_rowsr) itemsrrpop parse_optionsconvert_optionsheaderr read_options)rmapping pandas_name pyarrow_namerrr_get_pyarrow_options,s, z'ArrowParserWrapper._get_pyarrow_optionsframerc CsXt|j}d}|jdur7|jdur|jdurt||_t|j|kr3tt|t|j|j|_d}|j|_||j|\|_}|jdurt|jD]\}}t |r\|j||j|<qK||jvrit d|dqK|j |jddd|jdur|sdgt|j j|j _|j ddurz ||j d}W|Sty}zt |d}~ww|S)z Processes data read in based on kwargs. Parameters ---------- frame: DataFrame The DataFrame to process. Returns ------- DataFrame The processed DataFrame. TNFzIndex z invalid)dropinplacedtype)lencolumnsr;namesranger _do_date_conversions index_col enumeraterr set_indexindexrrastype TypeError)rrAnum_colsmulti_index_namediitemerrr_finalize_pandas_outputWs<       z*ArrowParserWrapper._finalize_pandas_outputcCstd}||j|j|jdi|j|jdi|j|jdi|j d}|j ddkr6|j t j d}n|j ddkrF|j tjd}n| }||S) z Reads the contents of a CSV file into a DataFrame and processes it according to the kwargs passed in the constructor. Returns ------- DataFrame The DataFrame created from the CSV file. z pyarrow.csv)r<r9r: dtype_backendpyarrow) types_mappernumpy_nullableNr)rr@read_csvr ReadOptionsr< ParseOptionsr9ConvertOptionsr:r to_pandaspd ArrowDtyperrrU)r pyarrow_csvtablerArrrreads  zArrowParserWrapper.read)r r r r )r r )rArr r)r r) __name__ __module__ __qualname____doc__rrr@rUrc __classcell__rrrrr s  +3r ) __future__rpandas._typingrpandas.compat._optionalrpandas.core.dtypes.inferencerpandasr_rpandas.io._utilrpandas.io.parsers.base_parserrr rrrrs