PySUS

PySUS copied to clipboard

Unable to concatenate parquet files to dataframe. > disease dengue > year 2020 https://github.com/AlertaDengue/PySUS/blob/master/pysus/tests/test_data/test_sinan.py#L43 ``` 48 DENGBR20.parquet/6d35585c41984b459cc3f72986f9aa6c-0.parquet 49 DENGBR20.parquet/f1d9168f79e1431a933faa433859c305-0.parquet 50 DENGBR20.parquet/5d8a203ccca04e87b12c5ef465a4d32d-0.parquet Killed pysus/tests/test_data/test_sinan.py::TestSINANDownload::test_chunked_df_size Killed ``` Reproduce the error: ``` fn...

esloch

- Closes #90.

esloch

``` pysus/tests/test_cnes.py::CNESTestCase::test_fetch_estabelecimentos FAILED pysus/tests/test_init.py::TestInitFunctions::test_last_update pysus/tests/test_sim.py::TestDecoder::test_group_and_count FAILED pysus/tests/test_sim.py::TestDecoder::test_redistribute_missing FAILED pysus/tests/test_utilities.py::TestReadDbc::test_read_dbc FAILED pysus/tests/test_utilities.py::TestReadDbc::test_read_dbc_dbf FAILED pysus/tests/test_data/test_sinan.py::TestSINANDownload::test_filename_only FAILED ```

esloch

Build conda packages for Windows and OSX

1

fccoelho

Excessive memory consumption during SIA-PA download

10

There are some SIA-PA files wich are huge and it seems that converting from dbc to parquet is consuming too much memory. Although the following example is somehow related to...

heber-augusto

Update README

1

- Add *CONDA* usage in settings to development environment - Add use of make commands to deploy jupyter in container

esloch

Update download method of SIA data for PA

2

Currently, DBC files of SIA data for PA have prefixes a,b and c. The following image show that:  So, the download method ```pysus.online_data.SIA.download( estado, ano, mes )``` is outdated.

alfonso777

Add Support to Other tables of SIA

1

SIA contains other available tables which can be made available through PySUS. I propose to add a new parameter to the download function of the SIA module, allowing the user...

fccoelho

It should be very easy to add support for downloading data from the Infodengue API. The `Alerta` tables would be of particular interest to the community.

fccoelho

Refactor FTP operations to a single function

3

Many of our modules replicate basic ftp file retrieval operations We should remove all the duplication of code by creating a single function for retrieving files through FTP. this function...

fccoelho