csvtools

csvtools copied to clipboard

cvsgrep : pattern based on column indexes

1

As of now `csvgrep` only supports column names as pattern key. This PR adds support for column indexes. I did not went for a new option (aka -P) as it...

stf8

Sort huge CSV by 7th column

1

I would like to sort a 300 MB CSV with a header (https://data.open-power-system-data.org/renewable_power_plants/2018-03-08/renewable_power_plants_DE.csv) by it's 7th column _electrical_capacity_ which contains numerical values: ``` 0.075 0.02937 0.4 0.303 ``` How could...

baerbock

csvlook implementation

7

Add ability to space out columns so they are easy to look at. For delight: cat file.csv | csvcut -K 0,1 | csvlook

kadwanev

Use [reservoir sampling](https://en.wikipedia.org/wiki/Reservoir_sampling) to randomly keep N rows in a streaming fashion. Print them in the end. Implementation should be fairly simple, reuse the `csv_tokenizer` and (sadly) allocate memory for...

DavyLandman

csvlook implementation

6

Great stuff! What are your thoughts on a csvlook implementation? I imagine it would read the first 100 rows or so and find out the max length of each column...

kadwanev

add a csvunawk to handle `print $0` which still has the `\x1F` record separator in the string

1

Perhaps an option to the `csvawk` to process to output to revert the `\x1F` back to the normal separator in case the awk command outputs original lines (instead of a...

DavyLandman

DavyLandman

DavyLandman

csvawk might have a buffer overflow (says `-Wp,-D_FORTIFY_SOURCE=3`)

3

Steps to reproduce: ```sh $ cd /tmp $ git clone https://github.com/DavyLandman/csvtools.git Cloning into 'csvtools'... remote: Enumerating objects: 1418, done. remote: Counting objects: 100% (7/7), done. remote: Compressing objects: 100% (5/5),...

lucaswerkmeister