fsttable

fsttable copied to clipboard

Is this package still being maintained?

2

Seems like a great package for handling large datasets.

waynelapierre

rbind/cbind two fsttable object or a fsttable with a data.frame or data.table

3

I would like to rbind two fsttable objects or a single fsttable with data.frame. What would be the preferred method? ``` library(fsttable) library(data.table) ft1

akrun1

Feature request: conditional select doesn't work

3

``` library(fsttable) nr_of_rows

ssh352

For example, we can have a `fst_remote` package that implements the _fst_ format as a _remote table_. That structure could be easily modified to have the `fst_remote` package running on...

MarcusKlik

Three layer interface

4

After some tweaking, the design is now as follows: * The _data_table_interface_ class (defined [here](../blob/develop/R/data_table_interface.R)) acts as a wrapper around the controller object of class _table_proxy_ (defined [here](../blob/develop/R/table_proxy.R)). * The...

MarcusKlik

Some operations might require temporary files. For example, a large _slice map_ or a newly created column can be stored in an additional `fst` file. When these potentially large temp...

MarcusKlik

fsttable should gracefully handle the deletion/modification of the file it refers to

1

The table object should determine when the file it points to is deleted. At a minimum, this should happen when a query arrives that requires reading from disk, so that...

martinblostein

Parsing the j argument requires 'computing on the language'

5

But it will not be _evaluated_ like in `data.table`. That's because the _datatableinterface_ object doesn't really contain any data, but just references to on-disk data. So we can't actually evaluate...

MarcusKlik

A _table proxy_ has a specific state. That state reflects the current table that it represents. But no actual data is read until necessary, so the state is a collection...

MarcusKlik

Move state-update ability from `datatableinterface` into `table_proxy`

9

Currently the `datatableinterface` inherits from `data.table`, and stores its `table_proxy` object in a `data.table` cell. This allows the `table_proxy` object to be updated in-place. I believe this functionality should be...

martinblostein