Handling Larger size datasets

Open yigitcancomlek opened this issue 2 years ago • 1 comments

Hello!

Thank you very much for providing this tool!

Is it possible to use any csv files that are more than 10MB in size? Is there a work around to handle larger datafiles (~500MB). Thank you very much in advance for your help!

Oct 13 '23 19:10 yigitcancomlek

Hi @yigitcancomlek，

Sure, the 10MB limit is due to the widgets interface.

PiML can handle larger data by pandas dataframe, see the user guide in https://selfexplainml.github.io/PiML-Toolbox/_build/html/guides/data/data_load.html#external-dataset.

Oct 14 '23 08:10 ZebinYang