Daoyuan Chen

as the title says. Please double check the modifications related to MF. Thanks @rayrayraykk @DavdGao

support - using cached data for huggingface datasets; - re-splitting the GLUE versions into custom FL versions

As the title says, fix #186

[Feature Request] Implement more streamlined interfaces for users seeking minimal functionality (data_juicer.op.functional)

3

### Search before continuing 先搜索，再继续 - [X] I have searched the Data-Juicer issues and found no similar feature requests. 我已经搜索了 Data-Juicer 的 issue 列表但是没有发现类似的功能需求。 ### Description 描述 This proposal is...

### Search before continuing 先搜索，再继续 - [X] I have searched the Data-Juicer issues and found no similar feature requests. 我已经搜索了 Data-Juicer 的 issue 列表但是没有发现类似的功能需求。 ### Description 描述 The hardware resources...

### Search before continuing 先搜索，再继续 - [X] I have searched the Data-Juicer issues and found no similar feature requests. 我已经搜索了 Data-Juicer 的 issue 列表但是没有发现类似的功能需求。 ### Description 描述 There is a...

### Search before continuing 先搜索，再继续 - [X] I have searched the Data-Juicer issues and found no similar feature requests. 我已经搜索了 Data-Juicer 的 issue 列表但是没有发现类似的功能需求。 ### Description 描述 Currently (in v1.0.3),...

Checkpointer support for Ray-Mode

1

### Search before continuing 先搜索，再继续 - [X] I have searched the Data-Juicer issues and found no similar feature requests. 我已经搜索了 Data-Juicer 的 issue 列表但是没有发现类似的功能需求。 ### Description 描述 Currently, the [dj_ckpt_manager](https://github.com/modelscope/data-juicer/blob/main/data_juicer/utils/ckpt_utils.py#L7)...

Guidance for OP with multiple data fields to be processed

2

### Search before continuing 先搜索，再继续 - [X] I have searched the Data-Juicer issues and found no similar feature requests. 我已经搜索了 Data-Juicer 的 issue 列表但是没有发现类似的功能需求。 ### Description 描述 Currently, users may...