data-juicer icon indicating copy to clipboard operation
data-juicer copied to clipboard
verified publisher icon modelscope

support LLM augmentation ops and support vllm

Open Cathy0908 opened this issue 1 year ago • 0 comments

Add new operators for llm data augmentation:

  • GenerateInstructionMapper
  • OptimizeInstructionMapper
  • ExtractQAMapper

And support vllm infer for these ops.

Cathy0908 avatar Jul 04 '24 03:07 Cathy0908