piper

p. 108 벨만 기대 방정식과 벨만 최적 방정식

1

### 정리 > 다이내믹 프로그래밍과 그리드월드 단락에서 '벨만 기대 방정식을 이용한 것은 정책 이터레이션이며, 벨만 최적 방정식을 이용한 것이 **정책 이터레이션**입니다.' --> '벨만 기대 방정식을 이용한 것은 정책 이터레이션이며, 벨만...

error because of the port number.

1

I appreciate for your amazing work. I would like to explain the error which was already issued(#4) for you to catch up easily. You can face the error the stage,...

Modified the mlm_masking method to exclude special tokens from the masking process. Previously, the method applied masking uniformly to all tokens without considering special tokens. **Changes** - Added a `special_tokens`...

In my opinion, many users will utilize this script to experiment with their own datasets for training. However, the original DatasetConstants class had two main issues: 1. The 'splits' attribute...

Special tokens masking candidates

1

Based on the masking implementation in the `transformers` library, special tokens (e.g., [CLS], [SEP]) should be excluded from the masking process. However, upon reviewing the implementation in sequence_packer.py, https://github.com/AnswerDotAI/ModernBERT/blob/8c57a0f01c12c4953ead53d398a36f81a4ba9e38/src/sequence_packer.py#L284 it...