docs icon indicating copy to clipboard operation
docs copied to clipboard

TiCDC Craft binary protocol document

Open sunxiaoguang opened this issue 4 years ago • 25 comments

First-time contributors' checklist

What is changed, added or deleted? (Required)

Which TiDB version(s) do your changes apply to? (Required)

  • [x] master (the latest development version)
  • [x] v5.2 (TiDB 5.2 versions)

What is the related PR or file link(s)?

  • This PR is translated in: https://github.com/pingcap/docs-cn/pull/7547
  • Other reference link(s):

Do your changes match any of the following descriptions?

  • [ ] Delete files
  • [ ] Change aliases
  • [ ] Need modification after applied to another branch
  • [ ] Might cause conflicts after applied to another branch

sunxiaoguang avatar Apr 13 '21 01:04 sunxiaoguang

CLA assistant check
All committers have signed the CLA.

CLAassistant avatar Apr 13 '21 01:04 CLAassistant

@sunxiaoguang This is an amazing work! Thanks!

TomShawn avatar May 11 '21 10:05 TomShawn

/translation doing /cc @amyangfei @leoppro /status PTAL @amyangfei @leoppro PTAL and help determine all the applicable versions. Thanks!

TomShawn avatar May 11 '21 11:05 TomShawn

@amyangfei @leoppro PTAL. Thanks!

TomShawn avatar Jun 07 '21 02:06 TomShawn

[REVIEW NOTIFICATION]

This pull request has been approved by:

  • amyangfei
  • hfxsd

To complete the pull request process, please ask the reviewers in the list to review by filling /cc @reviewer in the comment. After your PR has acquired the required number of LGTMs, you can assign this pull request to the committer in the list by filling /assign @committer in the comment to help you merge this pull request.

The full list of commands accepted by this bot can be found here.

Reviewer can indicate their review by submitting an approval review. Reviewer can cancel approval by submitting a request changes review.

ti-chi-bot avatar Jun 21 '21 02:06 ti-chi-bot

I'm making some final changes, please do not merge it at this time. Thanks

sunxiaoguang avatar Jun 21 '21 03:06 sunxiaoguang

@sunxiaoguang @amyangfei Could you please specify the applicable versions? Thanks!

TomShawn avatar Jun 22 '21 06:06 TomShawn

@sunxiaoguang @amyangfei Could you please specify the applicable versions? Thanks!

@amyangfei is going to have a final review and merge this PR in TiCDC soon, however I doubt we can make it in release 5.1.

sunxiaoguang avatar Jun 22 '21 06:06 sunxiaoguang

@sunxiaoguang @amyangfei Could you please specify the applicable versions? Thanks!

@amyangfei is going to have a final review and merge this PR in TiCDC soon, however I doubt we can make it in release 5.1.

It's finally merged.

sunxiaoguang avatar Jun 22 '21 10:06 sunxiaoguang

@sunxiaoguang @amyangfei Could you please specify the applicable versions? Thanks!

looks like this feature is going to be released in 5.1.1

image

sunxiaoguang avatar Jun 23 '21 06:06 sunxiaoguang

We would like to translate this document into Chinese with community effort.

sunxiaoguang avatar Sep 13 '21 07:09 sunxiaoguang

/verify

qiancai avatar Sep 13 '21 09:09 qiancai

@amyangfei Is this PR technically approved? @hfxsd Please also take a look. Thanks!

TomShawn avatar Sep 14 '21 02:09 TomShawn

@amyangfei Is this PR technically approved?

@TomShawn yes

amyangfei avatar Sep 14 '21 02:09 amyangfei

https://dev.mysql.com/doc/dev/mysql-server/latest/page_protocol_com_query.html uses hexdumps in examples. that might be useful here as well

dveeden avatar Oct 28 '21 14:10 dveeden

https://dev.mysql.com/doc/dev/mysql-server/latest/page_protocol_com_query.html uses hexdumps in examples. that might be useful here as well

Good idea. I put some examples for all event types:)

sunxiaoguang avatar Nov 17 '21 13:11 sunxiaoguang

Thanks a lot for precious suggestions. I made some changes to address all the suggestions except for the one that breaks binary compatibility. Please take another look @dveeden @hfxsd

sunxiaoguang avatar Nov 17 '21 13:11 sunxiaoguang

It's kind of hard to know why certain test failed and how to fix it.

sunxiaoguang avatar Nov 17 '21 13:11 sunxiaoguang

It's kind of hard to know why certain test failed and how to fix it.

[2021-11-17T13:39:59.228Z] functions-and-operators/expressions-pushed-down.md: this file has manual line breaks in the following lines:

[2021-11-17T13:39:59.228Z] 

[2021-11-17T13:39:59.228Z] MANUAL LINE BREAKS: L148

[2021-11-17T13:39:59.228Z] MANUAL LINE BREAKS: L149

[2021-11-17T13:39:59.228Z] MANUAL LINE BREAKS: L150

[2021-11-17T13:39:59.228Z] MANUAL LINE BREAKS: L151

[2021-11-17T13:39:59.228Z] MANUAL LINE BREAKS: L152

[2021-11-17T13:39:59.228Z] MANUAL LINE BREAKS: L153

[2021-11-17T13:39:59.228Z] MANUAL LINE BREAKS: L154

[2021-11-17T13:39:59.228Z] MANUAL LINE BREAKS: L155

[2021-11-17T13:39:59.228Z] MANUAL LINE BREAKS: L156

[2021-11-17T13:39:59.228Z] MANUAL LINE BREAKS: L157

[2021-11-17T13:39:59.228Z] MANUAL LINE BREAKS: L158

[2021-11-17T13:39:59.228Z] MANUAL LINE BREAKS: L159

[2021-11-17T13:39:59.228Z] MANUAL LINE BREAKS: L160

[2021-11-17T13:39:59.228Z] MANUAL LINE BREAKS: L161

[2021-11-17T13:39:59.228Z] MANUAL LINE BREAKS: L162

[2021-11-17T13:39:59.228Z] MANUAL LINE BREAKS: L163

[2021-11-17T13:39:59.228Z] MANUAL LINE BREAKS: L164

[2021-11-17T13:39:59.228Z] MANUAL LINE BREAKS: L165

[2021-11-17T13:39:59.228Z] MANUAL LINE BREAKS: L166

[2021-11-17T13:39:59.228Z] MANUAL LINE BREAKS: L167

[2021-11-17T13:39:59.228Z] 

[2021-11-17T13:39:59.228Z] functions-and-operators/json-functions.md: this file has manual line breaks in the following lines:

[2021-11-17T13:39:59.228Z] 

[2021-11-17T13:39:59.228Z] MANUAL LINE BREAKS: L87

[2021-11-17T13:39:59.229Z] MANUAL LINE BREAKS: L88

[2021-11-17T13:39:59.229Z] MANUAL LINE BREAKS: L89

[2021-11-17T13:39:59.229Z] MANUAL LINE BREAKS: L90

[2021-11-17T13:39:59.229Z] MANUAL LINE BREAKS: L91

[2021-11-17T13:39:59.229Z] MANUAL LINE BREAKS: L92

[2021-11-17T13:39:59.229Z] MANUAL LINE BREAKS: L93

[2021-11-17T13:39:59.229Z] MANUAL LINE BREAKS: L94

[2021-11-17T13:39:59.229Z] MANUAL LINE BREAKS: L95

[2021-11-17T13:39:59.229Z] MANUAL LINE BREAKS: L96

[2021-11-17T13:39:59.229Z] MANUAL LINE BREAKS: L97

[2021-11-17T13:39:59.229Z] MANUAL LINE BREAKS: L98

[2021-11-17T13:39:59.229Z] MANUAL LINE BREAKS: L99

[2021-11-17T13:39:59.229Z] MANUAL LINE BREAKS: L100

[2021-11-17T13:39:59.229Z] MANUAL LINE BREAKS: L101

[2021-11-17T13:39:59.229Z] MANUAL LINE BREAKS: L102

[2021-11-17T13:39:59.229Z] MANUAL LINE BREAKS: L103

[2021-11-17T13:39:59.229Z] MANUAL LINE BREAKS: L104

[2021-11-17T13:39:59.229Z] MANUAL LINE BREAKS: L105

[2021-11-17T13:39:59.229Z] MANUAL LINE BREAKS: L106

[2021-11-17T13:39:59.229Z] MANUAL LINE BREAKS: L107

[2021-11-17T13:39:59.229Z] MANUAL LINE BREAKS: L108

[2021-11-17T13:39:59.229Z] MANUAL LINE BREAKS: L109

[2021-11-17T13:39:59.229Z] MANUAL LINE BREAKS: L110

[2021-11-17T13:39:59.229Z] 

[2021-11-17T13:39:59.229Z] ticdc/ticdc-craft.md: this file has manual line breaks in the following lines:

[2021-11-17T13:39:59.229Z] 

[2021-11-17T13:39:59.229Z] MANUAL LINE BREAKS: L188

[2021-11-17T13:39:59.229Z] MANUAL LINE BREAKS: L189

[2021-11-17T13:39:59.229Z] MANUAL LINE BREAKS: L190

[2021-11-17T13:39:59.229Z] MANUAL LINE BREAKS: L191

[2021-11-17T13:39:59.229Z] MANUAL LINE BREAKS: L192

[2021-11-17T13:39:59.229Z] MANUAL LINE BREAKS: L193

[2021-11-17T13:39:59.229Z] MANUAL LINE BREAKS: L194

[2021-11-17T13:39:59.229Z] MANUAL LINE BREAKS: L195

[2021-11-17T13:39:59.229Z] MANUAL LINE BREAKS: L196

[2021-11-17T13:39:59.229Z] MANUAL LINE BREAKS: L197

[2021-11-17T13:39:59.229Z] MANUAL LINE BREAKS: L198

[2021-11-17T13:39:59.229Z] MANUAL LINE BREAKS: L199

[2021-11-17T13:39:59.229Z] MANUAL LINE BREAKS: L200

[2021-11-17T13:39:59.229Z] MANUAL LINE BREAKS: L201

[2021-11-17T13:39:59.229Z] MANUAL LINE BREAKS: L202

[2021-11-17T13:39:59.229Z] MANUAL LINE BREAKS: L203

[2021-11-17T13:39:59.229Z] MANUAL LINE BREAKS: L204

[2021-11-17T13:39:59.229Z] MANUAL LINE BREAKS: L205

[2021-11-17T13:39:59.229Z] MANUAL LINE BREAKS: L227

[2021-11-17T13:39:59.229Z] MANUAL LINE BREAKS: L228

[2021-11-17T13:39:59.229Z] MANUAL LINE BREAKS: L243

[2021-11-17T13:39:59.229Z] 

[2021-11-17T13:39:59.229Z] The above issues will cause website build failure. Please fix them.

script returned exit code 1

From https://ci.pingcap.net/blue/organizations/jenkins/atom-common/detail/atom-common/24631/pipeline/

dveeden avatar Nov 17 '21 14:11 dveeden

For now you can also run it like this:

[dvaneeden@dve-carbon docs]$ python3 <(curl -s -o - https://raw.githubusercontent.com/pingcap/docs/master/scripts/check-manual-line-breaks.py) ticdc/ticdc-craft.md 

ticdc/ticdc-craft.md: this file has manual line breaks in the following lines:

MANUAL LINE BREAKS: L188
MANUAL LINE BREAKS: L189
MANUAL LINE BREAKS: L190
MANUAL LINE BREAKS: L191
MANUAL LINE BREAKS: L192
MANUAL LINE BREAKS: L193
MANUAL LINE BREAKS: L194
MANUAL LINE BREAKS: L195
MANUAL LINE BREAKS: L196
MANUAL LINE BREAKS: L197
MANUAL LINE BREAKS: L198
MANUAL LINE BREAKS: L199
MANUAL LINE BREAKS: L200
MANUAL LINE BREAKS: L201
MANUAL LINE BREAKS: L202
MANUAL LINE BREAKS: L203
MANUAL LINE BREAKS: L204
MANUAL LINE BREAKS: L205
MANUAL LINE BREAKS: L227
MANUAL LINE BREAKS: L228
MANUAL LINE BREAKS: L243

The above issues will cause website build failure. Please fix them.

dveeden avatar Nov 17 '21 14:11 dveeden

For now you can also run it like this:

[dvaneeden@dve-carbon docs]$ python3 <(curl -s -o - https://raw.githubusercontent.com/pingcap/docs/master/scripts/check-manual-line-breaks.py) ticdc/ticdc-craft.md 

ticdc/ticdc-craft.md: this file has manual line breaks in the following lines:

MANUAL LINE BREAKS: L188
MANUAL LINE BREAKS: L189
MANUAL LINE BREAKS: L190
MANUAL LINE BREAKS: L191
MANUAL LINE BREAKS: L192
MANUAL LINE BREAKS: L193
MANUAL LINE BREAKS: L194
MANUAL LINE BREAKS: L195
MANUAL LINE BREAKS: L196
MANUAL LINE BREAKS: L197
MANUAL LINE BREAKS: L198
MANUAL LINE BREAKS: L199
MANUAL LINE BREAKS: L200
MANUAL LINE BREAKS: L201
MANUAL LINE BREAKS: L202
MANUAL LINE BREAKS: L203
MANUAL LINE BREAKS: L204
MANUAL LINE BREAKS: L205
MANUAL LINE BREAKS: L227
MANUAL LINE BREAKS: L228
MANUAL LINE BREAKS: L243

The above issues will cause website build failure. Please fix them.

Cool. Let me fix it

sunxiaoguang avatar Nov 18 '21 02:11 sunxiaoguang

For now you can also run it like this:

[dvaneeden@dve-carbon docs]$ python3 <(curl -s -o - https://raw.githubusercontent.com/pingcap/docs/master/scripts/check-manual-line-breaks.py) ticdc/ticdc-craft.md 

ticdc/ticdc-craft.md: this file has manual line breaks in the following lines:

MANUAL LINE BREAKS: L188
MANUAL LINE BREAKS: L189
MANUAL LINE BREAKS: L190
MANUAL LINE BREAKS: L191
MANUAL LINE BREAKS: L192
MANUAL LINE BREAKS: L193
MANUAL LINE BREAKS: L194
MANUAL LINE BREAKS: L195
MANUAL LINE BREAKS: L196
MANUAL LINE BREAKS: L197
MANUAL LINE BREAKS: L198
MANUAL LINE BREAKS: L199
MANUAL LINE BREAKS: L200
MANUAL LINE BREAKS: L201
MANUAL LINE BREAKS: L202
MANUAL LINE BREAKS: L203
MANUAL LINE BREAKS: L204
MANUAL LINE BREAKS: L205
MANUAL LINE BREAKS: L227
MANUAL LINE BREAKS: L228
MANUAL LINE BREAKS: L243

The above issues will cause website build failure. Please fix them.

Cool. Let me fix it

Looks like there are other files not related to this PR failed. Do I need to fix them?

sunxiaoguang avatar Nov 18 '21 02:11 sunxiaoguang

@sunxiaoguang line break issues in files unrelated to this PR can be ignored.

dveeden avatar Nov 18 '21 07:11 dveeden

PR for the Chinese translation of this document is created at https://github.com/pingcap/docs-cn/pull/7547 @TomShawn PTAL

sunxiaoguang avatar Nov 18 '21 14:11 sunxiaoguang

@sunxiaoguang Could you please help fix the comments and jenkins error, and finalize the document? After that, we can merge this PR. Thanks.

shichun-0415 avatar Feb 16 '22 04:02 shichun-0415