databend icon indicating copy to clipboard operation
databend copied to clipboard

[test] add sqlancer test

Open bohutang opened this issue 4 years ago • 8 comments

Summary Add sqlancer test: https://github.com/sqlancer/sqlancer

There are 2 parts here:

  1. build sqlancer test docker image
  2. run it in the CI

bohutang avatar Sep 08 '21 15:09 bohutang

I will evaluate it.

/assignme

PsiACE avatar Sep 08 '21 17:09 PsiACE

Ref: https://github.com/sqlancer/sqlancer/pull/429

PsiACE avatar Jan 12 '22 16:01 PsiACE

I think we still need to do that, but I probably won't put more effort into it.

Maybe @leiysky will have some suggestions for that.

PsiACE avatar Mar 27 '22 16:03 PsiACE

I think we still need to do that, but I probably won't put more effort into it.

Maybe @leiysky will have some suggestions for that.

It's helpful but not suitable for regression test in CI. We may have a periodic job for it one day.

leiysky avatar Mar 29 '22 10:03 leiysky

Any updates on this? @PsiACE

Xuanwo avatar Sep 16 '22 06:09 Xuanwo

Any updates on this? @PsiACE

This is an OSPP 2022 project and is assigned to @hanyisong . You can view the progress at https://github.com/datafuse-extras/sqlancer/pull/1 .

Now that we have almost supported sqlancer, there is still one important issue(#7463) left to resolve.

PsiACE avatar Sep 16 '22 06:09 PsiACE

cc @Xuanwo and @leiysky for the help on issue #7463 , it's blocking the sqlancer project.

bohutang avatar Sep 17 '22 08:09 bohutang

cc @Xuanwo and @leiysky for the help on issue #7463 , it's blocking the sqlancer project.

I'm already working on this. It would be fixed as soon as #6885 is finised.

leiysky avatar Sep 19 '22 03:09 leiysky

https://github.com/sqlancer/sqlancer/pull/568 has been merged and I think we have a implementation of the sqlancer test. The next step is to fix the known issues and explore sqlancer. So I think we can close this issue.

Also, with the upstream merge, I have merged https://github.com/datafuse-extras/sqlancer/pull/1 as well. https://github.com/datafuse-extras/sqlancer is the target repository for OSPP2022 assessment, so let's keep it until the end of the event.

Thank you @hanyisong for your excellent work in making Databend more reliable.

PsiACE avatar Sep 28 '22 16:09 PsiACE

Thank @hanyisong again! Let's close.

Xuanwo avatar Oct 27 '22 15:10 Xuanwo