sql-ds-cache Cannot easily start plasma service on AWS EMR cluster.

For OAP-1.2, we target to support all features on cloud. We choose emr-6.3.0 and the versions of software are showed below: For plasma-sql-ds-cache it's not convenient to log on each workers to start plasma service. Can we start plasma service through yarn service? We hope that all the actions can only be executed on master.

Jun 17 '21 10:06 haojinIntel

@winningsix @zhixingheyi-tian Please help to track the issue. Thanks!

Jun 18 '21 01:06 haojinIntel

To clarify further, we can install binary on each worker but can't do start service for each worker in initial script. Am I right?

Jun 18 '21 01:06 winningsix

cc @yma11

Jun 18 '21 01:06 winningsix

maybe through the yarn service? https://github.com/oap-project/sql-ds-cache/blob/master/docs/User-Guide.md#configuration-for-enabling-pmem-cache

Jun 18 '21 01:06 yma11

@winningsix Yes, your description is clear.

Jun 18 '21 02:06 haojinIntel

@yma11 wrong link? Didn't find how to use YARN to start the environment. @haojinIntel we should be able to start service via that way mentioned by @yma11 once she corrects that.

Jun 18 '21 02:06 winningsix

Link is correct. There are contents about "Use Yarn to start Plasma service".

Jun 18 '21 02:06 yma11

@yma11 that part should work. @haojinIntel can you help have a try?

Jun 18 '21 02:06 winningsix