njalan

No data for Min and Max when enable profiling

3

Below is my Configuration for enabling profiling: profiling: enabled: True profile_pattern: allow: - "ods_mos_pvg.xxx" After ingesting there are statistics for Null Count,Distinct Count but there is no data for **Min...

Trino version is 394. I found that one node cpu is high out of 8 workers. Below are the top thread take the cpu: LANG=C ps -eT -o%cpu,pid,tid,ppid,comm | grep...

there is no data when a couple of hudi tables join

3

There is one etl job run every hour and it is insert overwrite one table from the results that is generated by some hudi table join. It happens like one...

Incoming batch schema is not compatible with the table's one

13

I got below exception when ingest data from sql server into hudi. org.apache.hudi.exception.SchemaCompatibilityException: Incoming batch schema is not compatible with the table's one at org.apache.hudi.HoodieSparkSqlWriter$.deduceWriterSchema(HoodieSparkSqlWriter.scala:496) at org.apache.hudi.HoodieSparkSqlWriter$.write(HoodieSparkSqlWriter.scala:314) at org.apache.hudi.DefaultSource.createRelation(DefaultSource.scala:150) at...

Incoming batch schema is not compatible with the table's one #9980

3

### Change Logs Use meta sync database to fill hoodie.table.name if it not sets ### Impact Fix issue that if there are same table name under hive 'default' schema than...

Get duplicate records in kafka

1

Below is my connect-file-source.properties: name=local-file-source1 connector.class=com.github.mmolimar.kafka.connect.fs.FsSourceConnector tasks.max=1 fs.uris=file:///data/test_file topic=connect-test1 policy.class=com.github.mmolimar.kafka.connect.fs.policy.SleepyPolicy policy.sleepy.sleep=50000 policy.recursive=true poll.interval.ms=0 policy.regexp=.* policy.batch_size=0 #policy.cleanup=none file_reader.class=com.github.mmolimar.kafka.connect.fs.file.reader.TextFileReader file_reader.batch_size=0 when I run echo "bbb" >>/data/test_file/1.txt echo "ddd" >> /data/test_file/1.txt I got...

I am using trino 406 and faced below errors while doing extract and I am using python 3.8. 100%|███████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 28/28 [00:00

Output of main and server is totally different

3

When I start the service by main and server command and ask the same question like '上海有什么好玩的', the output is different. so how to keep the output response of API...

Output of sql is not same between cpu and gpu

1

Any one faced that Output of sql is not same between cpu and gpu? There are many columns and two columns result is not the same compared with cpu and...

there are duplicated records if copied one partition data file from another s3 bucket

4

If I copied the whole table file from another s3 bucker folder and then continue steaming upsert process, there is no duplicated records. It is working fine. But If I...