bithw1
bithw1
RocketMQSource defines a variable pendingOffsetsToCommit as `private LinkedMap pendingOffsetsToCommit;` But I didn't find real use of it, can it be removed?
Hi, In our product,we are going to use both graph db and rational db, but we are thinking about what data are good to be saved in graph db,and what...
Hi, It looks to me that there are serveral options to do bulk load data into nebula graph, such as, importer, exchanger ,spark connector, Java/Go client. I would ask if...
在cnn.cy (https://github.com/hanbt/learn_dl/blob/master/cnn.py)中,ConvLayer的初始化是: _cl = ConvLayer(5,5,3,3,3,2,1,2,IdentityActivator(),0.001)_ 它定义的channel_number为3, filter_number为2,但是从文章中看, > 我们可以把Feature Map可以看做是通过卷积变换提取到的图像特征,三个Filter就对原始图像提取出三组不同的特征,也就是得到了三个Feature Map,也称做三个通道(channel)。 也就是channel数应该跟filter相同,但是初始化的时候并不相同,不知道是不是初始化的时候,值设错了
Hi @bartosz25 , Spark provides `org.apache.spark.sql.catalyst.optimizer.ReorderJoin` for more efficient join. I notice that you have written 2 test cases about ReorderJoin in your article: https://www.waitingforcode.com/apache-spark-sql/spark-sql-operator-optimizations-part-2/read But, I think these two...
Hi, @bartosz25 , I have a simple test case that would like to see whole stage generated code ``` test("whole stage code gen test") { val spark = SparkSession.builder().enableHiveSupport().master("local").appName("whole stage...
Hi, @bartosz25 In the coming Spark 3.0 release or in the master branch of Apache Spark git, The feature `adaptive execution` is mature, it will be released in Spark 3.0...
Hi @phatak-dev First, thank you very much for the great effort to write the structured streaming series. I got a question: in http://blog.madhukaraphatak.com/introduction-to-spark-structured-streaming-part-11/ Running the Example Enter the below records...
I am using Hudi 0.15, I find that ORDERING_FIELD has been deprecated with PRECOMBINE_FIELD_NAME, ``` /** @deprecated Use {@link HoodieWriteConfig#PRECOMBINE_FIELD_NAME} and its methods instead */ @Deprecated public static final ConfigProperty...
Hi, I download the Hudi source code from master branch, Then I run the maven build `mvn clean package -DskipTests`, it looks that the build succeeds, but the model classes...