Jiaan Geng
Jiaan Geng
### What changes were proposed in this pull request? Currently, Spark have many string expressions support binary type, but missing examples of binary. This PR will add examples of binary...
### What changes were proposed in this pull request? If boolean expression have two similar binary comparisons have the same symbol(e.g., >) and one side is literal and connected with...
### What changes were proposed in this pull request? This PR used to simplify the description of built-in function. This PR have a lot of simplified cases. **Case one:** ```...
### What changes were proposed in this pull request? This PR is related to https://github.com/Qihoo360/XSQL/pull/68 and fix other deadlock risk in `XSQLSessionCatalog`. ### How was this patch tested? No UT.
### What changes were proposed in this pull request? XSQL supports schema discover for ElasticSearch, instead of spark.xsql.datasource.$dataSource.discover, we use spark.xsql.datasource.$dataSource.schemas.discover.config to specify the path of discover config. ### How...
### What changes were proposed in this pull request? **The background** Currently, Spark `Decimal` use the `java.math.BigDecimal` as the underlying implementation. As we know, the computing and storage efficiency of...
### What changes were proposed in this pull request? Extend Catalyst's type system by a new decimal type: Decimal128Type with Int128. ### Why are the changes needed? Spark SQL today...
### What changes were proposed in this pull request? Extend Catalyst's type system by a new decimal type: Decimal128Type with Int128. ### Why are the changes needed? Spark SQL today...
### What changes were proposed in this pull request? This PR propose to improve concurrency performance for `SparkSession`. ### Why are the changes needed? Currently, `SparkSession` adopted the mutable.Map caching...
[SPARK-43829][CONNECT] Improve SparkConnectPlanner by reuse Dataset and avoid construct new Dataset
### What changes were proposed in this pull request? Currently, `SparkConnectPlanner.transformRelation` always return the `LogicalPlan` of `Dataset`. The `SparkConnectPlanExecution.handlePlan` constructs a new `Dataset` for it. Sometimes, `SparkConnectPlanExecution.handlePlan` could reuse the...