enceladus

enceladus copied to clipboard

## Background Dell ECS tmp cleanup should be done on the date partition not the whole root folder of the dataset ## Feature Add report date to Dell ECS cleanup

Zejnilovic

Getting 'Atum already initialized' error when trying to run Std+Conf multiple times

1

## Describe the bug The error occurs when Standardization+Conformance jobs from a single Spark session. This happenned when running from Pramen since Pramen runs multiple Standardization+Conformance jobs in a single...

yruslan

## Background With the release of v2.27.3 we should add its release notes to the documentation.

benedeki

#2199 Counting runs count takes too much MongoDB CPU

1

* replaced DB-intensive `documentCount` for `estimatedDocumentCount` Closes #2199

benedeki

## Background Changes to the old supported version should be ported to the most recent version too. ## Feature Merge changes from 2.27.2 into the main branch

benedeki

## Describe the bug In release 2.27.2 Jackons was erroneously downgraded, which causes issues in _Menas_ ## To Reproduce Steps to reproduce the behavior OR commands run: 1. Deploys Menas...

benedeki

S3A and S3N path are not correctly handled

1

## Describe the bug While the `s3a://` and `s3n://` protocols are correctly recognized, they are replaced with hard-coded `s3://` ## To Reproduce See `FileSystemUtils` class ## Expected behavior Keep the...

benedeki

Counting runs count takes too much MongoDB CPU

1

## Describe the bug When application is counting _Runs_ count for the landing page info, it consumer too much CPU. ## To Reproduce See server logs ## Expected behavior It...

benedeki

#2175: Add ability to configure how spark handles dates in parquet files

2

Notes - Initialized `DEFAULT_PARQUET_DATETIME_READ_MODE` and `DEFAULT_PARQUET_DATETIME_WRITE_MODE` with a default value `CORRECTED`. - Added option condition for assessing the value of `datetime read/write mode` Closes #2175

TebaleloS

Bump spark-core_2.12 from 3.2.2 to 3.4.0

1

Bumps spark-core_2.12 from 3.2.2 to 3.4.0. [](https://docs.github.com/en/github/managing-security-vulnerabilities/about-dependabot-security-updates#about-compatibility-scores) Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a...

dependabot[bot]