Hydrograph

Hydrograph copied to clipboard

**Description**: Add components that allow users to read (GET) and write (POST) to a REST API endpoint. **Technical Document Link**: - TODO: Determine how to efficiently make API calls so...

danyanos

**Description**: Add component that allows users to express transformation logic in the form of a SQL statement. **Technical Document Link**: - TODO: Determine SQL dialect that will be used for...

danyanos

**Description**: Update Hydrograph input components with an additional "reject" port. This port allows users to work with records that fail initial schema validation checks. Currently Hydrograph jobs will fail if...

danyanos

**Description**: Allow users to specify whether fields are allowed to be null by adding a "nullable" option in the Hydrograph schema . When reading input data Hydrograph will check each...

danyanos

When a user executes a remote job by providing a SSH Key file and the SSH key file is encrypted using a passphrase, the remote execution fails. Need the Remote...

alpeshk

There was a typo when creating `hydrograph.engine.spark.components.adapter.base.InputAdatperBase`. Rename all occurrence of _InputAdatperBase_ to __InputAdapterBase__.

danyanos

_InputOracleComponent.scala_ duplicates the `compareSchema` method found in `hydrograph.engine.spark.components.utils.SchemaUtils`. Refactor _InputOracleComponent.scala_ to use the method from the `SchemaUtils` class.

danyanos

Job fails when Remove Duplicates component follows an Oracle Input component with the following exception - ~~~ java.lang.NullPointerException at hydrograph.engine.core.helper.JAXBTraversal.getOrderedComponentsList(JAXBTraversal.java:119) at hydrograph.engine.spark.flow.FlowBuilder.createAndConnect(FlowBuilder.scala:60) at hydrograph.engine.spark.flow.FlowBuilder$$anonfun$buildAndExecuteFlows$1.apply(FlowBuilder.scala:41) at hydrograph.engine.spark.flow.FlowBuilder$$anonfun$buildAndExecuteFlows$1.apply(FlowBuilder.scala:40) at scala.collection.Iterator$class.foreach(Iterator.scala:893) at scala.collection.AbstractIterator.foreach(Iterator.scala:1336)...

alpeshk

Add support for multi-character delimiters for input/output delimited file components

alpeshk

Bumps redshift-jdbc42 from 1.2.1.1001 to 2.1.0.9. [](https://docs.github.com/en/github/managing-security-vulnerabilities/about-dependabot-security-updates#about-compatibility-scores) Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a...

dependabot[bot]