Pere Miquel Brull

Results 65 issues of Pere Miquel Brull

# Context Sensitive data from services is currently stored in MySQL (or Postgres) encrypted. This is the current process between the OM server and Airflow workflows: ![image](https://user-images.githubusercontent.com/35870520/176695957-819e2d25-8c0c-4bfc-b440-5d91d11881f5.png) The `IngestionPipeline` contains...

epic
Ingestion
backend

We should only send requests to the sink in the shape of `Create` requests (or custom models passing required info such as FQN etc). This way we will be able...

Ingestion
cleanup

### Describe your changes : Fix #6278 - Separate Lineage and Usage workflows - Remove lineage ingestion from usage bulksink - Prepare Airflow DAG building for Lineage - Prepare UI...

We need to build a parser for EntityLink following the work on javascript and Java https://github.com/open-metadata/OpenMetadata/blob/main/openmetadata-core/src/main/java/org/openmetadata/core/util/MessageParser.java Instead of building it ad-hoc, let's use ANTLR similar to how it was implemented...

Ingestion

Throw a 400 with the message of the mismatching versions

Ingestion

docs.open-metadata.org/sdk/python/ingestion/dbt#parsing-the-dbt-files we are pointing to an old module

documentation
Ingestion

Let's see if we can figure out a full-fledged query we can run to get all necessary table data etc. The less time we need to keep a connection open...

Ingestion

make sure that we are pushing the filter predicates down. Moreover, for Snowflake, validate if and how we can use ACCOUNT_USAGE instead of INFORMATION_SCHEMA. Same with BigQuery.

Ingestion

on how to run all the pieces for each connector. We need to migrate some more info from gitbook to the new docs

documentation
profiler

even if we comment them out

documentation
Ingestion