cloud-dataproc icon indicating copy to clipboard operation
cloud-dataproc copied to clipboard

Broken link in readme - PubSub

Open kolban-google opened this issue 1 year ago • 4 comments

In the README there is a link which reads:

Spark Pubsub Connector

This link is broken.

kolban-google avatar Mar 22 '24 13:03 kolban-google

Same for

Also, many of the links are outdated (they refer to https://github.com/GoogleCloudPlatform/ repositories) but most of them correctly redirect to corresponding repositories in https://github.com/GoogleCloudDataproc

codelixir avatar May 22 '25 15:05 codelixir

In the public docs for BigQuery connectors, "Hadoop BigQuery Connector" redirects here: https://github.com/GoogleCloudDataproc/hadoop-connectors

codelixir avatar May 22 '25 15:05 codelixir

This is the only spark-pubsub package I could find on the central repository in the com.google.cloud namespace

https://central.sonatype.com/artifact/com.google.cloud/pubsublite-spark-sql-streaming

And this is the corresponding github repo: https://github.com/googleapis/java-pubsublite-spark which isn't owned by GoogleCloudDataproc

codelixir avatar May 22 '25 16:05 codelixir

Removed these two links for now:

and changing some of the other links to correctly refer to GoogleCloudDataproc instead of GoogleCloudPlatform.

Added more connectors. More projects can be added under the "Dataproc projects" sections as well, but for now just fixing the links. Removed the "Kubernetes Operators" section – one of the projects is read-only and the other one is now owned by a different team.

codelixir avatar May 23 '25 14:05 codelixir