Data Quality Scan in Dataplex with Python library

Question

Publish results to BigQuery and Dataplex Catalog UI I am configuring the creation of Data Quality scan using the python library to interact with the Dataplex API (dataplex_v1). I need, when creating a scan, to configure the option to have the results published in BigQuery and Dataplex Catalog UI. Does anyone know how to do it?

I saw this option but I understand that what it does is to save the results as records in a table in bigquery, what I need is to show the scan in the DATA QUALITY section of my table (see image). data_profile_spec { post_scan_actions { bigquery_export { results_table = "//bigquery.googleapis.com/projects/my-project-name/datasets/dataplex_dataset/tables/profile_export" } } }

Hello, I've the same problem. Did you solve it?

Luigi Cerone
– Luigi Cerone

2023-11-16 11:33:28 +00:00
Commented Nov 16, 2023 at 11:33 — Luigi Cerone
– Luigi Cerone, Commented Nov 16, 2023 at 11:33

JK GCP · Accepted Answer · 2023-12-12 00:31:10Z

0

There is no API support for publishing to BigQuery and DataCatalog UI yet. This API support will be available in Q1 2024. In the meanwhile, you can create the Datascans via python client SDK and use the UI to publish the results to BQ and DataCatalog UI.

answered Dec 12, 2023 at 0:31

JK GCP

1

Sign up to request clarification or add additional context in comments.

1 Comment

VYago Over a year ago

How it is going ?

Collectives™ on Stack Overflow

Data Quality Scan in Dataplex with Python library

1 Answer 1

1 Comment

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

1 Comment

Your Answer

Sign up or log in

Post as a guest

Related