Databricks-Certified-Data-Engineer-Professional 試験問題を無料オンラインアクセス

The data architect has decided that once data has been ingested from external sources into the Databricks Lakehouse, table access controls will be leveraged to manage permissions for all production tables and views.
The following logic was executed to grant privileges for interactive queries on a production database to the core engineering group.
GRANT USAGE ON DATABASE prod TO eng;
GRANT SELECT ON DATABASE prod TO eng;
Assuming these are the only privileges that have been granted to the eng group and that these users are not workspace administrators, which statement describes their privileges?

• A.Group members are able to query and modify all tables and views in the prod database, but cannot create new tables or views.
• B.Group members are able to list all tables in the prod database but are not able to see the results of any queries on those tables.
• C.Group members have full permissions on the prod database and can also assign permissions to other users or groups.
• D.Group members are able to create, query, and modify all tables and views in the prod database, but cannot define custom functions.
• E.Group members are able to query all tables and views in the prod database, but cannot create or edit anything in the database.

The data science team has requested assistance in accelerating queries on free form text from user reviews. The data is currently stored in Parquet with the below schema:
item_id INT, user_id INT, review_id INT, rating FLOAT, review STRING
The review column contains the full text of the review left by the user. Specifically, the data science team is looking to identify if any of 30 key words exist in this field.
A junior data engineer suggests converting this data to Delta Lake will improve query performance.
Which response to the junior data engineer s suggestion is correct?

• A.Text data cannot be stored with Delta Lake.
• B.ZORDER ON review will need to be run to see performance gains.
• C.The Delta log creates a term matrix for free text fields to support selective filtering.
• D.Delta Lake statistics are only collected on the first 4 columns in a table.
• E.Delta Lake statistics are not optimized for free text fields with high cardinality.

The data engineering team maintains the following code:
Get Latest & Actual Certified-Data-Engineer-Professional Exam's Question and Answers from

Assuming that this code produces logically correct results and the data in the source table has been de-duplicated and validated, which statement describes what will occur when this code is executed?

• A.The silver_customer_sales table will be overwritten by aggregated values calculated from all records in the gold_customer_lifetime_sales_summary table as a batch job.
• B.The gold_customer_lifetime_sales_summary table will be overwritten by aggregated values calculated from all records in the silver_customer_sales table as a batch job.
• C.A batch job will update the gold_customer_lifetime_sales_summary table, replacing only those rows that have different values than the current version of the table, using customer_id as the primary key.
• D.An incremental job will leverage running information in the state store to update aggregate values in the gold_customer_lifetime_sales_summary table.
• E.An incremental job will detect if new rows have been written to the silver_customer_sales table; if new rows are detected, all aggregates will be recalculated and used to overwrite the gold_customer_lifetime_sales_summary table.

The data governance team is reviewing user for deleting records for compliance with GDPR. The following logic has been implemented to propagate deleted requests from the user_lookup table to the user aggregate table.

Assuming that user_id is a unique identifying key and that all users have requested deletion have been removed from the user_lookup table, which statement describes whether successfully executing the above logic guarantees that the records to be deleted from the user_aggregates table are no longer accessible and why?

• A.No; the Delta Lake DELETE command only provides ACID guarantees when combined with the MERGE INTO command
• B.Yes; the change data feed uses foreign keys to ensure delete consistency throughout the Lakehouse.
• C.Yes; Delta Lake ACID guarantees provide assurance that the DELETE command successed fully and permanently purged these records.
• D.No; files containing deleted records may still be accessible with time travel until a BACUM command is used to remove invalidated data files.
• E.No; the change data feed only tracks inserts and updates not deleted records.

A nightly batch job is configured to ingest all data files from a cloud object storage container where records are stored in a nested directory structure YYYY/MM/DD. The data for each date represents all records that were processed by the source system on that date, noting that some records may be delayed as they await moderator approval. Each entry represents a user review of a product and has the following schema:
user_id STRING, review_id BIGINT, product_id BIGINT, review_timestamp TIMESTAMP, review_text STRING The ingestion job is configured to append all data for the previous date to a target table reviews_raw with an identical schema to the source system. The next step in the pipeline is a batch write to propagate all new records inserted into reviews_raw to a table where data is fully deduplicated, validated, and enriched.
Which solution minimizes the compute costs to propagate this batch of data?
Get Latest & Actual Certified-Data-Engineer-Professional Exam's Question and Answers from

• A.Configure a Structured Streaming read against the reviews_raw table using the trigger once execution mode to process new records as a batch job.
• B.Filter all records in the reviews_raw table based on the review_timestamp; batch append those records produced in the last 48 hours.
• C.Perform a batch read on the reviews_raw table and perform an insert-only merge using the natural composite key user_id, review_id, product_id, review_timestamp.
• D.Reprocess all records in reviews_raw and overwrite the next table in the pipeline.
• E.Use Delta Lake version history to get the difference between the latest version of reviews_raw and one version prior, then write these records to the next table.