Certified-Data-Engineer-Professional 試験問題を無料オンラインアクセス

A Delta Lake table representing metadata about content posts from users has the following schema:
user_id LONG, post_text STRING, post_id STRING, longitude FLOAT,
latitude FLOAT, post_time TIMESTAMP, date DATE
This table is partitioned by the date column. A query is run with the following filter:
longitude < 20 & longitude > -20
Which statement describes how data will be filtered?

• A.No file skipping will occur because the optimizer does not know the relationship between the partition column and the longitude.
• B.The Delta Engine will scan the parquet file footers to identify each row that meets the filter criteria.
• C.The Delta Engine will use row-level statistics in the transaction log to identify the flies that meet the filter criteria.
• D.Statistics in the Delta Log will be used to identify partitions that might Include files in the filtered range.
• E.Statistics in the Delta Log will be used to identify data files that might include records in the filtered range.

A CHECK constraint has been successfully added to the Delta table named activity_details using the following logic:

A batch job is attempting to insert new records to the table, including a record where latitude =
45.50 and longitude = 212.67.
Which statement describes the outcome of this batch insert?

• A.The write will include all records in the target table; any violations will be indicated in the boolean column named valid_coordinates.
• B.The write will insert all records except those that violate the table constraints; the violating records will be reported in a warning log.
• C.The write will fail when the violating record is reached; any records previously processed will be recorded to the target table.
• D.The write will insert all records except those that violate the table constraints; the violating records will be recorded to a quarantine table.
• E.The write will fail completely because of the constraint violation and no records will be inserted into the target table.

Incorporating unit tests into a PySpark application requires upfront attention to the design of your jobs, or a potentially significant refactoring of existing code.
Which statement describes a main benefit that offset this additional effort?

• A.Improves the quality of your data
• B.Ensures that all steps interact correctly to achieve the desired end result
• C.Yields faster deployment and execution times
• D.Validates a complete use case of your application
• E.Troubleshooting is easier since all steps are isolated and tested individually

A view is registered with the following code:

Both users and orders are Delta Lake tables.
Which statement describes the results of querying recent_orders?

• A.All logic will execute at query time and return the result of joining the valid versions of the source tables at the time the query finishes.
• B.All logic will execute when the view is defined and store the result of joining tables to the DBFS; this stored data will be returned when the view is queried.
• C.All logic will execute at query time and return the result of joining the valid versions of the source tables at the time the query began.
• D.Results will be computed and cached when the view is defined; these cached results will incrementally update as new records are inserted into source tables.

A data architect is implementing Delta Sharing as part of their data governance strategy to enable secure data collaboration with external partners and internal business units. The architect must establish a permission framework that allows designated data stewards to create shares for their respective domains while maintaining security boundaries and audit compliance. Which specific permissions and roles must be assigned to enable users to create, configure, and manage Delta Shares while maintaining proper security governance and access controls?

• A.Any user with USE_CATALOG privilege can create shares
• B.Users need to be metastore admins or have CREATE SHARE privilege for the metastore
• C.Users need the MANAGE SHARES permission on the workspace
• D.Only workspace admins can create and manage shares