Databricks-Certified-Professional-Data-Engineer Exam Question 51

An upstream system is emitting change data capture (CDC) logs that are being written to a cloud object storage directory. Each record in the log indicates the change type (insert, update, or delete) and the values for each field after the change. The source table has a primary key identified by the field pk_id.
For auditing purposes, the data governance team wishes to maintain a full record of all values that have ever been valid in the source system. For analytical purposes, only the most recent value for each record needs to be recorded. The Databricks job to ingest these records occurs once per hour, but each individual record may have changed multiple times over the course of an hour.
Which solution meets these requirements?
  • Databricks-Certified-Professional-Data-Engineer Exam Question 52

    A company has a task management system that tracks the most recent status of tasks. The system takes task events as input and processes events in near real-time using Lakeflow Declarative Pipelines. A new task event is ingested into the system when a task is created or the task status is changed. Lakeflow Declarative Pipelines provides a streaming table (tasks_status) for BI users to query.
    The table represents the latest status of all tasks and includes 5 columns:
    task_id (unique for each task)
    task_name
    task_owner
    task_status
    task_event_time
    The table enables three properties: deletion vectors, row tracking, and change data feed (CDF).
    A data engineer is asked to create a new Lakeflow Declarative Pipeline to enrich the tasks_status table in near real-time by adding one additional column representing task_owner's department, which can be looked up from a static dimension table (employee).
    How should this enrichment be implemented?
  • Databricks-Certified-Professional-Data-Engineer Exam Question 53

    An external object storage container has been mounted to the location /mnt/finance_eda_bucket.
    The following logic was executed to create a database for the finance team:

    After the database was successfully created and permissions configured, a member of the finance team runs the following code:

    If all users on the finance team are members of the finance group, which statement describes how the tx_sales table will be created?
  • Databricks-Certified-Professional-Data-Engineer Exam Question 54

    A data engineer wants to automate job monitoring and recovery in Databricks using the Jobs API. They need to list all jobs, identify a failed job, and rerun it.
    Which sequence of API actions should the data engineer perform?
  • Databricks-Certified-Professional-Data-Engineer Exam Question 55

    A data engineer deploys a multi-task Databricks job that orchestrates three notebooks. One task intermittently fails with Exit Code 1 but succeeds on retry. The engineer needs to collect detailed logs for the failing attempts, including stdout/stderr and cluster lifecycle context, and share them with the platform team.
    What steps the data engineer needs to follow using built-in tools?