DE-PRO practice questions 81–90

1. Question 81 · 202 in bank

   A Databricks job has been configured with three tasks, each of which is a Databricks notebook. Task A does not depend on other tasks. Tasks B and C run in parallel, with each having a serial dependency on task A. What will be the resulting state if tasks A and B complete successfully but task C fails during a scheduled run?

   • AAll logic expressed in the notebook associated with tasks A and B will have been successfully completed; some operations in task C may have completed successfully.
   • BUnless all tasks complete successfully, no changes will be committed to the Lakehouse; because task C failed, all commits will be rolled back automatically.
   • CBecause all tasks are managed as a dependency graph, no changes will be committed to the Lakehouse until all tasks have successfully been completed.
   • DAll logic expressed in the notebook associated with tasks A and B will have been successfully completed; any changes made in task C will be rolled back due to task failure.

   Show answer

   Answer: A

   Next question

2. Question 82 · 202 in bank

   When scheduling Structured Streaming jobs for production, which configuration automatically recovers from query failures and keeps costs low?

   • ACluster: New Job Cluster; Retries: Unlimited; Maximum Concurrent Runs: 1
   • BCluster: New Job Cluster; Retries: Unlimited; Maximum Concurrent Runs: Unlimited
   • CCluster: Existing All-Purpose Cluster; Retries: Unlimited; Maximum Concurrent Runs: 1
   • DCluster: New Job Cluster; Retries: None; Maximum Concurrent Runs: 1

   Show answer

   Answer: A

   Next question

3. Question 83 · 202 in bank

   A Delta Lake table was created with the below query:

   

   Realizing that the original query had a typographical error, the below code was executed: ALTER TABLE prod.sales_by_stor RENAME TO prod.sales_by_store Which result will occur after running the second command?

   • AThe table reference in the metastore is updated.
   • BAll related files and metadata are dropped and recreated in a single ACID transaction.
   • CThe table name change is recorded in the Delta transaction log.
   • DA new Delta transaction log is created for the renamed table.

   Show answer

   Answer: C

   Next question

4. Question 84 · 202 in bank

   The data engineering team has configured a Databricks SQL query and alert to monitor the values in a Delta Lake table. The recent_sensor_recordings table contains an identifying sensor_id alongside the timestamp and temperature for the most recent 5 minutes of recordings. The below query is used to create the alert:

   

   The query is set to refresh each minute and always completes in less than 10 seconds. The alert is set to trigger when mean (temperature) > 120. Notifications are triggered to be sent at most every 1 minute. If this alert raises notifications for 3 consecutive minutes and then stops, which statement must be true?

   • AThe total average temperature across all sensors exceeded 120 on three consecutive executions of the query
   • BThe average temperature recordings for at least one sensor exceeded 120 on three consecutive executions of the query
   • CThe source query failed to update properly for three consecutive minutes and then restarted
   • DThe maximum temperature recording for at least one sensor exceeded 120 on three consecutive executions of the query

   Show answer

   Answer: B

   Next question

5. Question 85 · 202 in bank

   The Databricks workspace administrator has configured interactive clusters for each of the data engineering groups. To control costs, clusters are set to terminate after 30 minutes of inactivity. Each user should be able to execute workloads against their assigned clusters at any time of the day. Assuming users have been added to a workspace but not granted any permissions, which of the following describes the minimal permissions a user would need to start and attach to an already configured cluster.

   • A"Can Manage" privileges on the required cluster
   • BCluster creation allowed, "Can Restart" privileges on the required cluster
   • CCluster creation allowed, "Can Attach To" privileges on the required cluster
   • D"Can Restart" privileges on the required cluster

   Show answer

   Answer: D

   Explanation

   'can restart' privileges as is needed start and attach a notebook. 'can attach to' is not having enough privileges to start a cluster. https://docs.databricks.com/en/security/auth/access-control/index.html#clusters

   Source: Adapted from community discussion — UrcoIbz

   References

   • Databricks documentation

   Next question

6. Question 86 · 202 in bank

   A junior data engineer has been asked to develop a streaming data pipeline with a grouped aggregation using DataFrame df. The pipeline needs to calculate the average humidity and average temperature for each non-overlapping five-minute interval. Events are recorded once per minute per device. Streaming DataFrame df has the following schema: "device_id INT, event_time TIMESTAMP, temp FLOAT, humidity FLOAT" Code block:

   

   Choose the response that correctly fills in the blank within the code block to complete this task.

   • Ato_interval("event_time", "5 minutes").alias("time")
   • Bwindow("event_time", "5 minutes").alias("time")
   • C"event_time"
   • Dwindow("event_time", "10 minutes").alias("time")
   • Elag("event_time", "10 minutes").alias("time")

   Show answer

   Answer: B

   Explanation

   B. window("event_time", "5 minutes").alias("time") In Structured Streaming, expressing such windows on event-time is simply performing a special grouping using the window() function. For example, counts over 5 minute tumbling (non-overlapping) windows on the eventTime column in the event is as following.

   Source: Adapted from community discussion — imatheushenrique

   Next question

7. Question 87 · 202 in bank

   A junior data engineer has configured a workload that posts the following JSON to the Databricks REST API endpoint 2.0/jobs/create.

   

   Assuming that all configurations and referenced resources are available, which statement describes the result of executing this workload three times?

   • AThe logic defined in the referenced notebook will be executed three times on the referenced existing all purpose cluster.
   • BThe logic defined in the referenced notebook will be executed three times on new clusters with the configurations of the provided cluster ID.
   • CThree new jobs named "Ingest new data" will be defined in the workspace, but no jobs will be executed.
   • DOne new job named "Ingest new data" will be defined in the workspace, but it will not be executed.

   Show answer

   Answer: C

   Next question

8. Question 88 · 202 in bank

   A view is registered with the following code:

   

   Both users and orders are Delta Lake tables. Which statement describes the results of querying recent_orders?

   • AThe versions of each source table will be stored in the table transaction log; query results will be saved to DBFS with each query.
   • BAll logic will execute when the table is defined and store the result of joining tables to the DBFS; this stored data will be returned when the table is queried.
   • CAll logic will execute at query time and return the result of joining the valid versions of the source tables at the time the query finishes.
   • DAll logic will execute at query time and return the result of joining the valid versions of the source tables at the time the query began.

   Show answer

   Answer: D

   Explanation

   Here the view is getting created not the table. view is only saver select query which will get data from the valid version of the underlying table at the begining of the select statement made on view.

   Source: Adapted from community discussion — divyapsingh

   Next question

9. Question 89 · 202 in bank

   A data engineer is performing a join operation to combine values from a static userLookup table with a streaming DataFrame streamingDF. Which code block attempts to perform an invalid stream-static join?

   • AuserLookup.join(streamingDF, ["user_id"], how="right")
   • BstreamingDF.join(userLookup, ["user_id"], how="inner")
   • CuserLookup.join(streamingDF, ["user_id"), how="inner")
   • DuserLookup.join(streamingDF, ["user_id"], how="left")

   Show answer

   Answer: D

   Next question

10. Question 90 · 202 in bank

    A data architect has designed a system in which two Structured Streaming jobs will concurrently write to a single bronze Delta table. Each job is subscribing to a different topic from an Apache Kafka source, but they will write data with the same schema. To keep the directory structure simple, a data engineer has decided to nest a checkpoint directory to be shared by both streams. The proposed directory structure is displayed below:

    

    Which statement describes whether this checkpoint directory structure is valid for the given scenario and why?

    • ANo; Delta Lake manages streaming checkpoints in the transaction log.
    • BYes; both of the streams can share a single checkpoint directory.
    • CNo; only one stream can write to a Delta Lake table.
    • DNo; each of the streams needs to have its own checkpoint directory.

    Show answer

    Answer: D

    Next question

Keyboard:J Kmove between questionsA–Dselect an answerRshow or hide the answer← →change page

DE-PRO practice, question 81. 202 questions available.