DE-PRO practice questions 21–30

1. Question 21 · 202 in bank

   A data engineer, User A, has promoted a pipeline to production by using the REST API to programmatically create several jobs. A DevOps engineer, User B, has configured an external orchestration tool to trigger job runs through the REST API. Both users authorized the REST API calls using their personal access tokens. A workspace admin, User C, inherits responsibility for managing this pipeline. User C uses the Databricks Jobs UI to take "Owner" privileges of each job. Jobs continue to be triggered using the credentials and tooling configured by User B. An application has been configured to collect and parse run information returned by the REST API. Which statement describes the value returned in the creator_user_name field?

   • AOnce User C takes "Owner" privileges, their email address will appear in this field; prior to this, User A’s email address will appear in this field.
   • BUser B’s email address will always appear in this field, as their credentials are always used to trigger the run.
   • CUser A’s email address will always appear in this field, as they still own the underlying notebooks.
   • DOnce User C takes "Owner" privileges, their email address will appear in this field; prior to this, User B’s email address will appear in this field.
   • EUser C will only ever appear in this field if they manually trigger the job, otherwise it will indicate User B.

   Show answer

   Answer: B

   Explanation

   Sorry - really B The creator_user_name field in the Databricks REST API response for job runs reflects the user who triggered the job, not the owner of the job or the creator of the underlying notebooks. Since User B's external orchestration tool triggers the job runs using their personal access token, the field will always indicate User B's email address as the "creator" of those job runs.

   Source: Adapted from community discussion — temple1305

   Next question

2. Question 22 · 202 in bank

   A member of the data engineering team has submitted a short notebook that they wish to schedule as part of a larger data pipeline. Assume that the commands provided below produce the logically correct results when run as presented.

   

   Which command should be removed from the notebook before scheduling it as a job?

   • ACmd 2
   • BCmd 3
   • CCmd 4
   • DCmd 5

   Show answer

   Answer: D

   Explanation

   The display function is built specifically for the notebook environment and will not work for Spark. Should you want to print contacts of DF in Spark then replace it with df.show()

   Source: Adapted from community discussion — csrazdan

   Next question

3. Question 23 · 202 in bank

   Which statement regarding Spark configuration on the Databricks platform is true?

   • AThe Databricks REST API can be used to modify the Spark configuration properties for an interactive cluster without interrupting jobs currently running on the cluster.
   • BSpark configurations set within a notebook will affect all SparkSessions attached to the same interactive cluster.
   • CWhen the same Spark configuration property is set for an interactive cluster and a notebook attached to that cluster, the notebook setting will always be ignored.
   • DSpark configuration properties set for an interactive cluster with the Clusters UI will impact all notebooks attached to that cluster.

   Show answer

   Answer: D

   Next question

4. Question 24 · 202 in bank

   A junior data engineer has configured a workload that posts the following JSON to the Databricks REST API endpoint 2.0/jobs/create.

   

   Assuming that all configurations and referenced resources are available, which statement describes the result of executing this workload three times?

   • AThree new jobs named "Ingest new data" will be defined in the workspace, and they will each run once daily.
   • BThe logic defined in the referenced notebook will be executed three times on new clusters with the configurations of the provided cluster ID.
   • CThree new jobs named "Ingest new data" will be defined in the workspace, but no jobs will be executed.
   • DOne new job named "Ingest new data" will be defined in the workspace, but it will not be executed.
   • EThe logic defined in the referenced notebook will be executed three times on the referenced existing all purpose cluster.

   Show answer

   Answer: C

   Explanation

   You can totally create 3 jobs with the same name using the UI. REST API is no different. Since no schedule information is in the json, it will not run.

   Source: Adapted from community discussion — arekm

   Next question

5. Question 25 · 202 in bank

   The business reporting team requires that data for their dashboards be updated every hour. The total processing time for the pipeline that extracts, transforms, and loads the data for their pipeline runs in 10 minutes. Assuming normal operating conditions, which configuration will meet their service-level agreement requirements with the lowest cost?

   • AConfigure a job that executes every time new data lands in a given directory
   • BSchedule a job to execute the pipeline once an hour on a new job cluster
   • CSchedule a Structured Streaming job with a trigger interval of 60 minutes
   • DSchedule a job to execute the pipeline once an hour on a dedicated interactive cluster

   Show answer

   Answer: B

   Next question

6. Question 26 · 202 in bank

   A Databricks SQL dashboard has been configured to monitor the total number of records present in a collection of Delta Lake tables using the following query pattern: SELECT COUNT (*) FROM table - Which of the following describes how results are generated each time the dashboard is updated?

   • AThe total count of rows is calculated by scanning all data files
   • BThe total count of rows will be returned from cached results unless REFRESH is run
   • CThe total count of records is calculated from the Delta transaction logs
   • DThe total count of records is calculated from the parquet file metadata

   Show answer

   Answer: C

   Next question

7. Question 27 · 202 in bank

   A Delta Lake table was created with the below query:

   

   Consider the following query: DROP TABLE prod.sales_by_store - If this statement is executed by a workspace admin, which result will occur?

   • AData will be marked as deleted but still recoverable with Time Travel.
   • BThe table will be removed from the catalog but the data will remain in storage.
   • CThe table will be removed from the catalog and the data will be deleted.
   • DAn error will occur because Delta Lake prevents the deletion of production data.

   Show answer

   Answer: C

   Next question

8. Question 28 · 202 in bank

   A developer has successfully configured their credentials for Databricks Repos and cloned a remote Git repository. They do not have privileges to make changes to the main branch, which is the only branch currently visible in their workspace. Which approach allows this user to share their code updates without the risk of overwriting the work of their teammates?

   • AUse Repos to create a new branch, commit all changes, and push changes to the remote Git repository.
   • BUse Repos to create a fork of the remote repository, commit all changes, and make a pull request on the source repository.
   • CUse Repos to pull changes from the remote Git repository; commit and push changes to a branch that appeared as changes were pulled.
   • DUse Repos to merge all differences and make a pull request back to the remote repository.

   Show answer

   Answer: A

   Next question

9. Question 29 · 202 in bank

   The security team is exploring whether or not the Databricks secrets module can be leveraged for connecting to an external database. After testing the code with all Python variables being defined with strings, they upload the password to the secrets module and configure the correct permissions for the currently active user. They then modify their code to the following (leaving all other variables unchanged).

   

   Which statement describes what will happen when the above code is executed?

   • AThe connection to the external table will succeed; the string "REDACTED" will be printed.
   • BAn interactive input box will appear in the notebook; if the right password is provided, the connection will succeed and the encoded password will be saved to DBFS.
   • CAn interactive input box will appear in the notebook; if the right password is provided, the connection will succeed and the password will be printed in plain text.
   • DThe connection to the external table will succeed; the string value of password will be printed in plain text.

   Show answer

   Answer: A

   Next question

10. Question 30 · 202 in bank

    The data science team has created and logged a production model using MLflow. The model accepts a list of column names and returns a new column of type DOUBLE. The following code correctly imports the production model, loads the customers table containing the customer_id key column into a DataFrame, and defines the feature columns needed for the model.

    

    Which code block will output a DataFrame with the schema "customer_id LONG, predictions DOUBLE"?

    • Adf.map(lambda x:model(x[columns])).select("customer_id, predictions")
    • Bdf.select("customer_id", model(*columns).alias("predictions"))
    • Cmodel.predict(df, columns)
    • Ddf.apply(model, columns).select("customer_id, predictions")

    Show answer

    Answer: B

    Explanation

    Correct Answer: B This option uses select to specify columns from the DataFrame and applies the model to the specified columns (columns). The output of the model is aliased as "predictions", which ensures the output DataFrame will have the column names "customer_id" and "predictions" with appropriate data types assuming the model returns a double type. This syntax aligns with PySpark's DataFrame transformations and is a typical way to apply a machine learning model to specific columns in Databricks.

    Source: Adapted from community discussion — Freyr

    Next question

Keyboard:J Kmove between questionsA–Dselect an answerRshow or hide the answer← →change page

DE-PRO practice, question 21. 202 questions available.