DE-ASSOC practice questions 11–20

1. Question 11 · 170 in bank

   A data engineer is attempting to drop a Spark SQL table my_table and runs the following command: DROP TABLE IF EXISTS my_table; After running this command, the engineer notices that the data files and metadata files have been deleted from the file system. What is the reason behind the deletion of all these files?

   • AThe table was managed
   • BThe table's data was smaller than 10 GB
   • CThe table did not have a location
   • DThe table was external

   Show answer

   Answer: A

   Explanation

   The answer should be A --> the table was MANAGED. If the metadata and the underlined files have been deleted, then this is a MANAGED table and not an external table.

   Source: Adapted from community discussion — jetplanes

   Next question

2. Question 12 · 170 in bank

   A data engineer needs to create a table in Databricks using data from a CSV file at location /path/to/csv. They run the following command:

   

   Which of the following lines of code fills in the above blank to successfully complete the task?

   • AFROM "path/to/csv"
   • BUSING CSV
   • CFROM CSV
   • DUSING DELTA

   Show answer

   Answer: B

   Next question

3. Question 13 · 170 in bank

   What is a benefit of creating an external table from Parquet rather than CSV when using a CREATE TABLE AS SELECT statement?

   • AParquet files can be partitioned
   • BParquet files will become Delta tables
   • CParquet files have a well-defined schema
   • DParquet files have the ability to be optimized

   Show answer

   Answer: C

   Next question

4. Question 14 · 170 in bank

   A data engineer has left the organization. The data team needs to transfer ownership of the data engineer’s Delta tables to a new data engineer. The new data engineer is the lead engineer on the data team. Assuming the original data engineer no longer has access, which of the following individuals must be the one to transfer ownership of the Delta tables in Data Explorer?

   • ADatabricks account representative
   • BThis transfer is not possible
   • CWorkspace administrator
   • DNew lead data engineer
   • EOriginal data engineer

   Show answer

   Answer: C

   Explanation

   The ownership of Delta tables in Data Explorer can be transferred by the current owner, a metastore admin, or the owner of the container1. In this case, since the original data engineer no longer has access, the Workspace Administrator (Option C) would be the most appropriate individual to transfer the ownership of the Delta tables to the new data engineer. This is because the Workspace Administrator typically has the necessary permissions to manage such resources2. Please note that the exact process may vary depending on the specific configurations and permissions set up in your workspace. It’s always a good idea to consult with your organization’s IT or data governance team to ensure the correct procedures are followed.

   Source: Adapted from community discussion — Garyn

   References

   • Databricks documentation

   Next question

5. Question 15 · 170 in bank

   Which SQL keyword can be used to convert a table from a long format to a wide format?

   • ATRANSFORM
   • BPIVOT
   • CSUM
   • DCONVERT

   Show answer

   Answer: B

   Explanation

   Answer is (B. PIVOT) The PIVOT keyword is used to transform rows into columns, converting data from a long format (where each row represents a single measurement) to a wide format (where multiple measurements are represented as columns). For example, if you have a table of sales data with columns for Date, Product, and Sales, you can use PIVOT to create a table where each Product has its own column, and sales are aggregated by Date.

   Source: Adapted from community discussion — 9d4d68a

   Next question

6. Question 16 · 170 in bank

   A data engineer has a Python variable table_name that they would like to use in a SQL query. They want to construct a Python code block that will run the query using table_name. They have the following incomplete code block: ____(f"SELECT customer_id, spend FROM {table_name}") What can be used to fill in the blank to successfully complete the task?

   • Aspark.delta.sql
   • Bspark.sql
   • Cspark.table
   • Ddbutils.sql

   Show answer

   Answer: B

   Next question

7. Question 17 · 170 in bank

   A data engineer has configured a Structured Streaming job to read from a table, manipulate the data, and then perform a streaming write into a new table. The code block used by the data engineer is below:

   

   Which line of code should the data engineer use to fill in the blank if the data engineer only wants the query to execute a micro-batch to process data every 5 seconds?

   • Atrigger("5 seconds")
   • Btrigger(continuous="5 seconds")
   • Ctrigger(once="5 seconds")
   • Dtrigger(processingTime="5 seconds")

   Show answer

   Answer: D

   Next question

8. Question 18 · 170 in bank

   A data engineer is maintaining a data pipeline. Upon data ingestion, the data engineer notices that the source data is starting to have a lower level of quality. The data engineer would like to automate the process of monitoring the quality level. Which of the following tools can the data engineer use to solve this problem?

   • AAuto Loader
   • BUnity Catalog
   • CDelta Lake
   • DDelta Live Tables

   Show answer

   Answer: D

   Next question

9. Question 19 · 170 in bank

   A data engineer has three tables in a Delta Live Tables (DLT) pipeline. They have configured the pipeline to drop invalid records at each table. They notice that some data is being dropped due to quality concerns at some point in the DLT pipeline. They would like to determine at which table in their pipeline the data is being dropped. Which approach can the data engineer take to identify the table that is dropping the records?

   • AThey can set up separate expectations for each table when developing their DLT pipeline.
   • BThey can navigate to the DLT pipeline page, click on the “Error” button, and review the present errors.
   • CThey can set up DLT to notify them via email when records are dropped.
   • DThey can navigate to the DLT pipeline page, click on each table, and view the data quality statistics.

   Show answer

   Answer: D

   Next question

10. Question 20 · 170 in bank

    A data engineer needs to create a table in Databricks using data from their organization’s existing SQLite database. They run the following command:

    

    Which of the following lines of code fills in the above blank to successfully complete the task?

    • Aorg.apache.spark.sql.jdbc
    • Bautoloader
    • Corg.apache.spark.sql.sqlite
    • Dsqlite

    Show answer

    Answer: A

    Next question

Keyboard:J Kmove between questionsA–Dselect an answerRshow or hide the answer← →change page

DE-ASSOC practice, question 11. 170 questions available.