Online Access Free CDP-3002 Exam Questions

How can you monitor the storage level and usage of persisted RDDs in your Spark application?

• A.Manually analyze the Spark application code
• B.Leverage Spark metrics like rdd.getStorageLevel() and rdd.getPersistedSize()
• C.All of the above
• D.Use Spark's web UI and look for information under the "Storage" tab

In the context of Cloudera's SQL engines, what does the presence of a "Broadcast Hash Join" in an Explain Plan suggest about query performance?

• A.It implies that no indexing is used in the join operation
• B.It means that the query will execute faster than with any other join method
• C.It suggests that the join operation might be a performance bottleneck for large datasets
• D.It indicates an optimal use of network resources

Which of the following is NOT a factor considered by the Optimization Framework when optimizing a query?

• A.The phase of the moon
• B.User-defined functions (UDFs) complexity
• C.Network latency between nodes
• D.Data skewness

You have an Airflow DAG that extracts data from a CSV file. How can you ensure that the DAG doesn't attempt to process the same file multiple times in case of retries or task failures?

• A.Modify the extraction task to skip processing existing files based on a timestamp or marker within the file.
• B.Implement a custom mechanism to rename the processed file after each successful run.
• C.Configure the DAG to run only once and manually trigger subsequent runs when needed.
• D.Use the File lock operator before the extraction task to prevent other tasks from accessing the file while it's being processed.

You're debugging a slow-running Spark job writing a large Iceberg table. Which optimization techniques could improve performance? (Choose three.

• A.Filtering data as early as possible in the Spark transformation pipeline
• B.Disabling Spark's adaptive query execution
• C.Converting the DataFrame to RDD for Iceberg writes
• D.Repartitioning the DataFrame before writing to Iceberg
• E.Using the Z-Order clustering option in Iceberg