Professional-Data-Engineer Exam Question 81

You are building an application to share financial market data with consumers, who will receive data feeds.
Data is collected from the markets in real time. Consumers will receive the data in the following ways:
* Real-time event stream
* ANSI SQL access to real-time stream and historical data
* Batch historical exports
Which solution should you use?
  • Professional-Data-Engineer Exam Question 82

    You want to automate execution of a multi-step data pipeline running on Google Cloud. The pipeline includes Cloud Dataproc and Cloud Dataflow jobs that have multiple dependencies on each other. You want to use managed services where possible, and the pipeline will run every day. Which tool should you use?
  • Professional-Data-Engineer Exam Question 83

    Your team is responsible for developing and maintaining ETLs in your company. One of your Dataflow jobs is failing because of some errors in the input data, and you need to improve reliability of the pipeline (incl.
    being able to reprocess all failing data).
    What should you do?
  • Professional-Data-Engineer Exam Question 84

    Your team runs a complex analytical query daily that processes terabytes of data. Recently, after running for
    20 minutes, the query fails with a "Resources exceeded" error. You need to resolve this issue. What should you do?
  • Professional-Data-Engineer Exam Question 85

    You have a table that contains millions of rows of sales data, partitioned by date Various applications and users query this data many times a minute. The query requires aggregating values by using avg. max. and sum, and does not require joining to other tables. The required aggregations are only computed over the past year of data, though you need to retain full historical data in the base tables You want to ensure that the query results always include the latest data from the tables, while also reducing computation cost, maintenance overhead, and duration. What should you do?