nerdexam
Amazon

DEA-C01 · Question #145

A data engineer is using an AWS Glue crawler to catalog data that is in an Amazon S3 bucket. The S3 bucket contains both .csv and json files. The data engineer configured the crawler to exclude the…

The correct answer is C. Relocate the .json files to a different path within the S3 bucket. Athena does not recognize exclude patterns that you specify an AWS Glue crawler. For example, if you have an Amazon S3 bucket that contains both .csv and .json files and you exclude the .json files from the crawler, Athena queries both groups of files. To avoid this, place the…

Data Ingestion and Transformation

Question

A data engineer is using an AWS Glue crawler to catalog data that is in an Amazon S3 bucket. The S3 bucket contains both .csv and json files. The data engineer configured the crawler to exclude the .json files from the catalog. When the data engineer runs queries in Amazon Athena, the queries also process the excluded .json files. The data engineer wants to resolve this issue. The data engineer needs a solution that will not affect access requirements for the .csv files in the source S3 bucket. Which solution will meet this requirement with the SHORTEST query times?

Options

  • AAdjust the AWS Glue crawler settings to ensure that the AWS Glue crawler also excludes .json
  • BUse the Athena console to ensure the Athena queries also exclude the .json files.
  • CRelocate the .json files to a different path within the S3 bucket.
  • DUse S3 bucket policies to block access to the .json files.

How the community answered

(31 responses)
  • A
    6% (2)
  • B
    16% (5)
  • C
    71% (22)
  • D
    6% (2)

Explanation

Athena does not recognize exclude patterns that you specify an AWS Glue crawler. For example, if you have an Amazon S3 bucket that contains both .csv and .json files and you exclude the .json files from the crawler, Athena queries both groups of files. To avoid this, place the files that you want to exclude in a different location. https://docs.aws.amazon.com/athena/latest/ug/troubleshooting-athena.html

Topics

#AWS Glue#Amazon Athena#Amazon S3#Query Optimization

Community Discussion

No community discussion yet for this question.

Full DEA-C01 Practice