A company generates approximately 20 GB of data multiple times each day. The company uses AWS DataSync to copy all data from on-premises storage to Amazon S3 every 6 hours for further processing…

Question

Options

• AModify the data generation process on-premises to create a manifest file at the end of the copy
• BModify the data generation process on-premises to create a manifest file at the end of the copy
• CCreate an AWS Lambda function that Amazon EventBridge invokes when the manifest file is
• DCreate an AWS Lambda function that an S3 Event Notification invokes when the manifest file is
• ECreate an Amazon Simple Notification Service (Amazon SNS) topic. Create an Amazon
• FCreate an Amazon Simple Notification Service (Amazon SNS) topic. Create an AWS Lambda

• A
  62% (42)
• B
  24% (16)
• C
  10% (7)
• F
  4% (3)

Explanation

To meet the requirements of copying only relevant data as soon as possible and receiving notifications upon completion, the following steps are recommended: Generate a Manifest File (Option A): Action: Modify the on-premises data generation process to create a manifest file at the end of each data generation cycle. This manifest should list the names of the objects that need to be copied to Amazon S3. Implementation: Develop a custom script that runs after data generation. This script compiles the list of relevant data files into a manifest file and uploads it to a designated S3 bucket. Justification: Using a manifest allows AWS DataSync to transfer only the specified files, reducing unnecessary data transfer and associated costs. Automate DataSync Task Execution (Option D): Action: Set up an S3 Event Notification to trigger an AWS Lambda function whenever a new manifest file is uploaded to the S3 bucket. Implementation: Configure the Lambda function to invoke the DataSync task by calling the StartTaskExecution API action, specifying the manifest file. This ensures that only the files listed in the manifest are copied from on-premises storage to Amazon S3. Justification: This automation ensures timely data transfer as soon as relevant data is available, minimizing delays and manual intervention. Set Up Completion Notifications (Option E): Action: Create an Amazon SNS topic to handle notifications. Then, establish an Amazon EventBridge rule that monitors the DataSync task execution status and sends an email notification to the SNS topic when the status changes to SUCCESS or ERROR. Implementation: Configure EventBridge to capture state changes of the DataSync task. When a task completes successfully or encounters an error, EventBridge triggers a notification to the SNS topic, which then sends an email to the subscribed recipients. Justification: This setup provides immediate feedback on the data transfer process, allowing the analytics team to act promptly based on the success or failure of the data copy operation.

No community discussion yet for this question.