Files from multiple data sources arrive in an Amazon S3 bucket on a regular basis. A data engineer wants to ingest new files into Amazon Redshift in near real time when the new files arrive in the…

Scheduling a COPY command via the query editor v2 would involve fixed intervals or manual execution, which does not meet the 'near real-time' requirement for new file arrivals.

The zero-ETL integration between Amazon Aurora and Amazon Redshift is designed for replicating data from an Aurora database to Redshift, not for ingesting files from an S3 bucket.

AWS Glue job bookmarks help in processing only new or changed data during ETL jobs, but an AWS Glue job typically runs on a schedule or requires a trigger, which might introduce more latency than a direct S3 event-Lambda invocation for simple data loading.

S3 Event Notifications can be configured to automatically trigger an AWS Lambda function whenever new files are uploaded to the S3 bucket. The Lambda function can then execute an Amazon Redshift COPY command or use the Redshift Data API to load the new data into the Redshift cluster, achieving near real-time ingestion.