You need to create a pipeline to ingest data from a variety of sources, including SQL Server databases, CSV files, and JSON files. Which of the following pipeline design strategies would be most…

Creating a separate pipeline for each data source leads to increased management overhead and complexity, especially as the number of sources grows, making it less effective.

Creating a single pipeline that includes multiple activities, each specifically configured to ingest data from a different source type (SQL Server, CSV, JSON), is the most effective and maintainable strategy. This approach centralizes the orchestration and monitoring of all ingestion tasks, allowing for efficient management and potential parallel execution of source-specific activities.

A lookup activity is typically used to retrieve configuration data or parameterize subsequent activities, not to determine the entire data source type and dynamically switch ingestion logic.

Using a script activity to dynamically create other activities introduces significant complexity and maintenance overhead; standard activities within a single pipeline are generally sufficient and more robust for varied ingestion tasks.