During application development, which of the following operations is not a typical network definition?

Question

Options

• ANetwork definition
• BNetwork execution
• CKnowledge distillation
• DWeight initialization

• A
  13% (7)
• B
  6% (3)
• C
  77% (40)
• D
  4% (2)

Explanation

Knowledge distillation (C) stands apart because it is a model compression technique - a process where a smaller "student" model is trained to replicate the behavior of a larger "teacher" model - not a step in setting up or defining a network. It belongs to a separate optimization/compression phase, not the standard development pipeline.

Why the distractors are wrong:

• A (Network definition) is the foundational step of specifying architecture: layers, connections, activations, and topology.
• B (Network execution) is a standard operation - running a forward pass to produce output or perform inference.
• D (Weight initialization) is a required setup step before training, assigning starting values to parameters (e.g., Xavier or He initialization).

Memory tip: Think of building a house - you define the blueprint (A), initialize materials on-site (D), and run the construction process (B). Knowledge distillation (C) is more like cloning a scaled-down version of the finished house after it's built - useful, but not part of the original build workflow.

No community discussion yet for this question.