PROFESSIONAL-MACHINE-LEARNING-ENGINEER · Question #144
You have recently created a proof-of-concept (POC) deep learning model. You are satisfied with the overall architecture, but you need to determine the value for a couple of hyperparameters. You want t
The correct answer is B. Use UNIT_LINEAR_SCALE for the embedding dimension, UNIT_LOG_SCALE for the learning. For hyperparameter tuning on Vertex AI, integer hyperparameters like embedding dimension typically use UNIT_LINEAR_SCALE, while floating-point hyperparameters like learning rate, which often span orders of magnitude, should use UNIT_LOG_SCALE.
Question
Options
- AUse UNIT_LINEAR_SCALE for the embedding dimension, UNIT_LOG_SCALE for the learning
- BUse UNIT_LINEAR_SCALE for the embedding dimension, UNIT_LOG_SCALE for the learning
- CUse UNIT_LOG_SCALE for the embedding dimension, UNIT_LINEAR_SCALE for the learning
- DUse UNIT_LOG_SCALE for the embedding dimension, UNIT_LINEAR_SCALE for the learning
How the community answered
(40 responses)- A3% (1)
- B80% (32)
- C5% (2)
- D13% (5)
Why each option
For hyperparameter tuning on Vertex AI, integer hyperparameters like embedding dimension typically use `UNIT_LINEAR_SCALE`, while floating-point hyperparameters like learning rate, which often span orders of magnitude, should use `UNIT_LOG_SCALE`.
This choice is incomplete in the prompt but would be incorrect if it suggests UNIT_LINEAR_SCALE for learning rate.
The embedding dimension is an integer hyperparameter that represents a linear range (16 to 64), making `UNIT_LINEAR_SCALE` appropriate for uniform sampling across this range. The learning rate (10e-05 to 10e-02) is a floating-point hyperparameter that typically performs best when sampled from a logarithmic scale, as changes of an order of magnitude are more significant than linear changes in its small range, thus `UNIT_LOG_SCALE` is the correct choice.
`UNIT_LOG_SCALE` is generally not suitable for embedding dimensions as they are integer values often explored linearly; `UNIT_LINEAR_SCALE` is incorrect for the learning rate which should be sampled logarithmically.
`UNIT_LOG_SCALE` is generally not suitable for embedding dimensions as they are integer values often explored linearly; `UNIT_LINEAR_SCALE` is incorrect for the learning rate which should be sampled logarithmically.
Concept tested: Vertex AI hyperparameter tuning scaling types
Source: https://cloud.google.com/vertex-ai/docs/training/hyperparameter-tuning-overview#scaling-types
Topics
Community Discussion
No community discussion yet for this question.