You need to run the same job many times with minor variations. Rather than hardcoding all job configuration options in your drive code, you've decided to have your Driver subclass…

Question

Options

• Ahadoop "mapred.job.name=Example" MyDriver input output
• Bhadoop MyDriver mapred.job.name=Example input output
• Chadoop MyDrive -D mapred.job.name=Example input output
• Dhadoop setproperty mapred.job.name=Example MyDriver input output
• Ehadoop setproperty ("mapred.job.name=Example") MyDriver input output

• A
  3% (1)
• B
  3% (1)
• C
  73% (24)
• D
  15% (5)
• E
  6% (2)

Explanation

Configure the property using the -D key=value notation: -D mapred.job.name='My Job' You can list a whole bunch of options by calling the streaming jar with just the -info argument Python hadoop streaming : Setting a job name

No community discussion yet for this question.