#Hadoop has a built-in process and resource scheduler #YARN for managing job allocation to various physical systems and storage volumes. Hadoop workflow managers allow IT teams to create complex scripts that control job creation, execution and output. Using a workflow manager with YARN is akin to using a #Linux scripting language like Awk, Bash, Perl or Python in conjunction with the operating system's native cron scheduler. IT teams that need to execute complex Hadoop tasks should understand the major features and various options of a workflow manager on Hadoop, including some that are native to a particular Hadoop distribution.
No comments:
Post a Comment