Qubole Scheduler

The QDS scheduler allows you to configure jobs and specify the intervals at which they run, and provides additional capabilities that make it a powerful tool for automating your workflow. Job characteristics you can specify include:

• The job type (Hive Query, Hadoop Job, etc.) and query parameters
• The job start and end date and time, and its time zone and frequency
• Javascript macros to be included
• The Hadoop Fair Scheduler queue (Hadoop 2) to be used
• The number of concurrent jobs to allow
• Hive and GCP GS dependencies, to ensure that the job runs only when the data it needs is available.

For more information, see the following topics:

• Using the Scheduler User Interface
• Understanding the Qubole Scheduler Concepts
• Viewing a Schedule
• Creating a New Schedule
• Configuring GS Files Data Dependency
• Configuring Hive Tables Data Dependency
• Managing Scheduler Permissions through the UI
• Editing and Cloning a Schedule
• Hive Datasets as Schedule Dependency
• Macros in Scheduler