Digipede Technologies Many Legs Make Light Work

1
Digipede TechnologiesMany Legs Make Light Work

• High Throughput Computing Week
• Introduction to the Digipede Network

2
Agenda

• Introduction to the Digipede Network
• System Overview
• Components
• Concepts in the Digipede Network
• Job templates, jobs, and tasks
• FileDefs, parameters, and other settings
• Using the Digipede Network with no programming
• Designing jobs using wizards in Digipede
  Workbench
• Using designers

3
What is the Digipede Network?

• A Windows-based
• grid computing solution
• middle-tier, distributed computing solution
• tool to improve application performance,
  scalability, through-put, and reliability.

The Digipede Network is a set of tools that make
it easy to distribute an applications execution
onto a network.
4
Digipede NetworkInstallation overview
5
Digipede NetworkComponents

• Infrastructure
• Digipede Server
• Digipede Agent
• Administration
• Digipede Control
• Job Submission
• Digipede Workbench
• Digipede Framework SDK
• PowerShell or JobSubmit.exe

6
Digipede NetworkInstallation Overview

• Infrastructure
• The Digipede Server
• A Digipede Agent on each compute node
• Job creation/submission tools
• Digipede Workbench
• Digipede Framework SDK

7
Concepts to Know Job Templates, Jobs, and Tasks

• Job Templates
• Defines how to work on a class of jobs
• Describes files to move and cache
• How to invoke the job
• Jobs
• Run against a job template
• May contain data or files that apply just to that
  job
• Task
• Part of a job
• Executed on one machine atomic unit of work
• May contain data or files that apply just to that
  task

8
Basic Concepts
Job Template Task Parameter
Job File Definition Job Defaults
9
Digipede NetworkFile Definitions

• File Definitions describe the files that will be
  moved as part of a job or task
• Relevance
• JobTemplate
• JobPlaceholder -gt Input
• InputPlaceholder -gt Input
• ResultPlaceholder -gt Result
• File Transfer
• Streamed (Digipede API apps only)
• Hosted
• Location
• Transfer Types

10
Digipede NetworkParameters

• Parameters are name-value pairs that can be used
  to pass information with a job template, job, or
  task
• Relevance
• JobTemplate
• JobPlaceholder - Input
• InputPlaceholder - Input
• Substitution Variables
• (tmpfile) - A unique temporary file name
• (JobID) The Job ID of the Job
• (string) The variable is replaced by the value
  of the parameter or file name of the file
  indicated by string.

11
Digipede NetworkJob Defaults
Minimum CPU Maximum Assignments
Minimum RAM Maximum Failures
Reassignment Interval
12
Digipede NetworkJob Template

• File Definition
• Job Defaults
• Application Control
• Command line
• .NET
• COM
• Version

13
Digipede NetworkJob

• File Definitions
• Parameter
• Settings
• Collection of tasks

14
Digipede NetworkTask

• File Definitions
• Result Files
• Parameters
• Command line (can be combination of hardcoded
  text, parameters, and file names)

15
Digipede NetworkDigipede Workbench Wizards
Job Template Wizard
16
Digipede NetworkDigipede Workbench Wizards
Job Wizard
17
Digipede NetworkDigipede Workbench Designers
Job Template Designer
18
Digipede NetworkDigipede Workbench Job Tracking
19
Digipede NetworkDigipede Control Monitoring
Pages
Job Page
20
Hello, World!

• Stage the files
• Manually deploy to each node
• Or put in an accessible (via copy or HTTP)
  location
• Create a Job Template (and Job) in Digipede
  Workbench
• Define common file (HelloWorld.exe)
• Create tasks (use a Range parameter)
• Tell it the command line
• In advanced options, make sure you select Save
  Standard Output

21
Install and Start Workbench

1. Open a browser and navigate to \\HTC-Server\Digip
   edeControl, and log in. Use your PC name as a
   login and password (e.g., LABPC04).Then, click
   on Digipede Workbench and follow installation
   instructions. During the install, the server
   name is HTC-Server and the login/password is your
   PC name.
2. Start Workbench (Start Menu -gt Programs -gt
   Digipede -gt Workbench)

22
The Job Wizard

1. Start Job Wizard
2. Existing? No

1. Name your job
2. Move files via Share

23
Define Files and Parameters

1. One common file
2. Browse and select
3. No Job or Task files

1. One parameter
2. Define range parameter

24
Finish and Submit

1. No result files or Digipede API
2. Define command line
3. Add TaskID to the command lineHelloWorld.exe
   (TaskID)
4. No notifications

1. Select Advanced Options, Save Standard
   Output
2. Finish and run!