Mn/DOT CS Consultant Evaluation

1
Mn/DOT CS Consultant Evaluation

• Best Practices Review
• May 01, 2003

2
Agenda

• Best Practices research plan (reprise)
• How we determined Best Practices
• Results of Best Practices Review
• The States with best practices
• Best Practice Findings
• Doing Consultant Evaluations
• Using Consultant Evaluations
• Mn/DOT Consultant Evaluations
• Level 2 Documentation
• Level 3 Documentation

3
The July 2002 Plan

• Research 13 states preliminarily identified for
  best practices in pre-qualification
• Research 10 states identified for best practices
  in consultant evaluation.
• Complete the question-set for all.

4
What is Best Practice

• Theory Process Maturity
• Five Levels of Process Maturity
• Refer to Process Maturity Article on LC Web
  Page
• Application of theory focused on
• Criterion 1 Documented addresses the extent to
  which an organizations processes are documented.
  The least mature state of documentation maturity
  is one in which processes typically are ad hoc,
  perhaps even chaotic. . . Alternatively, in the
  most mature state, written documentation is not
  only consistent throughout the organization, it
  is an intrinsic element of the process itself.
• Criterion 2 Practiced criterion addresses the
  consistency of process performance. In the least
  mature state, processes are practiced in an ad
  hoc or, at best, intermittent manner. By
  contrast, the processes of a more mature
  organization are practiced consistently and
  throughout the organization

5
Best Practice States
6
Doing Consultant Evaluations

1. An evaluation process is documented via formal
   policies procedures.(Ohio, Iowa, Kansas)
2. There is a clear separation between technical
   performance and project management performance
   (I.e., schedule, budget, communication). (Ohio,
   Iowa, Kansas, Florida)
3. Performance scales are pre-defined and explained
   in detail sufficient to ensure consistent
   application. (Ohio, Iowa, Ontario)
4. Evaluation criteria are pre-defined and explained
   in detail sufficient to ensure consistent
   application. (Ohio, Iowa, Florida)

7
Doing Consultant Evaluations

• Evaluation criteria require project-specific
  customization by Project Manager. (Ohio)
• Performance ratings must be supported with
  written comments. (Ohio, Kansas)
• Performance evaluation is shared with the
  Consultant in a performance evaluation
  conference. (Ohio, Iowa, Kansas)
• Consultant is given the opportunity to respond to
  the evaluation. (Ohio, Iowa, Kansas)

8
Using Consultant Evaluations

1. Consultant evaluations are explicitly used in
   project selection decisions. (Ohio, Kansas,
   Iowa, Florida, Ontario)
2. Poor Consultant evaluations are explicitly
   grounds for suspension of pre-qualification
   status. (Ohio, Florida, Ontario)