Download (direct link):
Assess Program Execution
Assessing program execution entails reviewing the game plan versus the current activities, and assessing the activities and decisions made that influenced the outcome. Aggregating information such as measurements and evaluating actual versus desired objectives help management determine areas within the portfolio that were successful at developing and executing it, as well as areas that were deficient.
Assessing program execution helps refine and improve the various stages in the process. For instance, criteria, performance metrics, and tuning options developed in the creating, assessing, and balancing stages might be refined and improved based on evaluating the results. Problems should be identified, and the specific areas of weakness should be corrected. Areas that met their expectations also provide valuable input for highlighting important lessons learned and reinforcing aspects of the IT portfolio management process and framework.
272 CHAPTER 5 BUILDING THE IT PORTFOLIO
EXHIBIT 5.49 ASSESSING EXECUTION TASKS
Iterate Throughout These Tasks
Assess Performance Assessment &
Program Assessment Execution
Execution Comparison Report
* Assess the actual * Reassess the overall * Identify and report all
performance of the ability of the company enhancement from areas
current portfolio to support and sustain identified in the game plan
management process the portfolio stage, and identify areas for
- Collect management process further refinement and
measurements and compare to the improvement
necessary to assessment in the
reflect and game plan stage
measure the IT - Evaluate maturity,
process capability /
- Compare actual dependence,
versus desired peer benchmarks
established in the
game plan stage
- Determine lessons
- Create program
Compare Performance Assessments
The performance assessment comparison reassesses and evaluates the maturity of the IT portfolio, determines strengths and weaknesses in the readiness assessment, and evaluates the relationship between IT and business. Areas evaluated as part of this activity include:
• Customer survey and user satisfaction levels to determine where the process excelled and where possible improvement can be made.
• Impacts of IT portfolio management based on the information and data collected, and whether the actual impacts were in line with the intended ones. Assessing and evaluating whether key deliverables, timelines, and milestones were met and aligned with business and strategic objectives is critical.
STAGE 8: ASSESSING EXECUTION 273
• People and culture aspects of performance, including evaluation and assessment of the extent to which the workforce complied with IT portfolio management, determination of the effectiveness of the collaboration efforts used to define criteria and weightings, and effectiveness of incentives and training in driving desired behaviors.18
Peer benchmarking is also used as part of this process to assure that the company is assessing and comparing its portfolio management process with other entities.
Prepare Assessment and Execution Report
All companies should have policies and procedures in place to document the findings from the assessing execution stage.19 The assessment and execution report documents all enhancements made from areas identified in the game plan stage and those areas that require further refinement and improvement. Knowledge and insight are gained from the positive and negative aspects learned during the stages and activities, and it is imperative to memorialize both the success and failures in order to learn from mistakes and minimize the chances of reoccurrence.