IVI Framework Viewer

Monitor

B3

Identify evidence of success to measure achievement of desired outcomes. Establish an effective monitoring system that collects and analyses data, and reports progress against plans to the governing body. Instigate mechanisms to monitor compliance with relevant legislation, regulations, and organizational policies.

Improvement Planning

Practices-Outcomes-Metrics (POM)

Representative POMs are described for Monitor at each level of maturity.

2Basic
  • Practice
    Define the major high-level success criteria that will be used to measure progress towards achieving the desired outcomes of the IT strategy.
    Outcome
    A documented high-level set of success criteria is available that can measure the performance of IT in achieving some of the key outcomes of the IT strategy.
    Metric
    # of success criteria defined.
  • Practice
    Establish basic IT monitoring in key areas.
    Outcomes
    • Some key areas begin to be monitored, but not all in a standard manner.
    • High-level information can be provided to the governing body on the progress of major change initiatives or of projects that are directly linked to implementing the IT strategy.
    Metrics
    • % of IT areas that are monitored.
    • % of change initiatives/projects whose progress is reported to the governing body.
  • Practice
    Establish an appropriate mechanism to monitor IT compliance with some key legislative and regulatory requirements and organizational policies.
    Outcomes
    • Basic counts of typical non-compliance events are reported.
    • Monitoring, however, may only be used as a result of, or from a fear of, major incidents.
    Metrics
    • % of internal and external obligations for which compliance is monitored.
    • # of compliance anomalies.
    • # of compliance breaches.
3Intermediate
  • Practice
    Define the detailed success criteria that will be used to measure progress towards achieving the desired outcomes of the IT strategy.
    Outcome
    A standard set of success criteria is available that can measure the performance of IT in achieving most of the key outcomes of the IT strategy.
    Metrics
    • # of success criteria defined.
    • # of success criteria directly linked to the IT strategy.
  • Practice
    Establish formal IT monitoring systems with a key performance focus.
    Outcomes
    • There is an effective monitoring system in place across most of IT.
    • Standard information on the progress of change programmes can be provided to the governing body, to ensure they achieve targeted business outcomes.
    Metrics
    • % of IT areas that are monitored.
    • % of change initiatives/projects whose progress is reported to the governing body.
    • Average of planned time vs. actual time to succeed with an individual IT project or initiative.
  • Practice
    Use appropriate reporting and audit practices to monitor IT compliance with all external mandates and most of the key organizational policies.
    Outcomes
    • An agreed set of indicators is monitored and reported in relation to IT compliance issues and breaches.
    • There is increased likelihood that the organization complies with all external regulatory mandates.
    Metrics
    • % of internal and external obligations for which compliance is monitored.
    • # of compliance anomalies. # of compliance breaches.
4Advanced
  • Practices
    • Define a comprehensive set of success criteria that will be used to measure the effectiveness of the IT strategy in supporting the strategic objectives of the business.
    • Provide the ability to change the success criteria to reflect changes to the IT strategy and the business environment.
    Outcomes
    • A comprehensive set of success criteria is available that can measure the performance of IT in achieving all of the key outcomes of the IT strategy.
    • The criteria can be rapidly changed to reflect any changes to the IT strategy and/or the business objectives.
    Metrics
    • # of success criteria defined.
    • # of success criteria directly linked to the IT strategy.
    • # of modifications to the success criteria.
  • Practice
    Establish flexible, outcome-focused IT governance monitoring systems (e.g. dashboards, scorecards, etc.) to provide comprehensive information on both change programme progress and the overall performance of IT against agreed objectives and outcomes.
    Outcomes
    • A full set of transparent and easily accessible tools is available to effectively monitor all of IT.
    • The monitoring system provides flexible reporting and highlights where deviations from expectations require an action or an appropriate intervention.
    Metrics
    • % of IT areas that are monitored.
    • % of change initiatives/projects whose progress is reported to the governing body.
    • Average of planned time vs. actual time to succeed with an individual IT project or initiative.
  • Practice
    Monitor IT compliance through the appropriate use of reporting and audit practices, ensuring that reviews are timely, comprehensive, and suitable for the evaluation of all legislative, regulatory, and organizational policy obligations.
    Outcomes
    • A comprehensive set of monitoring capabilities facilitates compliance reporting, with a complete organization-wide set of metrics and KPIs.
    • There is increased likelihood that the organization complies with the complete range of internal and external obligations and standards.
    Metrics
    • % of internal and external obligations for which compliance is monitored.
    • # of compliance anomalies.
    • # of compliance breaches.
5Optimized
  • Practices
    • Define a holistic set of success criteria that will be used to measure the effectiveness of the IT strategy in supporting strategic objectives across the business ecosystem.
    • Provide the ability to automatically/dynamically update these criteria to reflect any changes in the business environment and the IT strategy.
    Outcomes
    • The success criteria can measure the performance of IT in achieving all of the key strategic objectives across the business ecosystem.
    • Success criteria can be automatically updated to reflect changing requirements across the business ecosystem.
    Metrics
    • # of success criteria defined.
    • # of success criteria directly linked to the IT strategy.
    • # of modifications to the success criteria.
    • % automation of the success criteria.
  • Practices
    • Ensure a fully automated monitoring system is in place to provide information, as and when required.
    • Continually use IT monitoring across the business ecosystem to protect business value.
    Outcomes
    • The monitoring system supports optimized decision-making and ensures that the appropriate actions are taken.
    • All monitoring activities have business value orientation as their primary goal.
    Metrics
    • # of IT areas that are monitored.
    • % of change initiatives/projects whose progress is reported to the governing body.
    • Average of planned time vs. actual time to succeed with an individual IT project or initiative.
    • % automation of monitoring activities.
    • % of IT monitoring activities that emphasize business value criteria.
  • Practices
    • Automatically monitor and report all IT compliance activity across the business ecosystem.
    • Continually review compliance monitoring approaches, and update them based on the latest research, benchmarks, and best known-industry practices.
    Outcomes
    • The compliance monitoring process is regarded as an industry exemplar.
    • Comprehensive self-service and analysis tools aid insight and understanding of the compliance reports.
    Metrics
    • % of internal and external obligations for which compliance is monitored.
    • # of compliance anomalies.
    • # of compliance breaches.