3.1 Self-Assessment Framework and Materials Overview


3.1 Self-Assessment Framework and Materials Overview

Detailed Technical Framework

The technical framework is developed around the data life-cycle, which for the purposes of this guidance is broken down into five (5) Areas. Each data life-cycle area is further organized into several Sections and their individual Elements.

Figure 3-1. Guidance Framework

This Area supports the understanding of the needs and full costs of asset inventory, condition and performance, treatment, and work history data. This Area also addresses the documentation of data meaning, derivation, and quality, and the establishment of governance structures and processes and associated stewardship roles and responsibilities. This Area is subdivided into fifteen individual elements, grouped into five associated sections:

This Area explores TAM related data collection processes and practices, tools and technologies, and quality as delivered with respect to existing data standards.
This Area is subdivided into eleven individual elements, which are grouped into four associated sections:

This Area addresses data availability across the enterprise and the elimination of redundant and duplicative data. Specific asset life-cycle process areas, as well as external data and process areas, are identified for data standardization and integration in order to streamline business processes and improve decision-making. The Area is subdivided into fourteen individual elements, which are grouped into four associated sections:

This Area examines decision-support tools, techniques, and practices that facilitate development of actionable information and insights to support decision-making. It is subdivided into five individual elements, which are grouped into two associated sections:

This Area covers data informed TAM practices, exploring asset life-cycle management through resource allocation and prioritization, project planning, scoping, and design, and maintenance decision-making. It is subdivided into six individual elements, which are grouped into three associated sections:

Detailed Data Life-Cycle Framework

This Chapter shares supporting guidance and context for each Area and Section within this framework, to supplement and support detailed element-level practice benchmarks and potential improvement recommendations. Figure 3-2 provides a representation of the complete data life-cycle framework, comprised of 5 Areas, 18 Sections, and 51 Elements.

Assessment and Improvement Identification

The TAM Data Assistant includes descriptions of each assessment element, practice benchmarks, and associated improvements. Printable versions of these descriptions are included in the form of Element-Level Response Templates in Appendices A-E. Assessment participants can use these to become familiar with the material before using the tool in a group setting.

Prior to completing an assessment, participants are encouraged to review the Area- and Section-specific guidance materials that follow. These materials provide context and examples that will help participants to understand the benchmark levels and their associated improvements.

Evaluate the current and desired state of agency practice against element-level practice benchmarks and select from potential improvements to close identified gaps.

Completing the Assessment

The following steps are recommended for individuals completing the assessment:

  1. Review the element-level response templates familiarize yourself with the material. You only need to look at those Areas/Sections that have been selected as relevant to your assessment.
  2. Read the guidance material for your selected Areas/Sections that follow in this chapter. This material will help you to understand the scope of each portion of the assessment.
  3. Work through the assessment prior to getting together with your team, either using the templates or the tool. This will allow you to think through the material in advance.
  4. Share your results at group assessment sessions and listen to what others have to say. Work towards a set of consensus results to characterize your current practice levels, your desired practice levels, and the improvements to be considered.
Understanding Benchmark Levels

You will be selecting a level from 0 to 4 for each of the assessment elements – first to represent your agency’s current practice, and second, to represent your agency’s target level. The general meaning of each benchmark level is described below. However, keep in mind that each assessment element has a tailored set of level descriptions.

Selecting Target Levels

Don’t assume that your target should be the highest possible level (4) for all of the assessment elements. You may currently be at a level 0 for an element because there is no particular benefit to advancing in that area. For example, it may not be cost-effective to collect data or do sophisticated analysis for an asset that has a very short life cycle and accounts for a small portion of your agency’s budget.

Keep in mind that the levels are defined in a way that assumes you must pass through each one – it isn’t possible to skip levels. This means that often the most reasonable target (if you want to advance) is the next level up from where you currently are. It is helpful to use a standard timeframe (e.g. 2-3 years) when setting target levels. The target level should be one that (1) is beneficial for your agency to reach and (2) one that is realistic to achieve within the target timeframe.

Selecting candidate Improvements

Candidate improvements are suggested for each benchmark level. These improvements are designed to move your agency from its current level to the next level up. Keep in mind that not all of these candidate improvements will be appropriate for your agency. You should feel free to tailor them to your situation – or create new candidate improvements that would help your agency advance from your current level to the next level up.

Area and Section Guidance

You can use the Area-based guidance to:

  • Understand the definition and scope of each assessment Area and Section;
  • Understand some of the issues and key decisions to be made when considering improvements related to each Section; and
  • Review conceptual examples of agency practice relevant to the Section.
Response Templates

Areas A through E provide paper response templates that can be used to complete self-assessment and improvement identification independently of the TAM Data Assistant digital tool. The paper templates are not recommended for full application of the guidebook, however they can be useful for individual preparation in advance of group self-assessment discussion.

Benchmark Levels
General Practice Level Descriptions
  1. Non-Existent:

    The DOT does not have any significant practices within this aspect of their business.

  2. Initial Steps:

    DOT practices are found, however these are characterized by ad-hoc or informal application and are not likely to be endorsed by management.

  3. Incremental Improvement:

    The DOT is beginning to see formalization of the processes and structures within this aspect of their business.

  4. Advanced Practice:

    The DOT is performing at a level at or above the standard of their peers.

  5. Top Performing:

    The DOT is a leading example of practice amongst their peers.