Appendix . Overview of CMMI-ACQ

The initial draft CMMI for Acquisition (CMMI-ACQ) model focuses on the activities of the acquirer. The draft CMMI-ACQ addresses those activities required for supplier sourcing, developing and awarding contracts (supplier agreements), and managing the acquisition of solutions (such as products and services) by using a set of standard measures, acceptance criteria, and supplier deliverables. Supplier activities are not addressed in this report. CMMI for Development (CMMI-DEV) can be treated as a reference model for suppliers that develop products and services for an acquirer of technology solutions.

Introduction

The CMMI-ACQ contains six process areas unique to acquirers. A process area is a cluster of related practices in an area that, when implemented collectively, satisfies a set of goals that are considered important for making significant improvement in that area. The six process areas unique to the CMMI-ACQ describe those practices and capabilities that differentiate acquirers from other organizations such as developers:

The CMMI-ACQ also includes 16 foundation process areas common to all CMMI models. These process areas cover project management, process management, and support processes. These 16 process areas essentially describe practices and capabilities that an acquirer must possess. Each process area amplifies the nuances that successful acquirers master to implement those commodity practices and capabilities.

  • Causal Analysis and Resolution (CAR)

  • Configuration Management (CM)

  • Decision Analysis and Resolution (DAR)

  • Integrated Project Management (IPM)

  • Measurement and Analysis (MA)

  • Organizational Innovation and Deployment (OID)

  • Organizational Process Definition (OPD)

  • Organizational Process Focus (OPF)

  • Organizational Process Performance (OPP)

  • Organizational Training (OT)

  • Project Monitoring and Control (PMC)

  • Project Planning (PP)

  • Process and Product Quality Assurance (PPQA)

  • Quantitative Project Management (QPM)

  • Requirements Management (REQM)

  • Risk Management (RSKM)

The CMMI-ACQ does not specify that you must follow a particular acquisition process flow or that you must achieve a certain number of “deliverables per day” or specific performance targets. Instead, it specifies only that you have processes in place for adequately addressing acquisition-related practices. To determine whether this is so, you map your processes to the process areas contained in this report.

This mapping of processes to a process area allows you to track your progress to the CMMI-ACQ as you successfully deploy incremental process improvements or innovations. It is not intended that every process area of the CMMI-ACQ maps one to one with a given organization’s or project’s processes.

Process Improvement with CMMI

Like most organizations, acquirers strive to abandon ad hoc and chaotic processes. An acquirer attempts to continually enhance its ability (as well as its suppliers’ ability) to reliably meet its business objectives through incremental and innovative improvements in processes and technology. In such organizations, success no longer depends on the competence and heroics of a few individuals but on the use of proved processes applied by competent staff.

To support an acquirer to reach excellence, CMMI provides two improvement approaches. Experience has shown that organizations do their best when they focus their process improvement efforts on a manageable number of process areas at a time and that those areas require increasing sophistication as the organization improves.

In one improvement approach, you choose the focus of your process improvement efforts by choosing those process areas, or sets of interrelated process areas, that best benefit you and your business objectives. Once you select the process areas, you also select how much you would like to mature the associated processes (i.e., you select the appropriate capability level).

This selection is typically described through a target profile. A target profile defines all the process areas to be addressed and the targeted capability level for each. This profile then governs which goals and practices you will address in your process improvement efforts.

Target staging is a sequence of target profiles that describes the path of process improvement to be followed. When building target profiles, you should pay attention to the dependencies between generic practices and process areas. If a generic practice depends on a certain process area—either to carry out the generic practice or to provide a prerequisite product—the generic practice may be much less effective when the process area is not implemented.

In the second improvement approach, you use designated sets of process areas to follow a defined improvement path or maturity level. If you do not know where to start and which processes to choose to improve, this approach is a good choice. It gives you a specific set of processes to start improving as an acquirer of technology solutions. In other words, it provides a predetermined path of improvement from maturity level 1 to maturity level 5, each a layer in the foundation for ongoing process improvement.

As you progress and learn more about where you need targeted improvements, you can switch between the two improvement approaches.

The following sections summarize groupings of process areas that allow acquirers to get the project management and sourcing basics in place and to achieve sophisticated quantitative management. These sections also represent the predefined improvement path provided by the initial CMMI-ACQ. This path is cumulative in the sense that it requires you to continue to expand on previous process areas and capabilities to achieve the next higher plateau of excellence.

Managed Processes

Projects establish the foundation by institutionalizing basic project management and supplier management practices. The acquirer ensures that processes are planned and executed in accordance with policy; employs skilled people who have adequate resources to produce controlled outputs; involves relevant stakeholders; and monitors, controls, reviews, and evaluates projects for adherence to their process descriptions (see Figure A-1).

Level 2 process areas

Figure A-1. Level 2 process areas

The process discipline helps to ensure that you retain existing practices during times of stress. For instance, the status of the work products and the delivery of services are visible to management at defined points (such as at major milestones and at the completion of major tasks). Commitments are established among relevant stakeholders and are revised as needed. Work products are reviewed with stakeholders and are controlled. The work products and services satisfy their specified requirements, standards, and objectives.

The acquisition strategy and existing supplier agreements drive how much work, and what work, to give to a supplier. Depending on your acquisition strategy, there may be intermediate phases for the creation of prototypes, increments of capability, or spiral model cycles. In a complex project, you may be managing multiple supplier agreements simultaneously or in sequence. In such cases, any acquisition life cycle can end during any phase of the project life cycle.

You consider all supplier agreements within the context of the acquisition so that you develop an integrated approach rather than deal with activities individually. The characteristics of prequalified or other potential suppliers—including technical and financial capability, management and delivery processes, production capacity, and business type and size—are key elements of project success, and therefore you consider these characteristics in identifying constraints for the project.

The Solicitation and Supplier Agreement Development process area defines practices to prepare a solicitation package, select a capable supplier, and establish the supplier agreement. Acquisition Management focuses on maintaining the supplier agreement, including resolving disputes and managing your relationship with the supplier. This includes managing payments to and ongoing communications with suppliers. The Solicitation and Supplier Agreement Development and Acquisition Management process areas are described in detail in section A.3.

The purpose of the Project Planning area is to establish and maintain plans that define project activities. The amount of supplier work for a project largely determines the amount of your work that it takes to manage the project and the supplier. Estimate supplier work at a high level, and your work at a more detailed level. Your effort includes (1) effort associated with defining the scope of the project, (2) effort associated with the development and deployment of the technical solution, (3) operating and maintenance effort associated with the maintenance of the solution, and (4) disposal effort.

In addition to creating an estimation of the work products, you are encouraged to have your estimate independently reviewed by individuals outside the project to ensure that your estimates can be validated. Be sure to include the effort and cost of supporting execution of your processes as well as developing the product.

You develop a work breakdown structure (WBS) that clearly identifies which project work is performed by you and which is performed by the supplier. The WBS includes activities performed by you as well as milestones and deliverables for the suppliers. The supplier work identified in the WBS becomes the foundation for the statement of work for suppliers. The WBS identifies the deliverables from the supplier and the work products you develop. Your understanding of suppliers’ life-cycle models and processes, especially those that interact directly with your processes, enables you to plan for seamless interactions between you and your suppliers, resulting in a successful acquirer-supplier relationship.

During supplier selection and negotiation of the supplier agreement, you reconcile overall project work and resource levels based on the proposals from the supplier. Following completion of the supplier agreement, you incorporate supplier plans at an appropriate level of detail to support alignment of the plans. For example, you might incorporate major supplier milestones, deliverables, and reviews.

The project plan may include multiple plans, such as staffing plans, stakeholder involvement plans, risk mitigation plans, transition plans, quality assurance plans, and configuration management plans. Regardless of the form they take, the plans should address the acquisition strategy as well as the cradle-to-grave considerations for the project and product to be acquired. For example, you should consider what facilities and equipment must be provided by the supplier, as well as what you may need to provide for acceptance of the supplier deliverables, transition, and support of the acquired product. The supplier agreement must include any facility or equipment requirements for the supplier. You must also identify and ensure that any facilities or equipment to be provided to the supplier for its project work are accounted for in the project plan.

You must also plan for how data will be shared between you and the supplier as well as among relevant stakeholders. This planning avoids unexpected costs to procure, reformat, and deliver data. In many cases, the ideal solution is to leave your data in the physical possession of the supplier and have access to the supplier’s data. In addition to data access, the data management plan should include the requirement for your use of data and for its reproduction, manipulation, altering, or transfer of possession.

The supplier agreement specifies appropriate acquirer rights to the data in addition to requirements for delivery or access. Data, whenever it is delivered to you, is formatted in accordance with accepted data standards to ensure its usability by you. Include plans for managing data within the project teams and for the infrastructure required to manage data between the supplier, operational users, and other relevant stakeholders. Decide which project data and plans require version control or more stringent configuration control, and establish mechanisms to ensure that project data is controlled. Consider the implications of controlling access to classified and sensitive data (e.g., proprietary, export-controlled, source-selection-sensitive) and other access-controlled data.

When you provide data access to the supplier, security and access control are critical. This includes creating access lists of authorized supplier personnel and nondisclosure agreements between you and the supplier. For example, when the supplier performs work for you off-site (e.g., at an offshore development center), then you need to consider additional security measures. Examples include a firewall between your network and the supplier’s and restricted access to your workplace.

Ideally, the data management plan is supported by an integrated data system that meets the needs of both initial acquisition and the support community. Integrating acquisition and maintenance data systems into a total life-cycle integrated data environment lets you plan effectively for maintenance and facilitates insertion of new technology. It also ensures that acquisition planners have accurate information about total life-cycle costs.

The purpose of the Requirements Management process area is to manage the requirements of the project’s products and components and to identify inconsistencies between those requirements and the project’s plans and work products. Typically, you directly manage changes to customer and contractual requirements developed by you and oversee the supplier’s requirements management process. You negotiate commitments with the customer and supplier before committing to any changes in requirements. Requirements changes may result in changes to the supplier agreement; these changes need to be agreed upon between the project and the supplier after appropriate negotiations. The supplier maintains comprehensive bidirectional traceability to the requirements you define in the supplier agreement, and you verify that traceability.

You are responsible for monitoring the progress and output of the project. The Project Monitoring and Control process area is concerned with monitoring and control of acquirer activities and oversight of the progress and performance of the supplier’s execution according to the project plans. Project Monitoring and Control practices give you an understanding of the project’s progress; in this way, you can take appropriate corrective actions when the project’s performance deviates significantly from the plan.

As the acquisition unfolds, monitoring and control are essential to ensuring that appropriate resources are being applied and that your activities are progressing according to plan. For instance, you track commitments for resources that will result in expenditures (e.g., issued purchase orders and completed supplier deliverables that have been accepted) when they are incurred, even before formal payment. In this way, you can ensure that future financial and legal obligations are accounted for as soon as they are incurred.

You monitor overall project risk. Many risks are your sole responsibility and may include sensitive information that should not be shared with the supplier (e.g., source-selection-sensitive, recompetition, internal staffing, or other risks). There can also be risks (e.g., the feasibility of the technology to meet end user performance requirements) that require careful coordination with suppliers and appropriate escalation of risks and risk status. Shared risks may affect the mitigation approaches and may result in jointly planned mitigations.

After you select a supplier and establish a supplier agreement, the role of monitoring and control becomes twofold. You continue to monitor and control your activities and work products while also monitoring and controlling the progress and performance of the supplier’s execution under the supplier agreement and the supplier’s project plans. You monitor the progress of the supplier—including achievement of service levels established in the supplier agreement—by using the supplier’s measurement data about its progress and output. This includes monitoring the availability of resources provided by the supplier and the skills and knowledge of the supplier personnel. In addition to monitoring the attributes of your work products, you monitor the attributes of supplier deliverables through acceptance criteria and through analysis of the supplier’s peer review results.

If a corrective action is required to resolve variances from project plans, these actions should be defined and tracked to closure. Corrective action is taken for your deviations and when supplier execution does not satisfy the supplier agreement or align with project planning (e.g., date slippages in milestones and work products). Some corrective actions may be assigned to a supplier. When your monitoring of measurement data indicates, for example, that supplier progress does not appear to be sufficient to meet a service level defined in the supplier agreement, then you initiate and manage corrective action for the supplier. If the supplier does not comply appropriately, you escalate and handle this as a supplier agreement issue or dispute.

You use the practices in the Measurement and Analysis process area to support the information needs of the business, organization, and project. Some of this information may be needed from you, some from the supplier, and some from all parts of a project. The supplier agreement must designate all information required from the supplier. The measures you specify are designed to enable you to determine the status of your progress and output, the supplier’s progress and output per contractual requirements, and the status of the evolving products.

You use measurement objectives to define specific measures and their collection, analysis, storage, and usage procedures. You establish measurement objectives for your activities and work products and for supplier deliverables. The measurement objectives are derived from information needs that come from project objectives, organizational objectives, and business needs. Measurement objectives focus on your performance as well as the supplier’s performance, and on your understanding their effects on customer, operational, and financial performance. Measurement objectives for the supplier enable you to define and track service level expectations documented in the supplier agreement. You need to consider the impact of existing supplier agreements on measurement objectives.

To manage projects, you use supplier-reported measures in addition to your own measures of progress and output. The supplier measures allow you to comprehensively address the measurement objectives and determine the progress and output of the project. In some cases, these supplier measures will augment your measures. For instance, your return on investment measure can incorporate the supplier’s cost performance index.

In most cases, the supplier measures are the primary source of data, especially with regard to the development of the product. For instance, for effective management of the quality, size, cost, and schedule of the project (e.g., the amount of new, modified, and reused code; the percentage of function points complete; defect removal efficiency), it is essential that you apply technical performance measures to measure and analyze the product or components provided by a supplier.

When you are acquiring multiple products to deliver a capability to the end user, or when there are relationships with other projects to acquire joint capabilities, you can identify additional measures to track and achieve interoperability objectives in terms of programmatic, technical, and operational interfaces.

Measures may be provided by the supplier as detailed measurement data or measurement reports. The measures that come from suppliers must be associated with your acceptance criteria for supplier measures. The acceptance criteria can be captured in measurement specifications or by checklists, if appropriate.

The acceptance criteria should be defined in a way that enables the intended use of the supplier measures, such as potential aggregation and analysis. They need to include any criteria associated with the collection and transfer mechanisms and procedures that must be performed by the supplier. Consider all characteristics of the supplier measures that may affect their use, such as differences in financial calendars used by different suppliers. If data is not available or data integrity checks indicate potential errors, follow up with suppliers.

Supplier measures must be defined in the supplier agreement, including the supplier’s measurement collection requirements and the measurement reports to be provided to you. Data collection from a supplier can be integrated with periodic monitoring and review of supplier activities. You can conduct validity checks of supplier data by means of periodic audits of the supplier’s execution of the data collection and analysis procedures for your required measures. The supplier agreement specifies which measurement data the supplier must provide to you, the required format, the means of its collection and storage (e.g., retention period of data), how and how often it will be transferred to you, and who has access to the data. The supplier may consider some supplier data proprietary, and you may need to protect it as such. Also consider that some of your measurement data (e.g., total project cost data) may be proprietary and should not be shared with suppliers. You need to plan for the collection, storage, and access control of this type of sensitive data.

The Process and Product Quality Assurance area has processes for evaluating your critical work products, your processes, and the results of the supplier’s process quality assurance activities with respect to supplier deliverables and processes. You evaluate the project’s execution of your processes, including interactions with suppliers and reviews of the quality assurance reports provided by suppliers, to determine whether they follow their processes. There should be sufficient process quality assurance that you can detect noncompliance issues as early as possible that may affect your or the supplier’s ability to successfully deliver the technology solution to the customer. For example, process and product quality assurance ensures that the solicitation package was developed per the standard processes you agreed to and that it conforms to all applicable policies.

You can review the results of the supplier’s quality assurance activities for supplier processes to ensure that the supplier is following its own processes. Typically, you select critical supplier processes, such as engineering or verification processes, where the supplier is required (through the supplier agreement) to follow project-specified standards. In exceptional cases, you can directly perform product and process quality assurance for selected supplier processes.

You and the supplier periodically share quality assurance issues and findings that are of mutual interest. For example, the supplier agreement can require the supplier to provide detailed appraisal results of mandatory, acquirer-scoped CMMI for Development appraisals of supplier processes. Through the supplier agreement, you should retain the right to audit supplier processes if there is an indication that suppliers are not following acceptable processes.

You perform product quality assurance by applying practices from the Acquisition Technical Solution and Acquisition Verification process areas. In addition to objectively evaluating your critical work products, you use objective acceptance criteria to evaluate supplier deliverables throughout the project life cycle. For that purpose, your acceptance criteria for supplier deliverables are consistent with the project objectives and sufficient to allow the supplier to satisfactorily demonstrate that the technology solution conforms to contractual requirements.

The Configuration Management process area (not depicted in Figure A-1) uses configuration identification, configuration control, configuration status accounting, and configuration audits to establish and maintain the integrity of work products such as solicitation packages. Your approach to configuration management depends on acquisition-specific factors, such as your acquisition approach, the number of suppliers, your design responsibility, your support concept, and associated costs and risks. The level of control is typically selected based on project objectives, risk, or resources (or all three).

Levels of control can range from informal control (which simply tracks changes made when you are developing the configuration items or when supplier work products are delivered or made accessible to you) to formal configuration control (using baselines that can be changed only as part of a formal configuration management process). Although the supplier may manage configuration items on your behalf, you are responsible for approval and control of changes to such configuration items.

Configuration items may vary widely in complexity, size, and type, from an aircraft to commercial off-the-shelf software to a test meter or project plan. Any item required for product support and designated for separate procurement is a configuration item. Your work products provided to suppliers, such as solicitation packages and technical standards, are typically designated as configuration items.

Consider how configuration items will be shared between you and suppliers as well as among relevant stakeholders. If you extend the use of your configuration management system to a supplier, you must exercise security and access control procedures. If a configuration management system is shared between you and suppliers, then the supplier agreement must specify clear responsibility for managing the configuration items, baselines, security aspects, access restrictions, and backup and restore processes. You must ensure that the supplier agreement specifies the configuration management requirements for the supplier (e.g., status reporting and providing configuration audit results). In many cases, you can leave acquired configuration items in the physical possession of the supplier and have access to supplier deliverables. The supplier agreement specifies appropriate acquirer rights to the supplier deliverables in addition to requirements for delivery or access. Supplier work products, whenever they are delivered to you, are formatted in accordance with accepted standards to ensure usability by you.

In any case, configuration management involves interaction between you and suppliers. You review and approve the release of the product baselines created by the supplier. You create baselines for your work products to mark the agreement regarding the description of the project, requirements, funding, schedule, and performance parameters and to make a commitment to manage the program to those baselines. For example, your baseline might be a collection of your work products such as contractual requirements and acceptance criteria that are related to the product baseline managed by the supplier.

With regard to the technical solution, you maintain configuration control of the contractual requirements, and the supplier performs configuration management for the technical solution (e.g., it establishes and maintains a product baseline). Thus, you retain the authority and responsibility for approving any design changes that affect the product’s ability to meet contractual requirements. The supplier manages other design changes.

Change requests can be initiated by either you or the supplier. Changes that affect your work products and supplier deliverables as defined in the supplier agreement are handled through your configuration management process. You analyze the impact of submitted change requests to the supplier agreement. You maintain the right to access configuration data at any level required to implement planned or potential design changes and support options. Configuration management of legacy systems should be addressed on a case-by-case basis as design changes are contemplated.

Defined Processes

Acquirers are using defined processes for establishing and managing standard supplier agreements, and they embed tenets of project management and engineering best practices, such as requirements development and design constraints, into the standard process set. These processes are well characterized and understood and are described in standards, procedures, tools, and methods.

Your set of standard processes is established and improved over time. These standard processes are used to establish consistency across the organization. Projects establish their defined processes by tailoring the organization’s set of standard processes according to tailoring guidelines.

A critical distinction between defined processes and managed processes is the scope of standards, process descriptions, and procedures. Managed processes may be quite different in each specific instance of the process (e.g., from project to project). Defined processes for a project, on the other hand, are tailored from the organization’s set of standard processes to suit a particular project or unit, and therefore they are more consistent except for the differences allowed by the tailoring guidelines. Another critical distinction of defined processes is that they are typically described more rigorously than managed processes are. A defined process clearly states the purpose, inputs, entry criteria, activities, roles, measures, verification steps, outputs, and exit criteria.

Acquisition Requirements Development focuses on specifying customer and contractual requirements that express customer value (see Figure A-2). You use Acquisition Validation processes to ensure that the products received from the supplier will fulfill the stakeholders’ intentions. You provide design constraints to the supplier, and the product is designed and implemented by the supplier consistent with your design constraints.

Level 3 process areas

Figure A-2. Level 3 process areas

Acquisition Technical Solution covers developing design constraints and verifying the supplier’s technical solution. You apply Acquisition Verification processes to address whether the acquired product, intermediate acquirer work products, and supplier deliverables meet their contractual requirements. Acquisition Requirements Development, Acquisition Validation, Acquisition Technical Solution, and Acquisition Verification process areas are described in detail in section A.3.

You apply Integrated Project Management practices to establish and manage the project and the involvement of the relevant stakeholders according to an integrated and defined process that is tailored from the organization’s set of standard processes. The project’s defined process logically sequences acquirer activities and supplier deliverables (as identified in the supplier agreement) to deliver a product that meets the requirements. It is driven by your acquisition strategy. For example, the acquisition strategy might be to introduce new technology to the organization, or it might focus on consolidating the acquired products or services you are using. Which strategy you’ve adopted affects the project’s defined process.

You need to involve and integrate all the relevant acquisition, technical, support, and operational stakeholders. You ensure that stakeholder coordination and cooperation are maximized to the extent possible. Depending on the project’s scope and risk, your coordination efforts with the supplier can be significant. The supplier agreement provides the basis for managing supplier involvement.

The purpose of Risk Management is to identify potential problems before they occur so that you can plan and invoke risk handling activities as needed during the life of the product to mitigate adverse impacts on achieving objectives.

Risk Management has two contexts. The first context is the identification and assessment of project risks during project planning and managing these risks throughout the project. You enter the second context after the selection of a supplier and award of the supplier agreement. The risk management processes must address the risks associated with the supplier’s role in the project. Throughout the life cycle of the project, you continue to manage the risks related to the supplier as well as managing project risks overall.

Because of the acquirer-supplier relationship, the need for early and aggressive detection of risk is compounded by the complexity of acquisition projects. For example, your capabilities, the supplier’s experience of working with you, the supplier’s financial stability, or the availability of well-defined dispute resolution processes influence the risk of a project. You should conduct a risk assessment before solicitation to evaluate whether the project can achieve the technical, schedule, and budget constraints. You should discuss technical, schedule, and cost risks with potential suppliers before the solicitation is released. In this way, you can identify and address inherent critical risks in the solicitation.

Both you and the supplier must understand the project risks and know how to modify the risk management strategy and plans as the project progresses through its life cycle. Managing a project’s risks requires a close partnership between you and the supplier. Both parties need to share appropriate risk management documentation, understand the risks, and develop and execute risk management efforts.

You initially identify and categorize risk sources and categories (e.g., schedule, cost, sourcing, contract management, supplier execution, technology readiness, human safety, reliability-related risks, and other issues outside your control) and refine them over time. You consider the risks associated with a supplier’s capability (e.g., meeting schedule and cost requirements), including the potential risks to your intellectual capital or security vulnerabilities introduced by using a supplier. Your risk categories typically include sourcing, contract management, and supplier execution, in addition to project management, technology, and requirements. Thresholds for supplier risks that affect the project (e.g., schedule, quality, or risk exposure due to supplier risks) are specified in the supplier agreement along with escalation actions if the thresholds are exceeded.

A risk management strategy must be developed early in the project so that relevant risks are identified and managed aggressively. The acquisition strategy evolves based on risk identification and analysis. The early identification and assessment of critical risks allow you to formulate approaches and streamline the project definition and the solicitation around critical risks. You identify some risks by using the categories and parameters in the risk management strategy to examine the supplier’s WBS, product, and processes. Risks can be identified in many areas, such as requirements, technology, design, testing, vulnerability to threats, and life-cycle costs. Examining the project in these areas can help you develop or refine the acquisition strategy and the risk-sharing structure between you and suppliers.

You share selected risks with the supplier. Risks associated specifically with the acquisition process are tracked, and then they are resolved or controlled until mitigated. This monitoring includes risks that may be escalated by the supplier. To examine risks such as potential failures in products or processes, you can use tools such as failure mode and effects analysis. These tools can be used to evaluate risk management priorities for mitigating known threat vulnerabilities.

The practices in Decision Analysis and Resolution help you analyze possible decisions by using a formal process to evaluate identified alternatives against established criteria. A repeatable criteria-based decision-making process is especially important, both while you’re making the critical decisions that define and guide the acquisition process and later, when you make critical decisions with the selected supplier. Having a formal process for decision making provides you with documentation of the decision rationale. Such documentation lets you revisit the criteria for critical decisions when you consider making changes or adopting technology that will affect requirements or other critical project parameters. A formal process also supports the communication of decisions between you and suppliers. Suppliers competing to develop a technical solution can be directly evaluated in a final competition that possibly involves performance or functional demonstration of proposed solutions.

Organizational Process Definition focuses on establishing and maintaining a usable set of organizational process assets and work environment standards. Your set of standard processes also describes standard interactions with suppliers. Supplier interactions are typically identified in terms of deliverables expected from suppliers, acceptance criteria applicable to those deliverables, standards (such as architecture and technology standards), and standard milestone and progress reviews.

Basing standard processes on industry standards and widely accepted models, with common terminology, enables seamless interactions between you and suppliers. In a multisupplier environment, this is most important for your standard processes that directly interface with the supplier processes. Also, you may gain cost and coordination benefits from having suppliers work together to develop or reconcile common support processes that are aligned with your processes.

The life-cycle models may include acquisition life cycles, depending on the specific acquisition strategy chosen. The acquisition life cycle typically begins with the pre-award phase of a supplier agreement, continues through the phases of awarding and managing the supplier agreement, and ends when the supplier agreement period of performance ends, usually with the acceptance and completion of the warranty for the product and its transition to the support organization. Your review of life-cycle models typically includes the participation of suppliers for those processes and process elements that define expectations and constraints for suppliers.

Tailoring is a critical activity that allows controlled changes to the processes to meet specific needs of a project or a part of the organization. Processes and process elements that are directly related to critical business goals and objectives should usually be defined as mandatory (allowing less variation), but those that are less critical or only indirectly affect business objectives may allow for more tailoring (and therefore more variation). Tailoring might also depend on the life-cycle model of the project, the supplier, or the acquirer-supplier relationship.

The supplier agreement defines how changes to organizational process assets that affect the supplier (e.g., standard supplier deliverables, acceptance criteria) must be deployed. You should encourage participation of suppliers in process improvement activities (Organizational Process Focus). Suppliers may be involved in developing the process action plans if the processes that define interfaces between you and suppliers are targeted for improvement.

The purpose of the Organizational Training processes is to develop people’s skills and knowledge so that they can perform their roles effectively and efficiently. When you identify training needs, you may also want to address some training needs of suppliers, especially in those process elements that define interfaces with and expectations for suppliers.

Quantitatively Managed Processes

You control variation in your results by applying quantitative management. That is, you examine the business system being used to meet the needs of the end customer, identifying constraints that significantly impede overall business performance. You use statistical and other quantitative techniques to understand these constraints so that you can make the appropriate process refinements, including adjustments to your supplier interactions to better achieve business objectives. Focusing on these critical constraints, you can use process performance models to predict how to best maximize the flow of work through the project and the organization.

Defined processes are different from quantitatively managed processes in the predictability of process performance. The performance of quantitatively managed processes is controlled using statistical and other quantitative techniques and is quantitatively predictable. Typically, defined processes are only qualitatively predictable.

The purpose of the Quantitative Project Management process area is to quantitatively manage the project’s defined process to achieve the project’s established quality and process performance objectives. You use quantitative methods to manage your work and to gain insight into the supplier’s work and products. In addition to your own quantitative data, you use quantitative data provided by the supplier (as specified in the supplier agreement) to address the specific practices in this process area. For the successful implementation of this process area’s specific practices, you need to establish effective relationships with suppliers.

You establish the project’s quality and process performance objectives based on the objectives of the organization and the project. You can also establish quality performance objectives for supplier deliverables. These supplier objectives are documented in the supplier agreement. You may require the supplier to provide process performance measurements for its participation in the project’s processes or subprocesses (e.g., the estimating subprocess).

When you select the processes for analysis, it is critical to understand the relationships between the various processes and their impact on your and the supplier’s performance relative to delivering the product specified by the customer. Such an approach will help ensure that quantitative and statistical management is applied where it will have the most overall value to the business. Using data and measures submitted by the supplier, you analyze supplier process performance as it interfaces with your processes. Performance models are used to set performance objectives for the suppliers and to help them achieve these objectives.

You monitor the performance of selected subprocesses—including those that involve interaction with a supplier—as well as the quality performance of the supplier deliverables for adherence to the quality and performance objectives. This selective monitoring provides you with insight into project and supplier performance so that you can predict the likelihood of achieving the project’s objectives for quality and process performance. You use this information to manage the risks of the project and to initiate corrective actions in time to meet the project objectives.

The purpose of Organizational Process Performance is to establish and maintain a quantitative understanding of the performance of your set of standard processes in support of quality and process performance objectives, and to give you the process performance data, baselines, and models to quantitatively manage your projects. Process performance models are used to estimate or predict when to fund, hold, cancel, migrate, reengineer, or retire a project or program. Process performance models allow you to synchronize processes with the customer’s needs.

Your process performance baselines provide quantitative data on those aspects of the projects and organization that can approximate the throughput potential of its processes. Focusing on these critical constraints, process performance models allow you to predict how to best maximize the flow of work through the projects and the organization. Performance models are also used to set performance objectives for the suppliers and to provide data that can help suppliers achieve these objectives. The results of your process performance models are shared with the suppliers so that they can ensure synchronized delivery of products and services.

Optimizing Processes

An acquirer continually improves its processes based on a quantitative understanding of the common causes of variation inherent in processes. To optimize your processes, you select and deploy incremental and innovative improvements that measurably improve your processes and technologies (see the processes in the Organizational Innovation and Deployment process area). The improvements enhance your and your suppliers’ ability to meet your quality and process performance objectives.

Your customers and suppliers are vital sources of innovative ideas. Interorganizational and organizational learning are therefore critical to actively identifying and analyzing innovations. Together with your suppliers, you can establish an innovation review program. This program can create time-boxed innovation solicitation, which is a well-communicated formal process for analysis and guaranteed response to innovative ideas proposed by customers, employees, and suppliers.

You establish quantitative process improvement objectives for the organization, and then you continually revise them to reflect changing business objectives, and you use them as criteria in managing process improvement. You must continuously improve your processes and your alignment with your suppliers. You can look for opportunities to maximize throughput based on identifying the most limiting resource and, as a result, create a more agile supply chain. Examples of such opportunities include proposals that promise to make the supply chain respond both quickly and cost-effectively.

Your plan for deploying improvements can include openly sharing most process know-how with your suppliers. Any process-related knowledge that you or one of your suppliers possesses is viewed as accessible to virtually any other supplier in your supply chain (perhaps with the exception of a direct competitor). In this case, you need to establish rules and norms that prevent suppliers from accessing your knowledge unless they first explicitly agree to openly share knowledge with your other suppliers. For example, you have the ability to impose economic sanctions (e.g., withdrawal of business) on a supplier that violates the rule.

The effects of deployed process improvements are measured and evaluated against the quantitative process improvement objectives. Both the defined processes and your set of standard processes are targets of measurable improvement activities. You and suppliers can share the costs and benefits of improvements. You can increase the incentive for suppliers to participate in improvement efforts across the supply chain by allowing suppliers to appropriate all the value derived from a contributed improvement in the short term (e.g., 6 to 18 months). Over time the supplier may be expected to share a proportion of those savings with you (e.g., through cost reductions).

You typically achieve your quality and performance objectives in partnership with your suppliers. You typically focus on differentiating your capabilities along with collaborative supplier management. Achieving these objectives also depends on your being able to effectively evaluate and deploy proposed improvements to the processes and technologies. All members of the acquirer-supplier network participate in your process improvement and technology improvement activities. This requires the supplier’s willingness to open its processes for inspection to you and your other suppliers. Suppliers’ process improvement proposals are systematically gathered and addressed.

A critical distinction between quantitatively managed processes and optimizing processes is the type of process variation addressed. An acquirer that uses quantitatively managed processes is concerned with addressing special causes of process variation and providing statistical predictability of the results. Although processes may produce predictable results, the results may be insufficient to achieve the established objectives. Acquirers that use optimizing processes are concerned with addressing common causes of process variation and with changing the process (to shift the mean of the process’s performance or to reduce the inherent process variation experienced) and thereby improve process performance and achieve the established quantitative process improvement objectives.

The Big Six: Acquisition Process Areas

The CMMI-ACQ describes six process areas that represent core competencies of successful acquirers (see Figure A-3).

The “big six” acquisition process areas

Figure A-3. The “big six” acquisition process areas

The following sections describe those process areas in detail.

Solicitation and Supplier Agreement Development

The purpose of Solicitation and Supplier Agreement Development (SSAD) is to prepare a solicitation package and to select one or more suppliers for delivering the product or service. The Solicitation and Supplier Agreement Development process area includes developing the acquisition strategy. The acquisition strategy is a guide to direct and control the project and a framework to integrate the activities essential to acquiring an operational product.

The Solicitation and Supplier Agreement Development process area provides a set of practices that enable the acquirer to initialize and formalize a relationship with the supplier for the successful execution of the project. A formal agreement is any legal agreement between the organization (representing the project) and the supplier. This agreement may be a contract, a license, or a memorandum of agreement. The acquired product is delivered to the project from the supplier according to this formal agreement (also known as the “supplier agreement”).

The supplier agreement created using these practices enables the acquirer to execute its monitoring and control of supplier activities using other process areas, such as Project Monitoring and Control and Acquisition Management.

The practices of this process area apply equally to initial supplier agreements and to subsequent change orders, task orders, or amendments related to those agreements.

The acquirer is responsible for establishing and maintaining the ground rules for supplier communication, documenting decisions, and conflict resolution through the life of the agreement. The acquirer facilitates these activities with relevant project stakeholders. Specific roles and responsibilities of relevant project stakeholders for interaction with or direction of the suppliers are defined, coordinated, and adhered to.

The specific goals and specific practices of this process area build on each other in the following way. The Prepare for Solicitation and Supplier Agreement Development specific goal and associated practices identify potential suppliers and develop the evaluation criteria and the solicitation package. The solicitation package is developed using work products from other process areas, e.g., requirements from Acquisition Requirements Development and design constraints from Acquisition Technical Solution. The Select Suppliers specific goal and associated specific practices use the work products from the preparation for solicitation to solicit responses from potential suppliers, evaluate these responses, and negotiate and select a supplier who can best deliver to the solicitation package. Subsequently, the Establish Supplier Agreement specific goal and associated practices are used to document the approved supplier agreement. In turn, the data provided by the supplier and documented in the supplier agreement (e.g., cost, schedule, risks) is used by Project Planning practices to update the project plan.

Although this process area describes acquisition practices for a project, an acquirer would use the same practices in establishing a supplier agreement for multiple projects. The requirements included in the solicitation package and the supplier agreement would reflect the broader scope, and the evaluation and selection process would require an appropriate level of review before a selection is made.

Related Process Areas

  • Refer to the Acquisition Management process area for more information about managing selected suppliers’ activities based upon the supplier agreement.

  • Refer to the Acquisition Requirements Development process area for more information about defining customer and contractual requirements.

  • Refer to the Acquisition Verification and Acquisition Validation process areas for more information about evaluating requirements.

  • Refer to the Acquisition Technical Solution process area for more information about determining the design constraints, including standards that are included in the solicitation package.

Specific Practices by Goal

Prepare for Solicitation and Supplier Agreement Development

Note

Develop the acquisition strategy, qualify potential suppliers, and develop a solicitation package that includes the requirements and proposal evaluation criteria.

Develop the Acquisition Strategy

Note

Develop and maintain the overall acquisition strategy content.

The acquisition strategy is the business and technical management framework for planning, directing, contracting for, and managing a project or program. The acquisition strategy relates to the objectives for the acquisition, the constraints, availability of resources and technologies, consideration of acquisition methods, potential supplier agreement types, terms and conditions, accommodation of business considerations, considerations of risk, and support for the acquired product over its life cycle.

The acquisition strategy results from a thorough understanding of both the specific acquisition project or program and the general acquisition environment. The acquirer accounts for the potential value or benefit of the acquisition in the light of the potential risks, considers constraints, and takes into account experiences with different types of suppliers, agreements, and terms. A well-developed strategy minimizes the time and cost required to satisfy approved capability needs, and maximizes affordability throughout the project life cycle.

The acquisition strategy for a project typically tailors a program or organizational-level acquisition strategy.

The acquisition strategy is the basis for formulating solicitation packages, supplier agreements, and project plans. The strategy evolves over time and should continuously reflect the current status and desired end point of the project.

Typical Acquirer Work Products

  1. Acquisition strategy

Subpractices

  1. Identify the capabilities and objectives the acquisition is intended to satisfy or provide.

    The capabilities describe what the organization intends to acquire. Typically the capability included in the acquisition strategy summary highlights product characteristics driven by interoperability and/or families of products. It also identifies any dependency on planned or existing capabilities of other projects or products.

    Refer to Acquisition Requirements Development for information about determining capabilities and customer requirements.

    At a minimum, the acquirer identifies the cost, schedule, and key performance objectives for the acquisition. Each objective consists of an objective value representing customer expectations and a threshold value representing acceptable limits that, in the customer’s judgment, still provide the needed capability. While the number and specificity of performance parameters may change over the duration of an acquisition, the acquirer typically focuses on the minimum number of parameters that, if thresholds are not met, will require a re-evaluation of the project.

    The acquisition strategy establishes the milestone decision points and acquisition phases planned for the project. It prescribes the accomplishments for each phase and identifies the critical events affecting project management. Schedule parameters include, at a minimum, the projected dates for the project initiation, other major decision points, and initial operational capability.

  2. Identify the acquisition approach.

    The acquirer defines the approach the project will use to achieve full capability: either evolutionary or single step; it should include a brief rationale to justify the choice. When a project uses an evolutionary acquisition approach, the acquisition strategy describes the initial capability and how it will be funded, developed, tested, produced, and supported. The acquisition strategy previews similar planning for subsequent increments and identifies the approach to integrate and/or retrofit earlier increments with later increments.

  3. Document business considerations.

  4. Identify major risks and risk sharing with the supplier.

    All acquisition risks, whether primarily managed by the acquirer or by the supplier, must be assessed and managed by the acquirer. The acquisition strategy describes how risk is to be handled and identifies major risks and which risks are to be shared with the supplier and which are to be retained by acquirer.

  5. Identify the supplier agreement type.

    The acquirer identifies standardized procurement documents (e.g., standard supplier agreements), if any. The acquirer also determines the type of supplier agreement planned (e.g., firm fixed-price; fixed-price incentive; firm target; cost plus incentive fee; or cost plus award fee) and the reasons it is suitable, including considerations of risk assessment and reasonable risk-sharing by the acquirer and the supplier.

    The acquisition strategy explains the planned incentive structure for the acquisition, and how it incentivizes the supplier to provide the product or services at or below the established cost objectives and satisfy the schedule and key performance objectives. If more than one incentive is planned for a supplier agreement, the acquisition strategy explains how the incentives complement each other and do not interfere with one another. The acquisition strategy identifies any unusual terms and conditions of the planned supplier agreement and all existing or contemplated deviations to an organization’s terms and conditions, if any.

  6. Identify the product support strategy.

    The acquirer develops a product support strategy for life-cycle sustainment and continuous improvement of product affordability, reliability, and supportability, while sustaining readiness. The support strategy addresses how the acquirer will maintain oversight of the fielded product.

    The acquirer’s sustainment organization or supplier typically participates in product support strategy development.

  7. Review and obtain agreement with senior management on the acquisition strategy.

    The development of the acquisition strategy for a project typically requires senior management sponsorship. The appropriate senior management needs to approve the acquisition strategy before initiating a project.

Identify Potential Suppliers

Note

Identify and qualify potential suppliers.

Consistent with the acquisition strategy and along with the scope and requirements for the project or program, the acquirer identifies potential suppliers to receive the solicitation. The acquirer can identify suppliers from a variety of sources, e.g., employees, international seminars, market analysis reports.

Acquirers need to limit the number of suppliers they solicit proposals from in order to reduce their cost and efforts for the solicitation, while at the same time making sure they have included suppliers who are capable of meeting the requirements and that enough suppliers are included to provide a competitive environment. This competition enhances the leverage of the acquirer in achieving its objectives, e.g., providing different approaches to meeting the requirements.

Depending upon the applicable regulations or characteristics of the project, the acquirer may determine to sole source the project rather than place it for competitive bid.

Typical Acquirer Work Products

  1. List of potential suppliers prepared to respond to the solicitation

Subpractices

  1. Develop a list of potential suppliers.

    In developing the list of potential suppliers, the acquirer considers which suppliers have had experience with similar systems or projects, what kind of performance the acquirer has experienced with suppliers on previous projects, what suppliers are likely to provide the specific capabilities needed for the project, and what is the availability of critical resources to staff and support the project. In addition to assessing the supplier’s capabilities, a risk assessment is prepared on the supplier’s financial capabilities, e.g., credit worthiness, financial stability and access to capital, and the impact to the supplier of a successful bid.

  2. Communicate with potential suppliers concerning the forthcoming solicitation.

    The acquirer contacts the suppliers to outline the plans for the solicitation, including the projected schedule for releasing the solicitation package and the expected dates for responses from suppliers. If the supplier indicates its interest in responding to the solicitation, the appropriate confidentiality agreements are put in place.

    Typical information included in communication to candidate suppliers:

    • Anticipated scope of the solicitation

    • Schedule for release of the solicitation package

    • Overall project schedule

    • Approach/procedures that will be used throughout the solicitation process

    • High-level criteria for evaluating proposal responses

    • Required supplier qualifications, e.g., appraisal at a specific CMMI level

    • Schedule for return of proposal

    • Date for supplier to indicate whether it will or will not participate in the solicitation

  3. Verify the participants who will evaluate supplier proposals.

  4. Verify the participants in supplier negotiations.

Develop Solicitation Package

Note

Establish and maintain a solicitation package that includes the requirements and proposal evaluation criteria.

Solicitation packages are used to seek proposals from potential suppliers. The acquirer structures the solicitation package to facilitate an accurate and complete response from each potential supplier and to allow for an effective comparison and evaluation of proposals.

The solicitation package includes a description of the desired form of the response, the relevant statement of work for the supplier, and any required contractual provisions (e.g., a copy of the standard supplier agreement, non-disclosure provisions). With government agreements, some or all of the content and structure of the solicitation package can be defined by regulation.

The solicitation package typically contains:

  • The statement of work for the supplier, including supplier measures and service levels

  • Guidance on how potential suppliers are to respond to the solicitation package

  • Criteria that will be used to evaluate the proposals

  • Documentation requirements to submit with the response (e.g., project plans)

  • Schedule for completing the solicitation process

  • Procedures for addressing questions, contacts

The solicitation package is rigorous enough to ensure consistent, comparable responses, but flexible enough to allow consideration of supplier suggestions for better ways to satisfy the requirements. Inviting the suppliers to submit a proposal that is wholly responsive to the request for proposal and to provide a proposed alternative solution in a separate proposal can do this.

The complexity and level of detail of the solicitation package should be consistent with the value of, and risk associated with, the planned acquisition. In some cases, the solicitation may not include detailed requirements, e.g., it may be a solicitation for development of detailed requirements, or it may include a statement of objectives to provide the supplier greater flexibility in addressing the scope of the project. Proposal and supplier evaluation criteria are identified and documented.

Typical Acquirer Work Products

  1. Solicitation package

  2. Supplier and proposal evaluation criteria

Subpractices

  1. Develop the statement of work for the supplier.

    The statement of work for the supplier defines, for those items being acquired, only the portion of the project scope that is included within the related supplier agreement. The statement of work for a supplier is developed from the project scope, the work breakdown structure, and the task dictionary.

    The statement of work for the supplier is written to be clear, complete, and concise. It describes the acquired product or service in sufficient detail to allow prospective suppliers to determine whether they are capable of providing the product or service.

    The statement of work for the supplier can be revised and refined as required as it moves through the solicitation and supplier agreement development process until incorporated into a signed supplier agreement. For example, a prospective supplier can suggest a more efficient approach or a less costly product than that originally specified.

  2. Specify the measures, the acceptance criteria, and the associated service levels for the supplier.

    Service levels are designed to support the acquisition strategy. Typically the service levels are a limited set with a precise definition, including the assessment and calculation of incentives and penalties.

    A service level for a project, for example, may refer to an output from the supplier, such as providing a specific deliverable at an agreed-upon time, and to the quality of that output. Service levels also (directly or indirectly) relate to the performance targets or thresholds of progress measures. For example, if a service level requires on-time completion of deliverables from a supplier and the supplier doesn’t appear to be on schedule based on the progress measure “percent completion of deliverables,” then the acquirer and supplier will trigger corrective actions to bring the supplier’s delivery back on target.

  3. Develop supplier evaluation and proposal evaluation criteria.

    Evaluation criteria are developed and used to rate or score proposals. Evaluation criteria are included as a part of the solicitation package. Evaluation criteria can be limited to purchase price if the procurement item is readily available from a number of acceptable suppliers. Purchase price in this context includes both the cost of the item and ancillary expenses such as delivery. Other selection criteria can be identified and documented to support an assessment for a more complex product or service. For example:

    The individuals identified in the Project Planning resource plan develop and document the criteria for evaluating potential suppliers and for evaluating their proposals.

  4. Document the proposal content that the suppliers must submit with their response.

  5. Incorporate acquirer’s (standard) supplier agreement, terms and conditions, and additional information into the solicitation package.

    Contract terms and conditions typically include:

    • Recitals

    • Deliverables and rights

    • Compensation and payments

    • Confidentiality

    • Privacy statements

    • Continuous improvement and best practices

    • Exclusive services, key employees, supplier’s personnel at acquirer’s sites

    • Information gathering practices and ethical representation

    • Force majeure

    • Term

    • Termination for insolvency, breach or non-performance

    • Termination for convenience

    • Termination assistance

    • Indemnification

    • Insurance

    • Right to audit

    • Notices

    Typical considerations for additional instructions and general information for the supplier when responding to the solicitation package include the following:

    • Submission of intent to submit proposal

    • Submission due date, time, and destination

    • Number of proposal copies that must be submitted

    • Proposal format

    • Non-complying proposals

    • Proposal ownership

    • Bidder inquiries

    • Key dates and activities

    • Discretionary selection and potential modifications of solicitation process

    • No implied offer

    • Response constitutes an offer to do business

    • Confidentiality of information

    • Publicity

    • Use of subcontractors

    • Due diligence

    • Incurred costs

    • Language and statutory units

    • Warranty provisions

    • Licensing provisions

Review the Solicitation Package

Note

Review the solicitation package with stakeholders to make sure the approach is realistic and can reasonably lead to a usable product.

The solicitation package is reviewed with end users and other stakeholders to make sure the requirements have been accurately and sufficiently stated so that the solicitation can lead to a manageable agreement. The acquirer establishes traceability between the requirements and the solicitation package. Suppliers may be included as stakeholders in the review of the solicitation package. The acquirer wants the solicitation package to attract a variety of responses and encourage competition. The acquirer also wants to ensure that the package is legally inclusive of all qualified suppliers.

The acquirer may use standard templates and checklists to verify that the necessary components, e.g., skills, standards, verification and validation methods, measures, and acceptance criteria, are covered in the solicitation package.

The independent cost and schedule estimates for the supplier’s project work developed in the practice above are also reviewed.

Typical Acquirer Work Products

  1. Record of the reviews of the solicitation package

Distribute and Maintain Solicitation Package

Note

Distribute the solicitation package to potential suppliers for their response, and maintain its content throughout the solicitation.

The solicitation package is distributed to the potential suppliers identified above.

The acquirer uses the Project Planning practices and the Project Monitoring and Control practices to monitor, control, and replan acquirer activities during the solicitation process as necessary.

Typical Acquirer Work Products

  1. Potential suppliers

  2. Responses to supplier questions

  3. Amendments to the solicitation package

Typical Supplier Deliverables

  1. Supplier proposals

  2. Supplier questions, requests for clarification

Subpractices

  1. Finalize list of potential suppliers.

  2. Distribute solicitation package to potential suppliers.

  3. Document and respond to supplier questions according to the instructions in the solicitation package.

    Verify that all potential suppliers have equal access and opportunity to provide feedback on the solicitation package. Provide the opportunity for the selected potential suppliers and stakeholders to clarify points of ambiguity in the requirements as well as any disconnects or concerns with the requirements.

  4. Acknowledge the receipt of supplier proposals according to the schedule identified in the solicitation package.

  5. Verify the conformance with requirements and completeness of the supplier response. Contact suppliers if the response is non-conforming or incomplete so that they can take corrective action.

  6. Issue amendments to the solicitation package when changes are made to the solicitation.

Select Suppliers

Note

Select suppliers based on an evaluation of their ability to meet the specified requirements and established criteria.

Evaluate Proposed Solutions

Note

Evaluate proposed solutions according to the documented proposal evaluation plans and criteria.

Proposals, submitted in response to solicitation packages, are evaluated in accordance with an overall established timeline, and preliminary project plans and proposal evaluation criteria. The proposal evaluation criteria are used to evaluate the potential suppliers’ responses to the solicitation. Evaluation results and decision-making notes, e.g., advantages and disadvantages of potential suppliers and scoring against criteria, should be documented and maintained.

The acquirer refines the negotiation strategy based upon the evaluation of the suppliers’ proposals and the evaluation of the suppliers. The proposal evaluation and the negotiations with the suppliers provide the basis for selecting a supplier best able to meet the requirements of the solicitation.

For task orders or contractual changes against an existing supplier agreement, the acquirer uses documented evaluation criteria against which to evaluate the task order responses or proposed contractual changes. In a sole source or change order environment, this practice is critical for relevant stakeholders to understand the intent of the effort or changes before placing the additional work against the supplier agreement.

Typical Acquirer Work Products

  1. Clarification correspondence between the acquirer and potential suppliers

  2. Evaluation results and rationale

  3. Candidate suppliers

Typical Supplier Deliverables

  1. Proposal revisions based upon clarifications

  2. Supplier documentation of its approach to the project work, capabilities, preliminary technical solution

Subpractices

  1. Distribute supplier proposals to the individuals identified by the acquirer to perform the evaluation.

  2. Schedule acquirer evaluation review of supplier proposals to consolidate questions, concerns, and issues.

  3. Schedule supplier presentations.

  4. Verify the mutual understanding of the statement of work.

    A good practice is to compare the supplier’s estimates to those developed in the project planning practices; this comparison provides a means to determine whether there is a mutual understanding of the requirements and the associated work to fulfill them.

  5. Evaluate supplier proposals, and document the findings.

  6. Execute due diligence.

    Due diligence provides an opportunity for the acquirer to further clarify requirements, particularly those related to the acquirer’s existing environment and products in use. The potential suppliers ask questions and gain understanding, which enables them to make their proposals more realistic. It also enables the acquirer to gain insight into the capability of the potential suppliers’ proposed solutions to meet requirements.

    Due diligence helps to eliminate assumptions and replace them with facts, to identify and document risks and their mitigation plans or their effect on the agreement, and to list issues and dependencies between the acquirer and supplier to include in the agreement.

  7. Document candidate supplier recommendations based upon proposal evaluation.

Develop Negotiation Plans

Note

Develop negotiation plans to use in completing a supplier agreement.

Develop a negotiation plan for each of the candidate suppliers based upon evaluation of the suppliers and their proposals.

The size of a negotiation team depends upon the size and complexity of the project. Typically the team is led by supplier management and also includes individuals who possess detailed knowledge of the statement of work documented in the solicitation package. The negotiation team is typically supported by legal staff, a financial analyst, purchasing, and the project manager for the project.

Typical Acquirer Work Products

  1. Negotiation strategy for candidate suppliers

Finalize Supplier Selection

Note

Select suppliers based on an evaluation of their ability to meet the specified requirements and established criteria.

Proposal evaluation results are used to finalize a supplier selection based on the outcome of negotiations. The negotiations enable the acquirer to select the best supplier for the project. In some cases the acquirer may take the top two proposals and use negotiations to make the final selection decision.

The evaluation results, along with the negotiation results, support the selection decision or cause the acquirer to take other action as appropriate. If the return on investment is not sufficient the acquirer may decide to defer or cancel the project.

Typical Acquirer Work Products

  1. Revisions due to negotiations

  2. Supplier sourcing decision

Subpractices

  1. Negotiate with supplier(s) to determine best fit for the project.

    Negotiate with the selected supplier or candidate suppliers to resolve any issues identified during due diligence and to address any remaining issues with requirements, and revise the requirements to be fulfilled by the supplier.

  2. Select a supplier to be awarded the supplier agreement.

  3. Document the sourcing decision.

Establish Supplier Agreements

Note

Establish and maintain formal agreements with selected suppliers.

A formal agreement is established based on the supplier sourcing decision.

Establish Mutual Understanding of the Agreement

Note

Establish and maintain a mutual understanding of the contract with selected suppliers and end users based on the acquisition needs and the suppliers’ proposed approaches.

As points of clarification and ambiguities continue to arise after contract award, ensure that the mutual understanding is revised and maintained through the life of the project. Ensure that the supplier makes a contractual commitment to execute its proposed processes.

Typical Acquirer Work Products

  1. Correspondence clarifying elements of the agreement

  2. Frequently asked questions (for use with end users, other suppliers)

Document Supplier Agreement

Note

Document the approved supplier agreement.

The agreement may be either a stand-alone agreement or part of a master agreement. When part of a master agreement, the project may be, for instance, an addendum, work order, or service request to the master agreement.

Typical Acquirer Work Products

  1. Supplier agreement (including terms & conditions)

Subpractices

  1. Document the supplier agreement for the project.

    The supplier agreement provisions typically include:

    • The statement of work, specification, terms and conditions, list of deliverables, schedule, budget, and acceptance process

    • Product acceptance criteria to be satisfied by the supplier

    • Statement of work for the supplier

    • Measurements and reports that provide the acquirer visibility into the supplier’s process and results

    • Mechanisms and deliverables that provide the acquirer sufficient data to allow evaluation and analysis of acquired products

    • Names of representatives from the project and supplier who are responsible and authorized to make changes to the supplier agreement

    • Supplier’s responsibility for supporting business acceptance working with the acquirer

    • How requirements changes and changes to the supplier agreement are determined, communicated, and addressed

    • Standards and procedures that will be followed (e.g., configuration management, escalation, non-conformances, conflicts, issues, etc.)

    • Requirements for the supplier to establish a corrective action system that includes a change control process for rework and reevaluation

    • Critical dependencies between the acquirer and the supplier

    • Documentation of what the acquirer will provide to the supplier such as facilities, tools, software, documentation, and services

    • Verification methods and acceptance criteria for designated supplier deliverables

    • The type and depth of project oversight of the supplier procedures and evaluation criteria to be used by the acquirer in monitoring supplier performance

    • The types of reviews that will be conducted with the supplier

    • The supplier’s responsibilities to execute corrective actions when initiated by the Project Monitoring and Control practices

    • Non-hire and non-compete clauses

    • Confidentiality, non-disclosure, intellectual capital clauses pertaining to PPQA, measurement data, personnel who would perform audits or are authorized to validate measurement data

    • The supplier’s responsibilities for preparation of the site and training of the support and operations organizations according to acquirer-specified standards, tools, and methods

    • The supplier’s responsibilities for ongoing maintenance and support of the acquired products

    • Requirements for the supplier to be involved in the deployment of process assets as necessary

    • Warranty, ownership, and usage rights for the acquired products

    • Security and legal penalty recoveries

  2. Verify that all parties to the agreement understand and agree to all requirements by signing the supplier agreement.

  3. Notify those suppliers not selected for the award.

  4. Communicate the supplier agreement within the organization as required.

Acquisition Management

The purpose of Acquisition Management (AM) is to ensure that the supplier’s performance meets contractual requirements and that the acquirer performs according to the terms of the supplier agreement. The Acquisition Management process area involves the following:

  • Maintaining ongoing communications and mutual understanding with the supplier

  • Resolving issues and disputes

  • Revising and closing the supplier agreements

  • Accepting delivery of acquired products

  • Transitioning acquired products to the project

  • Managing the payment to the supplier

The legal nature of the acquirer-supplier relationship makes it imperative that the project management team is acutely aware of the legal implications of actions taken when managing any acquisition of products or services.

The supplier agreement is the basis for managing the relationship with the supplier, including resolving issues and disputes. It defines the mechanisms to allow the acquirer to oversee the supplier’s activities and evolving products, and to verify compliance with supplier agreement requirements. It also provides the vehicle for mutual understanding between the acquirer and the supplier.

Deviations from the project plan may cause changes to the supplier agreement, and significant changes to the supplier agreement may require the project plan to be modified. When the supplier’s performance, processes, or products fail to satisfy established criteria as outlined in the supplier agreement, the acquirer may decide to apply legal remedies.

Related Process Areas

Specific Practices by Goal

Manage Supplier Agreements

Note

Manage changes and revise the supplier agreement if necessary, and resolve supplier agreement issues or disputes.

Manage Supplier Agreement Communications

Note

Manage supplier agreement communications between the acquirer and the supplier about the relationship, performance, results, and impact to the business.

This specific practice covers communications internally and externally as well as the use of such information by acquirer and supplier to support marketing and public relations. The acquirer manages the relationship with the supplier to maintain effective communication on key issues, for example, change in the acquirer’s business, new supplier products and technologies, and changes in the organizational structure.

Typical Acquirer Work Products

  1. Marketing and communications material

  2. Correspondence between acquirer and supplier

Resolve Supplier Agreement Issues and Disputes

Note

Resolve issues and disputes associated with the supplier agreement, and determine corrective actions necessary to address the issues and disputes.

This specific practice represents the escalation of unresolved issues between the acquirer and supplier through multiple phases of escalation for an issue between acquirer and supplier before possible litigation.

The acquirer collects supplier agreement related issues or disputes and tracks these issues and disputes until resolution. Issues related to the supplier’s performance may be escalated from progress or milestone reviews, for example. If the supplier does not comply appropriately with the acquirer’s initiation of corrective action, the acquirer escalates and handles the issue as a supplier agreement dispute.

The supplier may also escalate issues related to the agreement, especially those related to the acquirer meeting specified commitments. Each issue is tracked from identification or receipt to resolution according to the escalation process or procedure defined in the supplier agreement. The resolution may require that a change be made to the supplier agreement. Relevant stakeholders, for example, senior managers, contract manager, governance bodies, legal consultants, project manager, and suppliers, may be requested to participate in resolution of an issue to prevent the issue becoming the subject of an agreement dispute.

Typical Acquirer Work Products

  1. List of escalated issues and disputed issues

  2. Corrective action plan

  3. Corrective action results

  4. Resolution of agreement issues and disputes (e.g., proposed supplier agreement language)

  5. Correspondence with supplier

Typical Supplier Deliverables

  1. List of escalated issues and disputed issues

  2. Corrective action plans for supplier issues

  3. Corrective action results for supplier issues

  4. Correspondence with acquirer

Subpractices

  1. Gather escalated issues associated with the supplier agreement for analysis.

  2. Determine and document the appropriate actions need to address the escalated issues.

    Collect documentation and backup material relevant to the issue, and interpret supplier agreement to compile advantages and disadvantages of various positions for resolution.

  3. Review escalated issues per the process or procedure in the supplier agreement, and resolve if possible.

  4. Classify issues not resolved through escalation as disputed issues.

  5. Build negotiations team and strategy to resolve the disputed issues.

  6. Conduct dispute resolution as required by the supplier agreement.

    Communicate proposed dispute resolution to the supplier, or analyze supplier’s proposed dispute resolution.

  7. Monitor escalated issues and disputes for completion.

  8. Analyze results of issues and dispute resolution to determine its effectiveness.

  9. Document resolution of escalated issues and disputes, and communicate as needed.

Revise Supplier Agreements

Note

Revise the supplier agreement to reflect changes in conditions where appropriate.

After award of the supplier agreement, the acquirer may find requirements that are no longer optimal or applicable based on the supplier’s progress or environment changes. Examples include availability of new technology, overly burdensome documentation, and reporting requirements. Changes to supplier agreements may also occur when the supplier’s processes or products fail to meet agreed-to criteria and service levels.

All changes are formally documented and approved by both the acquirer and the supplier before being implemented by this specific practice. Approved change requests can include modifications to the terms and conditions of the supplier agreement, including the statement of work, pricing, and description of products, services, or results to be acquired.

Typical Acquirer Work Products

  1. Revised supplier agreement

Close Supplier Agreements

Note

Close the supplier agreement after verifying completion of all supplier requirements.

This practice addresses each supplier agreement applicable to the project or a project phase. Depending on the acquisition life cycle, the term of the supplier agreement may be applicable only to a given phase of the project. In these cases, this specific practice closes the supplier agreement(s) applicable to that phase of the project. When a supplier agreement is applicable to an entire project, this specific practice typically closes the project. Unresolved issues or disputes may be subject to litigation after supplier agreement. The terms and conditions of the supplier agreement can prescribe specific procedures for supplier agreement closure.

Early termination of a supplier agreement is a special case of supplier agreement closure, and can result from a mutual agreement of the acquirer and supplier or from the default of one of the parties. The rights and responsibilities of the acquirer and supplier in the event of an early termination are contained in the termination clause of the supplier agreement.

Typical Acquirer Work Products

  1. Supplier agreement file

Subpractices

  1. Verify with stakeholders that all supplier activities and supplier deliverables specified in the agreement have been received and accepted.

    The acquirer verifies, for instance, that any warranty has been completed according to the supplier agreement and that all regulatory requirements have been met. This may also include a final supplier evaluation related to the agreement.

    Refer to the Acquisition Verification process area for information about verifying supplier deliverables.

  2. Ensure that all records related to the supplier agreement are stored, managed, and controlled for future use.

    The acquirer documents the performance of the supplier as a basis for future relationships with the supplier. Supplier performance evaluation by the acquirer is primarily carried out to confirm the competency or lack of competency of the supplier, relative to performing similar work on the project or other projects.

  3. Communicate to appropriate stakeholders that the supplier agreement has been closed.

    The acquirer, usually through its authorized supplier agreement or contract administrator, provides the supplier with formal written notice that the supplier agreement has been completed.

Satisfy Supplier Agreements

Note

Establish a productive and cooperative environment to meet the goals of the project.

Manage Payment to Supplier

Note

Receive, review, approve, and remit invoices provided by the supplier.

This practice handles invoices for any type of charge, for example, one-time, monthly, deliverable-based, pass-through, and expenses. It handles invoice errors or disputes, changes to invoices, billing errors, and withholding of disputed charges consistent with the terms and conditions of the supplier agreement. The acquirer must adhere to regulatory requirements, for example, tax deductions, in managing payments to the supplier. The acquirer must also ensure that appropriate financial controls are in place.

The intent of this practice is to ensure that payment terms defined within the supplier agreement are met and that supplier compensation is linked to supplier progress, as defined in the supplier agreement. When accepting supplier deliverables, the acquirer should not make final payment to the supplier until it has been certified that all the supplier deliverables meet the contractual requirements and that all acceptance criteria have been satisfied. To the degree that nonperformance is encountered, exercise the contract provisions for withholding or reducing payments to the supplier.

Typical Acquirer Work Products

  1. Invoices approved for payment

Typical Supplier Deliverables

  1. Invoices

Subpractices

  1. Review invoice and related supporting material.

  2. Resolve errors and manage disputes with supplier as required.

  3. Process invoice for payment.

Accept Acquired Product

Note

Ensure that the supplier agreement is satisfied before accepting the acquired product.

The acquirer ensures that all acceptance criteria have been satisfied and that all discrepancies have been corrected. Requirements for formal deliverable acceptance, and how to address non-conforming deliverables, are usually defined in the supplier agreement. The acquirer should be prepared to exercise all remedies in case the supplier fails to perform.

The acquirer, usually through its authorized supplier agreement or contract administrator, provides the supplier with formal written notice that the supplier deliverables have been accepted or rejected.

With this specific practice, an authorized representative of the acquirer assumes ownership of existing identified supplier products or deliverables tendered, or approves specific services rendered, as partial or complete performance of the supplier agreement on the part of the supplier.

Typical Acquirer Work Products

  1. Stakeholder approval reports

  2. Discrepancy reports

  3. Product acceptance review report with approval signatures

Typical Supplier Deliverables

  1. Work products as defined in the supplier agreement

Subpractices

  1. Review the validation results, reports, logs, and issues for the acquired product.

    Refer to the Acquisition Validation process area for more information about validating products.

  2. Confirm that all customer requirements and stakeholder intentions associated with the acquired product are satisfied.

  3. Review the verification results, reports, logs, and issues for the acquired product.

    Refer to the Acquisition Verification process area for more information about verifying products.

  4. Confirm that all contractual requirements associated with the acquired product are satisfied.

    This may include confirming that the appropriate license, warranty, ownership, usage, and support or maintenance agreements are in place and that all supporting materials are received.

  5. Confirm that all discrepancies have been corrected and that all acceptance criteria have been satisfied.

  6. Communicate the product’s readiness for transition to operations and support and also the product’s status to stakeholders.

Transition Product

Note

Transition the acquired product from the supplier to the acquirer.

Typically, the supplier integrates and packages the products and prepares for the transition to operations and support, including support for business user acceptance, and the acquirer oversees the supplier activities. These expectations and the acceptance criteria for transition to operations and support are included in the solicitation package and then supplier agreement.

Typical Acquirer Work Products

  1. Transition readiness report

  2. Transfer of ownership

  3. Transition analysis report

Typical Supplier Deliverables

  1. Transition plans

  2. Training reports

  3. Pilot results

Subpractices

  1. Ensure the completion of installation of the product in the production environment.

  2. Conduct pilot or initial implementation, as appropriate.

    The acquirer, following appropriate reviews of the transition activities, makes the product available for use according to the plans for pilot and transition. During this pilot or initial period of production, the acquirer validates that the product is capable and ready for full operational use. During this defined transition or warranty period, for example, 30 days or 90 days, the acquirer oversees activities to make sure the product is operating as planned and identifies any corrective actions required. Although the product is in the operational environment, full responsibility for operations and support is not transitioned until this pilot period is complete and any corrective actions identified have been successfully completed. During this defined transition period, the acquirer ensures support of the product, for example, the supplier may be given responsibility to maintain support during the transition.

    Ensure the viability of either dual operations or the capability to back out the product before transitioning to the production environment

  3. Transfer responsibility for operations and support.

    Responsibility for operations and support of the product is transferred by the acquirer to the operations and support organizations, which may be suppliers, only after the operations and support organization demonstrates its capability and capacity to support the product and accept the responsibilities to perform its assigned operations and support processes. The acquirer ensures that the operations and support organizations understand post-transition service requirements from the supplier.

    The acquirer maintains oversight responsibilities until the transition activities are complete and the transfer of responsibility for operations and support of the product has been accepted. This includes oversight of any supplier activities, based upon the supplier agreement, for the execution of the transition of the product to operations and support.

  4. Analyze the results of transition activities.

    After the transition is complete and the responsibility transferred to the operational and support organizations (e.g., at the end of the warranty period for a software product), the acquirer reviews and analyzes the results of the transition activities and determines whether any corrective actions must be completed before close.

    The following typical reports and logs are used in the analysis by the acquirer:

    • Results of transition activities including defects or quality-related measures collected during pilot and warranty period

    • Problem tracking reports, detailing resolution time, incident response, escalation, and root cause analysis

    • Change management reports

    • Operation logs to determine that sufficient information is stored to support reconstruction

    • Configuration management records

    • Violation of security activity reports

    • Actual operations costs compared to estimates

    • Actual support costs compared to estimates

  5. Analyze the actual operations and support cost against the estimated costs.

  6. Follow warranty terms and conditions to resolve problems during the period following transition. Ensure that storing, distributing, and using the acquired products are in compliance with the terms and conditions specified in the supplier agreement or license.

Acquisition Requirements Development

The purpose of Acquisition Requirements Development (ARD) is to produce and analyze customer and contractual requirements. Requirements are the basis for the selection and for the design or configuration of the acquired product. The development of requirements includes the following activities:

  • Elicitation, analysis, validation, and communication of customer needs, expectations, and constraints to obtain customer requirements that constitute an understanding of what will satisfy stakeholders

  • Collection and coordination of stakeholder needs

  • Development of the life-cycle requirements of the product

  • Establishment of the customer requirements

  • Establishment of contractual requirements consistent with customer requirements to a level of detail that is sufficient to be included in the solicitation package and supplier agreement

The requirements included in the solicitation package form the basis for evaluating alternative proposals by suppliers and for further negotiations with the suppliers and communication with the customer. The contractual requirements for the supplier are baselined in the supplier agreement.

Requirements are identified and refined throughout the project life cycle. Design decisions, subsequent corrective actions, and feedback during each phase of the project’s life cycle are analyzed for impact on contractual requirements.

Requirements analyses aid in understanding, defining, and selecting the requirements at all levels from competing alternatives. Analyses occur recursively at successively more detailed levels until sufficient detail is available to produce contractual requirements and to further refine these, if necessary, while the supplier builds or configures the product.

Involvement of relevant stakeholders in both requirements development and analyses gives them visibility into the evolution of requirements. Participation continually assures the stakeholders that the requirements are being properly defined.

The Acquisition Requirements Development process area includes three specific goals. The Develop Customer Requirements specific goal addresses eliciting and defining a set of customer requirements. The Develop Contractual Requirements specific goal addresses defining a set of contractual requirements that are based on customer requirements and included in the solicitation package and supplier agreement. The specific practices of the Analyze and Validate Requirements specific goal support the development of the requirements in both the Develop Customer Requirements specific goal and the Develop Contractual Requirements specific goal. The specific practices associated with this specific goal cover analyzing and validating the requirements with respect to the acquirer’s intended environment.

The processes associated with the Acquisition Requirements Development process area and those associated with the Acquisition Technical Solution process area may interact recursively with one another, for instance, to iteratively refine requirements.

Related Process Areas

  • Refer to the Acquisition Technical Solution process area for more information about how the outputs of the requirements development processes are used for defining technical constraints.

  • Refer to the Acquisition Verification process area for more information about verifying that the resulting product meets the contractual requirements.

  • Refer to the Acquisition Validation process area for more information about how the requirements will be validated against the stakeholder intentions.

Specific Practices by Goal

Develop Customer Requirements

Note

Stakeholder needs, expectations, constraints, and interfaces are collected and translated into customer requirements.

The intentions of stakeholders (e.g., customers, end users, suppliers, supplier agreement management personnel, manufacturers, and logistics support personnel) are the basis for determining requirements. The stakeholder needs, expectations, constraints, interfaces, operational concepts, and product concepts are analyzed, harmonized, refined, and elaborated for translation into a set of customer requirements.

Frequently, the stakeholders’ intentions are poorly identified or conflicting. Because the stakeholders’ intentions must be clearly identified and understood throughout the project life cycle, an iterative process is used throughout the life of the project to accomplish this objective. To facilitate the required interaction, relevant stakeholders are frequently involved throughout the project life cycle to communicate their needs, expectations, and constraints and to help resolve conflicts. Environmental, legal, and other constraints should be considered when the set of requirements for acquiring products or services are created and evolved.

Elicit Needs

Note

Elicit stakeholder needs, expectations, constraints, and interfaces for all phases of the product life cycle.

Eliciting goes beyond collecting requirements; eliciting proactively identifies additional requirements not explicitly provided by the stakeholders. Relevant stakeholders representing all phases of the product’s life cycle in the acquirer’s intended environment should include business as well as technical functions. In this way, needs for all product-related life-cycle processes are considered concurrently with the concepts for the acquired products.

Analyses of business processes are a common source of stakeholder needs, expectations, constraints, and interfaces. Additional needs typically address the various project life-cycle activities and their impact on the product.

Typical Acquirer Work Products

  1. Stakeholder intentions

Subpractices

  1. Engage relevant stakeholders using methods for eliciting needs, expectations, constraints, and external interfaces.

Develop the Customer Requirements

Note

Transform stakeholder needs, expectations, constraints, and interfaces into customer requirements.

The customer typically describes requirements as capabilities expressed in broad operational terms concerned with achieving a desired effect under specified standards and regulations. The various inputs from the customer and other stakeholders must be aligned to the organization’s strategy, missing information must be obtained, and conflicts must be resolved as the customer requirements are documented (e.g., customer requirements that exist as an output of another project’s activities such as a previous project that delivered the initial capability).

Typical Acquirer Work Products

  1. Prioritized customer requirements

  2. Customer constraints on the conduct of verification

  3. Customer constraints on the conduct of validation

Subpractices

  1. Translate the stakeholder needs, expectations, constraints, and interfaces into documented customer requirements

  2. Prioritize customer requirements

  3. Define constraints for verification and validation

Develop Contractual Requirements

Note

Customer requirements are refined and elaborated to develop contractual requirements.

Customer requirements are analyzed in conjunction with the development of the operational concept to derive more detailed and precise sets of requirements called contractual requirements to be included in the solicitation package for potential suppliers and eventually in the supplier agreement. The level of detail of contractual requirements is determined based on the acquisition strategy and project characteristics.

Contractual requirements arise from constraints, consideration of issues implied but not explicitly stated in the customer requirements baseline, and factors introduced by the design constraints and the supplier’s capabilities. The requirements are reexamined throughout the project life cycle.

The requirements are allocated to supplier deliverables. The traceability of requirements to supplier deliverables is documented.

Establish Contractual Requirements

Note

Establish and maintain contractual requirements, which are based on the stakeholder requirements.

The customer requirements may be expressed in the customer’s terms and may be non-technical descriptions. The contractual requirements are the expression of these requirements in technical terms that can be used for design decisions. An example of this translation is found in quality functional deployment, which maps customer desires into technical parameters. For instance, “solid sounding door” might be mapped to size, weight, fit, dampening, and resonant frequencies.

In addition to technical requirements (e.g., requirements specifying interfaces with other products or applications, functional requirements and their validation, and verification requirements such as product acceptance criteria), contractual requirements also cover non-technical stakeholder needs, expectations, and constraints.

The modification of requirements due to approved requirement changes is covered by the “maintain” function of this specific practice, whereas the administration of requirements changes is covered by the Requirements Management process area.

Refer to the Solicitation and Supplier Agreement Development process area for more information about developing solicitation packages and supplier agreements.

Refer to the Acquisition Technical Solution process area for more information about design constraints.

Typical Acquirer Work Products

  1. Contractual requirements

Subpractices

  1. Develop functional requirements necessary for development of alternative solutions and the product by the supplier.

    Functional requirements or definition of functionality can include actions, sequence, inputs, outputs, or other information that communicates the manner in which the product will be used. Functionality required may be prioritized as Critical/Must-Have, Good-to-Have, and Optional requirements.

  2. Develop requirements of the interface between the acquired product and other products in the intended environment.

    Requirements for interfaces are defined in terms of origination, destination, stimulus, data characteristics for software, and electrical and mechanical characteristics for hardware.

  3. Develop requirements for verification and validation of the product developed by the supplier.

    Requirements for verification and validation typically include types and coverage of testing and review to be carried out in the supplier’s and acquirer’s environment. Testing requirements may include mirroring the production environment by the supplier, type of test data to be used, and simulated testing for interfaces with other products.

    Review requirements may include the form of review to be used (e.g., walkthrough, prototype review) and the required participants for reviews.

  4. Develop requirements and constraints in technical terms necessary for development of alternative solutions and the product developed by the supplier.

    Refer to the Acquisition Technical Solution process area for defining design constraints.

    Design constraints express the qualities and performance points that are critical to the success of the product in the acquirer’s operational environment. They account for customer requirements in the context of multiple interoperable products. The project needs to identify any dependencies on planned or existing products. This must take project or program constraints into account (e.g., affordability and schedule constraints).

    Acquirers may accelerate the development of technical requirements and design constraints by reusing shared or common constraints or requirements and their associated test cases from previous acquisitions or by leveraging the supplier’s previous product developments.

  5. Establish and maintain relationships between requirements for consideration during change management and requirements allocation.

    Relationships between requirements can aid in evaluating the impact of changes. Expected requirements volatility is also a key factor in anticipating scope changes and supporting the acquirer’s selection of the appropriate acquisition type.

Allocate Contractual Requirements

Note

Allocate the requirements for each supplier deliverable.

The requirements for each supplier deliverables are documented. In some cases, this includes allocation of technical requirements to third-party products that must be used by the supplier (e.g., commercial off-the-shelf products).

Typical Acquirer Work Products

  1. Requirement allocation sheets

Subpractices

  1. Allocate requirements to supplier deliverables.

  2. Allocate design constraints to supplier deliverables.

  3. Document relationships among allocated requirements and design constraints.

    Relationships include dependencies in which a change in one requirement may affect other requirements.

  4. Allocate requirements to suppliers.

    In situations where multiple suppliers are involved in developing the technical solution, different products or product components may be allocated to different suppliers.

Analyze and Validate Requirements

Note

The requirements are analyzed and validated.

Analyses are performed to determine what impact the intended operational environment will have on the ability to satisfy the stakeholders’ needs, expectations, constraints, and interfaces. Considerations, such as feasibility, mission needs, cost constraints, potential market size, and acquisition strategy, must all be taken into account, depending on the product context.

The objectives of the analyses are to determine candidate requirements for product concepts that will satisfy stakeholder needs, expectations, and constraints, and then to translate these concepts into requirements. In parallel with this activity, the parameters that will be used to evaluate the effectiveness of the product are determined based on customer input and the preliminary product concept.

Requirements are validated to increase the probability that the resulting product will perform as intended in the acquirer’s environment.

Establish Operational Concepts and Scenarios

Note

Establish and maintain operational concepts and associated scenarios.

Operational concepts or concepts of operations give an overall description of the way in which an acquired product is intended to be used or operated, deployed, supported (including maintenance and sustainment), and disposed of. For that, the acquirer takes design constraints explicitly into account. For example, the operational concept for a satellite-based communications product is quite different from one based on landlines.

In contrast, an operational scenario is a sequence of events that might occur in the use of the acquired product and that make explicit some stakeholder intentions. Typically, operational scenarios are derived from business process descriptions and operational concepts.

The operational concepts and scenarios are refined as solution decisions are made and more detailed requirements are developed. They are evolved to facilitate the validation of the technical solutions delivered by the supplier.

Typical Acquirer Work Products

  1. Operational concepts

  2. Operational scenarios

  3. Requirements

Subpractices

  1. Develop operational concepts and scenarios that include functionality, performance, maintenance, support, and disposal as appropriate.

    Identify and develop concepts and scenarios, consistent with the level of detail in the stakeholder needs, expectations, and constraints, in which the proposed product is expected to operate.

  2. Define the environment the product will operate in, including boundaries and constraints.

  3. Review operational concepts and scenarios to refine and discover requirements.

    Operational concept and scenario development is an iterative process. The reviews should be held periodically to ensure that they agree with the requirements. The review may be in the form of a walkthrough.

  4. Develop a detailed operational concept, as products and product components are developed by the supplier, that defines the interaction of the product, the end user, and the environment, and that satisfies the operational, maintenance, support, and disposal needs.

Analyze Requirements

Note

Analyze requirements to ensure that they are necessary and sufficient.

As contractual requirements are defined, their relationship to customer requirements must be understood. In light of the operational concept and scenarios, the contractual requirements are analyzed to determine whether they are necessary and sufficient to meet the customer requirements. The analyzed requirements then provide the basis for more detailed and precise requirements throughout the project life cycle.

One of the other actions is the determination of which key requirements will be used to track technical progress. For instance, the weight of a product or size of a software product may be monitored through development based on its risk.

Typical Acquirer Work Products

  1. Requirements defects reports

  2. Proposed requirements changes to resolve defects

  3. Key requirements

  4. Technical performance measures

Subpractices

  1. Analyze stakeholder needs, expectations, constraints, and external interfaces to remove conflicts and to organize into related subjects.

  2. Analyze requirements to determine whether they satisfy the objectives of higher-level requirements.

  3. Analyze requirements to ensure that they are complete, feasible, realizable, and verifiable.

  4. Identify key requirements that have a strong influence on cost, schedule, functionality, risk, or performance.

  5. Identify technical performance measures that will be tracked during the acquisition effort.

    The total number of performance parameters should be the minimum number needed to characterize the major drivers of the product’s performance. The number and specificity of performance parameters may change over time. Early in a project or program the requirements baseline should reflect broadly defined measures of technology effectiveness or measures of performance to describe needed capabilities. As a program or project matures and requirements become better defined, the acquirer can define more detailed technical performance measures, if necessary. Data for technical performance measures is provided by the supplier as specified in the supplier agreement.

  6. Analyze operational concepts and scenarios to refine the customer needs, constraints, and interfaces and to discover new requirements.

    This analysis may result in more detailed operational concepts and scenarios as well as supporting the derivation of new requirements.

Analyze Requirements to Achieve Balance

Note

Analyze requirements to balance stakeholder needs and constraints.

Stakeholder needs and constraints can address cost, schedule, performance, functionality, reusable components, maintainability, or risk.

Typical Acquirer Work Products

  1. Assessment of risks related to requirements

Subpractices

  1. Use proven models, simulations, and prototyping to analyze the balance of stakeholder needs and constraints.

    Results of the analyses can be used to reduce the cost of the product and the risk in acquiring and using the product.

  2. Perform a risk assessment on the requirements and design constraints.

  3. Examine product life-cycle concepts for impacts of requirements on risks.

Validate Requirements with Comprehensive Methods

Note

Validate requirements to ensure the resulting product will perform as intended in the user’s environment using multiple techniques as appropriate.

The acquirer performs requirements validation early in the acquisition effort to gain confidence that the requirements are capable of guiding a development that results in successful final validation. This activity should be integrated with risk management activities. Mature organizations will typically perform requirements validation in a more sophisticated way using multiple techniques and will broaden the basis of the validation to include other stakeholder needs and expectations. These organizations will typically perform analyses, simulations, or prototypes to ensure that requirements will satisfy stakeholder needs and expectations.

Typical Acquirer Work Products

  1. Records of analysis methods and results

Typical Supplier Deliverables

  1. Requirements and validation methods (e.g., prototypes and simulations)

Subpractices

  1. Analyze the requirements to determine the risk that the resulting product will not perform appropriately in its intended-use environment.

  2. Explore the adequacy and completeness of requirements by developing product representations (e.g., prototypes, simulations, models, scenarios, and storyboards) and by obtaining feedback about them from relevant stakeholders.

    Refer to the Acquisition Validation process area for information about preparing for and performing validation on products and product components.

  3. Assess the product and product components as they are developed by the supplier in the context of the validation environment to identify issues and expose unstated needs and customer requirements.

Acquisition Technical Solution

The purpose of Acquisition Technical Solution (ATS) is to develop design constraints and to verify the technical solution of the supplier. The acquirer provides design constraints to the supplier. The product or service is designed and implemented by the supplier consistent with the acquirer’s design constraints. The Acquisition Technical Solution process area focuses on the following:

  • Developing design constraints for the supplier’s technical solution that potentially satisfy an appropriate set of allocated requirements

  • Verifying detailed designs for the selected solutions (detailed in the context of containing all the information needed to manufacture, code, or otherwise implement the design as a product or service)

  • Analyzing and verifying the development and implementation of the supplier’s technical solution to ensure contractual requirements are met

Typically, these activities interactively support each other. Some level of design, at times fairly detailed, may be needed for the acquirer to select solutions. Prototypes created by the supplier may be used as a means for the acquirer to gain sufficient knowledge to develop more comprehensive design constraints.

Related Process Areas

  • Refer to the Acquisition Requirements Development process area for more information about requirements allocations, establishing an operational concept, and interface requirements definition.

  • Refer to the Acquisition Verification process area for more information about conducting reviews and verifying that the product and product components meet requirements.

Specific Practices by Goal

Develop Technical Constraints

Note

Constraints for the technical solution are developed and satisfied by the supplier’s design.

Establish a Definition of Design Constraints

Note

Determine the design constraints for a technical solution.

Design constraints express the qualities and performance points that are critical to the success of the product in the acquirer’s operational environment. Design constraints may include standards and design rules governing development of products and their interfaces. The criteria for interfaces are often associated with safety, security, durability, and mission-critical characteristics.

To achieve high levels of reuse and interoperability, acquirers typically establish common design constraints for products or product families that can be deployed in one or more domains. Common design constraints (also reference architectures or product line architectures) provide a proven bundling of products, applications, and configurations. They provide a base for creating technical solutions that use design constraints more reliably and cost effectively.

Design criteria can be a part of the organizational process assets.

Typical Acquirer Work Products

  1. Design constraints including criteria for design and product reuse

  2. Guidelines for choosing COTS products

  3. Alternative solution screening criteria

  4. Selection criteria for final selection

Subpractices

  1. Define interface criteria between the supplier’s product and the acquirer’s operational environment.

  2. Develop criteria for the reuse of products and other existing assets like design elements, code components, etc.

    Analyze implications for maintenance when using off-the-shelf or non-developmental items (e.g., COTS, government off the shelf, and reuse).

  3. Establish and maintain criteria against which the supplier’s design and product can be evaluated.

    An acquirer typically specifies in the supplier agreement how the supplier has to document the design.

  4. Identify screening criteria to select a set of alternative solutions for consideration.

  5. Develop the criteria for selecting the best alternative solution.

    Criteria should be included that address design issues for the life of the product, such as provisions for more easily inserting new technologies or the ability to better exploit commercial products. Examples include criteria related to open design or open architecture concepts for the alternatives being evaluated.

  6. Document the design constraints.

Verify Design with Comprehensive Methods

Note

Verify design to ensure the resulting product will perform as intended in the acquirer’s environment.

The acquirer performs design verification (or technical review or architectural evaluation) throughout the project life cycle to gain confidence that the requirements are capable of guiding a development that results in a satisfactory technical solution. This activity should be integrated with risk management activities. Mature organizations will typically perform design verification in a more sophisticated way using multiple techniques and will broaden the basis of the verification to include other stakeholder needs and expectations.

Typical Acquirer Work Products

  1. Record of analysis methods and results

Typical Supplier Deliverables

  1. Alternative solutions

  2. Product architecture

  3. Product-component designs

  4. Technical data package

  5. Interface design specifications

  6. Interface control documents

  7. Interface specification criteria

  8. Criteria for design and product-component reuse

  9. Make-or-buy analyses

  10. Documented solutions, evaluations, and rationale

  11. Updated Requirements Traceability Matrix

Subpractices

  1. Evaluate each alternative solution or set of solutions presented by suppliers against the selection criteria.

  2. Based on the evaluation of alternatives, assess the adequacy of the selection criteria and update the criteria as necessary.

  3. Select the best set of alternative solutions that satisfy the established criteria.

  4. Ensure that the selected design adheres to applicable design standards and criteria.

  5. Ensure that the design adheres to allocated requirements.

    For example, putting required COTS products into the product architecture might modify the requirements and the requirements allocation.

  6. Analyze the supplier’s design to determine the risk that the resulting product will not perform appropriately in its intended-use environment.

  7. Explore the adequacy and completeness of the supplier’s design by reviewing product representations (e.g., prototypes, simulations, models, scenarios, and storyboards) and by obtaining feedback about them from relevant stakeholders.

    Refer to the Acquisition Verification process area for information about preparing for and performing verification on supplier deliverables.

  8. Assess the design as it matures in the context of the requirements to identify issues and expose unstated needs and customer requirements.

Analyze and Verify Technical Solution

Note

Analyze and verify the development and implementation of the technical solution by supplier.

The supplier implements the design verified by acquirer under the Verify Design with Comprehensive Methods practice. The implementation by supplier includes development of product components, integration of the components, unit and integration testing of the product, and development of end-user documentation.

The acquirer verifies the implementation to ensure that allocated requirements have been met by the implementation and that the product is ready to be brought into the acquirer environment for further integration and user acceptance testing.

Verify Technical Solution

Note

Verify the technical solution implementation by supplier to ensure contractual requirements continue to be met.

The acquirer examines a product to determine whether it is ready for production and whether the supplier has accomplished adequate production planning. The verification also examines risk; it determines whether production or production preparations incur unacceptable risks that might breach objectives of schedule, performance, cost, or other established criteria. The acquirer evaluates the full, production-configured product to determine whether it correctly and completely implements all contractual requirements. The acquirer also determines whether the traceability of final contractual requirements to the final production-configured product is maintained.

A successful verification of the technical solution is predicated on the acquirer’s determination that the requirements are fully met in the final production configuration, and that production capability forms a satisfactory basis for proceeding into pilots or full-rate production.

The acquirer convenes verifications of the technical solution with suppliers and subcontractors, as applicable. Verifications are conducted in an iterative fashion, concurrently with other technical reviews, such as design reviews.

Typical Acquirer Work Products

  1. Record of verification methods and results

Typical Supplier Deliverables

  1. Product components

  2. System documentation

  3. Supplier unit and integration test plans

  4. Unit and integration test results

  5. Updated Requirements Traceability Matrix

Subpractices

  1. Ensure that the implementation adheres to applicable standards and criteria.

  2. Ensure that the implementation adheres to allocated requirements.

  3. Verify that the implementation has been sufficiently tested by the supplier.

  4. Verify that the issues identified during testing have been resolved appropriately, with product revisions, if necessary.

  5. Ensure that sufficient end-user documentation has been developed and is in alignment with the tested implementation.

Analyze Interface Descriptions for Completeness

Note

Analyze the product interface descriptions to ensure they are complete and in alignment with the intended environment.

Typical Acquirer Work Products

  1. Record of analysis methods and results

Typical Supplier Deliverables

  1. Interface description documents

Subpractices

  1. Ensure that the interface description adheres to applicable standards, criteria, and required interface requirements between the supplier’s product and acquirer’s intended environment.

  2. Ensure that the interface description adheres to allocated requirements.

  3. Verify that the interfaces have been sufficiently tested by the supplier.

  4. Verify that the issues identified during testing have been resolved appropriately, with product revisions, if necessary.

Acquisition Validation

The purpose of Acquisition Validation (AVAL) is to demonstrate that an acquired product or service fulfills its intended use when placed in its intended environment. Validation demonstrates that the acquired product or service, as provided, will fulfill its intended use. In other words, validation ensures that the acquired product or service meets the stakeholders’ intentions and customer requirements.

Validation activities are performed early and incrementally throughout the project life cycle. They can be applied to all aspects of the product in any of its intended environments, such as operation, training, manufacturing, maintenance, and support services. The methods employed to accomplish validation can be applied to acquirer work products (such as customer requirements) and supplier deliverables (for example, prototypes developed by the supplier) as well as to the acquired product and service. The acquirer work products and supplier deliverables should be selected on the basis of which are the best predictors of how well the acquired product or service will satisfy stakeholder intentions.

Whenever possible, validation should be accomplished using the product operating in its intended environment. The entire environment can be used or only part of it. The validation environment therefore needs to represent the intended environment for the product or service as well as represent the intended environment suitable for validation activities with acquirer work products or supplier deliverables.

When validation issues are identified, they are referred to the processes associated with the Acquisition Requirements Development or Project Monitoring and Control process areas for resolution.

The specific practices of this process area build on each other in the following way:

  • The Select Products for Validation specific practice enables the identification of the product or product component to be validated and the methods to be used to perform the validation.

  • The Establish the Validation Environment specific practice enables the determination of the environment that will be used to carry out the validation.

  • The Establish Validation Procedures and Criteria specific practice enables the development of validation procedures and criteria that are aligned with the characteristics of selected products, customer constraints on validation, methods, and the validation environment.

  • The Perform Validation specific practice enables the performance of validation according to the established methods, procedures, and criteria.

Related Process Areas

  • Refer to the Acquisition Requirements Development process area for more information about requirements validation.

Specific Practices by Goal

Prepare for Validation

Note

Preparation for validation is conducted.

Preparation activities include selecting products and product components for validation and establishing and maintaining the validation environment, procedures, and criteria. The items selected for validation may include only the acquired product or may include appropriate levels of the product components that are used by the supplier to build the product. Any product or product component may be subject to validation, including replacement, maintenance, and training products, to name a few.

The environment required to validate the product or product component is prepared. The environment may be purchased or may be specified, designed, and built. The environments used for verification may be considered in collaboration with the validation environment to reduce cost and improve efficiency or productivity.

Select Products for Validation

Note

Select products or services to be validated and the validation methods that will be used for each.

Products or services are selected for validation on the basis of their relationship to stakeholder intentions and customer requirements. For each product or service, the scope of the validation (e.g., operational behavior, maintenance, training, and user interface) should be determined.

Validation methods should be selected early in the life of the project so that they are clearly understood and agreed to by the relevant stakeholders.

The validation methods address the development, maintenance, support, and training for the product or product component as appropriate.

Typical expectations built into the supplier agreement include the following:

  • List of acquired products that need validation by the acquirer before formal acceptance

  • List of products that must be validated with customer, users, or other stakeholders by the supplier, and applicable validation standards, procedures, methods, tools and criteria, if any.

  • Measurements to be collected and provided by the supplier with regard to validation activities

Typical Acquirer Work Products

  1. Lists of products or services selected for validation

  2. Validation methods for each product or service

  3. Requirements for performing validation for each product or service

  4. Validation constraints for each product or service

Subpractices

  1. Identify the key principles, features, and phases for product or service validation throughout the life of the project.

  2. Determine which customer requirements are to be validated.

    The product or product component must be maintainable and supportable in its intended environment. This specific practice also addresses the actual maintenance, training, and support services that may be delivered along with the product.

  3. Select the product or service to be validated.

  4. Select the evaluation methods for product or service validation.

  5. Review the validation selection, constraints, and methods with relevant stakeholders.

Establish the Validation Environment

Note

Establish and maintain the environment needed to support validation.

The requirements for the validation environment are driven by the product or service selected, by the type of the work products (e.g., design, prototype, final version), and by the methods of validation. These may yield requirements for the purchase or development of equipment, software, or other resources. The validation environment may include the reuse of existing resources. In this case, arrangements for the use of these resources must be made. Examples of the type of elements in a validation environment include the following:

  • Test tools interfaced with the product being validated (e.g., scopes, electronic devices, probes)

  • Temporary embedded test software

  • Recording tools for dump or further analysis and replay

  • Simulated subsystems or components (by software, electronics, or mechanics)

  • Simulated interfaced systems (e.g., a dummy warship for testing a naval radar)

  • Real interfaced systems (e.g., aircraft for testing a radar with trajectory tracking facilities)

  • Facilities and customer-supplied products

  • The skilled people to operate or use all the preceding elements

  • Dedicated computing or network test environment (e.g., pseudo-operational telecommunications-network testbed or facility with actual trunks, switches, and systems established for realistic integration and validation trials)

Early selection of the products or service to be validated, the work products to be used in the validation, and the validation methods ensure that the validation environment will be available when necessary.

The validation environment should be carefully controlled to provide for replication, analysis of results, and revalidation of problem areas.

Typical Acquirer Work Products

  1. Validation environment

Typical Supplier Deliverable

  1. Validation environment

Subpractices

  1. Identify validation environment requirements.

  2. Identify customer-supplied products.

  3. Identify reuse items.

  4. Identify validation equipment and tools.

  5. Identify validation resources that are available for reuse and modification.

  6. Plan the availability of resources in detail.

Establish Validation Procedures and Criteria

Note

Establish and maintain procedures and criteria for validation.

Validation procedures and criteria are defined to ensure that the product or product component will fulfill its intended use when placed in its intended environment. The validation procedures and criteria include validation of maintenance, training, and support services.

They also address validation of requirements and the acquired product or service throughout the project life cycle. Typically, formal user acceptance testing procedures and criteria are established to ensure that the delivered product or service meets stakeholder intentions before it is deployed in the intended environment.

The validation procedures and criteria applicable to the supplier are typically referenced in the solicitation package and supplier agreement.

Typical Acquirer Work Products

  1. Validation procedures

  2. Validation criteria

  3. Test and evaluation procedures for maintenance, training, and support

Subpractices

  1. Review the customer requirements to ensure that issues affecting validation of the acquired product or service are identified and resolved.

  2. Document the environment, operational scenario, procedures, inputs, outputs, and criteria for the validation of the acquired product or service.

  3. Assess the product or service as it matures in the context of the validation environment to identify validation issues.

Validate Products or Services

Note

The products or services are validated to ensure that they are suitable for use in their intended environment.

The validation methods, procedures, and criteria are used to validate the selected products and product components and any associated maintenance, training, and support services using the appropriate validation environment. Validation activities are performed throughout the project life cycle.

Perform Validation

Note

Perform validation on the selected products or services.

To be acceptable to stakeholders, a product or service must perform as expected in its intended environment.

Validation activities are performed and the resulting data are collected according to the established methods, procedures, and criteria.

The as-run validation procedures should be documented, and the deviations occurring during the execution should be noted, as appropriate.

Typical Acquirer Work Products

  1. Validation reports

  2. Validation results

  3. Validation cross-reference matrix

  4. As-run procedures log

  5. Operational demonstrations

Analyze Validation Results

Note

Analyze the results of the validation activities.

The data resulting from validation tests, inspections, demonstrations, or evaluations are analyzed against the defined validation criteria. Analysis reports indicate whether the stakeholders’ intentions were met; in the case of deficiencies, these reports document the degree of success or failure and categorize the probable cause of failure. The collected test, inspection, or review results are compared with established acceptance criteria to determine whether to proceed or to address requirements or design issues in the requirements development or technical solution processes.

Analysis reports or as-run validation documentation may also indicate that bad test results are due to a validation procedure problem or a validation environment problem.

Typical Acquirer Work Products

  1. Validation deficiency reports

  2. Validation issues

  3. Procedure change request

Subpractices

  1. Compare actual results to expected results.

  2. Based on the established validation criteria, identify products and product components that do not perform suitably in their intended operating environments, or identify problems with the methods, criteria, and/or environment.

  3. Analyze the validation data for defects.

  4. Record the results of the analysis, and identify issues.

  5. Use validation results to compare actual measurements and performance to intended use or operational need.

  6. Identify, document, and track action items to closure for any work products that do not pass their validation procedures and criteria.

Acquisition Verification

The purpose of Acquisition Verification (AVER) is to ensure that selected work products meet their contractual requirements. Acquisition verification addresses whether the acquired product, intermediate acquirer work products, and supplier deliverables properly reflect the contractual requirements.

The Acquisition Verification process area involves the following: verification preparation, verification performance, and identification of corrective action.

Verification is inherently an incremental process because it occurs throughout the acquisition of the product or service, beginning with verification of the requirements and plans, progressing through the verification of the evolving work products such as design and test results, and culminating in the verification of the completed product.

The specific practices of this process area build on each other in the following way:

  • The Select Work Products for Verification specific practice enables the identification of the work products to be verified, the methods to be used to perform the verification, and the documented requirements to be satisfied by each selected work product.

  • The Establish the Verification Environment specific practice enables the determination of the environment that will be used to carry out the verification.

  • The Establish Verification Procedures and Criteria specific practice then enables the development of verification procedures and criteria that are aligned with the selected work products, requirements, methods, and characteristics of the verification environment.

  • The Perform Verification specific practice conducts the verification according to the available methods, procedures, and criteria.

Peer reviews are an important method for verification of work products and are a proven mechanism for effective defect removal. An important corollary is to develop a better understanding of the work products and the processes that produced them so that defects can be prevented and process improvement opportunities can be identified.

Peer reviews involve a methodical examination of work products by the producers’ peers to identify defects and other changes that are needed.

Related Process Areas

  • Refer to the Acquisition Validation process area for more information about confirming that a product or product component fulfills its intended use when placed in its intended environment.

  • Refer to the Acquisition Requirements Development process area for more information about the generation and development of customer and contractual requirements.

Specific Practices by Goal

Prepare for Verification

Note

Preparation for verification is conducted.

Up-front preparation is necessary to ensure that verification provisions are embedded in the contractual requirements, constraints, plans, and schedules. Verification includes selection, inspection, testing, analysis, and demonstration of acquirer work products and supplier deliverables.

Methods of verification include, but are not limited to, inspections, peer reviews, audits, walkthroughs, analyses, simulations, testing, and demonstrations.

Preparation also entails the definition of support tools, test equipment and software, simulations, prototypes, and facilities.

Select Work Products for Verification

Note

Select the work products to be verified and the verification methods that will be used for each.

Acquirer work products are selected based on their contribution to meeting project objectives and requirements, and to addressing project risks.

The acquirer selects supplier deliverables for which the supplier must provide verification records. The required methods and criteria for these work products are described in the supplier agreement.

Verification can be performed by the project, as contrasted to Product and Process Quality Assurance, which is performed by an individual or group independent of the project.

Typical acquirer verification activities include review of the solicitation package, supplier agreements and plans, requirements documents, and design constraints developed by the acquirer.

Selection of the verification methods typically begins with involvement in the definition of contractual requirements to ensure that these requirements are verifiable. Re-verification should be addressed by the verification methods to ensure that rework performed on work products does not cause unintended defects. Suppliers should be involved in this selection to ensure that the project’s methods are appropriate for the supplier’s environment.

Typical Acquirer Work Products

  1. Lists of work products selected for verification

  2. Verification methods for each selected work product

Typical Supplier Deliverables

  1. List of supplier deliverables

Subpractices

  1. Identify acquirer work products for verification.

  2. Identify the requirements to be satisfied by each selected work product.

  3. Identify the verification methods that are available for use.

  4. Define the verification methods to be used for each selected work product.

  5. Include verification activities and methods to be used in the project plan.

    Refer to the Project Planning process area for information about coordinating with project planning.

  6. Establish in the supplier agreement expectations of supplier for verification of supplier deliverables.

Establish the Verification Environment

Note

Establish and maintain the environment needed to support verification.

An environment must be established to enable verification to take place. The type of environment required will depend on the work products selected for verification and the verification methods used. A peer review may require little more than a package of materials, reviewers, and a room. A product test may require simulators, emulators, scenario generators, data reduction tools, environmental controls, and interfaces with other systems.

The verification environment may be acquired, developed, reused, modified, or a combination of these, depending on the needs of the project.

Typical Acquirer Work Products

  1. Verification environment

Subpractices

  1. Identify verification environment requirements.

  2. Identify verification resources that are available for reuse and modification.

  3. Identify verification equipment and tools.

  4. Acquire verification support equipment and an environment, such as test equipment and software.

Establish Verification Procedures and Criteria

Note

Establish and maintain verification procedures and criteria for the selected work products.

Verification criteria are defined to ensure that the work products meet their requirements.

The verification procedures and criteria are typically included in the solicitation package and supplier agreement.

Typical Acquirer Work Products

  1. Verification procedures

  2. Verification criteria

Subpractices

  1. Generate the set of comprehensive, integrated verification procedures for work products and any commercial off-the-shelf products, as necessary.

  2. Develop and refine the verification criteria when necessary.

  3. Identify the expected results, any tolerances allowed in observation, and other criteria for satisfying the requirements.

  4. Identify any equipment and environmental components needed to support verification.

  5. Establish in the supplier agreement the verification methods such as acceptance criteria for supplier deliverables and other work products.

  6. Analyze operational concepts and scenarios to refine the customer needs, constraints, and interfaces and to discover new requirements.

    These criteria may be defined by the acquirer for critical supplier work products only, as identified under the Select Work Products for Verification practice.

    The peer review is an important and effective engineering method implemented via inspections, structured walkthroughs, or a number of other collegial review methods.

Verify Selected Work Products

Note

Selected work products are verified against their contractual requirements.

The verification methods, procedures, and criteria are used to verify the selected work products and any associated maintenance, training, and support services using the appropriate verification environment. Verification activities should be performed throughout the project life cycle.

Perform Verification

Note

Perform verification on the selected work products.

Verifying acquired products and work products incrementally promotes early detection of problems and can result in the early removal of defects. The results of verification save considerable cost of fault isolation and rework associated with troubleshooting problems.

Typical Acquirer Work Products

  1. Verification results

  2. Verification reports

  3. Demonstrations

  4. As-run procedures log

Typical Supplier Deliverables

  1. Verification results

  2. Verification reports

Subpractices

  1. Perform verification of selected work products against their requirements.

  2. Record the results of verification activities.

  3. Identify action items resulting from verification of work products.

  4. Document the “as-run” verification method and the deviations from the available methods and procedures discovered during its performance.

  5. Review critical verification results and data for verifications conducted by the supplier.

Analyze Verification Results

Note

Analyze the results of all verification activities.

Actual results must be compared to established verification criteria to determine acceptability.

The results of the analysis are recorded as evidence that verification was conducted.

For each work product, all available verification results are incrementally analyzed and corrective actions are initiated to ensure that the documented requirements have been met for both acquirer and supplier. Corrective actions are typically integrated into project monitoring activities. Because a peer review is one of several verification methods, peer review data should be included in this analysis activity to ensure that the verification results are analyzed sufficiently. Analysis reports or “as-run” method documentation may also indicate that bad verification results are due to method problems, criteria problems, or a verification environment problem.

Typical Acquirer Work Products

  1. Analysis report (e.g., statistics on performances, causal analysis of nonconformances, comparison of the behavior between the real product and models, and trends)

  2. Trouble reports

  3. Change requests for the verification methods, criteria, and environment

Subpractices

  1. Compare actual results to expected results.

  2. Based on the established verification criteria, identify products that have not met their requirements or identify problems in the methods, procedures, criteria, and verification environment.

  3. Analyze the verification data on defects.

  4. Record all results of the analysis in a report.

  5. Use verification results to compare actual measurements and performance to technical performance parameters.

  6. Provide information on how defects can be resolved (including verification methods, criteria, and verification environment), and formalize it in a plan.

..................Content has been hidden....................

You can't read the all page of ebook, please click here login for view all page.
Reset
3.133.128.145