What Is Technology Readiness?
A technology readiness assessment , as the GAO guide notes, “is a systematic, evidence-based process that evaluates the maturity of technologies (hardware, software, and processes) critical to the performance of a larger system or the fulfillment of the key objectives of an acquisition program, including cost and schedule.”
TRAs are used to test the technical maturity of a technology, and while they do not eliminate technology risk, when done well “they can illuminate concerns and serve as the basis for realistic discussions on how to address potential risks” as technologies move from research and development to deployment. TRAs also “help legislators, government officials, and the public hold government programs accountable for achieving technology performance goals,” the GAO says.
While the R in TRA stands for readiness, Persons says a TRA is essentially a risk assessment process for truly new or novel technologies that are being used in new ways for the first time.
“It’s important that you manage the risk of that particular insertion of that technology or the development of it for the success of these big capital programs,” Persons says.
TRAs can help agencies “parse the ampersand” between R&D, Persons says, noting that the difference between researching a technology and developing it to work in the field is quite different.
“Just because I am successful at the lab level doesn’t mean I can say my technology can be field tested and ruggedized and it will work in the same way,” he says.
An essential part of a TRA is recognizing the true critical technology elements an agency needs for a specific program. “What needs to be identified, how much development and testing and evaluation do I need to do before I go live and risk missions and lives?” Persons asks. “In most cases, these are very high-consequence systems where, if it’s not there, it would be game over for the U.S.”
Oversight bodies, such as those with department or agency acquisition officials or government auditors, can use the GAO guide to “evaluate whether the fundamental processes and best practices of effective TRAs have been followed and whether a TRA demonstrates the characteristics (credibility, objectivity, reliability, and usefulness) of a high-quality assessment,” the guide states.
Brian Bothwell, an assistant director at GAO who worked on the guide, says that when the GAO looks at an agency’s TRA process, it wants to see if it met all of those characteristics. “If it doesn’t rise to a certain level for all of them, we have a finding that is not high-quality,” he says.
What Are Technology Readiness Levels?
Technology Readiness Levels, or TRLs, are “the most common measure for systematically communicating the readiness of new technologies or new applications of existing technologies (sometimes referred to as heritage technologies) to be incorporated into a system or program,” the guide notes.
TRLs are a collection of characteristics that describe increasing levels of technical maturity based on demonstrated, or tested, capabilities. “The performance of a technology is compared to levels of maturity (numbered 1-9) based on demonstrations of increasing fidelity and complexity,” the GAO notes.
In general, TRLs are measured on a scale of 1 to 9, in which TRL 1 generally indicates that there are paper or research studies of the basic concept of a technology, moving to laboratory demonstrations around TRL 4, and ending at TRL 9, when an actual system has been proved through successful mission operations.