Part I — Foundations of Technology Evaluation

Chapter 2. The Evolution of Technology Assessment

2.1 Introduction

Technology assessment did not emerge as a single methodology.

It developed progressively as governments, researchers, organizations and societies recognized that technological development can generate consequences extending beyond technical performance.

Early approaches concentrated heavily on technological forecasting and impact analysis. Later approaches incorporated economic, environmental, ethical, social and political considerations. Still later approaches increasingly emphasized participation, interaction with innovators and continuous anticipation.

Smits, van Merkerk and Kuhlmann (1998) demonstrate the breadth of the field by distinguishing among forecasting, impact assessment, policy studies, constructive technology assessment and participatory approaches.

Contemporary technology assessment continues to evolve because technologies are developing more rapidly and because decision-makers increasingly need evidence before technologies reach widespread deployment.

2.2 Origins of Technology Assessment

Technology assessment developed institutionally in the twentieth century, particularly in response to concerns that scientific and technological developments could generate unintended consequences.

A major historical example was the United States Office of Technology Assessment (OTA), established by the U.S. Congress in 1972.

The OTA provided Congress with interdisciplinary assessments concerning the implications of science and technology.

Its work reflected a fundamental principle:

Technological decisions should be informed by systematic analysis of consequences.

Although the OTA was later closed, technology-assessment institutions and practices continued internationally.

2.3 Traditional Technology Assessment

Traditional technology assessment often involved:

identifying a technology;

forecasting possible developments;

identifying potential impacts;

analyzing consequences;

communicating findings to decision-makers.

This approach was particularly valuable for public policy.

However, it could become overly linear.

Technology was sometimes treated as an external object whose effects could be predicted independently of social interaction.

The increasing complexity of innovation demonstrated the limitations of this assumption.

2.4 Forecasting

Technology forecasting seeks to anticipate future technological developments.

Methods include:

trend extrapolation;

expert judgment;

patent analysis;

bibliometric analysis;

Delphi studies;

scenario development;

technology roadmapping;

horizon scanning.

Forecasting can help organizations anticipate emerging opportunities.

However, forecasts are not predictions of certainty.

They are structured representations of possible or probable developments based on available information.

The distinction is critical.

A forecast may identify a possible future without establishing that the future will occur.

2.5 Delphi Method

The Delphi method is a structured approach for obtaining and refining expert judgments through multiple rounds.

Typically:

experts respond independently;

responses are aggregated;

participants receive summarized results;

participants reconsider their judgments;

the process continues until sufficient convergence or insight is achieved.

Delphi can be useful when empirical evidence is limited.

However, Delphi results depend on:

expert selection;

question design;

panel diversity;

interpretation;

response rates;

aggregation methods.

It should therefore not be treated as an objective prediction mechanism.

2.6 Impact Assessment

Impact assessment focuses on potential consequences.

Depending on the technology, assessment may examine:

economic effects;

employment;

environment;

public health;

social behaviour;

security;

ethics;

infrastructure.

Impact assessment therefore expands the question from:

“Can this technology work?”

to:

“What might happen if this technology is implemented?”

2.7 Constructive Technology Assessment

Constructive Technology Assessment (CTA) represents an important development in the field.

Rather than assessing a technology only after major decisions have been made, CTA seeks to influence technological development itself.

The approach recognizes that technology is shaped through interaction among developers, users, regulators, investors and other stakeholders.

Smits et al. (1998) describe constructive approaches as more process-oriented and concerned with influencing the development of technologies rather than merely assessing consequences after development.

This introduces an important principle:

Evaluation can be formative.

Assessment does not necessarily have to occur after technology design.

It can occur during development.

2.8 Participatory Technology Assessment

Participatory approaches involve stakeholders in technology evaluation.

Stakeholders may include:

citizens;

employees;

consumers;

patients;

educators;

researchers;

businesses;

government officials;

professional associations;

civil-society organizations.

Participation can reveal perspectives that technical experts may overlook.

For example, an engineer designing an automated healthcare system may focus on accuracy and reliability.

Patients may raise concerns about:

privacy;

accessibility;

communication;

dignity;

trust;

informed consent.

Participation can therefore broaden the evidence base.

2.9 Real-Time Technology Assessment

Contemporary technological development increasingly requires continuous evaluation.

The OECD notes that the speed of technological emergence creates pressure for anticipatory and real-time technology assessment rather than assessment conducted only after technologies are mature.

Real-time assessment recognizes that technological development can change rapidly.

A technology may move from laboratory experimentation to commercial deployment within a short period.

Consequently, evaluation must be capable of updating evidence continuously.

2.10 Responsible Innovation

Responsible innovation extends technology assessment by emphasizing anticipation, reflection, inclusion and responsiveness.

The concept asks not only:

“What can we develop?”

but also:

“What should we develop?”

“Who should participate in deciding?”

“What consequences should be anticipated?”

“How can development remain responsive to societal values?”

Responsible innovation is therefore closely related to ethical technology assessment.

2.11 Ethical Technology Assessment

Ethical technology assessment examines the moral dimensions of technology.

Potential questions include:

Does the technology respect autonomy?

Does it protect dignity?

Does it distribute benefits fairly?

Does it increase surveillance?

Does it create discrimination?

Does it threaten privacy?

Who is responsible for harmful outcomes?

Ethical assessment should not be treated as a single moral checklist.

Different technologies generate different ethical questions.

An autonomous weapon system, an educational AI system and a renewable-energy technology will have very different ethical profiles.

2.12 Anticipatory Governance

Anticipatory governance refers broadly to institutional approaches designed to anticipate technological developments and guide them responsibly.

It may involve:

horizon scanning;

foresight;

stakeholder dialogue;

ethical assessment;

regulation;

experimentation;

monitoring.

The important principle is that governance should not begin only after widespread deployment.

Early engagement can create opportunities to influence design.

2.13 From Prediction to Preparedness

A major conceptual shift in contemporary technology assessment is movement from prediction toward preparedness.

Prediction asks:

“What will happen?”

Preparedness asks:

“What might happen, and how can we prepare for multiple possibilities?”

The second question is often more useful for emerging technologies.

Suppose three future scenarios are possible:

Scenario A: technology develops rapidly and becomes inexpensive.

Scenario B: technology develops slowly and remains expensive.

Scenario C: technological development encounters a major safety or regulatory obstacle.

A robust organization does not need to know which scenario will definitely occur.

It needs to understand what actions would be appropriate under each scenario.

2.14 Technology Assessment as a Toolkit

Smits et al. (1998) emphasize that technology assessment involves multiple methods rather than one universal technique. These methods can range from trend extrapolation and Delphi studies to stakeholder interventions and consensus-oriented processes.

This supports a central proposition of this book:

There is no single best technology-evaluation method.

The method should be selected according to:

technology;

evaluation purpose;

decision stage;

evidence availability;

stakeholder environment;

uncertainty;

resources;

consequences of error.

2.15 Table: Evolution of Technology Assessment

Table 2.1 — Evolution of Technology Assessment

2.16 Case Study: AI Governance

Artificial intelligence demonstrates why technology assessment has evolved.

An AI system may change:

during model development;

after deployment;

through new data;

through software updates;

through user adaptation;

through integration with other systems.

Therefore, a one-time assessment may become obsolete.

An effective evaluation system may require:

Initial assessment → pilot → monitoring → audit → stakeholder feedback → reassessment → modification.

This represents a transition from static evaluation to adaptive evaluation.

2.17 Chapter Research Questions

How has technology assessment evolved from forecasting toward continuous and participatory approaches?

What are the strengths and limitations of traditional technology assessment?

How does constructive technology assessment differ from traditional impact assessment?

What role should stakeholders play in technology assessment?

Why is real-time technology assessment increasingly important?

2.18 Chapter Summary

Technology assessment has developed from relatively traditional forecasting and impact-assessment approaches into a broader field incorporating participation, constructive intervention, ethics, responsible innovation and real-time monitoring.

The central lesson is that technology assessment is not one method.

It is a methodological field.

The appropriate approach depends on the technology, context, evidence, stakeholders and decision being considered.

Chapter 3 examines why technology evaluation is inherently difficult.

2.19 Discussion Questions

Why can technology forecasting never provide complete certainty?

When should stakeholder participation be included?

What are the advantages of constructive technology assessment?

How can technology assessment influence innovation without unnecessarily restricting it?

What is the difference between prediction and preparedness?