Back Matter

Conclusion: The Adams Multidimensional Technology Evaluation Framework and its Implications

1. Introduction

Technology is one of the principal forces shaping contemporary economic, organizational, educational, social, environmental, and human development. New technologies are emerging at a pace that challenges conventional approaches to planning, assessment, governance, and decision-making. Artificial intelligence, generative AI, autonomous systems, biotechnology, digital platforms, renewable energy, advanced manufacturing, connected infrastructures, quantum technologies, and other emerging technologies are changing not only what organizations can do, but also how societies understand work, knowledge, communication, education, healthcare, production, governance, and human interaction.

Yet technological capability does not automatically create technological value.

A technology may be technically impressive but economically unsustainable. It may be economically attractive but socially disruptive. It may be efficient but environmentally damaging. It may be innovative but difficult for an organization to implement. It may be accurate but insufficiently transparent. It may be useful but create significant privacy or cybersecurity risks. It may produce substantial benefits while distributing those benefits unevenly across society.

The central argument of this book has therefore been that emerging and new technologies require multidimensional evaluation.

Traditional approaches often emphasize technical feasibility, economic return, or technological maturity. These dimensions remain important, but they are insufficient by themselves. Technology assessment has progressively developed from early forecasting and impact assessment toward approaches that consider social, economic, environmental, ethical, and governance consequences (Banta, 2009; Smits et al., 1998; OECD, 2023).

This book extends that tradition through the Adams Multidimensional Technology Evaluation Framework (AMTEF).

AMTEF proposes that technology evaluation should systematically consider ten interconnected dimensions:

technical performance;

functional effectiveness;

economic value;

organizational readiness;

human impact;

social consequences;

ethical responsibility;

environmental sustainability;

risk and security; and

governance and regulation.

The framework does not assume that these dimensions can always be reduced to a single numerical score. Instead, it recognizes that technology decisions frequently involve trade-offs, uncertainty, non-compensatory risks, conflicting stakeholder interests, and context-dependent consequences.

The purpose of this conclusion is to synthesize the major arguments of the book and explain the implications of AMTEF for research, organizations, universities, governments, technology developers, professionals, and society.

2. From Technology Assessment to Technology Evaluation

The history of technology assessment demonstrates that societies have long attempted to understand the consequences of technological change. Traditional technology assessment focused substantially on anticipating impacts and informing public policy, while later approaches increasingly emphasized participation, interaction, responsibility, and governance (Smits et al., 1998).

Contemporary technology evaluation must go further.

The speed of technological development means that assessment cannot always remain separate from development and implementation. Emerging technologies may change during the evaluation process itself. Software is updated, AI models are retrained, user behaviour changes, regulations evolve, competitors introduce alternative systems, and new risks become visible.

OECD (2023) identifies the increasing need for technology assessment to provide strategic intelligence under conditions of technological uncertainty. This reinforces the argument developed throughout this book that technology evaluation should be understood as an ongoing process rather than a one-time approval exercise.

The transition can therefore be expressed as:

Technology Assessment → Technology Evaluation → Technology Governance → Continuous Technology Learning

Technology assessment asks what consequences may emerge.

Technology evaluation asks whether the technology provides sufficient value and evidence for a particular purpose and context.

Technology governance establishes how the technology should be controlled.

Continuous learning recognizes that evaluation must be updated as evidence and circumstances change.

3. The Central Contribution: AMTEF

The principal conceptual contribution of this book is the Adams Multidimensional Technology Evaluation Framework.

AMTEF was developed in response to a fundamental problem: no single technological, economic, organizational, ethical, environmental, or social measure is sufficient to determine whether an emerging technology should be adopted.

The framework therefore integrates ten dimensions.

Table C.1

Adams Multidimensional Technology Evaluation Framework

These dimensions should be viewed as interconnected rather than isolated.

For example, technical performance can affect economic value. Organizational readiness can affect functional effectiveness. Human factors can affect adoption. Governance can affect risk. Environmental sustainability can affect long-term economic value.

Consequently, AMTEF is fundamentally systemic.

4. The First Principle: Technology Must Be Evaluated in Context

One of the most important conclusions of this book is that there is no universally optimal technology independent of context.

A technology that performs effectively in one organization may perform poorly in another. A technology that is affordable in one country may be prohibitively expensive in another. A digital service that is accessible to urban populations may be inaccessible to rural communities. An AI system developed for one linguistic or cultural context may perform differently in another.

Technology evaluation must therefore include contextual analysis.

This is consistent with the broader understanding of development as a process involving human capabilities and freedoms rather than simply economic growth (Sen, 1999).

The relevant question is not simply:

“What can this technology do?”

It is:

“What can this technology realistically achieve within this particular human, organizational, economic, environmental, and institutional context?”

This principle has major implications for developing and emerging economies, where infrastructure, affordability, skills, digital connectivity, institutional capacity, and access to finance may substantially affect technological outcomes (World Bank, 2016).

5. The Second Principle: Technology Capability Is Not Technology Value

A recurring theme throughout this book is the distinction between technological capability and technological value.

A technology may possess extraordinary capabilities while providing limited practical value.

For example, an AI system may produce highly sophisticated outputs, but if users cannot interpret those outputs, if the data are poor, or if the organization lacks implementation capacity, technological capability may not translate into organizational value.

Similarly, a renewable-energy technology may demonstrate strong technical performance but face challenges related to cost, infrastructure, storage, materials, grid integration, or local conditions.

Technology evaluation should therefore distinguish:

Capability → Usability → Adoption → Outcomes → Impact

The presence of capability is only the beginning.

6. The Third Principle: Evidence Must Precede Large-Scale Adoption

A central principle emerging from AMTEF is:

Evidence before scale.

Emerging technologies frequently involve uncertainty. Evidence may be incomplete, historical data may be limited, and long-term consequences may be difficult to determine.

Technology evaluation should therefore identify:

what is known;

what is uncertain;

what assumptions are being made;

what evidence supports expected benefits;

what risks have been identified; and

what evidence remains necessary.

This principle is particularly important for technologies with significant consequences for health, education, employment, financial security, privacy, public safety, or environmental sustainability.

The stronger the potential consequences and the greater the uncertainty, the stronger the evaluation requirements should generally become.

7. The Fourth Principle: Risk Cannot Always Be Compensated by Benefit

Traditional decision models may encourage decision-makers to balance benefits against costs.

However, certain risks should not automatically be treated as variables that can simply be offset by financial or technical benefits.

For example, a technology producing substantial economic value should not automatically be considered acceptable if it creates unresolved critical safety, legal, privacy, or cybersecurity concerns.

AMTEF therefore incorporates a principle of non-compensatory critical risk.

This means that certain thresholds should be treated as conditions requiring mitigation, redesign, restriction, or further evidence rather than simply as negative values within an overall numerical score.

This approach is consistent with broader risk-management thinking, in which organizations identify, analyze, treat, monitor, and communicate risk rather than merely calculating an aggregate benefit figure (ISO, 2018).

8. The Fifth Principle: Human Beings Remain Central

Technology evaluation must ultimately consider human consequences.

Human-centred evaluation requires attention to:

dignity;

autonomy;

agency;

accessibility;

privacy;

safety;

workload;

employment;

learning;

wellbeing;

participation; and

inclusion.

The increasing use of AI makes this especially important.

UNESCO (2021) emphasizes human rights, dignity, transparency, fairness, accountability, and human oversight as important elements of responsible AI governance.

Technology should support human capabilities rather than unnecessarily reduce human agency.

This does not mean rejecting automation. Automation can improve productivity, safety, consistency, and access.

The question is whether the allocation of responsibility between humans and technology is appropriate for the task and the consequences involved.

9. The Sixth Principle: Technology Has Social Consequences

Technology is embedded within society.

Its effects may extend beyond the organization that purchases or deploys it.

A technology can influence:

employment;

education;

inequality;

social relationships;

access to services;

privacy;

public trust;

political participation;

community structures; and

patterns of economic opportunity.

Therefore, organizational technology evaluation should not be limited to internal performance.

Where technologies have substantial external consequences, social impact assessment becomes important.

The distribution of benefits and costs should also be examined.

The key questions are:

Who benefits?

Who bears the costs?

Who carries the risks?

Who controls the technology?

Who may be excluded?

10. The Seventh Principle: Sustainability Must Be Evaluated Across the Lifecycle

Environmental evaluation cannot be limited to operational energy consumption.

A technology's environmental footprint may arise during:

extraction of raw materials;

manufacturing;

transportation;

installation;

operation;

maintenance;

upgrades; and

disposal.

Life-cycle assessment provides a structured approach to examining environmental impacts across these stages (ISO, 2006a, 2006b).

Moni et al. (2020) demonstrate why lifecycle evaluation can be particularly challenging for emerging technologies, where data are limited and future functionality and scale may be uncertain.

The implication is clear:

Environmental sustainability must be considered throughout the technology lifecycle.

11. The Eighth Principle: Organizations Must Be Ready

Technology readiness and organizational readiness are not the same.

A technology can be mature while an organization remains unprepared.

Organizational readiness can involve:

leadership;

resources;

skills;

infrastructure;

processes;

culture;

change-management capability;

data governance;

cybersecurity;

stakeholder support; and

institutional policy.

Organizational readiness theory emphasizes the importance of collective commitment and perceived capability to implement change (Weiner, 2009).

Similarly, technology acceptance research demonstrates that perceived usefulness, ease of use, social influences, and facilitating conditions can influence adoption (Davis, 1989; Venkatesh et al., 2003).

Technology evaluation must therefore ask not only:

“Is the technology ready?”

but also:

“Is the organization ready?”

12. The Ninth Principle: Governance Is Part of Technology Evaluation

Governance cannot be treated as an administrative activity occurring after technology selection.

Governance should be incorporated into evaluation from the beginning.

This includes:

accountability;

regulatory compliance;

auditability;

transparency;

oversight;

incident response;

data governance;

privacy;

security;

stakeholder participation; and

review mechanisms.

The growth of AI demonstrates the importance of governance because technological systems increasingly influence decisions with significant consequences for individuals and institutions.

NIST's AI Risk Management Framework provides a structured approach to managing AI risks across governance, mapping, measurement, and management functions (National Institute of Standards and Technology, 2023).

13. The Tenth Principle: Evaluation Must Continue After Adoption

A technology does not stop changing when an organization adopts it.

Software updates.

AI models change.

Threats evolve.

Users adapt.

Regulations change.

Markets shift.

Costs change.

Environmental information improves.

New competitors emerge.

Consequently, technology evaluation should continue after implementation.

The evaluation cycle can therefore be expressed as:

Anticipate → Evaluate → Pilot → Decide → Implement → Monitor → Learn → Re-evaluate

This creates a continuous technology-learning system.

14. Implications for Organizations

AMTEF has significant implications for organizational management.

First, technology evaluation should become part of strategic planning.

Second, technology procurement should require evidence rather than relying exclusively on vendor claims.

Third, technology governance should be multidisciplinary.

Fourth, organizations should establish clear responsibility for technology decisions.

Fifth, monitoring should continue after implementation.

Sixth, organizations should establish mechanisms for technology retirement and replacement.

The implications are particularly important for large organizations because technology decisions can involve substantial financial commitments and long-term organizational dependencies.

Technology procurement should therefore move from:

Purchase → Install → Use

toward:

Define → Evaluate → Pilot → Govern → Implement → Monitor → Re-evaluate

15. Implications for Universities and Higher Education

Universities represent an especially important application of AMTEF.

Higher education institutions are simultaneously:

technology users;

research institutions;

educators;

knowledge producers;

technology evaluators;

employers; and

social institutions.

Universities increasingly use AI, learning analytics, learning-management systems, online education platforms, automated assessment tools, digital research systems, and generative AI.

AI in higher education therefore requires evaluation not only in terms of technical performance but also educational effectiveness, academic integrity, privacy, accessibility, faculty readiness, student readiness, and governance (Zawacki-Richter et al., 2019).

Generative AI has further increased the importance of institutional policies concerning assessment, authorship, research integrity, and appropriate use (UNESCO, 2023).

Universities should therefore consider establishing formal technology evaluation committees and policies.

16. Implications for Researchers

AMTEF provides several opportunities for future academic research.

Researchers can investigate:

the validity of AMTEF;

the reliability of specific evaluation instruments;

cross-cultural applications;

industry-specific applications;

technology-specific adaptations;

developing-country applications;

AI-assisted evaluation;

environmental evaluation;

organizational readiness;

stakeholder participation; and

systemic technology risk.

AMTEF can therefore become not only a managerial framework but also a research framework.

Researchers could develop empirical studies examining whether the ten dimensions predict:

successful adoption;

user satisfaction;

organizational performance;

sustainability;

technology longevity;

risk reduction; or

social outcomes.

17. Implications for Technology Developers

Technology developers should not regard evaluation as something that happens after a product is completed.

Responsible development should incorporate evaluation during design.

Developers should consider:

user requirements;

accessibility;

privacy;

cybersecurity;

explainability;

environmental impact;

maintainability;

interoperability;

safety; and

lifecycle management.

This aligns with the broader responsible-innovation perspective, which emphasizes anticipation, reflection, inclusion, and responsiveness (Stilgoe et al., 2013).

The development process should therefore become increasingly evaluation-aware.

18. Implications for Governments and Policy Makers

Governments face particularly complex technology decisions because public-sector technologies can affect large populations.

Governments may need to evaluate:

digital public services;

AI systems;

healthcare technologies;

energy systems;

transportation;

cybersecurity;

biometric systems;

education technologies;

environmental technologies; and

critical infrastructure.

Government technology evaluation should therefore incorporate public-interest considerations.

Technology assessment can provide strategic intelligence for policy under conditions of uncertainty (OECD, 2023).

Public institutions should also consider whether technology evaluation capacity exists within government.

Where internal expertise is insufficient, independent academic, scientific, technical, and civil-society expertise may be required.

19. Implications for Developing and Emerging Economies

For developing and emerging economies, AMTEF has an additional implication: technological adoption should be connected to development objectives.

Technology evaluation should examine:

affordability;

infrastructure;

local skills;

technology dependency;

digital inclusion;

local economic development;

sustainability;

climate resilience; and

capacity building.

The World Bank (2016) demonstrates that digital technologies can create substantial opportunities, but complementary factors such as skills, institutions, and regulatory environments influence whether those opportunities translate into development outcomes.

Consequently, developing countries should not evaluate technologies solely according to standards developed for technologically mature economies.

Context matters.

20. Implications for Technology Investment

Investors and organizational leaders often focus on return on investment.

AMTEF does not reject financial analysis.

Instead, it places financial analysis within a broader decision framework.

Technology investment should consider:

Financial Return + Strategic Value + Organizational Readiness + Human Impact + Social Consequences + Sustainability + Risk + Governance

This broader perspective may reduce the risk of investing heavily in technologies that appear financially attractive but are difficult to sustain or govern.

21. Implications for Technology Procurement

Technology procurement represents one of the most practical applications of AMTEF.

Procurement processes should require vendors to provide evidence concerning:

performance;

security;

privacy;

interoperability;

accessibility;

environmental impacts;

total cost;

maintenance;

data ownership;

contractual dependencies; and

exit arrangements.

Organizations should also be cautious about accepting vendor claims without independent verification.

Procurement should therefore become an evidence-based evaluation process.

22. Implications for Professional Education

The emergence of complex technologies requires a new category of professional competence.

Managers, researchers, policy makers, educators, engineers, and technology professionals need the ability to evaluate technology across disciplines.

Professional education should therefore incorporate:

technology assessment;

research methods;

data literacy;

risk management;

ethics;

sustainability;

governance;

economics;

organizational change; and

strategic technology management.

Technology evaluation should become a component of management and leadership education rather than remaining exclusively within technical disciplines.

23. Implications for Doctoral Research

The framework offers a substantial research agenda for doctoral scholars.

A doctoral researcher could examine AMTEF through:

Quantitative research

Surveying organizations and statistically testing relationships among the ten dimensions and adoption outcomes.

Qualitative research

Interviewing technology decision-makers, users, regulators, and other stakeholders.

Mixed-methods research

Combining organizational survey data with interviews, case studies, and technology-performance evidence.

Case study research

Applying AMTEF to a specific technology, sector, organization, or country.

Comparative research

Comparing technology evaluation practices across countries or industries.

Longitudinal research

Examining how technology evaluation changes from pre-adoption through implementation and post-adoption.

This makes AMTEF potentially useful as a foundation for doctoral research programmes.

24. Implications for Ethics and Human Responsibility

One of the most important implications of this book is that technological responsibility cannot be delegated entirely to technology.

An algorithm cannot assume moral responsibility.

A software platform cannot independently determine social priorities.

A technology provider cannot automatically bear every responsibility associated with downstream use.

Responsibility must be allocated among:

developers;

vendors;

managers;

users;

regulators;

institutions;

researchers; and

policy makers.

The principle of human responsibility therefore remains central even as technologies become increasingly autonomous.

25. Implications for Sustainable Development

Technology will be an important contributor to achieving sustainable development objectives, but technological development must itself be evaluated for sustainability.

The Sustainable Development Goals demonstrate the interconnected nature of poverty, health, education, energy, employment, inequality, infrastructure, climate, and environmental protection (United Nations, 2015).

Technology evaluation should therefore avoid narrow optimization.

For example, optimizing energy production without considering environmental consequences may create new problems. Optimizing educational access without considering digital inequality may leave vulnerable populations behind.

AMTEF encourages integrated thinking.

26. The Framework's Most Important Limitation

No framework can eliminate uncertainty.

AMTEF does not claim to predict the future.

It does not guarantee that a technology will succeed.

It does not remove disagreement among stakeholders.

It does not eliminate ethical dilemmas.

It does not produce certainty where evidence is unavailable.

Instead, AMTEF provides a structured method for making uncertainty visible and decisions more transparent.

This distinction is important.

The objective is not perfect prediction.

The objective is better-informed decision-making.

27. AMTEF as a Flexible Framework

AMTEF should not be interpreted as a rigid checklist.

The ten dimensions may require different levels of attention depending on:

technology;

sector;

country;

organization;

population;

risk;

maturity;

scale; and

intended purpose.

A healthcare technology may require extensive clinical and safety assessment.

An educational AI system may require extensive assessment of academic integrity and privacy.

An energy technology may require extensive environmental and lifecycle assessment.

A financial technology may require extensive cybersecurity and financial-risk assessment.

The framework is therefore designed to be adaptable while maintaining a common conceptual structure.

28. The Future Research Agenda

Several areas require further research.

28.1 Empirical Validation

AMTEF should be tested empirically across organizations and technologies.

28.2 Measurement Development

Researchers should develop reliable instruments for measuring dimensions such as social impact, ethical responsibility, organizational readiness, and responsible technology readiness.

28.3 Cross-Cultural Research

Technology evaluation should be studied across different cultural and institutional contexts.

28.4 Developing-Economy Applications

More research is required on technology evaluation under conditions of limited infrastructure and institutional capacity.

28.5 AI-Assisted Evaluation

Research should investigate how AI can support evaluation while maintaining evidence integrity and human accountability.

28.6 Longitudinal Evaluation

Technology outcomes should be studied over time rather than only at adoption.

28.7 Systemic Risk

Future research should investigate how interconnected technologies generate risks that cannot be identified by evaluating individual systems separately.

28.8 Environmental Integration

Technology evaluation should increasingly integrate lifecycle environmental evidence.

29. The Final AMTEF Architecture

The complete framework developed through this book can be summarized as follows.

Figure C.1

The Adams Multidimensional Technology Evaluation Framework

The Adams Multidimensional Technology Evaluation Framework

ADAPTATION OR RETIREMENT

The framework is therefore circular rather than linear.

30. The AMTEF Responsible Technology Principle

The entire book can ultimately be condensed into one principle:

A technology should be considered ready for responsible adoption only when sufficient evidence exists that it is technically capable, functionally effective, economically defensible, organizationally sustainable, human-centred, socially responsible, ethically acceptable, environmentally sustainable, appropriately secure, and adequately governed for its intended context.

This is the central proposition of AMTEF.

31. Final Conclusion

The evaluation of emerging technologies is becoming one of the most important interdisciplinary challenges of the twenty-first century.

Technology is developing faster than many organizations can evaluate it. The consequences of technological decisions can extend beyond the organizations that make those decisions. Technologies increasingly influence employment, education, healthcare, finance, communication, energy, environmental sustainability, research, and human relationships.

For this reason, technology evaluation can no longer be limited to technical feasibility or financial return.

A responsible evaluation must ask whether a technology works, whether it solves the intended problem, whether it creates sufficient value, whether organizations can sustain it, how it affects people, what social consequences it creates, whether it can be used ethically, what environmental effects it produces, what risks it introduces, and whether it can be governed responsibly.

This book has proposed AMTEF as one framework for bringing these dimensions together.

Its central contribution is not the claim that every technology can be reduced to a single formula. Rather, the contribution lies in establishing a structured way of thinking about technological decisions.

Technology evaluation should be:

multidimensional,

evidence-based,

context-sensitive,

human-centred,

risk-aware,

environmentally responsible,

governance-oriented,

participatory,

adaptive,

and continuous.

The ultimate purpose of technology evaluation is not to prevent technological progress.

Nor is it to accept every innovation simply because it is new.

Its purpose is to create the conditions under which innovation can be examined carefully, adopted responsibly, governed effectively, and continuously improved.

The future will undoubtedly produce technologies whose capabilities exceed many of today's expectations.

The challenge will not simply be to determine what these technologies can do.

The greater challenge will be to determine:

what they should do,

where they should be used,

under what conditions they should be used,

who should be responsible for them,

who should benefit from them,

what risks should be tolerated,

what risks should not be accepted,

and how society should respond when evidence changes.

That is why technology evaluation must become a continuing institutional capability rather than a one-time technical exercise.

The central message of this book can therefore be expressed in its simplest form:

Do not evaluate technology only by what it can do. Evaluate what it does, for whom, at what cost, under what conditions, with what consequences, with what risks, and under whose responsibility.

The Adams Multidimensional Technology Evaluation Framework provides a structured foundation for doing so.

Technology will continue to change.

Organizations will continue to change.

Societies will continue to change.

The evaluation process must therefore change as well.

The future of responsible technology depends not only upon better technologies, but upon better decisions about technologies.

And better technology decisions begin with better technology evaluation.

FINAL STATEMENT OF THE BOOK

Evaluating Emerging Technologies: A Multidimensional Framework for Value, Risk, Sustainability, Innovation and Responsible Adoption

The fundamental proposition of this book is that technological progress should be accompanied by intellectual responsibility.

Technology creates possibilities.

Evaluation creates understanding.

Governance creates accountability.

Human judgment creates responsibility.

Together, these provide the foundation for responsible technological development and adoption.