Part III — Practical Technology Evaluation Project
Students or professional evaluators may select an emerging technology and undertake a complete AMTEF evaluation.
The project should include:
Section 1: Technology Description
Describe the technology and its intended application.
Section 2: Problem Analysis
Identify the problem the technology is intended to address.
Section 3: Stakeholder Analysis
Identify all relevant stakeholders.
Section 4: Technical Evaluation
Assess performance, reliability, scalability, interoperability and security.
Section 5: Economic Evaluation
Assess cost, value, opportunity cost and financial risk.
Section 6: Organizational Evaluation
Assess institutional readiness.
Section 7: Human and Social Evaluation
Assess usability, inclusion, employment and social consequences.
Section 8: Ethical Evaluation
Assess privacy, fairness, transparency and accountability.
Section 9: Environmental Evaluation
Assess lifecycle environmental consequences.
Section 10: Risk Evaluation
Identify threats, vulnerabilities and consequences.
Section 11: Governance Evaluation
Assess regulatory requirements and accountability.
Section 12: Integrated Analysis
Identify trade-offs and unresolved uncertainties.
Section 13: Recommendations
The evaluator should identify:
conditions for adoption;
safeguards;
additional evidence required;
monitoring requirements;
reassessment conditions.
The final recommendation should be evidence-based rather than technology-driven.
CONCLUDING SYNTHESIS OF PART III
Part III has demonstrated that emerging technologies cannot be adequately evaluated through technical performance alone.
Risk and security are essential because technology creates vulnerabilities as well as opportunities.
Artificial intelligence requires evaluation of data, models, fairness, explainability, privacy, security, human oversight and governance.
Digital technologies require evaluation of interconnected systems, data governance, interoperability, resilience and dependency.
Biotechnology and healthcare technologies require particularly rigorous attention to safety, evidence, consent, privacy, equity, human dignity and long-term consequences.
Across all four domains, the central lesson is that technology evaluation is a multidimensional and lifecycle-based activity.
The AMTEF provides a common architecture for bringing these dimensions together.
Its ten dimensions are:
Technical performance
Functional effectiveness
Economic value
Organizational readiness
Human impact
Social consequences
Ethical responsibility
Environmental sustainability
Risk and security
Governance and regulation
These dimensions should not be treated as independent boxes.
They interact.
A technical decision can create an ethical consequence.
An economic decision can create a social consequence.
A design decision can create a cybersecurity vulnerability.
A data decision can create a privacy risk.
An organizational decision can determine whether a technically successful technology produces real benefits.
An environmental decision can affect long-term economic sustainability.
The evaluator must therefore move from a narrow technology-centred question:
Does the technology work?
to a broader decision framework:
Does the technology create sufficient value, under acceptable conditions, with manageable risks, adequate evidence, appropriate governance and responsible consequences for people, organizations, society and the environment?
This is the central purpose of AMTEF.
The framework does not claim that every technology can be reduced to a single numerical score. Indeed, attempting to reduce complex technological decisions to a single score can conceal important ethical, social and governance differences.
Instead, AMTEF seeks to improve the quality of judgement by making the dimensions, evidence, uncertainties and trade-offs visible.
This is particularly important in an era characterized by rapid technological development.
The evaluator must therefore become neither a technological optimist nor a technological pessimist.
The appropriate role is that of a critical, evidence-informed evaluator who asks:
What problem is being solved?
What evidence demonstrates effectiveness?
What could go wrong?
Who benefits?
Who bears the risks?
What assumptions are being made?
What remains unknown?
What safeguards are required?
Who is accountable?
How will outcomes be monitored?
When should the technology be reconsidered?
Such questions provide the intellectual foundation for responsible technology adoption.
Part III therefore prepares the reader for Part IV, which moves from technology-specific evaluation toward organizational readiness, evaluation methods, education and higher education, and the practical institutional implementation of technology evaluation.