Foundations of Artificial Intelligence and Machine Learning
Free to read online. For a copy of this book, or to quote, highlight or reproduce any part of it, please request permission through the contact page beforehand.
Editorial and publication note
This is a proposed educational series. IEEE-style technical writing and citations do not imply IEEE endorsement, publication, accreditation, certification, or affiliation. Any standard, designation, author credential, publication detail, or institutional relationship must be verified before publication. These Word files are expanded educational drafts and chapter-development manuscripts for editorial review; they are not represented as final peer-reviewed or publication-ready books.
The proposed series title is descriptive only. Do not use IEEE logos or imply IEEE affiliation without authorisation. Any references to standards should be checked in the official IEEE Standards Association catalogue and used only within their stated scope.
About this book
Establishes AI concepts, search and reasoning, probability, machine-learning paradigms, neural networks, evaluation, and responsible model development.
Who should use this book
This volume is designed for senior secondary, undergraduate, and beginner professionals. Instructors should adapt pacing, depth, tools, and examples to learner needs and local curriculum requirements.
Learning outcomes
- Explain the main concepts and vocabulary introduced throughout the volume.
- Apply a structured method to a relevant practical problem.
- Interpret evidence, identify limitations, and communicate results clearly.
- Consider privacy, fairness, safety, security, and human oversight where relevant.
How to use this book
Read the chapter explanation, complete the activity, answer the review questions, and keep a learning journal recording assumptions, decisions, mistakes, and improvements. For technical work, save code, data dictionaries, test results, and software-version details.
Table of contents
- Chapter 1: Defining Artificial Intelligence
- Chapter 2: The Historical Development of Intelligent Systems
- Chapter 3: Agents, Environments, and Rational Action
- Chapter 4: Search, Planning, and Problem-Solving
- Chapter 5: Knowledge Representation and Logical Reasoning
- Chapter 6: Probability and Decision Theory
- Chapter 7: Machine Learning Fundamentals
- Chapter 8: Supervised Learning: Regression and Classification
- Chapter 9: Unsupervised Learning: Clustering and Dimensionality Reduction
- Chapter 10: Reinforcement Learning Fundamentals
- Chapter 11: Artificial Neural Networks
- Chapter 12: Training, Validation, and Model Testing
- Chapter 13: Evaluation Metrics and Model Limitations
- Chapter 14: Explainability, Fairness, and Reliability
- Chapter 15: Building an AI Application
Chapter 1: Defining Artificial Intelligence
Learning outcomes
By the end of this chapter, the learner should be able to:
- Explain the central concepts introduced in defining artificial intelligence.
- Apply the ideas to a clearly defined example or practical task.
- Identify at least one limitation, assumption, or responsible-use consideration.
Core explanation
AI is a broad discipline concerned with systems that perform tasks associated with perception, language, reasoning, planning, learning, or action. Explain task-specific capabilities and avoid treating all AI systems as equivalent.
Worked example and application
Worked example: define a real-world task, list the inputs and constraints, sketch the steps or system components, and test the proposed solution with at least one ordinary case and one edge case. Record the outcome and what you would improve.
Practical activity
Classify five applications by the task performed and state what evidence would show they work.
Chapter review
- What is the main idea in 'Defining Artificial Intelligence'?
- Which assumptions or data requirements matter most in this topic?
- What could cause the approach to fail or produce a misleading result?
- How would you explain the result or limitation to a non-specialist?
Key takeaways
- Start with a clear question, objective, or system requirement.
- Document inputs, assumptions, methods, and limitations.
- Test the approach with relevant examples and review the consequences of errors.
Chapter 2: The Historical Development of Intelligent Systems
Learning outcomes
By the end of this chapter, the learner should be able to:
- Explain the central concepts introduced in the historical development of intelligent systems.
- Apply the ideas to a clearly defined example or practical task.
- Identify at least one limitation, assumption, or responsible-use consideration.
Core explanation
AI has developed through symbolic reasoning, search, statistical learning, neural networks, and large-scale generative systems. Progress reflects algorithms, data, computing resources, and application needs; it is not a simple linear replacement of one method by another.
Worked example and application
Worked example: define a real-world task, list the inputs and constraints, sketch the steps or system components, and test the proposed solution with at least one ordinary case and one edge case. Record the outcome and what you would improve.
Practical activity
Create a timeline of major approaches and identify one enduring challenge for each.
Chapter review
- What is the main idea in 'The Historical Development of Intelligent Systems'?
- Which assumptions or data requirements matter most in this topic?
- What could cause the approach to fail or produce a misleading result?
- How would you explain the result or limitation to a non-specialist?
Key takeaways
- Start with a clear question, objective, or system requirement.
- Document inputs, assumptions, methods, and limitations.
- Test the approach with relevant examples and review the consequences of errors.
Chapter 3: Agents, Environments, and Rational Action
Learning outcomes
By the end of this chapter, the learner should be able to:
- Explain the central concepts introduced in agents, environments, and rational action.
- Apply the ideas to a clearly defined example or practical task.
- Identify at least one limitation, assumption, or responsible-use consideration.
Core explanation
An agent receives information from an environment and chooses actions according to a design or policy. Rationality depends on goals, available information, constraints, and costs, not omniscience. Real environments may be partially observable or change over time.
Worked example and application
Worked example: define a real-world task, list the inputs and constraints, sketch the steps or system components, and test the proposed solution with at least one ordinary case and one edge case. Record the outcome and what you would improve.
Practical activity
Model a thermostat or route planner as an agent: specify observations, actions, goals, and constraints.
Chapter review
- What is the main idea in 'Agents, Environments, and Rational Action'?
- Which assumptions or data requirements matter most in this topic?
- What could cause the approach to fail or produce a misleading result?
- How would you explain the result or limitation to a non-specialist?
Key takeaways
- Start with a clear question, objective, or system requirement.
- Document inputs, assumptions, methods, and limitations.
- Test the approach with relevant examples and review the consequences of errors.
Chapter 4: Search, Planning, and Problem-Solving
Learning outcomes
By the end of this chapter, the learner should be able to:
- Explain the central concepts introduced in search, planning, and problem-solving.
- Apply the ideas to a clearly defined example or practical task.
- Identify at least one limitation, assumption, or responsible-use consideration.
Core explanation
Search explores possible states or actions. Breadth-first, depth-first, and heuristic approaches have different memory, completeness, and optimality properties. Planning must represent goals, actions, and constraints accurately.
Worked example and application
Worked example: define a real-world task, list the inputs and constraints, sketch the steps or system components, and test the proposed solution with at least one ordinary case and one edge case. Record the outcome and what you would improve.
Practical activity
Solve a small route or puzzle problem and compare two search strategies.
Chapter review
- What is the main idea in 'Search, Planning, and Problem-Solving'?
- Which assumptions or data requirements matter most in this topic?
- What could cause the approach to fail or produce a misleading result?
- How would you explain the result or limitation to a non-specialist?
Key takeaways
- Start with a clear question, objective, or system requirement.
- Document inputs, assumptions, methods, and limitations.
- Test the approach with relevant examples and review the consequences of errors.
Chapter 5: Knowledge Representation and Logical Reasoning
Learning outcomes
By the end of this chapter, the learner should be able to:
- Explain the central concepts introduced in knowledge representation and logical reasoning.
- Apply the ideas to a clearly defined example or practical task.
- Identify at least one limitation, assumption, or responsible-use consideration.
Core explanation
Rules, graphs, logic, and ontologies represent relationships and facts. Inference derives conclusions from represented knowledge, but missing or incorrect premises can produce wrong conclusions. Conflicting rules need explicit treatment.
Worked example and application
Worked example: define a real-world task, list the inputs and constraints, sketch the steps or system components, and test the proposed solution with at least one ordinary case and one edge case. Record the outcome and what you would improve.
Practical activity
Represent a small policy as logical rules and test ordinary and contradictory cases.
Chapter review
- What is the main idea in 'Knowledge Representation and Logical Reasoning'?
- Which assumptions or data requirements matter most in this topic?
- What could cause the approach to fail or produce a misleading result?
- How would you explain the result or limitation to a non-specialist?
Key takeaways
- Start with a clear question, objective, or system requirement.
- Document inputs, assumptions, methods, and limitations.
- Test the approach with relevant examples and review the consequences of errors.
Chapter 6: Probability and Decision Theory
Learning outcomes
By the end of this chapter, the learner should be able to:
- Explain the central concepts introduced in probability and decision theory.
- Apply the ideas to a clearly defined example or practical task.
- Identify at least one limitation, assumption, or responsible-use consideration.
Core explanation
Probability represents uncertainty; expected utility combines outcomes and their values under uncertainty. Decisions depend on both likelihood and consequence, and estimates may be poorly calibrated.
Worked example and application
Worked example: define a real-world task, list the inputs and constraints, sketch the steps or system components, and test the proposed solution with at least one ordinary case and one edge case. Record the outcome and what you would improve.
Practical activity
Compare two fictional decisions using probabilities, consequences, and a transparent decision table.
Chapter review
- What is the main idea in 'Probability and Decision Theory'?
- Which assumptions or data requirements matter most in this topic?
- What could cause the approach to fail or produce a misleading result?
- How would you explain the result or limitation to a non-specialist?
Key takeaways
- Start with a clear question, objective, or system requirement.
- Document inputs, assumptions, methods, and limitations.
- Test the approach with relevant examples and review the consequences of errors.
Chapter 7: Machine Learning Fundamentals
Learning outcomes
By the end of this chapter, the learner should be able to:
- Explain the central concepts introduced in machine learning fundamentals.
- Apply the ideas to a clearly defined example or practical task.
- Identify at least one limitation, assumption, or responsible-use consideration.
Core explanation
Machine learning estimates patterns from data to support prediction or structure discovery. Distinguish training, validation, and test data; identify labels, features, and the target task. Data leakage can make evaluation misleading.
Worked example and application
Worked example: imagine a small team considering this concept for a clearly scoped, low-risk task. First define the intended outcome and inputs; then choose a simple baseline, document assumptions, test representative examples, inspect errors, and explain when the method should not be used. Compare the result with a human-reviewed alternative before proposing deployment.
Practical activity
Design a data split for a fictional prediction problem and identify possible leakage.
Chapter review
- What is the main idea in 'Machine Learning Fundamentals'?
- Which assumptions or data requirements matter most in this topic?
- What could cause the approach to fail or produce a misleading result?
- How would you explain the result or limitation to a non-specialist?
Key takeaways
- Start with a clear question, objective, or system requirement.
- Document inputs, assumptions, methods, and limitations.
- Test the approach with relevant examples and review the consequences of errors.
Chapter 8: Supervised Learning: Regression and Classification
Learning outcomes
By the end of this chapter, the learner should be able to:
- Explain the central concepts introduced in supervised learning: regression and classification.
- Apply the ideas to a clearly defined example or practical task.
- Identify at least one limitation, assumption, or responsible-use consideration.
Core explanation
Regression predicts numerical outcomes; classification predicts categories. Linear models, trees, and other methods make different assumptions and trade-offs. Baselines provide a reference for judging whether a more complex model adds value.
Worked example and application
Worked example: define a real-world task, list the inputs and constraints, sketch the steps or system components, and test the proposed solution with at least one ordinary case and one edge case. Record the outcome and what you would improve.
Practical activity
Compare a simple baseline and a candidate model using a suitable held-out metric.
Chapter review
- What is the main idea in 'Supervised Learning: Regression and Classification'?
- Which assumptions or data requirements matter most in this topic?
- What could cause the approach to fail or produce a misleading result?
- How would you explain the result or limitation to a non-specialist?
Key takeaways
- Start with a clear question, objective, or system requirement.
- Document inputs, assumptions, methods, and limitations.
- Test the approach with relevant examples and review the consequences of errors.
Chapter 9: Unsupervised Learning: Clustering and Dimensionality Reduction
Learning outcomes
By the end of this chapter, the learner should be able to:
- Explain the central concepts introduced in unsupervised learning: clustering and dimensionality reduction.
- Apply the ideas to a clearly defined example or practical task.
- Identify at least one limitation, assumption, or responsible-use consideration.
Core explanation
Unsupervised methods identify structure without a known target label. Clusters depend on features, scaling, distance definitions, and chosen parameters; they are not automatically meaningful real-world groups.
Worked example and application
Worked example: define a real-world task, list the inputs and constraints, sketch the steps or system components, and test the proposed solution with at least one ordinary case and one edge case. Record the outcome and what you would improve.
Practical activity
Cluster a small fictional dataset and explain how scaling and feature choice could change results.
Chapter review
- What is the main idea in 'Unsupervised Learning: Clustering and Dimensionality Reduction'?
- Which assumptions or data requirements matter most in this topic?
- What could cause the approach to fail or produce a misleading result?
- How would you explain the result or limitation to a non-specialist?
Key takeaways
- Start with a clear question, objective, or system requirement.
- Document inputs, assumptions, methods, and limitations.
- Test the approach with relevant examples and review the consequences of errors.
Chapter 10: Reinforcement Learning Fundamentals
Learning outcomes
By the end of this chapter, the learner should be able to:
- Explain the central concepts introduced in reinforcement learning fundamentals.
- Apply the ideas to a clearly defined example or practical task.
- Identify at least one limitation, assumption, or responsible-use consideration.
Core explanation
Reinforcement learning studies agents that learn policies through interaction and reward signals. Exploration, delayed reward, unsafe experimentation, and reward misspecification are central challenges.
Worked example and application
Worked example: define a real-world task, list the inputs and constraints, sketch the steps or system components, and test the proposed solution with at least one ordinary case and one edge case. Record the outcome and what you would improve.
Practical activity
Use a simple grid-world simulation on paper to discuss reward design and unintended behaviour.
Chapter review
- What is the main idea in 'Reinforcement Learning Fundamentals'?
- Which assumptions or data requirements matter most in this topic?
- What could cause the approach to fail or produce a misleading result?
- How would you explain the result or limitation to a non-specialist?
Key takeaways
- Start with a clear question, objective, or system requirement.
- Document inputs, assumptions, methods, and limitations.
- Test the approach with relevant examples and review the consequences of errors.
Chapter 11: Artificial Neural Networks
Learning outcomes
By the end of this chapter, the learner should be able to:
- Explain the central concepts introduced in artificial neural networks.
- Apply the ideas to a clearly defined example or practical task.
- Identify at least one limitation, assumption, or responsible-use consideration.
Core explanation
Neural networks combine parameterised layers and nonlinear functions to learn representations. Training adjusts parameters to reduce a loss function, while architecture and data quality influence generalisation.
Worked example and application
Worked example: define a real-world task, list the inputs and constraints, sketch the steps or system components, and test the proposed solution with at least one ordinary case and one edge case. Record the outcome and what you would improve.
Practical activity
Sketch a small network and explain inputs, weights, activation, output, and loss.
Chapter review
- What is the main idea in 'Artificial Neural Networks'?
- Which assumptions or data requirements matter most in this topic?
- What could cause the approach to fail or produce a misleading result?
- How would you explain the result or limitation to a non-specialist?
Key takeaways
- Start with a clear question, objective, or system requirement.
- Document inputs, assumptions, methods, and limitations.
- Test the approach with relevant examples and review the consequences of errors.
Chapter 12: Training, Validation, and Model Testing
Learning outcomes
By the end of this chapter, the learner should be able to:
- Explain the central concepts introduced in training, validation, and model testing.
- Apply the ideas to a clearly defined example or practical task.
- Identify at least one limitation, assumption, or responsible-use consideration.
Core explanation
Training fits model parameters; validation supports model selection; testing estimates performance on data not used in those choices. Repeated tuning on the test set undermines its independence.
Worked example and application
Worked example: imagine a small team considering this concept for a clearly scoped, low-risk task. First define the intended outcome and inputs; then choose a simple baseline, document assumptions, test representative examples, inspect errors, and explain when the method should not be used. Compare the result with a human-reviewed alternative before proposing deployment.
Practical activity
Draw a data-splitting workflow and identify where hyperparameter tuning belongs.
Chapter review
- What is the main idea in 'Training, Validation, and Model Testing'?
- Which assumptions or data requirements matter most in this topic?
- What could cause the approach to fail or produce a misleading result?
- How would you explain the result or limitation to a non-specialist?
Key takeaways
- Start with a clear question, objective, or system requirement.
- Document inputs, assumptions, methods, and limitations.
- Test the approach with relevant examples and review the consequences of errors.
Chapter 13: Evaluation Metrics and Model Limitations
Learning outcomes
By the end of this chapter, the learner should be able to:
- Explain the central concepts introduced in evaluation metrics and model limitations.
- Apply the ideas to a clearly defined example or practical task.
- Identify at least one limitation, assumption, or responsible-use consideration.
Core explanation
Accuracy, precision, recall, F1, ROC-AUC, calibration, and task-specific costs answer different questions. Metrics must match the use case and class balance. A model can perform well on average while failing important subgroups.
Worked example and application
Worked example: imagine a small team considering this concept for a clearly scoped, low-risk task. First define the intended outcome and inputs; then choose a simple baseline, document assumptions, test representative examples, inspect errors, and explain when the method should not be used. Compare the result with a human-reviewed alternative before proposing deployment.
Practical activity
Choose metrics for a rare-event classifier and justify the trade-offs.
Chapter review
- What is the main idea in 'Evaluation Metrics and Model Limitations'?
- Which assumptions or data requirements matter most in this topic?
- What could cause the approach to fail or produce a misleading result?
- How would you explain the result or limitation to a non-specialist?
Key takeaways
- Start with a clear question, objective, or system requirement.
- Document inputs, assumptions, methods, and limitations.
- Test the approach with relevant examples and review the consequences of errors.
Chapter 14: Explainability, Fairness, and Reliability
Learning outcomes
By the end of this chapter, the learner should be able to:
- Explain the central concepts introduced in explainability, fairness, and reliability.
- Apply the ideas to a clearly defined example or practical task.
- Identify at least one limitation, assumption, or responsible-use consideration.
Core explanation
Explanations can help users inspect model behaviour but do not prove correctness. Fairness assessments require context, stakeholder input, and explicit criteria. Robustness and monitoring matter after deployment.
Worked example and application
Worked example: define a real-world task, list the inputs and constraints, sketch the steps or system components, and test the proposed solution with at least one ordinary case and one edge case. Record the outcome and what you would improve.
Practical activity
Prepare a model card outline covering intended use, data, performance, risks, and limitations.
Chapter review
- What is the main idea in 'Explainability, Fairness, and Reliability'?
- Which assumptions or data requirements matter most in this topic?
- What could cause the approach to fail or produce a misleading result?
- How would you explain the result or limitation to a non-specialist?
Key takeaways
- Start with a clear question, objective, or system requirement.
- Document inputs, assumptions, methods, and limitations.
- Test the approach with relevant examples and review the consequences of errors.
Chapter 15: Building an AI Application
Learning outcomes
By the end of this chapter, the learner should be able to:
- Explain the central concepts introduced in building an ai application.
- Apply the ideas to a clearly defined example or practical task.
- Identify at least one limitation, assumption, or responsible-use consideration.
Core explanation
A responsible AI application links a user need to data, a baseline, model selection, evaluation, deployment constraints, and monitoring. Include human review where consequences warrant it.
Worked example and application
Worked example: imagine a small team considering this concept for a clearly scoped, low-risk task. First define the intended outcome and inputs; then choose a simple baseline, document assumptions, test representative examples, inspect errors, and explain when the method should not be used. Compare the result with a human-reviewed alternative before proposing deployment.
Practical activity
Build a small prototype using an appropriate public dataset and present evidence for its intended use.
Chapter review
- What is the main idea in 'Building an AI Application'?
- Which assumptions or data requirements matter most in this topic?
- What could cause the approach to fail or produce a misleading result?
- How would you explain the result or limitation to a non-specialist?
Key takeaways
- Start with a clear question, objective, or system requirement.
- Document inputs, assumptions, methods, and limitations.
- Test the approach with relevant examples and review the consequences of errors.
Capstone project
Compare multiple models for an appropriate prediction task and justify the final model using evidence. Include problem framing, data provenance, baseline, split strategy, metrics, error analysis, limitations, and a responsible-use statement.
Suggested project deliverables
- A short problem statement and intended audience.
- A description of data, inputs, assumptions, tools, and method.
- Evidence of testing, analysis, or evaluation appropriate to the project.
- A clear explanation of results, limitations, and foreseeable risks.
- A final report or presentation and a reflection on possible improvements.
Assessment guidance
Assess conceptual accuracy, sound experimental design, correct metrics, baseline comparison, interpretation of errors, and responsible deployment planning.
Glossary
Agent: A system that observes an environment and selects actions.
Feature: An input variable used by a model.
Label: The target value or category supplied in supervised learning.
Overfitting: When a model fits training data too closely and generalises poorly.
Data leakage: Information improperly available during training that would not be available at real use or evaluation.
Responsible practice checklist
- Use data and materials only when their source and permitted use are understood.
- Avoid exposing personal, confidential, or credential information.
- Document assumptions, missing information, and important limitations.
- Test ordinary cases, boundary cases, and foreseeable failure conditions.
- Use human review where errors could materially affect people, safety, rights, or resources.
- Do not claim that a system is fair, safe, secure, compliant, or reliable without appropriate evidence.
References and further reading
The source material supplied for this project does not provide a complete, volume-specific bibliography. Before publication, add verified primary sources, textbooks, official documentation, and standards applicable to this volume. Confirm exact titles, editions, publication dates, URLs, licences, and access dates. Do not cite a standard as evidence of conformity unless the required assessment has actually been performed.
[1] C. M. Bishop, Pattern Recognition and Machine Learning. New York, NY, USA: Springer, 2006.
[2] I. Goodfellow, Y. Bengio, and A. Courville, Deep Learning. Cambridge, MA, USA: MIT Press, 2016.
[3] National Institute of Standards and Technology, Artificial Intelligence Risk Management Framework (AI RMF 1.0), NIST AI 100-1, Jan. 2023.
[4] IEEE, “IEEE Author Center.” [Online]. Available: https://journals.ieeeauthorcenter.ieee.org/
[5] IEEE Standards Association, “IEEE Standards.” [Online]. Available: https://standards.ieee.org/