Lecture 4C (2026-03-17): From Niches to Meta-Populations: Toward Distributed and Parallel Genetic Algorithms (DGA/PGA)

In this lecture, we close out our discussion of "niching" diversity-preservation approaches for multi-modal and multi-objective evolutionary algorithms. We had covered clearing/clustering algorithms in the past lecture (Lecture 4B), and so we start on crowding algorithms, including Restricted Tournament Selection (RTS), briefly the introduce Species Conserving Genetic Algorithm (SCGA), and then close with a discussion of islanding approaches. This sets up an introduction to distributed (and parallel) genetic algorithms, which we will start out with in the next lecture.

Whiteboard notes for this lecture can be found at:
https://www.dropbox.com/scl/fi/ngcurzxer85i4oft1qn68/IEE598-Lecture4C-2026-03-17-From_Niches_to_Meta_Populations-Distributed_and_Parallel_GA-Notes.pdf?rlkey=x8mb0bn5d56lhwtjftjx323u6&dl=0

Lecture 4B (2026-03-05): Niching Methods for Diversity Preservation in Multi-Objective and Multi-Modal Evolutionary Algorithms

In this lecture, we cover several of the different "niching methods" used for diversity preservation in both multi-objective and multi-modal evolutionary algorithms. We start with an overall goal to create "negative frequency-dependent selection" (or density dependence) that has the potential to be able to stabilize different subpopulations coexisting with each other. We start by discussing how evolutionary models like Hawk–Dove ("Chicken") have mixed Nash equilibria that can represent stable co-existence of discrete phenotypes (due to negative frequency dependence). But then we pivot to habitat selection models, with particular focus on the Ideal Free Distribution (IFD), as a better match for the diversity-preservation problem in MOEA's and MMEA's. That allows us to introduce "fitness sharing" (which matches very closely to the IFD) and various other fitness-modification methods that each have different computational costs and diversity benefits. We close by introduction selection-based approaches, such as breaking tournament-selection ties by crowding distance.

Whiteboard notes for this lecture can be found at:
https://www.dropbox.com/scl/fi/d2ucw5j4lqtlj6hzue2mk/IEE598-Lecture4B-2026-03-05-Niching_Methods_for_Diversity_Preservation_in_MOEA_and_MMO-Notes.pdf?rlkey=rvvs5xy2qmbva7xl1glsmhnja&dl=0

Lecture 3D/4A (2026-03-03): From Multi-Objective to Multi-Modal Optimization

In this lecture, we wrap up our discussion of Pareto ranking for Multi-Objective Evolutionary Algorithms (MOEA's) and then introduce the topic of diversity-preservation methods ("niching" methods) that maintain diversity across the Pareto frontier. We then pivot to introducing Multi-Modal Optimization (MMO), which also requires "niching" methods to populate the different peaks of the optimization objective. We close by starting to set up background that motivates the particular designs of niche-preserving methods.

Whiteboard notes for this lecture can be found at:
https://www.dropbox.com/scl/fi/blmmcyw7e0uf2ivjh1lkk/IEE598-Lecture3D_4A-2026-03-03-From_Multi_Objective_to_Multi_Modal_Optimization-Notes.pdf?rlkey=q95a982to30ovnv6izej1cd5y&dl=0

Lecture 3C (2026-02-26): Multi-Objective EA’s from Linearization to Pareto Ranking and Beyond

In this lecture, we review the concept of Pareto optimality (Pareto improvements, Pareto efficiency, Pareto-efficient sets of non-dominated solutions, and the Pareto frontier/front) and then start laying the foundations of building multi-objective evolutionary algorithms to find the Pareto front. This starts with introducing historical MOEA's – like WBGA-MO, RWGA, and VEGA – which are all based on a linear scalarization of multi-objective problems. We then show that these methods not only have trouble promoting diversity along the discovered samples of the Pareto frontier, but they completely miss non-convex portions of the Pareto frontier. To address these issues, we introduce Pareto ranking (from SPGA, MOGA, and NSGA) and the general concept of the community ecology of multi-objective optimization (where fitness is inversely proportional to distance to the Pareto frontier, and diversity is maintained in coexisting "niches" along the community of similar-fitness individuals). We will pick up with this idea and transition to multi-modal optimization (and the various diversity-preserving "niching" methods taht enable it) next time.

Whiteboard notes for this lecture can be found at:
https://www.dropbox.com/scl/fi/5umaoz9i6bt1w0fkeuw37/IEE598-Lecture3C-2026-02-26-Multi_Objective_EA-s_from_Linearization_to_Pareto_Ranking_and_Beyond-Notes.pdf?rlkey=2cixolbjafhd61r88055rxr3r&dl=0

Lecture 3B (2026-02-24): Multi-Objective Optimality and Introduction to Multi-Objective Evolutionary Algorithms

In this lecture, we start with a review of equilibrium and efficiency/dominance concepts from game theory – specifically the Nash equilibrium, Pareto efficiency, and payoff and risk dominance. We apply these for both a discrete game (the Stag Hunt) and a generic continuous game. That allows us to introduce Variational Inequalities as a more general numerical problem set that includes the Nash equilibrium as a member (for continuous games). We then pivot to Multi-Objective Optimization (MOO) and motivate the concept of Pareto improvements, Pareto efficiency, Pareto-efficient sets, and Pareto frontiers/fronts. We close with discussions about scalarization approaches to solve MOO problems, including linear scalarization, targets, satisficing, and Chebyshev/weighted minimax. We discuss problems with these approaches and then hint that we will move forward toward fitness concepts that do not require weighting/scalarization. We will pick up with that point in the next lecture, where we introduce several different forms of Multi-Objective Evolutionary Algorithms (and Pareto ranking).

Whiteboard notes for this lecture can be found at:
https://www.dropbox.com/scl/fi/hqfni3lxa8z09c8kzkfi9/IEE598-Lecture3B-2026-02-24-Multi_Objective_Optimality_and_Intro_to_Multi_Objectivce_Genetic_Algrithms-Notes.pdf?rlkey=si10th7dvglfj25wcv2kyoqrh&dl=0

Lecture 2D/3A (2026-02-19): From Immunocomputing to Games and Multi-Objective Optimization (MOO)

In this lecture, we start with a description of two major classes of Artificial Immune System strategies – negative selection and clonal selection – along with the biological processes in the acquired/adaptive/specific immune system in vertebrates that inspired these algorithms. We focus on how both approaches maintain useful diversity, and we frame clonal selection as a form of multi-modal optimization (which will be discussed in more detail in Unit 4). This allows us to pivot to multi-objective optimization. In the last section of the lecture, we start outlining fundamentals of thinking about systems with multiple competing objectives – focusing first on game theory and the concept of the Nash equilibrium. Next time, we will define Pareto efficiency and start to introduce classical algorithms for finding Pareto-efficient sets.

Whiteboard notes for this lecture can be found at:
https://www.dropbox.com/scl/fi/p8ly7l88ouvyc7m60lq8v/IEE598-Lecture3A-2026-02-19-Multicriteria_Decision_Making_Pareto_Optimality_and_Intro_to_Multiobjective_Evolutionary_Algorithms_MOEAs-Notes.pdf?rlkey=yhb60lgihm2mv0w1eid1nxas1&dl=0

Lecture 2C (2026-02-17): Genetic Programming and Artificial Immune Systems

In this lecture, we review the core principles of Genetic Programming, starting with Linear Genetic Programming (LGP) and transitioning to tree-based Genetic Programming (GP) that incorporates Abstract Syntax Trees (AST's) as its genotypes. We cover the different mutation operators and selection operators for these forms of GP and typical application spaces that use GP. We then close the lecture with an introduction to Immunocomputing and Artificial Immune Systems (AIS), which mimic the acquired/adaptive/specific immune system of (jawless) vertebrates. We will continue our discussion of immunocomputing/AIS in the next lecture and use it to pivot to multi-objective optimization (the subject of the next unit).

Whiteboard notes for this lecture can be found at:
https://www.dropbox.com/scl/fi/men7ns3f44783gqk20b64/IEE598-Lecture2C-2026-02-17-Genetic_Programming_and_Artificial_Immune_Systems-Notes.pdf?rlkey=yyjbn4sm6wssd8no5qvnqs8ft&dl=0