CS/ECE 374: Stuff You Already Know

This page lists several basic mathematical concepts, data types, data structures, and algorithms that are typically covered in CS 173 and CS 225, with pointers to the corresponding Wikipedia entries. We assume you are already familiar with all of them. You can use any of these in your homework or exam solutions without providing further details or citing any source.

For detailed review of any of these topics, we strongly recommend using an actual textbook or one of the following online resources. (Beware that Wikipedia occasionally makes some very strange choices.)

• Building Blocks for Theoretical Computer Science by Margaret Fleck, written specifically for CS 173.
• Mathematics for Computer Science by Eric Lehman, Tom Leighton, and Albert Meyer, written for the Mathematics for Computer Science course at MIT.
• Open Data Structures by Pat Morin, an open-content textbook (like open source, but for words) that really ought to be the standard reference for CS 225.

Discrete Mathematics

• Elementary algebra
• Logarithm identities
• Naive set theory
• Binary relations, including functions, equivalence relations, and partial orders
• Modular arithmetic
• Asymptotic notation (o, O, Θ, Ω, ω); comparing asymptotic growth rates
• Evaluating simple summations (at least asymptotically)
• Propositional logic (T, F, ¬, ∧, ∨, ⇒, ⇔) and first-order predicate logic (∀, ∃)
• Basic proof techniques: direct, indirect, exhaustive case analysis, contradiction
• Induction (or equivalently, proof by minimal counterexample), especially strong induction and structural induction
  • Jeff's notes on induction
  • Chandra's notes on induction
• Recurrences
  • Solving simple divide-and-conquer recurrences via recursion trees (or at least the Master Theorem)
  • Jeff's notes on solving recurrences
• Graphs (both undirected and directed), trees, directed acyclic graphs

Abstract data types

• scalars (booleans, characters, integers, reals, etc.)
• records
• pointers / references
• strings
• arrays / vectors (indexed sequences)
• stacks (LIFO lists)
• queues (FIFO lists)
• deques (double-ended queues)
• priority queues
• dictionaries
• graphs (directed and undirected)

Elementary data structures

• binary numbers, including 2's complement representation of negative integers
• arrays
• linked lists (singly and doubly linked, linear and circular)
• hash tables
• binary trees: worst-case depth is O(n)
• binary heaps
• binary search trees
• balanced search trees: worst-case depth is O(log n)
  • At least one of the following: B-trees (such as 2-3-trees or (a,b)-trees), AVL trees, red-black trees, skip lists
• adjacency matrices
• adjacency lists
• The difference between this list and the previous list

Elementary algorithms

• elementary arithmetic á la Al-Kwarizmi
• sequential search
• binary search
• comparison-based sorting:
  • insertion sort, selection sort, (standard) quicksort: worst-case time is O(n²)
  • mergesort, heapsort: worst-case time is O(n log n)
• radix sort
• binary tree traversal: pre-order, post-order, in-order, level-order
• depth-first search (at least for rooted trees)
• breadth-first search (at least for rooted trees)
• topological sorting