Resource allocation in congested queueing systems with time-varying demand: An application to airport operations

•A dynamic resource allocation problem is formulated as a Markov Decision Process.•Approximation methods for nonstationary queues during busy periods are developed.•Approximate dynamic programming methods for resource allocation are proposed.•Proposed heuristic methods perform well in comparison to simpler alternatives.