HandyPose: Multi-level framework for hand pose estimation

•We propose HandyPose, a multi-level and multi-scale, end-to-end train-able, singlestage framework for 2D hand pose estimation.•We introduce the Multi-level Waterfall Atrous Spatial Pooling module that effectively encodes feature maps with large FOV and contextual information.•HandyPose is a modular encoder-decoder architecture that incorpo-rates multilevel features in both the encoder and the decoder modules,making it easy to modify and expand.•HandyPose achieves state-of-the-art result for 2D hand pose on two popular benchmarks.