Weakly supervised learning of actions from transcripts.

•A HMM based system for weakly supervised action segmentation is proposed.•Only a sequence of occurring actions is needed, no framewise annotation required.•CNN features can easily be included in the framework.•Our model shows state-of-the-art performance on various datasets.