Pixel Voting Decoder: A novel decoder that regresses pixel relationships for segmentation

•The introduction of the instance segmentation and semantic segmentation tasks.•A novel encoder-decoder to regress the pixel relationships for better segmentation.•The proposed dynamic deconvolution uses the pixel relationships as weights.•The matrix implementation boosts the calculation speed and reduced the memory cost.•The proposed method outperforms the well-known methods on COCO and Cityscapes.