We identify winning tickets in a fully-connected architecture for MNIST and convolutional and residual architectures for CIFAR10, like networks with dropout, Xavier initialization, and batch normalization.