I guess you can use the trained neural network to generate (hallucinate) images, and those images will depend on the original training images, and may contain features of those images.

I suppose that even if you consider the neural network as a black box, you can generate images that bear some resemblance to the training data in some indirect way. For example by walking along a gradient of the output with respect to changes in the input.