patternMinor
What is the "spatial information" in convolutional neural network
Viewed 0 times
thewhatneuralnetworkconvolutionalspatialinformation
Problem
deep learning research papers always claim that deeper layers of CNN have good "semantic information" but poor "spatial information". What is the spatial information exactly. Is that some activations in deeper layers?
Solution
I think the authors are referring to spatial invariance. I will explain it on image classification/recognition example.
Convolutional Neural Networks are designed to be spatially invariant, that is - they are not sensitive to the position of, for example, object in the picture. The deeper you go into layers, the originally not so (pixelwise) similar objects (or usually parts of objects) are becoming more similar (and this is achieved via convolution). At the deepest layers we have extracted features with no information on where they were positioned on the original image. We even lose the information on pixel-size of original objects because of another process in CNN called pooling.
Convolution is the key for why CNNs perform better than any other model in such "human-like" tasks like recognizing specific objects in the picture, words in a recorded speech,$\ldots$.
Further "reading":
$\ $ - Convolution is nicely explained and visualized in this YouTube video.
$\ $ - A more lengthy and deeper video on this subject is Convolutional Neural Networks - The Math of Intelligence
Convolutional Neural Networks are designed to be spatially invariant, that is - they are not sensitive to the position of, for example, object in the picture. The deeper you go into layers, the originally not so (pixelwise) similar objects (or usually parts of objects) are becoming more similar (and this is achieved via convolution). At the deepest layers we have extracted features with no information on where they were positioned on the original image. We even lose the information on pixel-size of original objects because of another process in CNN called pooling.
Convolution is the key for why CNNs perform better than any other model in such "human-like" tasks like recognizing specific objects in the picture, words in a recorded speech,$\ldots$.
Further "reading":
$\ $ - Convolution is nicely explained and visualized in this YouTube video.
$\ $ - A more lengthy and deeper video on this subject is Convolutional Neural Networks - The Math of Intelligence
Context
StackExchange Computer Science Q#96672, answer score: 4
Revisions (0)
No revisions yet.