Pre-trained CNN for one-shot learning2019 Community Moderator ElectionUsing neural networks to recognize digits in a sceneWhy not use more than 3 hidden layers for MNIST classification?Tool for designing CNN architecturesWhy Deep Reinforcement Learning fails to learn how to play Asteroids?Are Convolutional Neural Networks a one model, multiple output layers.?How to add non-image features along side images as the input of CNNscnn classifier failing on image after contour selectingCNN to learn and visualize 2d featuresConvolutional neural networks for non-image applications?How to implement a Fourier Convolution layer in keras?
Is it unprofessional to ask if a job posting on GlassDoor is real?
Why was the shrinking from 8″ made only to 5.25″ and not smaller (4″ or less)?
Facing a paradox: Earnshaw's theorem in one dimension
AES: Why is it a good practice to use only the first 16bytes of a hash for encryption?
Is it legal for company to use my work email to pretend I still work there?
Where does SFDX store details about scratch orgs?
What reasons are there for a Capitalist to oppose a 100% inheritance tax?
Twin primes whose sum is a cube
Theorems that impeded progress
Watching something be written to a file live with tail
How to draw the figure with four pentagons?
A reference to a well-known characterization of scattered compact spaces
Is "remove commented out code" correct English?
In a spin, are both wings stalled?
How can I prevent hyper evolved versions of regular creatures from wiping out their cousins?
Does a druid starting with a bow start with no arrows?
I Accidentally Deleted a Stock Terminal Theme
Anagram holiday
Why can't we play rap on piano?
Is the Joker left-handed?
Has there ever been an airliner design involving reducing generator load by installing solar panels?
How to prevent "they're falling in love" trope
Why is consensus so controversial in Britain?
Infinite Abelian subgroup of infinite non Abelian group example
Pre-trained CNN for one-shot learning
2019 Community Moderator ElectionUsing neural networks to recognize digits in a sceneWhy not use more than 3 hidden layers for MNIST classification?Tool for designing CNN architecturesWhy Deep Reinforcement Learning fails to learn how to play Asteroids?Are Convolutional Neural Networks a one model, multiple output layers.?How to add non-image features along side images as the input of CNNscnn classifier failing on image after contour selectingCNN to learn and visualize 2d featuresConvolutional neural networks for non-image applications?How to implement a Fourier Convolution layer in keras?
$begingroup$
I'm currently trying to learn one-shot learning using convolutional neural networks. According to this video, the CNN that I use should have been pre-trained on the MNIST. Why must the CNN be pre-trained??
cnn mnist
asked Aug 16 '18 at 23:49
sabrinazuraimisabrinazuraimi
1263
$endgroup$
add a comment |
$begingroup$
I'm currently trying to learn one-shot learning using convolutional neural networks. According to this video, the CNN that I use should have been pre-trained on the MNIST. Why must the CNN be pre-trained??
cnn mnist
asked Aug 16 '18 at 23:49
sabrinazuraimisabrinazuraimi
1263
$endgroup$
add a comment |
$begingroup$
I'm currently trying to learn one-shot learning using convolutional neural networks. According to this video, the CNN that I use should have been pre-trained on the MNIST. Why must the CNN be pre-trained??
cnn mnist
asked Aug 16 '18 at 23:49
sabrinazuraimisabrinazuraimi
1263
$endgroup$
I'm currently trying to learn one-shot learning using convolutional neural networks. According to this video, the CNN that I use should have been pre-trained on the MNIST. Why must the CNN be pre-trained??
cnn mnist
cnn mnist
asked Aug 16 '18 at 23:49
sabrinazuraimisabrinazuraimi
1263
asked Aug 16 '18 at 23:49
sabrinazuraimisabrinazuraimi
1263
asked Aug 16 '18 at 23:49
sabrinazuraimisabrinazuraimi
1263
asked Aug 16 '18 at 23:49
sabrinazuraimisabrinazuraimi
1263
asked Aug 16 '18 at 23:49
sabrinazuraimisabrinazuraimi
1263
1263
add a comment |
add a comment |
2 Answers
2
active
oldest
votes
$begingroup$
Because the layers in the CNNs must be already able to extract features from images.
Normally this procedure takes thousands of iterations to be completed, so if they were not trained we could't have the concept of one-shot learning.
answered Sep 19 '18 at 22:11
ILM91ILM91
935
$endgroup$
add a comment |
$begingroup$
There is nothing like pre-training on MNIST data.
You can take any advanced CNN architecture and then fine-tune the network on your dataset. For performing the one-shot learning, the need for fine-tuning or training is must as this will tune your model to understand and emphasise only on the images that the model has been trained upon.
To simplify, a network trained on faces will be able to recognise only the facial features over other objects in the images which is must for generating the embedding.
In one-shot learning, the network tries to generate embedding by forward propagation of the image data through the network. The generated embedding must only emphasis on the required part of the image and not onto the useless data in the image data. A pre-trained model in this case is chosen that is capable of selecting the features in a image that are required to be emphasised.
Let's try to understand it through the example Face Recognition system. In this case, we would require to have a model that has been trained with images of faces so that whenever we try to create a new embedding, the model must know that it has to concentrate its weights on face rather than the noise in the image. Thus when the embedding are generated, the part of the face is concentrated and thus the cosine distances between the embedding could be minimized to uniquely identify the closeness among the 2 images.
You can get a better understanding of such a network in this video by Andrew Ng.
answered Nov 19 '18 at 6:27
thanatozthanatoz
534319
$endgroup$
add a comment |
Your Answer
StackExchange.ifUsing("editor", function ()
return StackExchange.using("mathjaxEditing", function ()
StackExchange.MarkdownEditor.creationCallbacks.add(function (editor, postfix)
StackExchange.mathjaxEditing.prepareWmdForMathJax(editor, postfix, [["$", "$"], ["\\(","\\)"]]);
);
);
, "mathjax-editing");
StackExchange.ready(function()
var channelOptions =
tags: "".split(" "),
id: "557"
;
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function()
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled)
StackExchange.using("snippets", function()
createEditor();
);
else
createEditor();
);
function createEditor()
StackExchange.prepareEditor(
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: false,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: null,
bindNavPrevention: true,
postfix: "",
imageUploader:
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
,
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
);
);
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fdatascience.stackexchange.com%2fquestions%2f37061%2fpre-trained-cnn-for-one-shot-learning%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
2 Answers
2
active
oldest
votes
2 Answers
2
active
oldest
votes
active
oldest
votes
active
oldest
votes
$begingroup$
Because the layers in the CNNs must be already able to extract features from images.
Normally this procedure takes thousands of iterations to be completed, so if they were not trained we could't have the concept of one-shot learning.
answered Sep 19 '18 at 22:11
ILM91ILM91
935
$endgroup$
add a comment |
$begingroup$
Because the layers in the CNNs must be already able to extract features from images.
Normally this procedure takes thousands of iterations to be completed, so if they were not trained we could't have the concept of one-shot learning.
answered Sep 19 '18 at 22:11
ILM91ILM91
935
$endgroup$
add a comment |
$begingroup$
Because the layers in the CNNs must be already able to extract features from images.
Normally this procedure takes thousands of iterations to be completed, so if they were not trained we could't have the concept of one-shot learning.
answered Sep 19 '18 at 22:11
ILM91ILM91
935
$endgroup$
Because the layers in the CNNs must be already able to extract features from images.
Normally this procedure takes thousands of iterations to be completed, so if they were not trained we could't have the concept of one-shot learning.
answered Sep 19 '18 at 22:11
ILM91ILM91
935
answered Sep 19 '18 at 22:11
ILM91ILM91
935
answered Sep 19 '18 at 22:11
ILM91ILM91
935
answered Sep 19 '18 at 22:11
ILM91ILM91
935
935
add a comment |
add a comment |
$begingroup$
There is nothing like pre-training on MNIST data.
You can take any advanced CNN architecture and then fine-tune the network on your dataset. For performing the one-shot learning, the need for fine-tuning or training is must as this will tune your model to understand and emphasise only on the images that the model has been trained upon.
To simplify, a network trained on faces will be able to recognise only the facial features over other objects in the images which is must for generating the embedding.
In one-shot learning, the network tries to generate embedding by forward propagation of the image data through the network. The generated embedding must only emphasis on the required part of the image and not onto the useless data in the image data. A pre-trained model in this case is chosen that is capable of selecting the features in a image that are required to be emphasised.
Let's try to understand it through the example Face Recognition system. In this case, we would require to have a model that has been trained with images of faces so that whenever we try to create a new embedding, the model must know that it has to concentrate its weights on face rather than the noise in the image. Thus when the embedding are generated, the part of the face is concentrated and thus the cosine distances between the embedding could be minimized to uniquely identify the closeness among the 2 images.
You can get a better understanding of such a network in this video by Andrew Ng.
answered Nov 19 '18 at 6:27
thanatozthanatoz
534319
$endgroup$
add a comment |
$begingroup$
There is nothing like pre-training on MNIST data.
You can take any advanced CNN architecture and then fine-tune the network on your dataset. For performing the one-shot learning, the need for fine-tuning or training is must as this will tune your model to understand and emphasise only on the images that the model has been trained upon.
To simplify, a network trained on faces will be able to recognise only the facial features over other objects in the images which is must for generating the embedding.
In one-shot learning, the network tries to generate embedding by forward propagation of the image data through the network. The generated embedding must only emphasis on the required part of the image and not onto the useless data in the image data. A pre-trained model in this case is chosen that is capable of selecting the features in a image that are required to be emphasised.
Let's try to understand it through the example Face Recognition system. In this case, we would require to have a model that has been trained with images of faces so that whenever we try to create a new embedding, the model must know that it has to concentrate its weights on face rather than the noise in the image. Thus when the embedding are generated, the part of the face is concentrated and thus the cosine distances between the embedding could be minimized to uniquely identify the closeness among the 2 images.
You can get a better understanding of such a network in this video by Andrew Ng.
answered Nov 19 '18 at 6:27
thanatozthanatoz
534319
$endgroup$
add a comment |
$begingroup$
There is nothing like pre-training on MNIST data.
You can take any advanced CNN architecture and then fine-tune the network on your dataset. For performing the one-shot learning, the need for fine-tuning or training is must as this will tune your model to understand and emphasise only on the images that the model has been trained upon.
To simplify, a network trained on faces will be able to recognise only the facial features over other objects in the images which is must for generating the embedding.
In one-shot learning, the network tries to generate embedding by forward propagation of the image data through the network. The generated embedding must only emphasis on the required part of the image and not onto the useless data in the image data. A pre-trained model in this case is chosen that is capable of selecting the features in a image that are required to be emphasised.
Let's try to understand it through the example Face Recognition system. In this case, we would require to have a model that has been trained with images of faces so that whenever we try to create a new embedding, the model must know that it has to concentrate its weights on face rather than the noise in the image. Thus when the embedding are generated, the part of the face is concentrated and thus the cosine distances between the embedding could be minimized to uniquely identify the closeness among the 2 images.
You can get a better understanding of such a network in this video by Andrew Ng.
answered Nov 19 '18 at 6:27
thanatozthanatoz
534319
$endgroup$
There is nothing like pre-training on MNIST data.
You can take any advanced CNN architecture and then fine-tune the network on your dataset. For performing the one-shot learning, the need for fine-tuning or training is must as this will tune your model to understand and emphasise only on the images that the model has been trained upon.
To simplify, a network trained on faces will be able to recognise only the facial features over other objects in the images which is must for generating the embedding.
In one-shot learning, the network tries to generate embedding by forward propagation of the image data through the network. The generated embedding must only emphasis on the required part of the image and not onto the useless data in the image data. A pre-trained model in this case is chosen that is capable of selecting the features in a image that are required to be emphasised.
Let's try to understand it through the example Face Recognition system. In this case, we would require to have a model that has been trained with images of faces so that whenever we try to create a new embedding, the model must know that it has to concentrate its weights on face rather than the noise in the image. Thus when the embedding are generated, the part of the face is concentrated and thus the cosine distances between the embedding could be minimized to uniquely identify the closeness among the 2 images.
You can get a better understanding of such a network in this video by Andrew Ng.
answered Nov 19 '18 at 6:27
thanatozthanatoz
534319
edited 6 mins ago
answered Nov 19 '18 at 6:27
thanatozthanatoz
534319
answered Nov 19 '18 at 6:27
thanatozthanatoz
534319
answered Nov 19 '18 at 6:27
thanatozthanatoz
534319
534319
add a comment |
add a comment |
Thanks for contributing an answer to Data Science Stack Exchange!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
Use MathJax to format equations. MathJax reference.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fdatascience.stackexchange.com%2fquestions%2f37061%2fpre-trained-cnn-for-one-shot-learning%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
