using unsupervised learning algorithms on images The 2019 Stack Overflow Developer Survey Results Are InImage clustering by similarity measurement (CW-SSIM)Best approach for this unsupervised clustering problem with categorical data?Neural Network: how to utilize weakly-/unsupervised data to improve supervised network?Image Classification, Convolution Network and Gamma Correction for imagesAre there any very good APIs for matching similar images?What approach other than Tf-Idf could I use for text-clustering using K-Means?CNN not learning properlyMulti-input Convolutional Neural Network for Images ClassificationWhen using Data augmentation is it ok to validate only with the original images?How to convert a time series data which can be fed to a Machine Leanring model for unsupervised learning?
Why doesn't UInt have a toDouble()?
Why isn't the black hole white?
How come people say “Would of”?
Flight paths in orbit around Ceres?
Is an up-to-date browser secure on an out-of-date OS?
Getting crown tickets for Statue of Liberty
Falsification in Math vs Science
Loose spokes after only a few rides
Mathematics of imaging the black hole
Did the UK government pay "millions and millions of dollars" to try to snag Julian Assange?
Deal with toxic manager when you can't quit
Is it ok to offer lower paid work as a trial period before negotiating for a full-time job?
How to display lines in a file like ls displays files in a directory?
Old scifi movie from the 50s or 60s with men in solid red uniforms who interrogate a spy from the past
How to type a long/em dash `—`
Is it safe to harvest rainwater that fell on solar panels?
How do I free up internal storage if I don't have any apps downloaded?
How can I add encounters in the Lost Mine of Phandelver campaign without giving PCs too much XP?
What is the motivation for a law requiring 2 parties to consent for recording a conversation
Straighten subgroup lattice
I am an eight letter word. What am I?
Geography at the pixel level
Is it possible for absolutely everyone to attain enlightenment?
If I can cast sorceries at instant speed, can I use sorcery-speed activated abilities at instant speed?
using unsupervised learning algorithms on images
The 2019 Stack Overflow Developer Survey Results Are InImage clustering by similarity measurement (CW-SSIM)Best approach for this unsupervised clustering problem with categorical data?Neural Network: how to utilize weakly-/unsupervised data to improve supervised network?Image Classification, Convolution Network and Gamma Correction for imagesAre there any very good APIs for matching similar images?What approach other than Tf-Idf could I use for text-clustering using K-Means?CNN not learning properlyMulti-input Convolutional Neural Network for Images ClassificationWhen using Data augmentation is it ok to validate only with the original images?How to convert a time series data which can be fed to a Machine Leanring model for unsupervised learning?
$begingroup$
I am working on a project to classify images of types of cloth (shirt, tshirt, pant etc). While this is a standard supervised classification problem, the accuracy of the neural network is not good. This is because of the close similarity of the types of cloth that I am trying to classify.
I am working with 9 classes with around 10,000 images per class. For the classification problem I tried using CNN to classify the images. But over fitting took place with a good training accuracy (around 95%), but not so great validation accuracy (around 77%).
I wanted to know if there was any way I could create clusters based on the type of cloth using some unsupervised learning algorithm like K Means or DBScan.
python neural-network unsupervised-learning
edited Aug 14 '18 at 10:22
Stephen Rauch♦
1,52551330
asked Aug 14 '18 at 4:21
SashaankSashaank
1
$endgroup$
bumped to the homepage by Community♦ 3 mins ago
This question has answers that may be good or bad; the system has marked it active so that they can be reviewed.
add a comment |
$begingroup$
I am working on a project to classify images of types of cloth (shirt, tshirt, pant etc). While this is a standard supervised classification problem, the accuracy of the neural network is not good. This is because of the close similarity of the types of cloth that I am trying to classify.
I am working with 9 classes with around 10,000 images per class. For the classification problem I tried using CNN to classify the images. But over fitting took place with a good training accuracy (around 95%), but not so great validation accuracy (around 77%).
I wanted to know if there was any way I could create clusters based on the type of cloth using some unsupervised learning algorithm like K Means or DBScan.
python neural-network unsupervised-learning
edited Aug 14 '18 at 10:22
Stephen Rauch♦
1,52551330
asked Aug 14 '18 at 4:21
SashaankSashaank
1
$endgroup$
bumped to the homepage by Community♦ 3 mins ago
This question has answers that may be good or bad; the system has marked it active so that they can be reviewed.
$begingroup$
Did you try data augmentation (rotating your images....)
$endgroup$
– Robin Nicole
Dec 12 '18 at 20:04
add a comment |
$begingroup$
I am working on a project to classify images of types of cloth (shirt, tshirt, pant etc). While this is a standard supervised classification problem, the accuracy of the neural network is not good. This is because of the close similarity of the types of cloth that I am trying to classify.
I am working with 9 classes with around 10,000 images per class. For the classification problem I tried using CNN to classify the images. But over fitting took place with a good training accuracy (around 95%), but not so great validation accuracy (around 77%).
I wanted to know if there was any way I could create clusters based on the type of cloth using some unsupervised learning algorithm like K Means or DBScan.
python neural-network unsupervised-learning
edited Aug 14 '18 at 10:22
Stephen Rauch♦
1,52551330
asked Aug 14 '18 at 4:21
SashaankSashaank
1
$endgroup$
I am working on a project to classify images of types of cloth (shirt, tshirt, pant etc). While this is a standard supervised classification problem, the accuracy of the neural network is not good. This is because of the close similarity of the types of cloth that I am trying to classify.
I am working with 9 classes with around 10,000 images per class. For the classification problem I tried using CNN to classify the images. But over fitting took place with a good training accuracy (around 95%), but not so great validation accuracy (around 77%).
I wanted to know if there was any way I could create clusters based on the type of cloth using some unsupervised learning algorithm like K Means or DBScan.
python neural-network unsupervised-learning
python neural-network unsupervised-learning
edited Aug 14 '18 at 10:22
Stephen Rauch♦
1,52551330
asked Aug 14 '18 at 4:21
SashaankSashaank
1
edited Aug 14 '18 at 10:22
Stephen Rauch♦
1,52551330
asked Aug 14 '18 at 4:21
SashaankSashaank
1
edited Aug 14 '18 at 10:22
Stephen Rauch♦
1,52551330
edited Aug 14 '18 at 10:22
Stephen Rauch♦
1,52551330
edited Aug 14 '18 at 10:22
Stephen Rauch♦
1,52551330
1,52551330
asked Aug 14 '18 at 4:21
SashaankSashaank
1
asked Aug 14 '18 at 4:21
SashaankSashaank
1
asked Aug 14 '18 at 4:21
SashaankSashaank
1
1
bumped to the homepage by Community♦ 3 mins ago
This question has answers that may be good or bad; the system has marked it active so that they can be reviewed.
bumped to the homepage by Community♦ 3 mins ago
This question has answers that may be good or bad; the system has marked it active so that they can be reviewed.
$begingroup$
Did you try data augmentation (rotating your images....)
$endgroup$
– Robin Nicole
Dec 12 '18 at 20:04
add a comment |
$begingroup$
Did you try data augmentation (rotating your images....)
$endgroup$
– Robin Nicole
Dec 12 '18 at 20:04
$begingroup$
Did you try data augmentation (rotating your images....)
$endgroup$
– Robin Nicole
Dec 12 '18 at 20:04
$begingroup$
Did you try data augmentation (rotating your images....)
$endgroup$
– Robin Nicole
Dec 12 '18 at 20:04
add a comment |
1 Answer
1
active
oldest
votes
$begingroup$
Have you included dropout in your model? It can help avoid overfitting issue.
For your problem, yes, you can use auto-encoders, GAN, etc. for feature learning.
However, I'm not sure if unsupervised learning can help, since it's more like a training issue. Your have label with your data so supervised learning is ideal, plus supervised learning generally shows better performance than unsupervised in image classification. You might want to check the false classification examples in your dataset, and try to alter the CNN structure based on that, which would be a more direct way.
answered Aug 14 '18 at 5:31
plpopkplpopk
1038
$endgroup$
$begingroup$
Yes I have used dropout for my network. but That does not seem to have much effect. The problem is if you are familiar with Indian clothing (kurta is very similar to salwar) And since my dataset comprises of both the types of clothing, the program does not work well. should i try increasing the data size though i dod not know if that will have that big of an impact
$endgroup$
– Sashaank
Aug 14 '18 at 6:07
$begingroup$
I checked google for them, it seems the main difference is the shape. CNN should be able to recognize such difference. Usually I will try to take the data for these two label out and train CNN for them only, and then see if can classify between them. If true, it means the degradation of model is caused by the introduction of multi-class classification. Otherwise, it's simply caused by the model structure, and you might want to work on that.
$endgroup$
– plpopk
Aug 14 '18 at 7:00
$begingroup$
I will try that. thanks. Any idea on how to deal with multi classes?
$endgroup$
– Sashaank
Aug 14 '18 at 7:54
$begingroup$
Check if you used softmax activation. At the moment, what come to my mind is either adjust the cost function or add extra models (e.g. combine with a binary classification model which works well).
$endgroup$
– plpopk
Aug 14 '18 at 8:32
add a comment |
Your Answer
StackExchange.ifUsing("editor", function ()
return StackExchange.using("mathjaxEditing", function ()
StackExchange.MarkdownEditor.creationCallbacks.add(function (editor, postfix)
StackExchange.mathjaxEditing.prepareWmdForMathJax(editor, postfix, [["$", "$"], ["\\(","\\)"]]);
);
);
, "mathjax-editing");
StackExchange.ready(function()
var channelOptions =
tags: "".split(" "),
id: "557"
;
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function()
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled)
StackExchange.using("snippets", function()
createEditor();
);
else
createEditor();
);
function createEditor()
StackExchange.prepareEditor(
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: false,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: null,
bindNavPrevention: true,
postfix: "",
imageUploader:
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
,
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
);
);
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fdatascience.stackexchange.com%2fquestions%2f36906%2fusing-unsupervised-learning-algorithms-on-images%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
1 Answer
1
active
oldest
votes
1 Answer
1
active
oldest
votes
active
oldest
votes
active
oldest
votes
$begingroup$
Have you included dropout in your model? It can help avoid overfitting issue.
For your problem, yes, you can use auto-encoders, GAN, etc. for feature learning.
However, I'm not sure if unsupervised learning can help, since it's more like a training issue. Your have label with your data so supervised learning is ideal, plus supervised learning generally shows better performance than unsupervised in image classification. You might want to check the false classification examples in your dataset, and try to alter the CNN structure based on that, which would be a more direct way.
answered Aug 14 '18 at 5:31
plpopkplpopk
1038
$endgroup$
$begingroup$
Yes I have used dropout for my network. but That does not seem to have much effect. The problem is if you are familiar with Indian clothing (kurta is very similar to salwar) And since my dataset comprises of both the types of clothing, the program does not work well. should i try increasing the data size though i dod not know if that will have that big of an impact
$endgroup$
– Sashaank
Aug 14 '18 at 6:07
$begingroup$
I checked google for them, it seems the main difference is the shape. CNN should be able to recognize such difference. Usually I will try to take the data for these two label out and train CNN for them only, and then see if can classify between them. If true, it means the degradation of model is caused by the introduction of multi-class classification. Otherwise, it's simply caused by the model structure, and you might want to work on that.
$endgroup$
– plpopk
Aug 14 '18 at 7:00
$begingroup$
I will try that. thanks. Any idea on how to deal with multi classes?
$endgroup$
– Sashaank
Aug 14 '18 at 7:54
$begingroup$
Check if you used softmax activation. At the moment, what come to my mind is either adjust the cost function or add extra models (e.g. combine with a binary classification model which works well).
$endgroup$
– plpopk
Aug 14 '18 at 8:32
add a comment |
$begingroup$
Have you included dropout in your model? It can help avoid overfitting issue.
For your problem, yes, you can use auto-encoders, GAN, etc. for feature learning.
However, I'm not sure if unsupervised learning can help, since it's more like a training issue. Your have label with your data so supervised learning is ideal, plus supervised learning generally shows better performance than unsupervised in image classification. You might want to check the false classification examples in your dataset, and try to alter the CNN structure based on that, which would be a more direct way.
answered Aug 14 '18 at 5:31
plpopkplpopk
1038
$endgroup$
$begingroup$
Yes I have used dropout for my network. but That does not seem to have much effect. The problem is if you are familiar with Indian clothing (kurta is very similar to salwar) And since my dataset comprises of both the types of clothing, the program does not work well. should i try increasing the data size though i dod not know if that will have that big of an impact
$endgroup$
– Sashaank
Aug 14 '18 at 6:07
$begingroup$
I checked google for them, it seems the main difference is the shape. CNN should be able to recognize such difference. Usually I will try to take the data for these two label out and train CNN for them only, and then see if can classify between them. If true, it means the degradation of model is caused by the introduction of multi-class classification. Otherwise, it's simply caused by the model structure, and you might want to work on that.
$endgroup$
– plpopk
Aug 14 '18 at 7:00
$begingroup$
I will try that. thanks. Any idea on how to deal with multi classes?
$endgroup$
– Sashaank
Aug 14 '18 at 7:54
$begingroup$
Check if you used softmax activation. At the moment, what come to my mind is either adjust the cost function or add extra models (e.g. combine with a binary classification model which works well).
$endgroup$
– plpopk
Aug 14 '18 at 8:32
add a comment |
$begingroup$
Have you included dropout in your model? It can help avoid overfitting issue.
For your problem, yes, you can use auto-encoders, GAN, etc. for feature learning.
However, I'm not sure if unsupervised learning can help, since it's more like a training issue. Your have label with your data so supervised learning is ideal, plus supervised learning generally shows better performance than unsupervised in image classification. You might want to check the false classification examples in your dataset, and try to alter the CNN structure based on that, which would be a more direct way.
answered Aug 14 '18 at 5:31
plpopkplpopk
1038
$endgroup$
Have you included dropout in your model? It can help avoid overfitting issue.
For your problem, yes, you can use auto-encoders, GAN, etc. for feature learning.
However, I'm not sure if unsupervised learning can help, since it's more like a training issue. Your have label with your data so supervised learning is ideal, plus supervised learning generally shows better performance than unsupervised in image classification. You might want to check the false classification examples in your dataset, and try to alter the CNN structure based on that, which would be a more direct way.
answered Aug 14 '18 at 5:31
plpopkplpopk
1038
answered Aug 14 '18 at 5:31
plpopkplpopk
1038
answered Aug 14 '18 at 5:31
plpopkplpopk
1038
answered Aug 14 '18 at 5:31
plpopkplpopk
1038
1038
$begingroup$
Yes I have used dropout for my network. but That does not seem to have much effect. The problem is if you are familiar with Indian clothing (kurta is very similar to salwar) And since my dataset comprises of both the types of clothing, the program does not work well. should i try increasing the data size though i dod not know if that will have that big of an impact
$endgroup$
– Sashaank
Aug 14 '18 at 6:07
$begingroup$
I checked google for them, it seems the main difference is the shape. CNN should be able to recognize such difference. Usually I will try to take the data for these two label out and train CNN for them only, and then see if can classify between them. If true, it means the degradation of model is caused by the introduction of multi-class classification. Otherwise, it's simply caused by the model structure, and you might want to work on that.
$endgroup$
– plpopk
Aug 14 '18 at 7:00
$begingroup$
I will try that. thanks. Any idea on how to deal with multi classes?
$endgroup$
– Sashaank
Aug 14 '18 at 7:54
$begingroup$
Check if you used softmax activation. At the moment, what come to my mind is either adjust the cost function or add extra models (e.g. combine with a binary classification model which works well).
$endgroup$
– plpopk
Aug 14 '18 at 8:32
add a comment |
$begingroup$
Yes I have used dropout for my network. but That does not seem to have much effect. The problem is if you are familiar with Indian clothing (kurta is very similar to salwar) And since my dataset comprises of both the types of clothing, the program does not work well. should i try increasing the data size though i dod not know if that will have that big of an impact
$endgroup$
– Sashaank
Aug 14 '18 at 6:07
$begingroup$
I checked google for them, it seems the main difference is the shape. CNN should be able to recognize such difference. Usually I will try to take the data for these two label out and train CNN for them only, and then see if can classify between them. If true, it means the degradation of model is caused by the introduction of multi-class classification. Otherwise, it's simply caused by the model structure, and you might want to work on that.
$endgroup$
– plpopk
Aug 14 '18 at 7:00
$begingroup$
I will try that. thanks. Any idea on how to deal with multi classes?
$endgroup$
– Sashaank
Aug 14 '18 at 7:54
$begingroup$
Check if you used softmax activation. At the moment, what come to my mind is either adjust the cost function or add extra models (e.g. combine with a binary classification model which works well).
$endgroup$
– plpopk
Aug 14 '18 at 8:32
$begingroup$
Yes I have used dropout for my network. but That does not seem to have much effect. The problem is if you are familiar with Indian clothing (kurta is very similar to salwar) And since my dataset comprises of both the types of clothing, the program does not work well. should i try increasing the data size though i dod not know if that will have that big of an impact
$endgroup$
– Sashaank
Aug 14 '18 at 6:07
$begingroup$
Yes I have used dropout for my network. but That does not seem to have much effect. The problem is if you are familiar with Indian clothing (kurta is very similar to salwar) And since my dataset comprises of both the types of clothing, the program does not work well. should i try increasing the data size though i dod not know if that will have that big of an impact
$endgroup$
– Sashaank
Aug 14 '18 at 6:07
$begingroup$
I checked google for them, it seems the main difference is the shape. CNN should be able to recognize such difference. Usually I will try to take the data for these two label out and train CNN for them only, and then see if can classify between them. If true, it means the degradation of model is caused by the introduction of multi-class classification. Otherwise, it's simply caused by the model structure, and you might want to work on that.
$endgroup$
– plpopk
Aug 14 '18 at 7:00
$begingroup$
I checked google for them, it seems the main difference is the shape. CNN should be able to recognize such difference. Usually I will try to take the data for these two label out and train CNN for them only, and then see if can classify between them. If true, it means the degradation of model is caused by the introduction of multi-class classification. Otherwise, it's simply caused by the model structure, and you might want to work on that.
$endgroup$
– plpopk
Aug 14 '18 at 7:00
$begingroup$
I will try that. thanks. Any idea on how to deal with multi classes?
$endgroup$
– Sashaank
Aug 14 '18 at 7:54
$begingroup$
I will try that. thanks. Any idea on how to deal with multi classes?
$endgroup$
– Sashaank
Aug 14 '18 at 7:54
$begingroup$
Check if you used softmax activation. At the moment, what come to my mind is either adjust the cost function or add extra models (e.g. combine with a binary classification model which works well).
$endgroup$
– plpopk
Aug 14 '18 at 8:32
$begingroup$
Check if you used softmax activation. At the moment, what come to my mind is either adjust the cost function or add extra models (e.g. combine with a binary classification model which works well).
$endgroup$
– plpopk
Aug 14 '18 at 8:32
add a comment |
Thanks for contributing an answer to Data Science Stack Exchange!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
Use MathJax to format equations. MathJax reference.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fdatascience.stackexchange.com%2fquestions%2f36906%2fusing-unsupervised-learning-algorithms-on-images%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
$begingroup$
Did you try data augmentation (rotating your images....)
$endgroup$
– Robin Nicole
Dec 12 '18 at 20:04