Binary Classifier for photo detection2019 Community Moderator ElectionBinary classification model for sparse / biased dataBinary classification with unexplained dataClassifier and Technique to use for large number of categoriesRecognition human in images through HOG descriptor and SVM classifier performs poorlyHow to implement multi class classifier for a set of sentences?Are there established good algorithms for incremental feature learning for a neural network? Do any python ML libraries implement such algorithms?Multi-class neural net always predicting 1 class after optimizationIs this a good classified model based confusion matrix and classification report?Can training label confidence be used to improve prediction accuracy?Is my model overfitting when I add new features?

How does Loki do this?

Is expanding the research of a group into machine learning as a PhD student risky?

Proof of work - lottery approach

What can we do to stop prior company from asking us questions?

What does the word "Atten" mean?

How to pronounce the slash sign

How to safely derail a train during transit?

What does "I’d sit this one out, Cap," imply or mean in the context?

Two monoidal structures and copowering

What Brexit proposals are on the table in the indicative votes on the 27th of March 2019?

Hostile work environment after whistle-blowing on coworker and our boss. What do I do?

Sequence of Tenses: Translating the subjunctive

Large drywall patch supports

Closest Prime Number

Is this apparent Class Action settlement a spam message?

How can we prove that any integral in the set of non-elementary integrals cannot be expressed in the form of elementary functions?

Why didn't Theresa May consult with Parliament before negotiating a deal with the EU?

Is there a problem with hiding "forgot password" until it's needed?

Pole-zeros of a real-valued causal FIR system

How to draw lines on a tikz-cd diagram

System.debug(JSON.Serialize(o)) Not longer shows full string

Opposite of a diet

How does buying out courses with grant money work?

Is this version of a gravity generator feasible?



Binary Classifier for photo detection



2019 Community Moderator ElectionBinary classification model for sparse / biased dataBinary classification with unexplained dataClassifier and Technique to use for large number of categoriesRecognition human in images through HOG descriptor and SVM classifier performs poorlyHow to implement multi class classifier for a set of sentences?Are there established good algorithms for incremental feature learning for a neural network? Do any python ML libraries implement such algorithms?Multi-class neural net always predicting 1 class after optimizationIs this a good classified model based confusion matrix and classification report?Can training label confidence be used to improve prediction accuracy?Is my model overfitting when I add new features?










0












$begingroup$


Two training sets are involved, one complete, one with missing feature data as well. The data consists of CNNs and GIST features.



For the normalising, I have MinMax Scaler feature. I have cleaned up the missing data by using the mean of the column because I tried the mean by row but this bring down the accuracy of the classifier further down. I am assuming that this because the average of all the features for the specific photo doesn't calculate well.



I then concatenated both the datasets. Is calling the fit method twice incrementally better?



Classifier Results



  • low accuracy (70%)


  • Log loss is 9



     precision recall f1-score support

    0.0 0.67 0.56 0.61 431
    1.0 0.72 0.80 0.76 605

    micro avg 0.70 0.70 0.70 1036
    macro avg 0.69 0.68 0.68 1036
    weighted avg 0.70 0.70 0.70 1036


I also have tried multiple train-test splits, I achieve the best accuracy at 0.6 train.
I understand this is a broad question.
I have tried both logistic regression with saga and liblinear. SVM with rbf too. But still unable to increase the accuracy of my classifier.



I plotted my training set data of one feature from both classes and the data appears to be non linearly separable? As in the data from 1 and the data point from 2 appears to be all over. I am not sure how else I can do this?



Also how can I attach confidence of the training data into my classifier? As In I have the confidence for each record of data. ID 1 - 0.2, ID 2 - 0.4 and so on..



I am new to the subject, apologies if any of it sounds dumb.










share|improve this question







New contributor




Will is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.







$endgroup$
















    0












    $begingroup$


    Two training sets are involved, one complete, one with missing feature data as well. The data consists of CNNs and GIST features.



    For the normalising, I have MinMax Scaler feature. I have cleaned up the missing data by using the mean of the column because I tried the mean by row but this bring down the accuracy of the classifier further down. I am assuming that this because the average of all the features for the specific photo doesn't calculate well.



    I then concatenated both the datasets. Is calling the fit method twice incrementally better?



    Classifier Results



    • low accuracy (70%)


    • Log loss is 9



       precision recall f1-score support

      0.0 0.67 0.56 0.61 431
      1.0 0.72 0.80 0.76 605

      micro avg 0.70 0.70 0.70 1036
      macro avg 0.69 0.68 0.68 1036
      weighted avg 0.70 0.70 0.70 1036


    I also have tried multiple train-test splits, I achieve the best accuracy at 0.6 train.
    I understand this is a broad question.
    I have tried both logistic regression with saga and liblinear. SVM with rbf too. But still unable to increase the accuracy of my classifier.



    I plotted my training set data of one feature from both classes and the data appears to be non linearly separable? As in the data from 1 and the data point from 2 appears to be all over. I am not sure how else I can do this?



    Also how can I attach confidence of the training data into my classifier? As In I have the confidence for each record of data. ID 1 - 0.2, ID 2 - 0.4 and so on..



    I am new to the subject, apologies if any of it sounds dumb.










    share|improve this question







    New contributor




    Will is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
    Check out our Code of Conduct.







    $endgroup$














      0












      0








      0





      $begingroup$


      Two training sets are involved, one complete, one with missing feature data as well. The data consists of CNNs and GIST features.



      For the normalising, I have MinMax Scaler feature. I have cleaned up the missing data by using the mean of the column because I tried the mean by row but this bring down the accuracy of the classifier further down. I am assuming that this because the average of all the features for the specific photo doesn't calculate well.



      I then concatenated both the datasets. Is calling the fit method twice incrementally better?



      Classifier Results



      • low accuracy (70%)


      • Log loss is 9



         precision recall f1-score support

        0.0 0.67 0.56 0.61 431
        1.0 0.72 0.80 0.76 605

        micro avg 0.70 0.70 0.70 1036
        macro avg 0.69 0.68 0.68 1036
        weighted avg 0.70 0.70 0.70 1036


      I also have tried multiple train-test splits, I achieve the best accuracy at 0.6 train.
      I understand this is a broad question.
      I have tried both logistic regression with saga and liblinear. SVM with rbf too. But still unable to increase the accuracy of my classifier.



      I plotted my training set data of one feature from both classes and the data appears to be non linearly separable? As in the data from 1 and the data point from 2 appears to be all over. I am not sure how else I can do this?



      Also how can I attach confidence of the training data into my classifier? As In I have the confidence for each record of data. ID 1 - 0.2, ID 2 - 0.4 and so on..



      I am new to the subject, apologies if any of it sounds dumb.










      share|improve this question







      New contributor




      Will is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
      Check out our Code of Conduct.







      $endgroup$




      Two training sets are involved, one complete, one with missing feature data as well. The data consists of CNNs and GIST features.



      For the normalising, I have MinMax Scaler feature. I have cleaned up the missing data by using the mean of the column because I tried the mean by row but this bring down the accuracy of the classifier further down. I am assuming that this because the average of all the features for the specific photo doesn't calculate well.



      I then concatenated both the datasets. Is calling the fit method twice incrementally better?



      Classifier Results



      • low accuracy (70%)


      • Log loss is 9



         precision recall f1-score support

        0.0 0.67 0.56 0.61 431
        1.0 0.72 0.80 0.76 605

        micro avg 0.70 0.70 0.70 1036
        macro avg 0.69 0.68 0.68 1036
        weighted avg 0.70 0.70 0.70 1036


      I also have tried multiple train-test splits, I achieve the best accuracy at 0.6 train.
      I understand this is a broad question.
      I have tried both logistic regression with saga and liblinear. SVM with rbf too. But still unable to increase the accuracy of my classifier.



      I plotted my training set data of one feature from both classes and the data appears to be non linearly separable? As in the data from 1 and the data point from 2 appears to be all over. I am not sure how else I can do this?



      Also how can I attach confidence of the training data into my classifier? As In I have the confidence for each record of data. ID 1 - 0.2, ID 2 - 0.4 and so on..



      I am new to the subject, apologies if any of it sounds dumb.







      machine-learning python classification scikit-learn






      share|improve this question







      New contributor




      Will is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
      Check out our Code of Conduct.











      share|improve this question







      New contributor




      Will is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
      Check out our Code of Conduct.









      share|improve this question




      share|improve this question






      New contributor




      Will is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
      Check out our Code of Conduct.









      asked 41 mins ago









      Will Will

      1




      1




      New contributor




      Will is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
      Check out our Code of Conduct.





      New contributor





      Will is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
      Check out our Code of Conduct.






      Will is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
      Check out our Code of Conduct.




















          0






          active

          oldest

          votes











          Your Answer





          StackExchange.ifUsing("editor", function ()
          return StackExchange.using("mathjaxEditing", function ()
          StackExchange.MarkdownEditor.creationCallbacks.add(function (editor, postfix)
          StackExchange.mathjaxEditing.prepareWmdForMathJax(editor, postfix, [["$", "$"], ["\\(","\\)"]]);
          );
          );
          , "mathjax-editing");

          StackExchange.ready(function()
          var channelOptions =
          tags: "".split(" "),
          id: "557"
          ;
          initTagRenderer("".split(" "), "".split(" "), channelOptions);

          StackExchange.using("externalEditor", function()
          // Have to fire editor after snippets, if snippets enabled
          if (StackExchange.settings.snippets.snippetsEnabled)
          StackExchange.using("snippets", function()
          createEditor();
          );

          else
          createEditor();

          );

          function createEditor()
          StackExchange.prepareEditor(
          heartbeatType: 'answer',
          autoActivateHeartbeat: false,
          convertImagesToLinks: false,
          noModals: true,
          showLowRepImageUploadWarning: true,
          reputationToPostImages: null,
          bindNavPrevention: true,
          postfix: "",
          imageUploader:
          brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
          contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
          allowUrls: true
          ,
          onDemand: true,
          discardSelector: ".discard-answer"
          ,immediatelyShowMarkdownHelp:true
          );



          );






          Will is a new contributor. Be nice, and check out our Code of Conduct.









          draft saved

          draft discarded


















          StackExchange.ready(
          function ()
          StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fdatascience.stackexchange.com%2fquestions%2f48116%2fbinary-classifier-for-photo-detection%23new-answer', 'question_page');

          );

          Post as a guest















          Required, but never shown

























          0






          active

          oldest

          votes








          0






          active

          oldest

          votes









          active

          oldest

          votes






          active

          oldest

          votes








          Will is a new contributor. Be nice, and check out our Code of Conduct.









          draft saved

          draft discarded


















          Will is a new contributor. Be nice, and check out our Code of Conduct.












          Will is a new contributor. Be nice, and check out our Code of Conduct.











          Will is a new contributor. Be nice, and check out our Code of Conduct.














          Thanks for contributing an answer to Data Science Stack Exchange!


          • Please be sure to answer the question. Provide details and share your research!

          But avoid


          • Asking for help, clarification, or responding to other answers.

          • Making statements based on opinion; back them up with references or personal experience.

          Use MathJax to format equations. MathJax reference.


          To learn more, see our tips on writing great answers.




          draft saved


          draft discarded














          StackExchange.ready(
          function ()
          StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fdatascience.stackexchange.com%2fquestions%2f48116%2fbinary-classifier-for-photo-detection%23new-answer', 'question_page');

          );

          Post as a guest















          Required, but never shown





















































          Required, but never shown














          Required, but never shown












          Required, but never shown







          Required, but never shown

































          Required, but never shown














          Required, but never shown












          Required, but never shown







          Required, but never shown







          Popular posts from this blog

          Ружовы пелікан Змест Знешні выгляд | Пашырэнне | Асаблівасці біялогіі | Літаратура | НавігацыяДагледжаная версіяправерана1 зменаДагледжаная версіяправерана1 змена/ 22697590 Сістэматыкана ВіківідахВыявына Вікісховішчы174693363011049382

          ValueError: Error when checking input: expected conv2d_13_input to have shape (3, 150, 150) but got array with shape (150, 150, 3)2019 Community Moderator ElectionError when checking : expected dense_1_input to have shape (None, 5) but got array with shape (200, 1)Error 'Expected 2D array, got 1D array instead:'ValueError: Error when checking input: expected lstm_41_input to have 3 dimensions, but got array with shape (40000,100)ValueError: Error when checking target: expected dense_1 to have shape (7,) but got array with shape (1,)ValueError: Error when checking target: expected dense_2 to have shape (1,) but got array with shape (0,)Keras exception: ValueError: Error when checking input: expected conv2d_1_input to have shape (150, 150, 3) but got array with shape (256, 256, 3)Steps taking too long to completewhen checking input: expected dense_1_input to have shape (13328,) but got array with shape (317,)ValueError: Error when checking target: expected dense_3 to have shape (None, 1) but got array with shape (7715, 40000)Keras exception: Error when checking input: expected dense_input to have shape (2,) but got array with shape (1,)

          Illegal assignment from SObject to ContactFetching String, Id from Map - Illegal Assignment Id to Field / ObjectError: Compile Error: Illegal assignment from String to BooleanError: List has no rows for assignment to SObjectError on Test Class - System.QueryException: List has no rows for assignment to SObjectRemote action problemDML requires SObject or SObject list type error“Illegal assignment from List to List”Test Class Fail: Batch Class: System.QueryException: List has no rows for assignment to SObjectMapping to a user'List has no rows for assignment to SObject' Mystery