Looking for other opinions on approach to classification problem2019 Community Moderator Electionwhat is buyer classification problem?Classification when one class is otherApproach to Text Classification ProblemBayesian combination of multi-dimensional experts?What methods to create singular content classification from inconsistent inbound info?Why is spam detection a classification problem and not a class modelling problemSelecting ML algorithm for music compositionClassification of keystrokesPearson's Coefficient for classification problemBest approach for classification problem where examples most belong to one set
Need help identifying/translating a plaque in Tangier, Morocco
I’m planning on buying a laser printer but concerned about the life cycle of toner in the machine
Domain expired, GoDaddy holds it and is asking more money
Where to refill my bottle in India?
Is it legal to have the "// (c) 2019 John Smith" header in all files when there are hundreds of contributors?
Landlord wants to switch my lease to a "Land contract" to "get back at the city"
Information to fellow intern about hiring?
What is the offset in a seaplane's hull?
Is window.confirm() accessible?
New order #4: World
Can I legally use front facing blue light in the UK?
How would photo IDs work for shapeshifters?
Shall I use personal or official e-mail account when registering to external websites for work purpose?
Find the positive root of a 4-th degree polynomial equation
How to answer pointed "are you quitting" questioning when I don't want them to suspect
Copycat chess is back
Are cabin dividers used to "hide" the flex of the airplane?
Landing in very high winds
Find the number of surjections from A to B.
What is the meaning of "of trouble" in the following sentence?
Is there a name of the flying bionic bird?
Ideas for 3rd eye abilities
Is domain driven design an anti-SQL pattern?
Filling an area between two curves
Looking for other opinions on approach to classification problem
2019 Community Moderator Electionwhat is buyer classification problem?Classification when one class is otherApproach to Text Classification ProblemBayesian combination of multi-dimensional experts?What methods to create singular content classification from inconsistent inbound info?Why is spam detection a classification problem and not a class modelling problemSelecting ML algorithm for music compositionClassification of keystrokesPearson's Coefficient for classification problemBest approach for classification problem where examples most belong to one set
$begingroup$
I'm looking to implement an "opt-out" filter for my company. The input is short, text-message style messages. A few examples of opt-out messages are:
- "remove me from your list"
- "remove from list"
- "please unsubscribe from list"
- etc.
All other messages are "good", and should not be removed.
My thoughts on approaches:
I was thinking of using a Bayesian classifier here, but not really knowing the solution space (or having much of a background in ML), want to be sure I'm not wasting time on a sub-optimal solution.
I'm fine with not having the most cutting-edge solution, but want to be sure I'm not missing an approach that might be equally as straightforward but more effective.
classification naive-bayes-classifier
$endgroup$
add a comment |
$begingroup$
I'm looking to implement an "opt-out" filter for my company. The input is short, text-message style messages. A few examples of opt-out messages are:
- "remove me from your list"
- "remove from list"
- "please unsubscribe from list"
- etc.
All other messages are "good", and should not be removed.
My thoughts on approaches:
I was thinking of using a Bayesian classifier here, but not really knowing the solution space (or having much of a background in ML), want to be sure I'm not wasting time on a sub-optimal solution.
I'm fine with not having the most cutting-edge solution, but want to be sure I'm not missing an approach that might be equally as straightforward but more effective.
classification naive-bayes-classifier
$endgroup$
add a comment |
$begingroup$
I'm looking to implement an "opt-out" filter for my company. The input is short, text-message style messages. A few examples of opt-out messages are:
- "remove me from your list"
- "remove from list"
- "please unsubscribe from list"
- etc.
All other messages are "good", and should not be removed.
My thoughts on approaches:
I was thinking of using a Bayesian classifier here, but not really knowing the solution space (or having much of a background in ML), want to be sure I'm not wasting time on a sub-optimal solution.
I'm fine with not having the most cutting-edge solution, but want to be sure I'm not missing an approach that might be equally as straightforward but more effective.
classification naive-bayes-classifier
$endgroup$
I'm looking to implement an "opt-out" filter for my company. The input is short, text-message style messages. A few examples of opt-out messages are:
- "remove me from your list"
- "remove from list"
- "please unsubscribe from list"
- etc.
All other messages are "good", and should not be removed.
My thoughts on approaches:
I was thinking of using a Bayesian classifier here, but not really knowing the solution space (or having much of a background in ML), want to be sure I'm not wasting time on a sub-optimal solution.
I'm fine with not having the most cutting-edge solution, but want to be sure I'm not missing an approach that might be equally as straightforward but more effective.
classification naive-bayes-classifier
classification naive-bayes-classifier
asked 14 hours ago
wheresmycookiewheresmycookie
1164
1164
add a comment |
add a comment |
1 Answer
1
active
oldest
votes
$begingroup$
You should use text classification techniques. The most basic one is multinomial naive Bayes classifier with tf-idf features. for this method, take a look at this:
https://scikit-learn.org/stable/tutorial/text_analytics/working_with_text_data.html
If you don’t get enough accuracy (or maybe precision, recall or f-score), you could test more complex techniques e.g. using deep LSTM networks with word embedding. For this method, take a look at this:
https://machinelearningmastery.com/use-word-embedding-layers-deep-learning-keras/
$endgroup$
add a comment |
Your Answer
StackExchange.ifUsing("editor", function ()
return StackExchange.using("mathjaxEditing", function ()
StackExchange.MarkdownEditor.creationCallbacks.add(function (editor, postfix)
StackExchange.mathjaxEditing.prepareWmdForMathJax(editor, postfix, [["$", "$"], ["\\(","\\)"]]);
);
);
, "mathjax-editing");
StackExchange.ready(function()
var channelOptions =
tags: "".split(" "),
id: "557"
;
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function()
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled)
StackExchange.using("snippets", function()
createEditor();
);
else
createEditor();
);
function createEditor()
StackExchange.prepareEditor(
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: false,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: null,
bindNavPrevention: true,
postfix: "",
imageUploader:
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
,
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
);
);
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fdatascience.stackexchange.com%2fquestions%2f48886%2flooking-for-other-opinions-on-approach-to-classification-problem%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
1 Answer
1
active
oldest
votes
1 Answer
1
active
oldest
votes
active
oldest
votes
active
oldest
votes
$begingroup$
You should use text classification techniques. The most basic one is multinomial naive Bayes classifier with tf-idf features. for this method, take a look at this:
https://scikit-learn.org/stable/tutorial/text_analytics/working_with_text_data.html
If you don’t get enough accuracy (or maybe precision, recall or f-score), you could test more complex techniques e.g. using deep LSTM networks with word embedding. For this method, take a look at this:
https://machinelearningmastery.com/use-word-embedding-layers-deep-learning-keras/
$endgroup$
add a comment |
$begingroup$
You should use text classification techniques. The most basic one is multinomial naive Bayes classifier with tf-idf features. for this method, take a look at this:
https://scikit-learn.org/stable/tutorial/text_analytics/working_with_text_data.html
If you don’t get enough accuracy (or maybe precision, recall or f-score), you could test more complex techniques e.g. using deep LSTM networks with word embedding. For this method, take a look at this:
https://machinelearningmastery.com/use-word-embedding-layers-deep-learning-keras/
$endgroup$
add a comment |
$begingroup$
You should use text classification techniques. The most basic one is multinomial naive Bayes classifier with tf-idf features. for this method, take a look at this:
https://scikit-learn.org/stable/tutorial/text_analytics/working_with_text_data.html
If you don’t get enough accuracy (or maybe precision, recall or f-score), you could test more complex techniques e.g. using deep LSTM networks with word embedding. For this method, take a look at this:
https://machinelearningmastery.com/use-word-embedding-layers-deep-learning-keras/
$endgroup$
You should use text classification techniques. The most basic one is multinomial naive Bayes classifier with tf-idf features. for this method, take a look at this:
https://scikit-learn.org/stable/tutorial/text_analytics/working_with_text_data.html
If you don’t get enough accuracy (or maybe precision, recall or f-score), you could test more complex techniques e.g. using deep LSTM networks with word embedding. For this method, take a look at this:
https://machinelearningmastery.com/use-word-embedding-layers-deep-learning-keras/
answered 10 hours ago
pythinkerpythinker
5431211
5431211
add a comment |
add a comment |
Thanks for contributing an answer to Data Science Stack Exchange!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
Use MathJax to format equations. MathJax reference.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fdatascience.stackexchange.com%2fquestions%2f48886%2flooking-for-other-opinions-on-approach-to-classification-problem%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown