Is this an NLP problem?What type of a problem is this?Resolving time in NLPNLP grouping word categoriesOrganization of layers in Keras for a NLP problemNLP: how to organize this research into TensorflowMachine learning - Algorithm suggestion for my problem using NLPIncreasing SpaCy max NLP limitHelp in NLP ProblemNLP: Fuzzy Word/Phrase Match“Context Resolution” Task in NLP
Giving feedback to someone without sounding prejudiced
Possible Eco thriller, man invents a device to remove rain from glass
What does the word 'upstream' mean in the context?
Why can't the Brexit deadlock in the UK parliament be solved with a plurality vote?
El Dorado Word Puzzle II: Videogame Edition
How to make a list of partial sums using forEach
Sound waves in different octaves
ContourPlot — How do I color by contour curvature?
Air travel with refrigerated insulin
Make a Bowl of Alphabet Soup
Typing CO_2 easily
How do you justify more code being written by following clean code practices?
Do I have to know the General Relativity theory to understand the concept of inertial frame?
Isometric embedding of a genus g surface
Why would five hundred and five be same as one?
How to get directions in deep space?
How to write Quadratic equation with negative coefficient
How do I fix the group tension caused by my character stealing and possibly killing without provocation?
Cumulative Sum using Java 8 stream API
What is this high flying aircraft over Pennsylvania?
Make a border of symbols in Gimp
Why the "ls" command is showing the permissions of files in a FAT32 partition?
Can I cause damage to electrical appliances by unplugging them when they are turned on?
What should be the ideal length of sentences in a blog post for ease of reading?
Is this an NLP problem?
What type of a problem is this?Resolving time in NLPNLP grouping word categoriesOrganization of layers in Keras for a NLP problemNLP: how to organize this research into TensorflowMachine learning - Algorithm suggestion for my problem using NLPIncreasing SpaCy max NLP limitHelp in NLP ProblemNLP: Fuzzy Word/Phrase Match“Context Resolution” Task in NLP
$begingroup$
Good evening,
I have a dataset with a free form text field as one of the variables. Essentially I want to determine if a record has the phrase "This cat is present". However, this phrase could be written "cat is present", "cat-present", "There is a cat", "cat here", "cat here to report", paragraph "cat is present", another paragraph, etc, etc. One issue I see is that I want to exclude situations like "I was outside playing with my friend Bob. It was sunny. It was warm. Cat was present" because this has "useful" context.
Would this boil down to searching this variable for various different phrases with a max character cap, and make the assumption that anything over a certain character limit has "useful context"? Or is there an algorithmic way to provide higher confidence?
python nlp
$endgroup$
add a comment |
$begingroup$
Good evening,
I have a dataset with a free form text field as one of the variables. Essentially I want to determine if a record has the phrase "This cat is present". However, this phrase could be written "cat is present", "cat-present", "There is a cat", "cat here", "cat here to report", paragraph "cat is present", another paragraph, etc, etc. One issue I see is that I want to exclude situations like "I was outside playing with my friend Bob. It was sunny. It was warm. Cat was present" because this has "useful" context.
Would this boil down to searching this variable for various different phrases with a max character cap, and make the assumption that anything over a certain character limit has "useful context"? Or is there an algorithmic way to provide higher confidence?
python nlp
$endgroup$
add a comment |
$begingroup$
Good evening,
I have a dataset with a free form text field as one of the variables. Essentially I want to determine if a record has the phrase "This cat is present". However, this phrase could be written "cat is present", "cat-present", "There is a cat", "cat here", "cat here to report", paragraph "cat is present", another paragraph, etc, etc. One issue I see is that I want to exclude situations like "I was outside playing with my friend Bob. It was sunny. It was warm. Cat was present" because this has "useful" context.
Would this boil down to searching this variable for various different phrases with a max character cap, and make the assumption that anything over a certain character limit has "useful context"? Or is there an algorithmic way to provide higher confidence?
python nlp
$endgroup$
Good evening,
I have a dataset with a free form text field as one of the variables. Essentially I want to determine if a record has the phrase "This cat is present". However, this phrase could be written "cat is present", "cat-present", "There is a cat", "cat here", "cat here to report", paragraph "cat is present", another paragraph, etc, etc. One issue I see is that I want to exclude situations like "I was outside playing with my friend Bob. It was sunny. It was warm. Cat was present" because this has "useful" context.
Would this boil down to searching this variable for various different phrases with a max character cap, and make the assumption that anything over a certain character limit has "useful context"? Or is there an algorithmic way to provide higher confidence?
python nlp
python nlp
asked 9 mins ago
DataNoob7DataNoob7
193
193
add a comment |
add a comment |
0
active
oldest
votes
Your Answer
StackExchange.ifUsing("editor", function ()
return StackExchange.using("mathjaxEditing", function ()
StackExchange.MarkdownEditor.creationCallbacks.add(function (editor, postfix)
StackExchange.mathjaxEditing.prepareWmdForMathJax(editor, postfix, [["$", "$"], ["\\(","\\)"]]);
);
);
, "mathjax-editing");
StackExchange.ready(function()
var channelOptions =
tags: "".split(" "),
id: "557"
;
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function()
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled)
StackExchange.using("snippets", function()
createEditor();
);
else
createEditor();
);
function createEditor()
StackExchange.prepareEditor(
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: false,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: null,
bindNavPrevention: true,
postfix: "",
imageUploader:
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
,
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
);
);
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fdatascience.stackexchange.com%2fquestions%2f47705%2fis-this-an-nlp-problem%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
0
active
oldest
votes
0
active
oldest
votes
active
oldest
votes
active
oldest
votes
Thanks for contributing an answer to Data Science Stack Exchange!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
Use MathJax to format equations. MathJax reference.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fdatascience.stackexchange.com%2fquestions%2f47705%2fis-this-an-nlp-problem%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown