How does GlobalMaxPooling work on the output of Conv1D?2019 Community Moderator ElectionOutput a word instead of a vector after word embedding?In a convolutional neural network (CNN), when convolving the image, is the operation used the dot product or the sum of element-wise multiplication?how to deal with varying output layerHow filters are made in a CNN?Visualizing word embeddingsWhat is the purpose of a 1x1 convolutional layer?degeneracy of a CNN having only 1 convolution kernel down to a fully connected NNWhat is the motivation for row-wise convolution and folding in Kalchbrenner et al. (2014)?Weight update to fully convolutional network when supervision is only for a patchHow to set kernel size (height and width) for 1D convolution layer in CNN Keras R API for doc2vec input?
Is it tax fraud for an individual to declare non-taxable revenue as taxable income? (US tax laws)
Are there any consumables that function as addictive (psychedelic) drugs?
Copenhagen passport control - US citizen
whey we use polarized capacitor?
I probably found a bug with the sudo apt install function
Possibly bubble sort algorithm
XeLaTeX and pdfLaTeX ignore hyphenation
How is this relation reflexive?
Example of a relative pronoun
What typically incentivizes a professor to change jobs to a lower ranking university?
How to report a triplet of septets in NMR tabulation?
What are these boxed doors outside store fronts in New York?
What do you call a Matrix-like slowdown and camera movement effect?
Is there really no realistic way for a skeleton monster to move around without magic?
Why is this code 6.5x slower with optimizations enabled?
Why did the Germans forbid the possession of pet pigeons in Rostov-on-Don in 1941?
How do I create uniquely male characters?
"You are your self first supporter", a more proper way to say it
Infinite past with a beginning?
Why was the small council so happy for Tyrion to become the Master of Coin?
Is it possible to make sharp wind that can cut stuff from afar?
Why Is Death Allowed In the Matrix?
N.B. ligature in Latex
How do you conduct xenoanthropology after first contact?
How does GlobalMaxPooling work on the output of Conv1D?
2019 Community Moderator ElectionOutput a word instead of a vector after word embedding?In a convolutional neural network (CNN), when convolving the image, is the operation used the dot product or the sum of element-wise multiplication?how to deal with varying output layerHow filters are made in a CNN?Visualizing word embeddingsWhat is the purpose of a 1x1 convolutional layer?degeneracy of a CNN having only 1 convolution kernel down to a fully connected NNWhat is the motivation for row-wise convolution and folding in Kalchbrenner et al. (2014)?Weight update to fully convolutional network when supervision is only for a patchHow to set kernel size (height and width) for 1D convolution layer in CNN Keras R API for doc2vec input?
$begingroup$
In the field of text classification, it is common to use Conv1D filters running over word embeddings and then getting a single value on the output for each filter using GlobalMaxPooling1D.
As I understand the process, the convolutional filter is a matrix of the same size as the $$textsize of filter matrix = textembedding dimcdottextwidth of the filter$$ The filter matrix is then applied to the input embeddings (multiplied element by element) which produces a matrix of the same size for each filter position. Not a single number.
So how does the global max pooling get a single number on the output? Does it simply take a maximum over all the values in all the output matrices, or is there any other processing?
Please correct me if I'm wrong.
keras nlp cnn
asked 6 hours ago
MSKLMSKL
713
$endgroup$
add a comment |
$begingroup$
In the field of text classification, it is common to use Conv1D filters running over word embeddings and then getting a single value on the output for each filter using GlobalMaxPooling1D.
As I understand the process, the convolutional filter is a matrix of the same size as the $$textsize of filter matrix = textembedding dimcdottextwidth of the filter$$ The filter matrix is then applied to the input embeddings (multiplied element by element) which produces a matrix of the same size for each filter position. Not a single number.
So how does the global max pooling get a single number on the output? Does it simply take a maximum over all the values in all the output matrices, or is there any other processing?
Please correct me if I'm wrong.
keras nlp cnn
asked 6 hours ago
MSKLMSKL
713
$endgroup$
add a comment |
$begingroup$
In the field of text classification, it is common to use Conv1D filters running over word embeddings and then getting a single value on the output for each filter using GlobalMaxPooling1D.
As I understand the process, the convolutional filter is a matrix of the same size as the $$textsize of filter matrix = textembedding dimcdottextwidth of the filter$$ The filter matrix is then applied to the input embeddings (multiplied element by element) which produces a matrix of the same size for each filter position. Not a single number.
So how does the global max pooling get a single number on the output? Does it simply take a maximum over all the values in all the output matrices, or is there any other processing?
Please correct me if I'm wrong.
keras nlp cnn
asked 6 hours ago
MSKLMSKL
713
$endgroup$
In the field of text classification, it is common to use Conv1D filters running over word embeddings and then getting a single value on the output for each filter using GlobalMaxPooling1D.
As I understand the process, the convolutional filter is a matrix of the same size as the $$textsize of filter matrix = textembedding dimcdottextwidth of the filter$$ The filter matrix is then applied to the input embeddings (multiplied element by element) which produces a matrix of the same size for each filter position. Not a single number.
So how does the global max pooling get a single number on the output? Does it simply take a maximum over all the values in all the output matrices, or is there any other processing?
Please correct me if I'm wrong.
keras nlp cnn
keras nlp cnn
asked 6 hours ago
MSKLMSKL
713
asked 6 hours ago
MSKLMSKL
713
edited 6 hours ago
MSKL
asked 6 hours ago
MSKLMSKL
713
asked 6 hours ago
MSKLMSKL
713
asked 6 hours ago
MSKLMSKL
713
713
add a comment |
add a comment |
1 Answer
1
active
oldest
votes
$begingroup$
Apparently I forgot how the convolution works. The input is multiplied element wise with the filter weights and the products are then summed. That's how a single value is obtained on the output.
answered 6 hours ago
MSKLMSKL
713
$endgroup$
add a comment |
Your Answer
StackExchange.ifUsing("editor", function ()
return StackExchange.using("mathjaxEditing", function ()
StackExchange.MarkdownEditor.creationCallbacks.add(function (editor, postfix)
StackExchange.mathjaxEditing.prepareWmdForMathJax(editor, postfix, [["$", "$"], ["\\(","\\)"]]);
);
);
, "mathjax-editing");
StackExchange.ready(function()
var channelOptions =
tags: "".split(" "),
id: "557"
;
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function()
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled)
StackExchange.using("snippets", function()
createEditor();
);
else
createEditor();
);
function createEditor()
StackExchange.prepareEditor(
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: false,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: null,
bindNavPrevention: true,
postfix: "",
imageUploader:
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
,
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
);
);
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fdatascience.stackexchange.com%2fquestions%2f48832%2fhow-does-globalmaxpooling-work-on-the-output-of-conv1d%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
1 Answer
1
active
oldest
votes
1 Answer
1
active
oldest
votes
active
oldest
votes
active
oldest
votes
$begingroup$
Apparently I forgot how the convolution works. The input is multiplied element wise with the filter weights and the products are then summed. That's how a single value is obtained on the output.
answered 6 hours ago
MSKLMSKL
713
$endgroup$
add a comment |
$begingroup$
Apparently I forgot how the convolution works. The input is multiplied element wise with the filter weights and the products are then summed. That's how a single value is obtained on the output.
answered 6 hours ago
MSKLMSKL
713
$endgroup$
add a comment |
$begingroup$
Apparently I forgot how the convolution works. The input is multiplied element wise with the filter weights and the products are then summed. That's how a single value is obtained on the output.
answered 6 hours ago
MSKLMSKL
713
$endgroup$
Apparently I forgot how the convolution works. The input is multiplied element wise with the filter weights and the products are then summed. That's how a single value is obtained on the output.
answered 6 hours ago
MSKLMSKL
713
answered 6 hours ago
MSKLMSKL
713
answered 6 hours ago
MSKLMSKL
713
answered 6 hours ago
MSKLMSKL
713
713
add a comment |
add a comment |
Thanks for contributing an answer to Data Science Stack Exchange!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
Use MathJax to format equations. MathJax reference.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fdatascience.stackexchange.com%2fquestions%2f48832%2fhow-does-globalmaxpooling-work-on-the-output-of-conv1d%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
