Why is MLP working similar to RNN for text generation The Next CEO of Stack Overflow2019 Community Moderator Electionpython - What is the format of the WAV file for a Text to Speech Neural Network?how can I solve label shape problem in tensorflow when using one-hot encoding?Why are RNN/LSTM preferred in time series analysis and not other NN?Suspected Exploding Gradient in Character Generator LSTMUsing RNN (LSTM) for Gesture Recognition SystemTimeDistributed with different input / output sequence lengthNeed to make an multivariate RNN, confused about input shape?Can a neural network be created that will derive the pythogorean theorem?Architecture for linear regression with variable input where each input is n-sized one-hot encodedHow to prepare the data for text generation task
What can we do to stop prior company from asking us questions?
'Given that' in a matrix
Crossing the line between justified force and brutality
How to make a variable always equal to the result of some calculations?
How easy is it to start Magic from scratch?
Describing a person. What needs to be mentioned?
Horror movie/show or scene where a horse creature opens its mouth really wide and devours a man in a stables
Why use "finir par" instead of "finir de" before an infinitive?
Rotate a column
Fastest way to shutdown Ubuntu Mate 18.10
Is it my responsibility to learn a new technology in my own time my employer wants to implement?
Opposite of a diet
How do I get the green key off the shelf in the Dobby level of Lego Harry Potter 2?
What is meant by a M next to a roman numeral?
Return of the Riley Riddles in Reverse
How can I quit an app using Terminal?
What is the difference in properties java.runtime.version and java.version
Understanding "table margins"
How did Arya survive the stabbing?
declare as function pointer and initialize in the same line
ls Ordering[Ordering[list]] optimal?
How can I open an app using Terminal?
How to Reset Passwords on Multiple Websites Easily?
Number of words that can be made using all the letters of the word W, if Os as well as Is are separated is?
Why is MLP working similar to RNN for text generation
The Next CEO of Stack Overflow2019 Community Moderator Electionpython - What is the format of the WAV file for a Text to Speech Neural Network?how can I solve label shape problem in tensorflow when using one-hot encoding?Why are RNN/LSTM preferred in time series analysis and not other NN?Suspected Exploding Gradient in Character Generator LSTMUsing RNN (LSTM) for Gesture Recognition SystemTimeDistributed with different input / output sequence lengthNeed to make an multivariate RNN, confused about input shape?Can a neural network be created that will derive the pythogorean theorem?Architecture for linear regression with variable input where each input is n-sized one-hot encodedHow to prepare the data for text generation task
$begingroup$
I was trying to perform text generation using only a character level feed-forward neural network after having followed this tutorial which uses LSTM. I one-hot encoded the characters of my corpus which gave a vector of length 45. Then I concatenated every 20 characters and fed this 20*45 length vector as input to an MLP with the 21st character's one hot as the output.
Thus my X (input data) shape is -> (144304, 900)
and my Y (output data) shape is -> (144304, 45)
Here's the output from my code:
alice was beginning very about a grible thing was and bet she with a
great come and fill feel at and beck to the darcht repeat allice
waited it, put this was not an encir to the white knew the mock turtle
with a sigh. ‘i only took the regular cours was be crosd it to fits
some to see it was and getting she dodn as the endge of the evence,
and went on to love that you were no alway not--ohe f whow to the
gryphon is, who denight to goover and even stried to the dormouse, and
repeated her question. ‘why did they live at the bottom of a well?’
‘tabl the without once it it howling it the duchess to herself it as
eng, longing one of the door and wasting for the homend of the taits.’
‘sthing i cancus croquet with the queen to-day?’
‘i should like it very much,’ said the dryphon, ‘you first form into a
line along-the sea-shore--’
‘the right!’ cried the queen nother frowing tone. any the this her for
some thing is and at like the look of it at all,’ said the king:
‘however, it may kiss my hand if it likes.’
‘i’d really feeer that in a few this for some whele wish to get thing
to eager to think thcapered twice, and shook note bill herself in a
lell as expectant, and thowedd all have come fuconfuse it the march
hare: she thought it must be the right way of speaking to a mouse: she
had never done such a thing before, but she remembered having seen in
her brother’s latin grammar, ‘a mouse--of a mouse--to a mouse--a
mouse--o mister once to hin fent on the words with her fane with ale
three king the said, and diffich a vage and so mane alice this cime.
My Question is why is MLP working similar to an RNN/LSTM. What's the advantage of using RNN/LSTM for such tasks over MLP?
neural-network recurrent-neural-net natural-language-process language-model
asked 1 hour ago
Atif HassanAtif Hassan
1263
$endgroup$
add a comment |
$begingroup$
I was trying to perform text generation using only a character level feed-forward neural network after having followed this tutorial which uses LSTM. I one-hot encoded the characters of my corpus which gave a vector of length 45. Then I concatenated every 20 characters and fed this 20*45 length vector as input to an MLP with the 21st character's one hot as the output.
Thus my X (input data) shape is -> (144304, 900)
and my Y (output data) shape is -> (144304, 45)
Here's the output from my code:
alice was beginning very about a grible thing was and bet she with a
great come and fill feel at and beck to the darcht repeat allice
waited it, put this was not an encir to the white knew the mock turtle
with a sigh. ‘i only took the regular cours was be crosd it to fits
some to see it was and getting she dodn as the endge of the evence,
and went on to love that you were no alway not--ohe f whow to the
gryphon is, who denight to goover and even stried to the dormouse, and
repeated her question. ‘why did they live at the bottom of a well?’
‘tabl the without once it it howling it the duchess to herself it as
eng, longing one of the door and wasting for the homend of the taits.’
‘sthing i cancus croquet with the queen to-day?’
‘i should like it very much,’ said the dryphon, ‘you first form into a
line along-the sea-shore--’
‘the right!’ cried the queen nother frowing tone. any the this her for
some thing is and at like the look of it at all,’ said the king:
‘however, it may kiss my hand if it likes.’
‘i’d really feeer that in a few this for some whele wish to get thing
to eager to think thcapered twice, and shook note bill herself in a
lell as expectant, and thowedd all have come fuconfuse it the march
hare: she thought it must be the right way of speaking to a mouse: she
had never done such a thing before, but she remembered having seen in
her brother’s latin grammar, ‘a mouse--of a mouse--to a mouse--a
mouse--o mister once to hin fent on the words with her fane with ale
three king the said, and diffich a vage and so mane alice this cime.
My Question is why is MLP working similar to an RNN/LSTM. What's the advantage of using RNN/LSTM for such tasks over MLP?
neural-network recurrent-neural-net natural-language-process language-model
asked 1 hour ago
Atif HassanAtif Hassan
1263
$endgroup$
add a comment |
$begingroup$
I was trying to perform text generation using only a character level feed-forward neural network after having followed this tutorial which uses LSTM. I one-hot encoded the characters of my corpus which gave a vector of length 45. Then I concatenated every 20 characters and fed this 20*45 length vector as input to an MLP with the 21st character's one hot as the output.
Thus my X (input data) shape is -> (144304, 900)
and my Y (output data) shape is -> (144304, 45)
Here's the output from my code:
alice was beginning very about a grible thing was and bet she with a
great come and fill feel at and beck to the darcht repeat allice
waited it, put this was not an encir to the white knew the mock turtle
with a sigh. ‘i only took the regular cours was be crosd it to fits
some to see it was and getting she dodn as the endge of the evence,
and went on to love that you were no alway not--ohe f whow to the
gryphon is, who denight to goover and even stried to the dormouse, and
repeated her question. ‘why did they live at the bottom of a well?’
‘tabl the without once it it howling it the duchess to herself it as
eng, longing one of the door and wasting for the homend of the taits.’
‘sthing i cancus croquet with the queen to-day?’
‘i should like it very much,’ said the dryphon, ‘you first form into a
line along-the sea-shore--’
‘the right!’ cried the queen nother frowing tone. any the this her for
some thing is and at like the look of it at all,’ said the king:
‘however, it may kiss my hand if it likes.’
‘i’d really feeer that in a few this for some whele wish to get thing
to eager to think thcapered twice, and shook note bill herself in a
lell as expectant, and thowedd all have come fuconfuse it the march
hare: she thought it must be the right way of speaking to a mouse: she
had never done such a thing before, but she remembered having seen in
her brother’s latin grammar, ‘a mouse--of a mouse--to a mouse--a
mouse--o mister once to hin fent on the words with her fane with ale
three king the said, and diffich a vage and so mane alice this cime.
My Question is why is MLP working similar to an RNN/LSTM. What's the advantage of using RNN/LSTM for such tasks over MLP?
neural-network recurrent-neural-net natural-language-process language-model
asked 1 hour ago
Atif HassanAtif Hassan
1263
$endgroup$
I was trying to perform text generation using only a character level feed-forward neural network after having followed this tutorial which uses LSTM. I one-hot encoded the characters of my corpus which gave a vector of length 45. Then I concatenated every 20 characters and fed this 20*45 length vector as input to an MLP with the 21st character's one hot as the output.
Thus my X (input data) shape is -> (144304, 900)
and my Y (output data) shape is -> (144304, 45)
Here's the output from my code:
alice was beginning very about a grible thing was and bet she with a
great come and fill feel at and beck to the darcht repeat allice
waited it, put this was not an encir to the white knew the mock turtle
with a sigh. ‘i only took the regular cours was be crosd it to fits
some to see it was and getting she dodn as the endge of the evence,
and went on to love that you were no alway not--ohe f whow to the
gryphon is, who denight to goover and even stried to the dormouse, and
repeated her question. ‘why did they live at the bottom of a well?’
‘tabl the without once it it howling it the duchess to herself it as
eng, longing one of the door and wasting for the homend of the taits.’
‘sthing i cancus croquet with the queen to-day?’
‘i should like it very much,’ said the dryphon, ‘you first form into a
line along-the sea-shore--’
‘the right!’ cried the queen nother frowing tone. any the this her for
some thing is and at like the look of it at all,’ said the king:
‘however, it may kiss my hand if it likes.’
‘i’d really feeer that in a few this for some whele wish to get thing
to eager to think thcapered twice, and shook note bill herself in a
lell as expectant, and thowedd all have come fuconfuse it the march
hare: she thought it must be the right way of speaking to a mouse: she
had never done such a thing before, but she remembered having seen in
her brother’s latin grammar, ‘a mouse--of a mouse--to a mouse--a
mouse--o mister once to hin fent on the words with her fane with ale
three king the said, and diffich a vage and so mane alice this cime.
My Question is why is MLP working similar to an RNN/LSTM. What's the advantage of using RNN/LSTM for such tasks over MLP?
neural-network recurrent-neural-net natural-language-process language-model
neural-network recurrent-neural-net natural-language-process language-model
asked 1 hour ago
Atif HassanAtif Hassan
1263
asked 1 hour ago
Atif HassanAtif Hassan
1263
asked 1 hour ago
Atif HassanAtif Hassan
1263
asked 1 hour ago
Atif HassanAtif Hassan
1263
asked 1 hour ago
Atif HassanAtif Hassan
1263
1263
add a comment |
add a comment |
0
active
oldest
votes
Your Answer
StackExchange.ifUsing("editor", function ()
return StackExchange.using("mathjaxEditing", function ()
StackExchange.MarkdownEditor.creationCallbacks.add(function (editor, postfix)
StackExchange.mathjaxEditing.prepareWmdForMathJax(editor, postfix, [["$", "$"], ["\\(","\\)"]]);
);
);
, "mathjax-editing");
StackExchange.ready(function()
var channelOptions =
tags: "".split(" "),
id: "557"
;
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function()
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled)
StackExchange.using("snippets", function()
createEditor();
);
else
createEditor();
);
function createEditor()
StackExchange.prepareEditor(
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: false,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: null,
bindNavPrevention: true,
postfix: "",
imageUploader:
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
,
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
);
);
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fdatascience.stackexchange.com%2fquestions%2f48165%2fwhy-is-mlp-working-similar-to-rnn-for-text-generation%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
0
active
oldest
votes
0
active
oldest
votes
active
oldest
votes
active
oldest
votes
Thanks for contributing an answer to Data Science Stack Exchange!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
Use MathJax to format equations. MathJax reference.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fdatascience.stackexchange.com%2fquestions%2f48165%2fwhy-is-mlp-working-similar-to-rnn-for-text-generation%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown