How to build Non Linear Vector auto regression using Neural Nets The 2019 Stack Overflow Developer Survey Results Are In Announcing the arrival of Valued Associate #679: Cesar Manara Planned maintenance scheduled April 17/18, 2019 at 00:00UTC (8:00pm US/Eastern) 2019 Moderator Election Q&A - Questionnaire 2019 Community Moderator Election ResultsIf my data looks like this, is linear regression just never gonna be useful?What are some methodologies for performing feature selection for simple feed-forward neural networks?Is linear regression fit for this dataMulti-dimensional regression with ensemble models?xgboost cannot identify perfectly fitting regression lineHow to model & predict user activity/presence time in a websitenormalization of probabilities in predicting a poly-neuron output in neural netsWhat should be the requirement for training data in order to obtain a good regression model using neural network?Are RNN or LSTM appropriate Neural Networks approaches for multivariate time-series regression?Can I use Linear Regression to model a nonlinear function?
Do warforged have souls?
How does this infinite series simplify to an integral?
Road tyres vs "Street" tyres for charity ride on MTB Tandem
Why can't devices on different VLANs, but on the same subnet, communicate?
Make it rain characters
Working through the single responsibility principle (SRP) in Python when calls are expensive
Derivation tree not rendering
How are presidential pardons supposed to be used?
Sort a list of pairs representing an acyclic, partial automorphism
How did the audience guess the pentatonic scale in Bobby McFerrin's presentation?
What can I do if neighbor is blocking my solar panels intentionally?
Change bounding box of math glyphs in LuaTeX
Does Parliament hold absolute power in the UK?
Netflix Recommendations?
What's the point in a preamp?
Do working physicists consider Newtonian mechanics to be "falsified"?
How does ice melt when immersed in water?
Can the prologue be the backstory of your main character?
Arduino Pro Micro - switch off LEDs
Is it ok to offer lower paid work as a trial period before negotiating for a full-time job?
Is above average number of years spent on PhD considered a red flag in future academia or industry positions?
Why does the Event Horizon Telescope (EHT) not include telescopes from Africa, Asia or Australia?
How many people can fit inside Mordenkainen's Magnificent Mansion?
Is this wall load bearing? Blueprints and photos attached
How to build Non Linear Vector auto regression using Neural Nets
The 2019 Stack Overflow Developer Survey Results Are In
Announcing the arrival of Valued Associate #679: Cesar Manara
Planned maintenance scheduled April 17/18, 2019 at 00:00UTC (8:00pm US/Eastern)
2019 Moderator Election Q&A - Questionnaire
2019 Community Moderator Election ResultsIf my data looks like this, is linear regression just never gonna be useful?What are some methodologies for performing feature selection for simple feed-forward neural networks?Is linear regression fit for this dataMulti-dimensional regression with ensemble models?xgboost cannot identify perfectly fitting regression lineHow to model & predict user activity/presence time in a websitenormalization of probabilities in predicting a poly-neuron output in neural netsWhat should be the requirement for training data in order to obtain a good regression model using neural network?Are RNN or LSTM appropriate Neural Networks approaches for multivariate time-series regression?Can I use Linear Regression to model a nonlinear function?
$begingroup$
I have worked on VAR ( vector Auto regression), which forecasts multiple output values(continuous) when there is linear relationship between all variables. I want to use Neural nets to do so,sothat I can include non linear relation among variables also.
Is there any specific type of NN available?
If not how can I implement it using NN?
neural-network regression lstm
asked Jun 14 '18 at 10:01
Arpit SisodiaArpit Sisodia
27718
$endgroup$
bumped to the homepage by Community♦ 34 mins ago
This question has answers that may be good or bad; the system has marked it active so that they can be reviewed.
add a comment |
$begingroup$
I have worked on VAR ( vector Auto regression), which forecasts multiple output values(continuous) when there is linear relationship between all variables. I want to use Neural nets to do so,sothat I can include non linear relation among variables also.
Is there any specific type of NN available?
If not how can I implement it using NN?
neural-network regression lstm
asked Jun 14 '18 at 10:01
Arpit SisodiaArpit Sisodia
27718
$endgroup$
bumped to the homepage by Community♦ 34 mins ago
This question has answers that may be good or bad; the system has marked it active so that they can be reviewed.
add a comment |
$begingroup$
I have worked on VAR ( vector Auto regression), which forecasts multiple output values(continuous) when there is linear relationship between all variables. I want to use Neural nets to do so,sothat I can include non linear relation among variables also.
Is there any specific type of NN available?
If not how can I implement it using NN?
neural-network regression lstm
asked Jun 14 '18 at 10:01
Arpit SisodiaArpit Sisodia
27718
$endgroup$
I have worked on VAR ( vector Auto regression), which forecasts multiple output values(continuous) when there is linear relationship between all variables. I want to use Neural nets to do so,sothat I can include non linear relation among variables also.
Is there any specific type of NN available?
If not how can I implement it using NN?
neural-network regression lstm
neural-network regression lstm
asked Jun 14 '18 at 10:01
Arpit SisodiaArpit Sisodia
27718
asked Jun 14 '18 at 10:01
Arpit SisodiaArpit Sisodia
27718
asked Jun 14 '18 at 10:01
Arpit SisodiaArpit Sisodia
27718
asked Jun 14 '18 at 10:01
Arpit SisodiaArpit Sisodia
27718
asked Jun 14 '18 at 10:01
Arpit SisodiaArpit Sisodia
27718
27718
bumped to the homepage by Community♦ 34 mins ago
This question has answers that may be good or bad; the system has marked it active so that they can be reviewed.
bumped to the homepage by Community♦ 34 mins ago
This question has answers that may be good or bad; the system has marked it active so that they can be reviewed.
add a comment |
add a comment |
1 Answer
1
active
oldest
votes
$begingroup$
The type of artificial neural nets (ANN) you are looking for is ANN with cycles which is widely known as recurrent neural networks(RNN). As you have mentioned Vector Auto regression (VAR) I would recommend you to check out this paper which compares VAR to RNN on two different tasks pertaining to two different real world datasets.
One specific type of RNN is Long short term memory (LSTM). It is particularly good at learning over long sequences. Although RNN is also perfectly capable of that theoretically, but with little empirical success. So, in recent years LSTM has gained huge popularity and has been very successful over sequence learning tasks. I would recommend this book which provides a fair bit of understanding of ANN with cycles and the tasks they are being applied to.
For implementation of RNN there are many APIs available. Keras provides a high level API for the same.
For modelling multivariate time series with LSTM check out this tutorial.
You can also have a look at this question that I answered on cross validated.
answered Jun 16 '18 at 5:58
naivenaive
2817
$endgroup$
$begingroup$
I know different tools and API( not the deep understanding). My concern is -having multiple output in output layer. How would common loss function look like.( As now NN has to minimize multiple loss functions.. Will this be possible also?
$endgroup$
– Arpit Sisodia
Jun 18 '18 at 6:15
$begingroup$
@ArpitSisodia Edit you question accordingly. It doesn't exactly reflect what you are asking.
$endgroup$
– naive
Jun 18 '18 at 6:46
$begingroup$
sure @Naive. anyway R2N2 is useful, I need to read this paper.
$endgroup$
– Arpit Sisodia
Jun 18 '18 at 7:45
add a comment |
Your Answer
StackExchange.ready(function()
var channelOptions =
tags: "".split(" "),
id: "557"
;
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function()
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled)
StackExchange.using("snippets", function()
createEditor();
);
else
createEditor();
);
function createEditor()
StackExchange.prepareEditor(
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: false,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: null,
bindNavPrevention: true,
postfix: "",
imageUploader:
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
,
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
);
);
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fdatascience.stackexchange.com%2fquestions%2f33143%2fhow-to-build-non-linear-vector-auto-regression-using-neural-nets%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
1 Answer
1
active
oldest
votes
1 Answer
1
active
oldest
votes
active
oldest
votes
active
oldest
votes
$begingroup$
The type of artificial neural nets (ANN) you are looking for is ANN with cycles which is widely known as recurrent neural networks(RNN). As you have mentioned Vector Auto regression (VAR) I would recommend you to check out this paper which compares VAR to RNN on two different tasks pertaining to two different real world datasets.
One specific type of RNN is Long short term memory (LSTM). It is particularly good at learning over long sequences. Although RNN is also perfectly capable of that theoretically, but with little empirical success. So, in recent years LSTM has gained huge popularity and has been very successful over sequence learning tasks. I would recommend this book which provides a fair bit of understanding of ANN with cycles and the tasks they are being applied to.
For implementation of RNN there are many APIs available. Keras provides a high level API for the same.
For modelling multivariate time series with LSTM check out this tutorial.
You can also have a look at this question that I answered on cross validated.
answered Jun 16 '18 at 5:58
naivenaive
2817
$endgroup$
$begingroup$
I know different tools and API( not the deep understanding). My concern is -having multiple output in output layer. How would common loss function look like.( As now NN has to minimize multiple loss functions.. Will this be possible also?
$endgroup$
– Arpit Sisodia
Jun 18 '18 at 6:15
$begingroup$
@ArpitSisodia Edit you question accordingly. It doesn't exactly reflect what you are asking.
$endgroup$
– naive
Jun 18 '18 at 6:46
$begingroup$
sure @Naive. anyway R2N2 is useful, I need to read this paper.
$endgroup$
– Arpit Sisodia
Jun 18 '18 at 7:45
add a comment |
$begingroup$
The type of artificial neural nets (ANN) you are looking for is ANN with cycles which is widely known as recurrent neural networks(RNN). As you have mentioned Vector Auto regression (VAR) I would recommend you to check out this paper which compares VAR to RNN on two different tasks pertaining to two different real world datasets.
One specific type of RNN is Long short term memory (LSTM). It is particularly good at learning over long sequences. Although RNN is also perfectly capable of that theoretically, but with little empirical success. So, in recent years LSTM has gained huge popularity and has been very successful over sequence learning tasks. I would recommend this book which provides a fair bit of understanding of ANN with cycles and the tasks they are being applied to.
For implementation of RNN there are many APIs available. Keras provides a high level API for the same.
For modelling multivariate time series with LSTM check out this tutorial.
You can also have a look at this question that I answered on cross validated.
answered Jun 16 '18 at 5:58
naivenaive
2817
$endgroup$
$begingroup$
I know different tools and API( not the deep understanding). My concern is -having multiple output in output layer. How would common loss function look like.( As now NN has to minimize multiple loss functions.. Will this be possible also?
$endgroup$
– Arpit Sisodia
Jun 18 '18 at 6:15
$begingroup$
@ArpitSisodia Edit you question accordingly. It doesn't exactly reflect what you are asking.
$endgroup$
– naive
Jun 18 '18 at 6:46
$begingroup$
sure @Naive. anyway R2N2 is useful, I need to read this paper.
$endgroup$
– Arpit Sisodia
Jun 18 '18 at 7:45
add a comment |
$begingroup$
The type of artificial neural nets (ANN) you are looking for is ANN with cycles which is widely known as recurrent neural networks(RNN). As you have mentioned Vector Auto regression (VAR) I would recommend you to check out this paper which compares VAR to RNN on two different tasks pertaining to two different real world datasets.
One specific type of RNN is Long short term memory (LSTM). It is particularly good at learning over long sequences. Although RNN is also perfectly capable of that theoretically, but with little empirical success. So, in recent years LSTM has gained huge popularity and has been very successful over sequence learning tasks. I would recommend this book which provides a fair bit of understanding of ANN with cycles and the tasks they are being applied to.
For implementation of RNN there are many APIs available. Keras provides a high level API for the same.
For modelling multivariate time series with LSTM check out this tutorial.
You can also have a look at this question that I answered on cross validated.
answered Jun 16 '18 at 5:58
naivenaive
2817
$endgroup$
The type of artificial neural nets (ANN) you are looking for is ANN with cycles which is widely known as recurrent neural networks(RNN). As you have mentioned Vector Auto regression (VAR) I would recommend you to check out this paper which compares VAR to RNN on two different tasks pertaining to two different real world datasets.
One specific type of RNN is Long short term memory (LSTM). It is particularly good at learning over long sequences. Although RNN is also perfectly capable of that theoretically, but with little empirical success. So, in recent years LSTM has gained huge popularity and has been very successful over sequence learning tasks. I would recommend this book which provides a fair bit of understanding of ANN with cycles and the tasks they are being applied to.
For implementation of RNN there are many APIs available. Keras provides a high level API for the same.
For modelling multivariate time series with LSTM check out this tutorial.
You can also have a look at this question that I answered on cross validated.
answered Jun 16 '18 at 5:58
naivenaive
2817
edited Jun 17 '18 at 7:45
answered Jun 16 '18 at 5:58
naivenaive
2817
answered Jun 16 '18 at 5:58
naivenaive
2817
answered Jun 16 '18 at 5:58
naivenaive
2817
2817
$begingroup$
I know different tools and API( not the deep understanding). My concern is -having multiple output in output layer. How would common loss function look like.( As now NN has to minimize multiple loss functions.. Will this be possible also?
$endgroup$
– Arpit Sisodia
Jun 18 '18 at 6:15
$begingroup$
@ArpitSisodia Edit you question accordingly. It doesn't exactly reflect what you are asking.
$endgroup$
– naive
Jun 18 '18 at 6:46
$begingroup$
sure @Naive. anyway R2N2 is useful, I need to read this paper.
$endgroup$
– Arpit Sisodia
Jun 18 '18 at 7:45
add a comment |
$begingroup$
I know different tools and API( not the deep understanding). My concern is -having multiple output in output layer. How would common loss function look like.( As now NN has to minimize multiple loss functions.. Will this be possible also?
$endgroup$
– Arpit Sisodia
Jun 18 '18 at 6:15
$begingroup$
@ArpitSisodia Edit you question accordingly. It doesn't exactly reflect what you are asking.
$endgroup$
– naive
Jun 18 '18 at 6:46
$begingroup$
sure @Naive. anyway R2N2 is useful, I need to read this paper.
$endgroup$
– Arpit Sisodia
Jun 18 '18 at 7:45
$begingroup$
I know different tools and API( not the deep understanding). My concern is -having multiple output in output layer. How would common loss function look like.( As now NN has to minimize multiple loss functions.. Will this be possible also?
$endgroup$
– Arpit Sisodia
Jun 18 '18 at 6:15
$begingroup$
I know different tools and API( not the deep understanding). My concern is -having multiple output in output layer. How would common loss function look like.( As now NN has to minimize multiple loss functions.. Will this be possible also?
$endgroup$
– Arpit Sisodia
Jun 18 '18 at 6:15
$begingroup$
@ArpitSisodia Edit you question accordingly. It doesn't exactly reflect what you are asking.
$endgroup$
– naive
Jun 18 '18 at 6:46
$begingroup$
@ArpitSisodia Edit you question accordingly. It doesn't exactly reflect what you are asking.
$endgroup$
– naive
Jun 18 '18 at 6:46
$begingroup$
sure @Naive. anyway R2N2 is useful, I need to read this paper.
$endgroup$
– Arpit Sisodia
Jun 18 '18 at 7:45
$begingroup$
sure @Naive. anyway R2N2 is useful, I need to read this paper.
$endgroup$
– Arpit Sisodia
Jun 18 '18 at 7:45
add a comment |
Thanks for contributing an answer to Data Science Stack Exchange!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
Use MathJax to format equations. MathJax reference.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fdatascience.stackexchange.com%2fquestions%2f33143%2fhow-to-build-non-linear-vector-auto-regression-using-neural-nets%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
