Looking for a proper reinforcement learning solution Announcing the arrival of Valued Associate #679: Cesar Manara Planned maintenance scheduled April 17/18, 2019 at 00:00UTC (8:00pm US/Eastern) 2019 Moderator Election Q&A - Questionnaire 2019 Community Moderator Election Resultslearning rate in reinforcement learningCooperative Reinforcement LearningWhat is Reinforcement Learning?Understanding advantage functionsReinforcement learning, pendulum pythonReinforcement learning for continuous (rather than discrete) actionsReinforcement Learning different patientsCan Reinforcement Learning work for Dutch auctions?Reinforcement Learning - What's the formula for the value functionReinforcement Learning (Q Learning)

How did the aliens keep their waters separated?

Can smartphones with the same camera sensor have different image quality?

How many spell slots should a Fighter 11/Ranger 9 have?

Single author papers against my advisor's will?

Using "nakedly" instead of "with nothing on"

Is there folklore associating late breastfeeding with low intelligence and/or gullibility?

Is above average number of years spent on PhD considered a red flag in future academia or industry positions?

Limit for e and 1/e

Mortgage adviser recommends a longer term than necessary combined with overpayments

What kind of display is this?

How to colour the US map with Yellow, Green, Red and Blue to minimize the number of states with the colour of Green

3 doors, three guards, one stone

Antler Helmet: Can it work?

Slither Like a Snake

Losing the Initialization Vector in Cipher Block Chaining

What's the point in a preamp?

Simulating Exploding Dice

Working around an AWS network ACL rule limit

Can a zero nonce be safely used with AES-GCM if the key is random and never used again?

How to retrograde a note sequence in Finale?

How are presidential pardons supposed to be used?

Can the prologue be the backstory of your main character?

I'm having difficulty getting my players to do stuff in a sandbox campaign

What is the largest species of polychaete?



Looking for a proper reinforcement learning solution



Announcing the arrival of Valued Associate #679: Cesar Manara
Planned maintenance scheduled April 17/18, 2019 at 00:00UTC (8:00pm US/Eastern)
2019 Moderator Election Q&A - Questionnaire
2019 Community Moderator Election Resultslearning rate in reinforcement learningCooperative Reinforcement LearningWhat is Reinforcement Learning?Understanding advantage functionsReinforcement learning, pendulum pythonReinforcement learning for continuous (rather than discrete) actionsReinforcement Learning different patientsCan Reinforcement Learning work for Dutch auctions?Reinforcement Learning - What's the formula for the value functionReinforcement Learning (Q Learning)










0












$begingroup$


I am looking for a proper reinforcement learning solution for the following problem:



Suppose I have a pool of candidate functions f in Pool(it's like f1, f2, ... fn), and I am trying to synthesize several sequences of functions, each sequence contains arbitrary amount of f.



Given a sequence s, when deciding whether to extend s by appending a new function f and forming a new sequence s' = sf, I have the following reward scheme:



  1. when F(s') = true, reward += 1


  2. when T(s') = true, reward += 3


  3. every time the sequence grows by one, I try to penalize by reward -= 0.5


In other words, I don't want each sequence s to be too long, but also will consider cases when special property F and T are satisfied.



I view this as a learning problem, and envision it can be solved by reinforcement learning techniques, such as DQN or so. But I am a newbie to this field and find it difficult for me to formalize this problem. Could anyone can shed some lights on this and what kind of reinforcement learning algorithms/scheme I can have a try? Thanks a lot. Any suggestion or advice will be appreciated.










share|improve this question







New contributor




lllllllllllll is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.







$endgroup$
















    0












    $begingroup$


    I am looking for a proper reinforcement learning solution for the following problem:



    Suppose I have a pool of candidate functions f in Pool(it's like f1, f2, ... fn), and I am trying to synthesize several sequences of functions, each sequence contains arbitrary amount of f.



    Given a sequence s, when deciding whether to extend s by appending a new function f and forming a new sequence s' = sf, I have the following reward scheme:



    1. when F(s') = true, reward += 1


    2. when T(s') = true, reward += 3


    3. every time the sequence grows by one, I try to penalize by reward -= 0.5


    In other words, I don't want each sequence s to be too long, but also will consider cases when special property F and T are satisfied.



    I view this as a learning problem, and envision it can be solved by reinforcement learning techniques, such as DQN or so. But I am a newbie to this field and find it difficult for me to formalize this problem. Could anyone can shed some lights on this and what kind of reinforcement learning algorithms/scheme I can have a try? Thanks a lot. Any suggestion or advice will be appreciated.










    share|improve this question







    New contributor




    lllllllllllll is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
    Check out our Code of Conduct.







    $endgroup$














      0












      0








      0





      $begingroup$


      I am looking for a proper reinforcement learning solution for the following problem:



      Suppose I have a pool of candidate functions f in Pool(it's like f1, f2, ... fn), and I am trying to synthesize several sequences of functions, each sequence contains arbitrary amount of f.



      Given a sequence s, when deciding whether to extend s by appending a new function f and forming a new sequence s' = sf, I have the following reward scheme:



      1. when F(s') = true, reward += 1


      2. when T(s') = true, reward += 3


      3. every time the sequence grows by one, I try to penalize by reward -= 0.5


      In other words, I don't want each sequence s to be too long, but also will consider cases when special property F and T are satisfied.



      I view this as a learning problem, and envision it can be solved by reinforcement learning techniques, such as DQN or so. But I am a newbie to this field and find it difficult for me to formalize this problem. Could anyone can shed some lights on this and what kind of reinforcement learning algorithms/scheme I can have a try? Thanks a lot. Any suggestion or advice will be appreciated.










      share|improve this question







      New contributor




      lllllllllllll is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
      Check out our Code of Conduct.







      $endgroup$




      I am looking for a proper reinforcement learning solution for the following problem:



      Suppose I have a pool of candidate functions f in Pool(it's like f1, f2, ... fn), and I am trying to synthesize several sequences of functions, each sequence contains arbitrary amount of f.



      Given a sequence s, when deciding whether to extend s by appending a new function f and forming a new sequence s' = sf, I have the following reward scheme:



      1. when F(s') = true, reward += 1


      2. when T(s') = true, reward += 3


      3. every time the sequence grows by one, I try to penalize by reward -= 0.5


      In other words, I don't want each sequence s to be too long, but also will consider cases when special property F and T are satisfied.



      I view this as a learning problem, and envision it can be solved by reinforcement learning techniques, such as DQN or so. But I am a newbie to this field and find it difficult for me to formalize this problem. Could anyone can shed some lights on this and what kind of reinforcement learning algorithms/scheme I can have a try? Thanks a lot. Any suggestion or advice will be appreciated.







      reinforcement-learning






      share|improve this question







      New contributor




      lllllllllllll is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
      Check out our Code of Conduct.











      share|improve this question







      New contributor




      lllllllllllll is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
      Check out our Code of Conduct.









      share|improve this question




      share|improve this question






      New contributor




      lllllllllllll is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
      Check out our Code of Conduct.









      asked 28 mins ago









      llllllllllllllllllllllllll

      1012




      1012




      New contributor




      lllllllllllll is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
      Check out our Code of Conduct.





      New contributor





      lllllllllllll is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
      Check out our Code of Conduct.






      lllllllllllll is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
      Check out our Code of Conduct.




















          0






          active

          oldest

          votes












          Your Answer








          StackExchange.ready(function()
          var channelOptions =
          tags: "".split(" "),
          id: "557"
          ;
          initTagRenderer("".split(" "), "".split(" "), channelOptions);

          StackExchange.using("externalEditor", function()
          // Have to fire editor after snippets, if snippets enabled
          if (StackExchange.settings.snippets.snippetsEnabled)
          StackExchange.using("snippets", function()
          createEditor();
          );

          else
          createEditor();

          );

          function createEditor()
          StackExchange.prepareEditor(
          heartbeatType: 'answer',
          autoActivateHeartbeat: false,
          convertImagesToLinks: false,
          noModals: true,
          showLowRepImageUploadWarning: true,
          reputationToPostImages: null,
          bindNavPrevention: true,
          postfix: "",
          imageUploader:
          brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
          contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
          allowUrls: true
          ,
          onDemand: true,
          discardSelector: ".discard-answer"
          ,immediatelyShowMarkdownHelp:true
          );



          );






          lllllllllllll is a new contributor. Be nice, and check out our Code of Conduct.









          draft saved

          draft discarded


















          StackExchange.ready(
          function ()
          StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fdatascience.stackexchange.com%2fquestions%2f49294%2flooking-for-a-proper-reinforcement-learning-solution%23new-answer', 'question_page');

          );

          Post as a guest















          Required, but never shown

























          0






          active

          oldest

          votes








          0






          active

          oldest

          votes









          active

          oldest

          votes






          active

          oldest

          votes








          lllllllllllll is a new contributor. Be nice, and check out our Code of Conduct.









          draft saved

          draft discarded


















          lllllllllllll is a new contributor. Be nice, and check out our Code of Conduct.












          lllllllllllll is a new contributor. Be nice, and check out our Code of Conduct.











          lllllllllllll is a new contributor. Be nice, and check out our Code of Conduct.














          Thanks for contributing an answer to Data Science Stack Exchange!


          • Please be sure to answer the question. Provide details and share your research!

          But avoid


          • Asking for help, clarification, or responding to other answers.

          • Making statements based on opinion; back them up with references or personal experience.

          Use MathJax to format equations. MathJax reference.


          To learn more, see our tips on writing great answers.




          draft saved


          draft discarded














          StackExchange.ready(
          function ()
          StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fdatascience.stackexchange.com%2fquestions%2f49294%2flooking-for-a-proper-reinforcement-learning-solution%23new-answer', 'question_page');

          );

          Post as a guest















          Required, but never shown





















































          Required, but never shown














          Required, but never shown












          Required, but never shown







          Required, but never shown

































          Required, but never shown














          Required, but never shown












          Required, but never shown







          Required, but never shown







          Popular posts from this blog

          Ружовы пелікан Змест Знешні выгляд | Пашырэнне | Асаблівасці біялогіі | Літаратура | НавігацыяДагледжаная версіяправерана1 зменаДагледжаная версіяправерана1 змена/ 22697590 Сістэматыкана ВіківідахВыявына Вікісховішчы174693363011049382

          ValueError: Error when checking input: expected conv2d_13_input to have shape (3, 150, 150) but got array with shape (150, 150, 3)2019 Community Moderator ElectionError when checking : expected dense_1_input to have shape (None, 5) but got array with shape (200, 1)Error 'Expected 2D array, got 1D array instead:'ValueError: Error when checking input: expected lstm_41_input to have 3 dimensions, but got array with shape (40000,100)ValueError: Error when checking target: expected dense_1 to have shape (7,) but got array with shape (1,)ValueError: Error when checking target: expected dense_2 to have shape (1,) but got array with shape (0,)Keras exception: ValueError: Error when checking input: expected conv2d_1_input to have shape (150, 150, 3) but got array with shape (256, 256, 3)Steps taking too long to completewhen checking input: expected dense_1_input to have shape (13328,) but got array with shape (317,)ValueError: Error when checking target: expected dense_3 to have shape (None, 1) but got array with shape (7715, 40000)Keras exception: Error when checking input: expected dense_input to have shape (2,) but got array with shape (1,)

          Illegal assignment from SObject to ContactFetching String, Id from Map - Illegal Assignment Id to Field / ObjectError: Compile Error: Illegal assignment from String to BooleanError: List has no rows for assignment to SObjectError on Test Class - System.QueryException: List has no rows for assignment to SObjectRemote action problemDML requires SObject or SObject list type error“Illegal assignment from List to List”Test Class Fail: Batch Class: System.QueryException: List has no rows for assignment to SObjectMapping to a user'List has no rows for assignment to SObject' Mystery