Can someone please explain what this sample function is upto? Announcing the arrival of Valued Associate #679: Cesar Manara Planned maintenance scheduled April 23, 2019 at 23:30 UTC (7:30pm US/Eastern) 2019 Moderator Election Q&A - Questionnaire 2019 Community Moderator Election ResultsCan someone explain the following error in my python code?How should I analyze this data from reddit (sample text included)What type of a problem is this?What Naive Bayes method is being used in this example?Please help me out with this Python error - 'invalid syntax'How can I prevent this model to learn more(less) :)))Can ReLU replace a Sigmoid Activation Function in Neural NetworkWhy xgboost can not deal with this simple sentence case?Can this be a case of multi-class skewness?

Central Vacuuming: Is it worth it, and how does it compare to normal vacuuming?

Co-worker has annoying ringtone

A term for a woman complaining about things/begging in a cute/childish way

Project Euler #1 in C++

How to write capital alpha?

How can I prevent/balance waiting and turtling as a response to cooldown mechanics

The test team as an enemy of development? And how can this be avoided?

What is the meaning of 'breadth' in breadth first search?

Trademark violation for app?

How do living politicians protect their readily obtainable signatures from misuse?

Is there public access to the Meteor Crater in Arizona?

Why is it faster to reheat something than it is to cook it?

Flight departed from the gate 5 min before scheduled departure time. Refund options

Tannaka duality for semisimple groups

If Windows 7 doesn't support WSL, then what is "Subsystem for UNIX-based Applications"?

What are the discoveries that have been possible with the rejection of positivism?

Deconstruction is ambiguous

How does Belgium enforce obligatory attendance in elections?

Has negative voting ever been officially implemented in elections, or seriously proposed, or even studied?

Sum letters are not two different

One-one communication

Does the Mueller report show a conspiracy between Russia and the Trump Campaign?

Why can't I install Tomboy in Ubuntu Mate 19.04?

Why weren't discrete x86 CPUs ever used in game hardware?



Can someone please explain what this sample function is upto?



Announcing the arrival of Valued Associate #679: Cesar Manara
Planned maintenance scheduled April 23, 2019 at 23:30 UTC (7:30pm US/Eastern)
2019 Moderator Election Q&A - Questionnaire
2019 Community Moderator Election ResultsCan someone explain the following error in my python code?How should I analyze this data from reddit (sample text included)What type of a problem is this?What Naive Bayes method is being used in this example?Please help me out with this Python error - 'invalid syntax'How can I prevent this model to learn more(less) :)))Can ReLU replace a Sigmoid Activation Function in Neural NetworkWhy xgboost can not deal with this simple sentence case?Can this be a case of multi-class skewness?










3












$begingroup$


So there is a function in Dino_Name_Generator at Deeplearning.ai notebook



def sample(parameters, char_to_ix, seed): 
# Retrieve parameters and relevant shapes from "parameters" dictionary
Waa, Wax, Wya, by, b = parameters['Waa'], parameters['Wax'],parameters['Wya'], parameters['by'], parameters['b']
vocab_size = by.shape[0]
n_a = Waa.shape[1]

### START CODE HERE ###
# Step 1: Create the one-hot vector x for the first character (initializing the sequence generation). (≈1 line)
x = np.zeros((vocab_size, 1))

# Step 1': Initialize a_prev as zeros (≈1 line)
a_prev = np.zeros((n_a, 1))

# Create an empty list of indices, this is the list which will contain the list of indices of the characters to generate (≈1 line)
indices = []

# Idx is a flag to detect a newline character, we initialize it to -1
idx = -1

# Loop over time-steps t. At each time-step, sample a character from a probability distribution and append
# its index to "indices". We'll stop if we reach 50 characters (which should be very unlikely with a well
# trained model), which helps debugging and prevents entering an infinite loop.
counter = 0
newline_character = char_to_ix['n']

while (idx != newline_character and counter != 50):

# Step 2: Forward propagate x using the equations (1), (2) and (3)
a = np.tanh(np.dot(Wax, x) + np.dot(Waa, a_prev) + b)
z = np.dot(Wya, a) + by
y = softmax(z)

# for grading purposes
np.random.seed(counter+seed)

# Step 3: Sample the index of a character within the vocabulary from the probability distribution y
idx = np.random.choice(vocab_size, size=None, p = y.ravel())

# Append the index to "indices"
indices.append(idx)

# Step 4: Overwrite the input character as the one corresponding to the sampled index.
x = np.zeros((vocab_size, 1))
x[[idx]] = 1

# Update "a_prev" to be "a"
a_prev = a

# for grading purposes
seed += 1
counter +=1


### END CODE HERE ###

if (counter == 50):
indices.append(char_to_ix['n'])

return indices


Can someone please help and explain what benefit of returned indices over normal char_to_integer indices?



I want to understand the text processing in the link carried out before feeding into the network.










share|improve this question











$endgroup$




bumped to the homepage by Community 24 mins ago


This question has answers that may be good or bad; the system has marked it active so that they can be reviewed.



















    3












    $begingroup$


    So there is a function in Dino_Name_Generator at Deeplearning.ai notebook



    def sample(parameters, char_to_ix, seed): 
    # Retrieve parameters and relevant shapes from "parameters" dictionary
    Waa, Wax, Wya, by, b = parameters['Waa'], parameters['Wax'],parameters['Wya'], parameters['by'], parameters['b']
    vocab_size = by.shape[0]
    n_a = Waa.shape[1]

    ### START CODE HERE ###
    # Step 1: Create the one-hot vector x for the first character (initializing the sequence generation). (≈1 line)
    x = np.zeros((vocab_size, 1))

    # Step 1': Initialize a_prev as zeros (≈1 line)
    a_prev = np.zeros((n_a, 1))

    # Create an empty list of indices, this is the list which will contain the list of indices of the characters to generate (≈1 line)
    indices = []

    # Idx is a flag to detect a newline character, we initialize it to -1
    idx = -1

    # Loop over time-steps t. At each time-step, sample a character from a probability distribution and append
    # its index to "indices". We'll stop if we reach 50 characters (which should be very unlikely with a well
    # trained model), which helps debugging and prevents entering an infinite loop.
    counter = 0
    newline_character = char_to_ix['n']

    while (idx != newline_character and counter != 50):

    # Step 2: Forward propagate x using the equations (1), (2) and (3)
    a = np.tanh(np.dot(Wax, x) + np.dot(Waa, a_prev) + b)
    z = np.dot(Wya, a) + by
    y = softmax(z)

    # for grading purposes
    np.random.seed(counter+seed)

    # Step 3: Sample the index of a character within the vocabulary from the probability distribution y
    idx = np.random.choice(vocab_size, size=None, p = y.ravel())

    # Append the index to "indices"
    indices.append(idx)

    # Step 4: Overwrite the input character as the one corresponding to the sampled index.
    x = np.zeros((vocab_size, 1))
    x[[idx]] = 1

    # Update "a_prev" to be "a"
    a_prev = a

    # for grading purposes
    seed += 1
    counter +=1


    ### END CODE HERE ###

    if (counter == 50):
    indices.append(char_to_ix['n'])

    return indices


    Can someone please help and explain what benefit of returned indices over normal char_to_integer indices?



    I want to understand the text processing in the link carried out before feeding into the network.










    share|improve this question











    $endgroup$




    bumped to the homepage by Community 24 mins ago


    This question has answers that may be good or bad; the system has marked it active so that they can be reviewed.

















      3












      3








      3





      $begingroup$


      So there is a function in Dino_Name_Generator at Deeplearning.ai notebook



      def sample(parameters, char_to_ix, seed): 
      # Retrieve parameters and relevant shapes from "parameters" dictionary
      Waa, Wax, Wya, by, b = parameters['Waa'], parameters['Wax'],parameters['Wya'], parameters['by'], parameters['b']
      vocab_size = by.shape[0]
      n_a = Waa.shape[1]

      ### START CODE HERE ###
      # Step 1: Create the one-hot vector x for the first character (initializing the sequence generation). (≈1 line)
      x = np.zeros((vocab_size, 1))

      # Step 1': Initialize a_prev as zeros (≈1 line)
      a_prev = np.zeros((n_a, 1))

      # Create an empty list of indices, this is the list which will contain the list of indices of the characters to generate (≈1 line)
      indices = []

      # Idx is a flag to detect a newline character, we initialize it to -1
      idx = -1

      # Loop over time-steps t. At each time-step, sample a character from a probability distribution and append
      # its index to "indices". We'll stop if we reach 50 characters (which should be very unlikely with a well
      # trained model), which helps debugging and prevents entering an infinite loop.
      counter = 0
      newline_character = char_to_ix['n']

      while (idx != newline_character and counter != 50):

      # Step 2: Forward propagate x using the equations (1), (2) and (3)
      a = np.tanh(np.dot(Wax, x) + np.dot(Waa, a_prev) + b)
      z = np.dot(Wya, a) + by
      y = softmax(z)

      # for grading purposes
      np.random.seed(counter+seed)

      # Step 3: Sample the index of a character within the vocabulary from the probability distribution y
      idx = np.random.choice(vocab_size, size=None, p = y.ravel())

      # Append the index to "indices"
      indices.append(idx)

      # Step 4: Overwrite the input character as the one corresponding to the sampled index.
      x = np.zeros((vocab_size, 1))
      x[[idx]] = 1

      # Update "a_prev" to be "a"
      a_prev = a

      # for grading purposes
      seed += 1
      counter +=1


      ### END CODE HERE ###

      if (counter == 50):
      indices.append(char_to_ix['n'])

      return indices


      Can someone please help and explain what benefit of returned indices over normal char_to_integer indices?



      I want to understand the text processing in the link carried out before feeding into the network.










      share|improve this question











      $endgroup$




      So there is a function in Dino_Name_Generator at Deeplearning.ai notebook



      def sample(parameters, char_to_ix, seed): 
      # Retrieve parameters and relevant shapes from "parameters" dictionary
      Waa, Wax, Wya, by, b = parameters['Waa'], parameters['Wax'],parameters['Wya'], parameters['by'], parameters['b']
      vocab_size = by.shape[0]
      n_a = Waa.shape[1]

      ### START CODE HERE ###
      # Step 1: Create the one-hot vector x for the first character (initializing the sequence generation). (≈1 line)
      x = np.zeros((vocab_size, 1))

      # Step 1': Initialize a_prev as zeros (≈1 line)
      a_prev = np.zeros((n_a, 1))

      # Create an empty list of indices, this is the list which will contain the list of indices of the characters to generate (≈1 line)
      indices = []

      # Idx is a flag to detect a newline character, we initialize it to -1
      idx = -1

      # Loop over time-steps t. At each time-step, sample a character from a probability distribution and append
      # its index to "indices". We'll stop if we reach 50 characters (which should be very unlikely with a well
      # trained model), which helps debugging and prevents entering an infinite loop.
      counter = 0
      newline_character = char_to_ix['n']

      while (idx != newline_character and counter != 50):

      # Step 2: Forward propagate x using the equations (1), (2) and (3)
      a = np.tanh(np.dot(Wax, x) + np.dot(Waa, a_prev) + b)
      z = np.dot(Wya, a) + by
      y = softmax(z)

      # for grading purposes
      np.random.seed(counter+seed)

      # Step 3: Sample the index of a character within the vocabulary from the probability distribution y
      idx = np.random.choice(vocab_size, size=None, p = y.ravel())

      # Append the index to "indices"
      indices.append(idx)

      # Step 4: Overwrite the input character as the one corresponding to the sampled index.
      x = np.zeros((vocab_size, 1))
      x[[idx]] = 1

      # Update "a_prev" to be "a"
      a_prev = a

      # for grading purposes
      seed += 1
      counter +=1


      ### END CODE HERE ###

      if (counter == 50):
      indices.append(char_to_ix['n'])

      return indices


      Can someone please help and explain what benefit of returned indices over normal char_to_integer indices?



      I want to understand the text processing in the link carried out before feeding into the network.







      python data-cleaning probability numpy text-generation






      share|improve this question















      share|improve this question













      share|improve this question




      share|improve this question








      edited Sep 20 '18 at 21:58







      thanatoz

















      asked Sep 20 '18 at 21:34









      thanatozthanatoz

      684421




      684421





      bumped to the homepage by Community 24 mins ago


      This question has answers that may be good or bad; the system has marked it active so that they can be reviewed.







      bumped to the homepage by Community 24 mins ago


      This question has answers that may be good or bad; the system has marked it active so that they can be reviewed.






















          1 Answer
          1






          active

          oldest

          votes


















          0












          $begingroup$

          From the link you provided:




          Sample a sequence of characters according to a sequence of probability
          distributions output of the RNN



          Arguments:
          parameters -- python dictionary containing the parameters Waa, Wax, Wya, by, and b.
          char_to_ix -- python dictionary mapping each character to an index.



          Returns:
          indices -- a list of length n containing the indices of the sampled characters




          You are returning the indices from a dictionary you gave as argument. Why should you use char_to_integer indices.






          share|improve this answer











          $endgroup$












          • $begingroup$
            I want to understand how this returned indices are transforming text data entered for feeding it into the network?
            $endgroup$
            – thanatoz
            Sep 20 '18 at 21:55












          Your Answer








          StackExchange.ready(function()
          var channelOptions =
          tags: "".split(" "),
          id: "557"
          ;
          initTagRenderer("".split(" "), "".split(" "), channelOptions);

          StackExchange.using("externalEditor", function()
          // Have to fire editor after snippets, if snippets enabled
          if (StackExchange.settings.snippets.snippetsEnabled)
          StackExchange.using("snippets", function()
          createEditor();
          );

          else
          createEditor();

          );

          function createEditor()
          StackExchange.prepareEditor(
          heartbeatType: 'answer',
          autoActivateHeartbeat: false,
          convertImagesToLinks: false,
          noModals: true,
          showLowRepImageUploadWarning: true,
          reputationToPostImages: null,
          bindNavPrevention: true,
          postfix: "",
          imageUploader:
          brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
          contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
          allowUrls: true
          ,
          onDemand: true,
          discardSelector: ".discard-answer"
          ,immediatelyShowMarkdownHelp:true
          );



          );













          draft saved

          draft discarded


















          StackExchange.ready(
          function ()
          StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fdatascience.stackexchange.com%2fquestions%2f38577%2fcan-someone-please-explain-what-this-sample-function-is-upto%23new-answer', 'question_page');

          );

          Post as a guest















          Required, but never shown

























          1 Answer
          1






          active

          oldest

          votes








          1 Answer
          1






          active

          oldest

          votes









          active

          oldest

          votes






          active

          oldest

          votes









          0












          $begingroup$

          From the link you provided:




          Sample a sequence of characters according to a sequence of probability
          distributions output of the RNN



          Arguments:
          parameters -- python dictionary containing the parameters Waa, Wax, Wya, by, and b.
          char_to_ix -- python dictionary mapping each character to an index.



          Returns:
          indices -- a list of length n containing the indices of the sampled characters




          You are returning the indices from a dictionary you gave as argument. Why should you use char_to_integer indices.






          share|improve this answer











          $endgroup$












          • $begingroup$
            I want to understand how this returned indices are transforming text data entered for feeding it into the network?
            $endgroup$
            – thanatoz
            Sep 20 '18 at 21:55
















          0












          $begingroup$

          From the link you provided:




          Sample a sequence of characters according to a sequence of probability
          distributions output of the RNN



          Arguments:
          parameters -- python dictionary containing the parameters Waa, Wax, Wya, by, and b.
          char_to_ix -- python dictionary mapping each character to an index.



          Returns:
          indices -- a list of length n containing the indices of the sampled characters




          You are returning the indices from a dictionary you gave as argument. Why should you use char_to_integer indices.






          share|improve this answer











          $endgroup$












          • $begingroup$
            I want to understand how this returned indices are transforming text data entered for feeding it into the network?
            $endgroup$
            – thanatoz
            Sep 20 '18 at 21:55














          0












          0








          0





          $begingroup$

          From the link you provided:




          Sample a sequence of characters according to a sequence of probability
          distributions output of the RNN



          Arguments:
          parameters -- python dictionary containing the parameters Waa, Wax, Wya, by, and b.
          char_to_ix -- python dictionary mapping each character to an index.



          Returns:
          indices -- a list of length n containing the indices of the sampled characters




          You are returning the indices from a dictionary you gave as argument. Why should you use char_to_integer indices.






          share|improve this answer











          $endgroup$



          From the link you provided:




          Sample a sequence of characters according to a sequence of probability
          distributions output of the RNN



          Arguments:
          parameters -- python dictionary containing the parameters Waa, Wax, Wya, by, and b.
          char_to_ix -- python dictionary mapping each character to an index.



          Returns:
          indices -- a list of length n containing the indices of the sampled characters




          You are returning the indices from a dictionary you gave as argument. Why should you use char_to_integer indices.







          share|improve this answer














          share|improve this answer



          share|improve this answer








          edited Sep 20 '18 at 21:56

























          answered Sep 20 '18 at 21:49









          Francesco PegoraroFrancesco Pegoraro

          614118




          614118











          • $begingroup$
            I want to understand how this returned indices are transforming text data entered for feeding it into the network?
            $endgroup$
            – thanatoz
            Sep 20 '18 at 21:55

















          • $begingroup$
            I want to understand how this returned indices are transforming text data entered for feeding it into the network?
            $endgroup$
            – thanatoz
            Sep 20 '18 at 21:55
















          $begingroup$
          I want to understand how this returned indices are transforming text data entered for feeding it into the network?
          $endgroup$
          – thanatoz
          Sep 20 '18 at 21:55





          $begingroup$
          I want to understand how this returned indices are transforming text data entered for feeding it into the network?
          $endgroup$
          – thanatoz
          Sep 20 '18 at 21:55


















          draft saved

          draft discarded
















































          Thanks for contributing an answer to Data Science Stack Exchange!


          • Please be sure to answer the question. Provide details and share your research!

          But avoid


          • Asking for help, clarification, or responding to other answers.

          • Making statements based on opinion; back them up with references or personal experience.

          Use MathJax to format equations. MathJax reference.


          To learn more, see our tips on writing great answers.




          draft saved


          draft discarded














          StackExchange.ready(
          function ()
          StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fdatascience.stackexchange.com%2fquestions%2f38577%2fcan-someone-please-explain-what-this-sample-function-is-upto%23new-answer', 'question_page');

          );

          Post as a guest















          Required, but never shown





















































          Required, but never shown














          Required, but never shown












          Required, but never shown







          Required, but never shown

































          Required, but never shown














          Required, but never shown












          Required, but never shown







          Required, but never shown







          Popular posts from this blog

          Францішак Багушэвіч Змест Сям'я | Біяграфія | Творчасць | Мова Багушэвіча | Ацэнкі дзейнасці | Цікавыя факты | Спадчына | Выбраная бібліяграфія | Ушанаванне памяці | У філатэліі | Зноскі | Літаратура | Спасылкі | НавігацыяЛяхоўскі У. Рупіўся дзеля Бога і людзей: Жыццёвы шлях Лявона Вітан-Дубейкаўскага // Вольскі і Памідораў з песняй пра немца Адвакат, паэт, народны заступнік Ашмянскі веснікВ Минске появится площадь Богушевича и улица Сырокомли, Белорусская деловая газета, 19 июля 2001 г.Айцец беларускай нацыянальнай ідэі паўстаў у бронзе Сяргей Аляксандравіч Адашкевіч (1918, Мінск). 80-я гады. Бюст «Францішак Багушэвіч».Яўген Мікалаевіч Ціхановіч. «Партрэт Францішка Багушэвіча»Мікола Мікалаевіч Купава. «Партрэт зачынальніка новай беларускай літаратуры Францішка Багушэвіча»Уладзімір Іванавіч Мелехаў. На помніку «Змагарам за родную мову» Барэльеф «Францішак Багушэвіч»Памяць пра Багушэвіча на Віленшчыне Страчаная сталіца. Беларускія шыльды на вуліцах Вільні«Krynica». Ideologia i przywódcy białoruskiego katolicyzmuФранцішак БагушэвічТворы на knihi.comТворы Францішка Багушэвіча на bellib.byСодаль Уладзімір. Францішак Багушэвіч на Лідчыне;Луцкевіч Антон. Жыцьцё і творчасьць Фр. Багушэвіча ў успамінах ягоных сучасьнікаў // Запісы Беларускага Навуковага таварыства. Вільня, 1938. Сшытак 1. С. 16-34.Большая российская1188761710000 0000 5537 633Xn9209310021619551927869394п

          Partai Komunis Tiongkok Daftar isi Kepemimpinan | Pranala luar | Referensi | Menu navigasidiperiksa1 perubahan tertundacpc.people.com.cnSitus resmiSurat kabar resmi"Why the Communist Party is alive, well and flourishing in China"0307-1235"Full text of Constitution of Communist Party of China"smengembangkannyas

          ValueError: Expected n_neighbors <= n_samples, but n_samples = 1, n_neighbors = 6 (SMOTE) The 2019 Stack Overflow Developer Survey Results Are InCan SMOTE be applied over sequence of words (sentences)?ValueError when doing validation with random forestsSMOTE and multi class oversamplingLogic behind SMOTE-NC?ValueError: Error when checking target: expected dense_1 to have shape (7,) but got array with shape (1,)SmoteBoost: Should SMOTE be ran individually for each iteration/tree in the boosting?solving multi-class imbalance classification using smote and OSSUsing SMOTE for Synthetic Data generation to improve performance on unbalanced dataproblem of entry format for a simple model in KerasSVM SMOTE fit_resample() function runs forever with no result