Please god help me with my training data Unicorn Meta Zoo #1: Why another podcast? Announcing the arrival of Valued Associate #679: Cesar Manara 2019 Moderator Election Q&A - Questionnaire 2019 Community Moderator Election ResultsSKNN regression problemTensorflow regression predicting 1 for all inputsHelp with training XGBNeural network accuracy for simple classificationSimple prediction with KerasMy Neural network in Tensorflow does a bad job in comparison to the same Neural network in KerasTraining Accuracy stuck in KerasValue error in Merging two different models in kerasSolving an ODE using neural networks (via Tensorflow)Something is disastrously wrong with my neural network and what it's produced

How can I wire a 9-position switch so that each position turns on one more LED than the one before?

How to have a sharp product image?

How important is it that $TERM is correct?

Bayes factor vs P value

Island of Knights, Knaves and Spies

How do I check if a string is entirely made of the same substring?

How long after the last departure shall the airport stay open for an emergency return?

Drawing a german abacus as in the books of Adam Ries

Was Dennis Ritchie being too modest in this quote about C and Pascal?

What is purpose of DB Browser(dbbrowser.aspx) under admin tool?

Complex numbers z=-3-4i polar form

What *exactly* is electrical current, voltage, and resistance?

Scheduling based problem

Co-worker works way more than he should

All ASCII characters with a given bit count

How to not starve gigantic beasts

Mistake in years of experience in resume?

Is there really no use for MD5 anymore?

Ramp colors through selected symbols in QGIS?

Crossed out red box fitting tightly around image

Sharepoint Designer Discontinuation - software to modify existing workflows

Why did C use the -> operator instead of reusing the . operator?

Is Diceware more secure than a long passphrase?

Multiple fireplaces in an apartment building?



Please god help me with my training data



Unicorn Meta Zoo #1: Why another podcast?
Announcing the arrival of Valued Associate #679: Cesar Manara
2019 Moderator Election Q&A - Questionnaire
2019 Community Moderator Election ResultsSKNN regression problemTensorflow regression predicting 1 for all inputsHelp with training XGBNeural network accuracy for simple classificationSimple prediction with KerasMy Neural network in Tensorflow does a bad job in comparison to the same Neural network in KerasTraining Accuracy stuck in KerasValue error in Merging two different models in kerasSolving an ODE using neural networks (via Tensorflow)Something is disastrously wrong with my neural network and what it's produced










0












$begingroup$


Im working on my first NN following a tensorflow tut and trying to use my own data.
After about 80 attempts of formatting my data and trying to load it into a dataset to train im throwing in the towel.



Here is how my data currently looks



syslog_data = [
[302014,0,0,63878,30,3,1], [302014,0,0,3891,0,0,0], [302014,0,0,15928,0,0,2], [305013,5,0,123,99999,0,3],
[302014,0,0,5185,0,0,0], [305013,5,0,123,99999,0,3], [302014,0,0,56085,0,0,0], [110002,4,2,50074,99999,0,4],


In this the last item in each list is the label.
If you can tell me if I need to reformat my data and how or just how to get it loaded into a dataset properly.



Thanks for any help or advice you can give



Here is the full code:



import tensorflow as tf
import numpy as np
from tensorflow.keras import layers
from . import syslog

print(tf.VERSION)
print(tf.keras.__version__)

model = tf.keras.Sequential()
# Adds a densely-connected layer with 64 units to the model:
model.add(layers.Dense(64, activation='relu'))
# Add another:
model.add(layers.Dense(64, activation='relu'))
# Add a softmax layer with 10 output units:
model.add(layers.Dense(10, activation='softmax'))

model.compile(optimizer=tf.train.AdamOptimizer(0.001),
loss='categorical_crossentropy',
metrics=['accuracy'])

dataset = tf.data.dataset.from_tensor_slices(syslog)

model.fit(dataset, epochs=10, steps_per_epoch=30)









share|improve this question







New contributor




Alex F is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.







$endgroup$
















    0












    $begingroup$


    Im working on my first NN following a tensorflow tut and trying to use my own data.
    After about 80 attempts of formatting my data and trying to load it into a dataset to train im throwing in the towel.



    Here is how my data currently looks



    syslog_data = [
    [302014,0,0,63878,30,3,1], [302014,0,0,3891,0,0,0], [302014,0,0,15928,0,0,2], [305013,5,0,123,99999,0,3],
    [302014,0,0,5185,0,0,0], [305013,5,0,123,99999,0,3], [302014,0,0,56085,0,0,0], [110002,4,2,50074,99999,0,4],


    In this the last item in each list is the label.
    If you can tell me if I need to reformat my data and how or just how to get it loaded into a dataset properly.



    Thanks for any help or advice you can give



    Here is the full code:



    import tensorflow as tf
    import numpy as np
    from tensorflow.keras import layers
    from . import syslog

    print(tf.VERSION)
    print(tf.keras.__version__)

    model = tf.keras.Sequential()
    # Adds a densely-connected layer with 64 units to the model:
    model.add(layers.Dense(64, activation='relu'))
    # Add another:
    model.add(layers.Dense(64, activation='relu'))
    # Add a softmax layer with 10 output units:
    model.add(layers.Dense(10, activation='softmax'))

    model.compile(optimizer=tf.train.AdamOptimizer(0.001),
    loss='categorical_crossentropy',
    metrics=['accuracy'])

    dataset = tf.data.dataset.from_tensor_slices(syslog)

    model.fit(dataset, epochs=10, steps_per_epoch=30)









    share|improve this question







    New contributor




    Alex F is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
    Check out our Code of Conduct.







    $endgroup$














      0












      0








      0





      $begingroup$


      Im working on my first NN following a tensorflow tut and trying to use my own data.
      After about 80 attempts of formatting my data and trying to load it into a dataset to train im throwing in the towel.



      Here is how my data currently looks



      syslog_data = [
      [302014,0,0,63878,30,3,1], [302014,0,0,3891,0,0,0], [302014,0,0,15928,0,0,2], [305013,5,0,123,99999,0,3],
      [302014,0,0,5185,0,0,0], [305013,5,0,123,99999,0,3], [302014,0,0,56085,0,0,0], [110002,4,2,50074,99999,0,4],


      In this the last item in each list is the label.
      If you can tell me if I need to reformat my data and how or just how to get it loaded into a dataset properly.



      Thanks for any help or advice you can give



      Here is the full code:



      import tensorflow as tf
      import numpy as np
      from tensorflow.keras import layers
      from . import syslog

      print(tf.VERSION)
      print(tf.keras.__version__)

      model = tf.keras.Sequential()
      # Adds a densely-connected layer with 64 units to the model:
      model.add(layers.Dense(64, activation='relu'))
      # Add another:
      model.add(layers.Dense(64, activation='relu'))
      # Add a softmax layer with 10 output units:
      model.add(layers.Dense(10, activation='softmax'))

      model.compile(optimizer=tf.train.AdamOptimizer(0.001),
      loss='categorical_crossentropy',
      metrics=['accuracy'])

      dataset = tf.data.dataset.from_tensor_slices(syslog)

      model.fit(dataset, epochs=10, steps_per_epoch=30)









      share|improve this question







      New contributor




      Alex F is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
      Check out our Code of Conduct.







      $endgroup$




      Im working on my first NN following a tensorflow tut and trying to use my own data.
      After about 80 attempts of formatting my data and trying to load it into a dataset to train im throwing in the towel.



      Here is how my data currently looks



      syslog_data = [
      [302014,0,0,63878,30,3,1], [302014,0,0,3891,0,0,0], [302014,0,0,15928,0,0,2], [305013,5,0,123,99999,0,3],
      [302014,0,0,5185,0,0,0], [305013,5,0,123,99999,0,3], [302014,0,0,56085,0,0,0], [110002,4,2,50074,99999,0,4],


      In this the last item in each list is the label.
      If you can tell me if I need to reformat my data and how or just how to get it loaded into a dataset properly.



      Thanks for any help or advice you can give



      Here is the full code:



      import tensorflow as tf
      import numpy as np
      from tensorflow.keras import layers
      from . import syslog

      print(tf.VERSION)
      print(tf.keras.__version__)

      model = tf.keras.Sequential()
      # Adds a densely-connected layer with 64 units to the model:
      model.add(layers.Dense(64, activation='relu'))
      # Add another:
      model.add(layers.Dense(64, activation='relu'))
      # Add a softmax layer with 10 output units:
      model.add(layers.Dense(10, activation='softmax'))

      model.compile(optimizer=tf.train.AdamOptimizer(0.001),
      loss='categorical_crossentropy',
      metrics=['accuracy'])

      dataset = tf.data.dataset.from_tensor_slices(syslog)

      model.fit(dataset, epochs=10, steps_per_epoch=30)






      python tensorflow






      share|improve this question







      New contributor




      Alex F is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
      Check out our Code of Conduct.











      share|improve this question







      New contributor




      Alex F is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
      Check out our Code of Conduct.









      share|improve this question




      share|improve this question






      New contributor




      Alex F is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
      Check out our Code of Conduct.









      asked 18 mins ago









      Alex FAlex F

      1




      1




      New contributor




      Alex F is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
      Check out our Code of Conduct.





      New contributor





      Alex F is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
      Check out our Code of Conduct.






      Alex F is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
      Check out our Code of Conduct.




















          0






          active

          oldest

          votes












          Your Answer








          StackExchange.ready(function()
          var channelOptions =
          tags: "".split(" "),
          id: "557"
          ;
          initTagRenderer("".split(" "), "".split(" "), channelOptions);

          StackExchange.using("externalEditor", function()
          // Have to fire editor after snippets, if snippets enabled
          if (StackExchange.settings.snippets.snippetsEnabled)
          StackExchange.using("snippets", function()
          createEditor();
          );

          else
          createEditor();

          );

          function createEditor()
          StackExchange.prepareEditor(
          heartbeatType: 'answer',
          autoActivateHeartbeat: false,
          convertImagesToLinks: false,
          noModals: true,
          showLowRepImageUploadWarning: true,
          reputationToPostImages: null,
          bindNavPrevention: true,
          postfix: "",
          imageUploader:
          brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
          contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
          allowUrls: true
          ,
          onDemand: true,
          discardSelector: ".discard-answer"
          ,immediatelyShowMarkdownHelp:true
          );



          );






          Alex F is a new contributor. Be nice, and check out our Code of Conduct.









          draft saved

          draft discarded


















          StackExchange.ready(
          function ()
          StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fdatascience.stackexchange.com%2fquestions%2f50934%2fplease-god-help-me-with-my-training-data%23new-answer', 'question_page');

          );

          Post as a guest















          Required, but never shown

























          0






          active

          oldest

          votes








          0






          active

          oldest

          votes









          active

          oldest

          votes






          active

          oldest

          votes








          Alex F is a new contributor. Be nice, and check out our Code of Conduct.









          draft saved

          draft discarded


















          Alex F is a new contributor. Be nice, and check out our Code of Conduct.












          Alex F is a new contributor. Be nice, and check out our Code of Conduct.











          Alex F is a new contributor. Be nice, and check out our Code of Conduct.














          Thanks for contributing an answer to Data Science Stack Exchange!


          • Please be sure to answer the question. Provide details and share your research!

          But avoid


          • Asking for help, clarification, or responding to other answers.

          • Making statements based on opinion; back them up with references or personal experience.

          Use MathJax to format equations. MathJax reference.


          To learn more, see our tips on writing great answers.




          draft saved


          draft discarded














          StackExchange.ready(
          function ()
          StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fdatascience.stackexchange.com%2fquestions%2f50934%2fplease-god-help-me-with-my-training-data%23new-answer', 'question_page');

          );

          Post as a guest















          Required, but never shown





















































          Required, but never shown














          Required, but never shown












          Required, but never shown







          Required, but never shown

































          Required, but never shown














          Required, but never shown












          Required, but never shown







          Required, but never shown