Neural nets require a LOT of reinforcing training time. If you have a child, you understand this process intuitively. People can learn simple things by rote, but they can extrapolate and understand things only if they are shown enough examples to reinforce their forming theory about a governing rule.
A 2- or 3-year old kid needs to be exposed to a rule hundreds of times before they really can apply it (unless it somehow sparks their imagination and interest). A 10-year old probably only needs a few dozen math problems before they can start to apply the method on similar problems. An adult should be able to recognize and extrapolate on a pattern after a few examples.
In the case of your neural net that learns even/odd number rules, you are hoping to train the network to do two things: develop a direct 1:1 relationship between the lowest binary bit input and the output answer bit, while simultaneously completely burning out or dismissing all value from every other binary input bit. Seems simple to you, but not to a 3-year old.
--
[ e d @ h a l l e y . c c ]
Posts are HTML formatted. Put <p> </p> tags around your paragraphs. Put <code> </code> tags around your code and data!
Titles consisting of a single word are discouraged, and in most cases are disallowed outright.
Read Where should I post X? if you're not absolutely sure you're posting in the right place.
Please read these before you post! —
Posts may use any of the Perl Monks Approved HTML tags:
- a, abbr, b, big, blockquote, br, caption, center, col, colgroup, dd, del, details, div, dl, dt, em, font, h1, h2, h3, h4, h5, h6, hr, i, ins, li, ol, p, pre, readmore, small, span, spoiler, strike, strong, sub, summary, sup, table, tbody, td, tfoot, th, thead, tr, tt, u, ul, wbr
You may need to use entities for some characters, as follows. (Exception: Within code tags, you can put the characters literally.)
| |
For: |
|
Use: |
| & | | & |
| < | | < |
| > | | > |
| [ | | [ |
| ] | | ] |
Link using PerlMonks shortcuts! What shortcuts can I use for linking?
See Writeup Formatting Tips and other pages linked from there for more info.