Re^2: backpropagation accuracy issue

The correct values were provided and are posted here

The algorithm is described in Tom M. Mitchell's "Machine Learning" (p. 98) there are pdf slides here slides numbered 88-92 on pages 4 and 5 respectively.

That's unfortunate that its not a rounding error I will comb through more closely and hopefully find where the problem is. If you have any suggestions it is certainly appreciated. Thank you for your help so far.

Comment on Re^2: backpropagation accuracy issue

Replies are listed 'Best First'.
Re^3: backpropagation accuracy issue by ikegami (Patriarch) on Feb 19, 2011 at 03:35 UTC
@hiddenweight after one epoch: `$VAR1 = [ '0.596062038434604', '0.596062038434604', '0.596062038434604' ];` [download] After two: `$VAR1 = [ '0.592154093746109', '0.592154093746109', '0.592154093746109' ];` [download] Shouldn't they be different? (Just guessing here.)	[reply] [d/l] [select]
Re^4: backpropagation accuracy issue by perlchris (Initiate) on Feb 19, 2011 at 03:44 UTC
Yes I thought so too, but it wasn't until going back over the output source you asked for that I realized that some of the vars that are scalars need to be arrays and a few that are arrays need to be arrays of arrays. So I am going to try to make some additional fixes and fix the bugs those ultimately cause ;) and see where I am at. Again thank you so much for your help. I will post an update as soon as possible	[reply]
Re^3: backpropagation accuracy issue by ikegami (Patriarch) on Feb 19, 2011 at 03:21 UTC
Doesn't even start the same. Him: `*** Epoch 1 * Maximum RMSE: 0.5435466682137927 Average RMSE: 0.4999991292217466` [download] You: `* Epoch 1 *** Maximum RMSE: 0.574001103043358 Average RMSE: 0.50006970432383` [download]	[reply] [d/l] [select]