OCHRE- Optical Character Recognition Using Neural Networks in Java |
||
Table of Contents: Introduction Backpropagation neural networks Backpropagation in details The OCHRE applet How to work this thing Get the source code! Other sites about neural networks in Java |
The ten icons with the digits in them, along the the top of the applet window, are the actual inputs that are used to test and train the neural network. To submit one to the network, press the "test" button that appears above it. The row of ten LEDs below the icons indicate the activity of the ten output neurons. When the network is fully trained, the only active output neuron should be the one below the icon which you just tested. It should glow bright red, while the others remain black. But on startup, the network is not trained yet- it doesn't "know" anything about what Arabic numerals look like- and so it won't know how to recognize one. You're likely to see all the neurons light up, at least a little bit. To train the network, press the "Start training" button on the lower panel. As the applet begins to train the network, you will see the number of training epochs (individual training iterations) increase, and the sum squared error (the cumulative error in the network output) slowly decrease. You will also see the network output icon changing (at the lower right side of the applet). This icon summarizes all of the network's responses to all ten of the training inputs. Squares in the icon that are blue indicate appropriate responses by output neurons, and those that are red indicate inappropriate responses. Training should take a few minutes, and is complete after about 150-250 training epochs, when the sum squared error reaches a low value (approximately 0.01). On my Pentium-133, it usually takes about two minutes of training for the network to reach an error that low. The network output icon should appear as a diagonal row of bright blue squares. At this point, you can press the "Stop training" button to stop training the network. If you press the "test" buttons above each digit icon, the appropriate LED should now light up. You can test the network on your own hand-drawn symbol, by drawing one with your mouse in the large icon at the lower left of the applet. Your left mouse button will light a pixel up, and your right mouse button will darken it. (If your mouse only has one button, you can click while holding down your ALT key to darken a pixel.) You can blur or sharpen your drawing using the buttons along the left of the large icon. To see what the network thinks you just drew a picture of, press the "test" button at bottom, and see which of the LEDs light up. I have varying luck with it. Sometimes the network recognizes my digit immediately, and sometimes it refuses to unless the picture is smoothed with the blur button. One interesting thing to do is to test the network on a novel input, such as a letter "A". Neural networks behave unpredictably with novel inputs. The network can be trained on any of your own novel inputs as well. You should be able to alter any of the digit icons at the top by drawing on it. To blur, sharpen, or clear them, use your "B", "S", and "C" keys respectively. To restore the original digits, press the "Reset inputs" button. To reset the network itself, press the "Reset network" button. You can change the number of input layer neurons and hidden layer neurons by changing the numbers in the corresponding fields before pressing "Reset network". Too few neurons, and the network will be unable to learn anything. Too many, and overlearning becomes likely- the network learns the specific training inputs so well that it won't tolerate any slight deviation from them. |
|
BackProp.java-
the neural network object.
Documentation
for class BackProp
Note that with the code as it is, you are limited
to a three layer network that uses a log-sigmoid transfer function (i.e.,
1/(1+e-x)) for all neurons. If you want to modify the code for your
own purposes, feel free to knock yourself out.
ochre.java-
the applet itself.
Documentation
for Class ochre
ochre.txt- file containing definitions of the default symbol set. (Pressing a capital "P" over an icon will dump its matrix definition to your Java console, if you want to create your own default symbol set files.)
IconMatrix.java-
my AWT icon widget that allows drawing and simple image filtering.
Documentation
for Class IconMatrix
LED.java-
another AWT widget. Simulates an LED.
Documentation for
Class LED
Neural Java-Neural Networks Tutorial with Java Applets obviously would fit into this category. This is a site located in Lausanne, Switzerland, with demonstration applets that show the concepts behind different kinds of neural networks.
Web Applets for Artificial Neural Learning - This site contains some simple applets that demonstrate graphically how artificial neurons work and how some elementary neural networks are put together.
Neural Networks with Java - this is an impressively designed site by Jochen Fröhlich from Germany. (For some reason, most neural network sites tend to be outside the USA. Wonder why?) He has written a class library that is available for download from his site, and it includes Java class files for backpropagation networks and Kohonen networks. Kohonen networks are a form of self-organizing map that requires no supervision during training. They are particularly good at solving the "traveling salesman" problem and there is a beautiful applet at his site that shows one doing just that. This is a site worth a visit, especially if you're a traveling salesman.
David W. Clark's Neural Networks
Web Site -This David W. Clark guy looks serious- I'm pretty certain
that he appears somewhere in "the literature". His applets are very advanced and
may be somewhat counterintuitive to those not familiar with artificial neural
networks. However, if you are up to the material, give his site a look.