LIPREADING WITH SPIKING NEURONS, ONE PASS LEARNING

We present in this article a lipreading system implementing spiking neurons (STANs). A new preprocessing is proposed in order to reduce as much as possible the learning phase of the system. This training is done in one pass: the user pronounces once all of the words of the dictionary; the system is then able to recognize these words throughout different sessions during which the position and the chrominance of the images of the speaker's mouth strongly change.