Optical sensor integrated CNN for real-time computational applications

A previously implemented CNN layer based on a bio-inspired system model is integrated with optical sensors comprised of PN type photodiodes and the design is fabricated in CMOS technology. The implemented test chip is measured and obtained results are presented. The sensor integration marks a new step in prototyping of this system in CMOS, which allows the cell states to be programmed via light interactions, rather than successive state programming procedure which was utilized previously. It is shown that the cell input states in the network can be successfully introduced via exposure of the 2D array to a light source. The followed custom design methods and this remarkably compatible sensor integration can lead to compact on-chip solutions for real-time high performance applications, including but not limited to certain types of image processing