Recent advances in large array format SPAD sensors, call for novel image processing pipelines (ISP) to create optimised computer vision systems using these sensors. The single photon detection capability of SPADs with accompanying in-pixel computation, provides the opportunity for tailored optimisation of resolution, dynamic range, signal to noise and motion capture in challenging scenes.To refine the ISP for computer vision, the resultant SPAD sensor + ISP will be deployed in a real computer vision application (e.g. robotic navigation, fall detection, human tracking).The project deliverables will be as follows:-A bespoke ISP optimised for single-photon input data.-Demo system with application-specific optimisation.-Analysis and refinement of optimal ISP partitioning and in-pixel compute.

Further information

The project is supported by STMicroelectronics and will involve close engagement with STMicroelectronics Imaging Division, Edinburgh.

I. Gyongy et al., "A Direct Time-of-Flight Image Sensor With In-Pixel Surface Detection and Dynamic Vision," in IEEE Journal of Selected Topics in Quantum Electronics, vol. 30, no. 1: Single-Photon Technologies and Applications, pp. 1-11, Jan.-Feb. 2024, Art no. 3800111, doi: 10.1109/JSTQE.2023.3238520

Principal Supervisor: Dr Istvan Gyongy

Assistant Supervisor: Professor Robert Henderson

Eligibility

An undergraduate degree at 2:1 or above (or international equivalent) in a relevant science or engineering discipline, possibly supported by an MSc degree.

Funding

Funding is provided for this project and is open to Home and Overseas students.

Further information and other funding options.

Informal Enquiries: istvan.gyongy@ed.ac.uk