An Asynchronous Flash LiDAR Sensor Based on Pixel-wise Time-of-Flight Validation via Background Light Adaptive Threshold

Abstract

The demand for 3D imaging technologies is rapidly increasing across various fields, including autonomous vehicles, robotics, augmented reality, and industrial automation. These applications rely on accurate and efficient depth sensing systems capable of capturing high-speed and high-resolution data in real time. Such systems must handle a wide range of environmental conditions, including variable lighting, diverse target reflectivity, and dynamic scenes, while maintaining robustness and reliability. The key challenges include managing wide input dynamic ranges, mitigating background light interference, and optimizing resource utilization such as memory and power. These constraints drive the need for innovative solutions to advance the performance of depth sensing technologies. Flash LiDAR sensors have emerged as essential tools to meet these demands, offering unparalleled speed and resolution. However, existing systems face significant limitations in their ability to efficiently process wide dynamic ranges and cope with environmental noise. This research addresses these challenges through two key contributions: the development of a novel Delta Intensity Quaternary Search (DIQS) histogramming Time-to-Digital Converter (hTDC) and its integration into an asynchronous flash LiDAR sensor. Together, these innovations enable precise and robust depth measurements while minimizing resource consumption. The DIQS hTDC represents a substantial advancement over traditional zooming histogramming TDCs by introducing a coarse-to-fine histogramming mechanism combined with adaptive bin allocation. This approach enhances memory efficiency and extends the dynamic range, ensuring accurate time-of- flight (ToF) measurements even under challenging conditions. The DIQS hTDC iteratively narrows the region of interest using a quaternary search method, concentrating computational resources on the most relevant photon arrival times. This technique inherently suppresses background noise, reduces memory usage, and enables scalability for resource-constrained ToF systems, addressing critical bottlenecks in previous designs. Building on the DIQS hTDC, an asynchronous flash LiDAR sensor is proposed to autonomously validate pixel-level ToF measurements. Each pixel dynamically adjusts its integration time based on the intensity of background light, leveraging a compact bitwise arithmetic unit to compute thresholds in real time. This pixel-level autonomy eliminates the need for complex global synchronization while selectively reading out validated pixels. Non-validated pixels continue collecting photons, improving data efficiency and robustness. The asynchronous architecture simplifies system complexity and enhances adaptability across diverse environmental and operational conditions. A prototype asynchronous flash LiDAR sensor incorporating the DIQS hTDC was fabricated in a 90- nm CMOS process and extensively tested. The sensor achieved a precision of 6 cm and an accuracy of 8 cm over ranges from 1.5 to 22.5 meters indoors. Under outdoor conditions with ambient illumination up to 30 klux, the sensor maintained a true detection rate exceeding 95% at a distance of 21 meters. Its ability to dynamically adjust frame rates from 5 to 250 fps demonstrates versatility and adaptability across varying signal-to-noise ratio conditions, catering to applications ranging from high-speed operation to high-precision imaging. This research makes two significant contributions to the advancement of SPAD-based flash LiDAR systems. First, the DIQS hTDC introduces a scalable and efficient histogramming solution that overcomes memory and noise challenges. Second, the asynchronous flash LiDAR sensor demonstrates the practical integration of this technology into a robust and compact system capable of addressing the complex demands of real-world environments. Together, these innovations pave the way for the next generation of 3D imaging systems, offering a practical, high-performance, and scalable solution for diverse applications requiring precise and efficient depth sensing. Keywords: 3D imager, CMOS image sensor, depth sensor, LiDAR, time-of-flight (ToF), direct ToF, histogramming, in-pixel histogramming, single-photon avalanche diode (SPAD), time-to-digital converter (TDC), delta intensity quaternary search (DIQS), asynchronous.