用于IToF传感器的极低功耗RISC-V专用处理器设计

doi:10.19678/j.issn.1000-3428.0062281

摘要/Abstract

摘要： IToF深度探测技术是当前主流的3D感知实现方案之一，该技术的核心部件是IToF传感芯片。随着当今社会数字化与智能化进程的加快，各科技领域对IToF传感芯片的需求日益提高，然而IToF传感芯片产能的提升引起了由芯片运行所带来的功耗问题。针对IToF传感器设计一款基于第五代精简指令集架构（RISC-V）的极低功耗专用处理器IToF-miniRV。IToF-miniRV包含支持RV32I指令集、RV32M指令集和自定义IToF型指令的处理器，以及用于加速深度计算和光幅度运算的IToF硬件加速器。将IToF-miniRV处理器与蜂鸟E203、PULPissimo这两款开源的基于RISC-V的超低功耗处理器分别部署在Xilinx Zynq-7000芯片上，进行FPGA资源使用情况和运行功耗的对比实验，结果表明，相比蜂鸟E203和PULPissimo，IToF-miniRV处理器的FPGA资源使用率分别减少5.2和10.9个百分点，运行功耗分别下降37.6%和89.7%。

关键词: 光电传感器, 硬件加速器, 专用处理器, 第五代精简指令集架构, 现场可编程门阵列

Abstract: Indirect Time of Flight(IToF) depth detection technology is one of the current mainstream solutions to realize 3D perception.The core component of this technology is the IToF sensor chip.With the acceleration of digitization and intellectualization, the demand for IToF sensor chips is increasing in various scientific and technological fields.However, the increase in the production capacity of IToF sensor chips has created a power consumption problem caused by chip operation.To address this challenge, an ultra-low-power dedicated processor IToF-miniRV is designed based on Reduced Instruction Set Computer-Five(RISC-V) instruction set architecture.The IToF-miniRV includes a processor that supports the RV32I instruction set, the RV32M instruction set, custom IToF type instructions, and an IToF hardware accelerator for accelerating depth and optical amplitude calculations.The IToF-miniRV processor is deployed on an Xilinx Zynq-7000 chip with two open-source RISC-V-based ultra-low-power processors:Hummingbird E203 and PULPissimo.A comparison experiment on FPGA resource utilization and running power consumption shows that, compared with Hummingbird E203 and PULPissimo, the FPGA resource utilization rate of the IToF-miniRV processor decreased by 5.2 and 10.9 percentage points, respectively, and the running power consumption decreased by 37.6% and 89.7%, respectively.

Key words: photoelectric sensor, hardware accelerator, dedicated processor, Reduced Instruction Set Computer-Five (RISC-V), Field Programmable Gate Array(FPGA)

中图分类号:

TP391

黄正伟, 刘宏伟, 徐渊. 用于IToF传感器的极低功耗RISC-V专用处理器设计[J]. 计算机工程, 2022, 48(9): 146-154.

HUANG Zhengwei, LIU Hongwei, XU Yuan. Design of Ultra-Low-Power RISC-V Dedicated Processor for IToF Sensor[J]. Computer Engineering, 2022, 48(9): 146-154.

http://www.ecice06.com/CN/Y2022/V48/I9/146

图/表 19

20220924180033

20220924180036

20220924180040

20220924180044

20220924180048

20220924180051

20220924180055

20220924180058

20220924180102

20220924180105

20220924180110

20220924180114

20220924180118

20220924180122

20220924180126

20220924180131

20220924180135

20220924180139

20220924180143

参考文献

[1] 侯飞.基于飞行时间的三维目标点云提取和重建研究[D].北京:中国科学院大学(中国科学院国家空间科学中心), 2019. HOU F.Research on extraction and reconstruction of 3D object point cloud based on flight time[D].Beijing:National Space Science Center, Chinese Academy of Sciences, 2019.(in Chinese)
[2] 程源文, 刘宏伟, 徐渊.单点相位式TOF深度探测器研究与设计[J].激光杂志, 2021, 42(1):65-70. CHENG Y W, LIU H W, XU Y.Research anddesign of single point phase TOF depth detector[J].Laser Journal, 2021, 42(1):65-70.(in Chinese)
[3] 洪一帆, 宋坤坡, 夏顺仁, 等.三维成像声纳图像后处理与可视化[J].计算机工程, 2011, 37(22):196-197. HONG Y F, SONG K P, XIA S R, et al.Post-processing and visualization for three-dimension imaging sonar image[J].Computer Engineering, 2011, 37(22):196-197.(in Chinese)
[4] 魏加立, 曲慧东, 王永宪, 等.基于飞行时间法的3D相机研究综述[J].红外技术, 2021, 43(1):60-67. WEI J L, QU H D, WANG Y X, et al.Research review of 3D cameras based on time-of-flight method[J].Infrared Technology, 2021, 43(1):60-67.(in Chinese)
[5] ZACH G, DAVIDOVIC M, ZIMMERMANN H.A 16×16 pixel distance sensor with in-pixel circuitry that tolerates 150 klx of ambient light[J].IEEE Journal of Solid-State Circuits, 2010, 45(7):1345-1353.
[6] RICHARDSON J, WALKER R, GRANT L, et al.A 32×3250 ps resolution 10 bit time to digital converter array in 130 nm CMOS for time correlated imaging[C]//Proceedings of 2009 IEEE Custom Integrated Circuits Conference.Washington D.C., USA:IEEE Press, 2009:77-80.
[7] WATERMAN A, LEE Y, PATTERSON D A, et al.The RISC-V instruction set manual.volume 1:user-level ISA, version 2.0[EB/OL].[2021-07-05].https://www2.eecs.berkeley.edu/Pubs/TechRpts/2016/EECS-2016-118.pdf.
[8] 张坤宁, 赵烁, 何虎, 等.基于RISC-V处理器的卷积加速SoC系统设计[J].计算机工程, 2021, 47(4):153-157. ZHANG K N, ZHAO S, HE H, et al.Design of SoC system for convolution acceleration based on RISC-V processor[J].Computer Engineering, 2021, 47(4):153-157.(in Chinese)
[9] 廖汉松, 吴朝晖, 李斌.基于RISC-V的卷积神经网络专用指令集处理器[J].计算机工程, 2021, 47(7):196-204. LIAO H S, WU Z H, LI B.Special instruction set processor for convolutional neural network based on RISC-V[J].Computer Engineering, 2021, 47(7):196-204.(in Chinese)
[10] PERENZONI M, STOPPA D.Figures of merit for indirect time-of-flight 3D cameras:definition and experimental evaluation[J].Remote Sensing, 2011, 3(11):2461-2472.
[11] DRAYTON B M M, CARNEGIE D A, DORRINGTON A A.Improved phase detection algorithms for indirect time of flight range imaging cameras[C]//Proceedings of IEEE International Symposium on Robotic and Sensors Environments.Washington D.C., USA:IEEE Press, 2012:156-161.
[12] 漆晓峰.用于手机前置3D人脸识别摄像头的ITOF传感器关键技术研究[D].深圳:深圳大学, 2018. QI X F.ITOF sensor research for 3D face recognition of mobile phone front camera[D].Shenzhen:Shenzhen University, 2018.(in Chinese)
[13] 黄志宇.相位式TOF深度探测器的像素设计与优化[D].深圳:深圳大学, 2019. HUANG Z Y.The design and optimization of the pixel of indirect time-of-flight range imagers[D].Shenzhen:Shenzhen University, 2019.(in Chinese)
[14] 吴键.基于FPGA的查找表实现四象限反正切函数算法[J].中国新通信, 2019, 21(15):138-139. WU J.Realization of four-quadrant arctangent function algorithm based on FPGA-based lookup table[J].China New Telecommunications, 2019, 21(15):138-139.(in Chinese)
[15] 雷思磊.RISC-V架构的开源处理器及SoC研究综述[J].单片机与嵌入式系统应用, 2017, 17(2):56-60, 76. LEI S L.Research on open source processor and SoC based on RISC-V[J].Microcontrollers & Embedded Systems, 2017, 17(2):56-60, 76.(in Chinese)
[16] 邓天传, 胡振波.一种超低功耗的RISC-V处理器流水线结构[J].电子技术应用, 2019, 45(6):50-53. DENG T C, HU Z B.An ultra-low-power RISC-V processor pipeline-structure[J].Application of Electronic Technique, 2019, 45(6):50-53.(in Chinese)
[17] SCHIAVONE P D, ROSSI D, PULLINI A, et al.Quentin:an ultra-low-power PULPissimo SoC in 22 nm FDX[C]//Proceedings of IEEE SOI-3D-Subthreshold Microelectronics Technology Unified Conference.Washington D.C., USA:IEEE Press, 2018:1-3.
[18] 折如义, 李炳辉, 姜佩贺.三级流水线RISC-V处理器设计与验证[J].电子技术应用, 2020, 46(5):44-49. ZHE R Y, LI B H, JIANG P H.Design and verification of RISC-V processor with three-stage pipeline[J].Application of Electronic Technique, 2020, 46(5):44-49.(in Chinese)
[19] 秦爽, 李健, 陈杰.面向GNSS信道译码的RISC-V专用指令设计[J].微电子学与计算机, 2021, 38(11):61-66. QIN S, LI J, CHEN J.Design of RISC-V dedicated instructions for GNSS channel decoding[J].Microelectronics & Computer, 2021, 38(11):61-66.(in Chinese)
[20] 陈锐, 李冰, 刘向东.基于RISC-V指令扩展的低开销SM4算法设计与实现[J].电子器件, 2021, 44(1):108-113. CHEN R, LI B, LIU X D.Design and implementation of low-cost SM4 algorithm based on RISC-V instruction set extension[J].Chinese Journal of Electron Devices, 2021, 44(1):108-113.(in Chinese)
[21] 潘越, 史府鑫, 李稚.基于RISC-V的卫星通信终端处理器指令集优化研究[C]//第十六届卫星通信学术年会论文集.北京:中国通信学会卫星通信委员会, 2020:247-255. PAN Y, SHI F X, LI Z.Research on instruction set optimization of satellite communication terminal processor based on RISC-V[C]//Proceedings of the 16th Annual Academic Conference on Satellite Communication.Beijing:Satellite Communication Committee of China Communications Society, 2020:247-255.(in Chinese)
[22] 赵坤.基于RISC-V架构的SoC设计与实现[D].海口:海南大学, 2021. ZHAO K.Design and implementation of SoC based on RISC-V architecture[D].Haikou:Hainan University, 2021.(in Chinese)
[23] 廖汉松.基于RISC-V的卷积神经网络专用指令集处理器研究与设计[D].广州:华南理工大学, 2020. LIAO H S.Study and design of RISC-V based convolu-tional neural network application specific instruction-set processor[D].Guangzhou:South China University of Technology, 2020.(in Chinese)

选择文件类型/文献管理软件名称

选择包含的内容