Publications
Research publications ordered by year, newest first. Patents are listed separately on the patents page.
2027
- EDIVA: Exploiting Human Behavioral Patterns for Differential Egocentric Video Processing in Augmented Reality.
2026
- UTOPI: Efficient Egocentric Long-Video Understanding in AR via User-Guided Token Pre-Compression. PDF
- SaliMory: Orchestrating Cognitive Memory for Conversational Agents. PDFarXiv
- AdaDino: Adaptive Vision Foundation Models for Edge Intelligence via LLM-Guided Execution. PDFarXiv
- EgoEverything: A Benchmark for Human Behavior Inspired Long Context Egocentric Video Understanding in AR Environment. PDFarXiv
- FoSAM: Focus-Oriented Adaptive Token Sampling for Efficient Segment Anything in Augmented Reality. PDFOpenReview
2025
- DFT Gaze: Distilled and Fine-Tuned Gaze Estimation for Personalization on Tiny Devices.
- FrameVoting: A Robust and Fast Method of Using Gaze Estimations to Identify Objects of Interest.
- H4H: Hybrid Convolution-Transformer Architecture Search for NPU-CIM Heterogeneous Systems for AR/VR Applications. PDFarXiv
- Foveated Instance Segmentation. PDFCVF
2024
- Unlocking Visual Secrets: Inverting Features with Diffusion Priors for Image Reconstruction.
- GazeGen: Gaze-Driven User Interaction for Visual Content Generation. PDFarXiv
- Neural Architecture Search of Hybrid Models for NPU-CIM Heterogeneous AR/VR Devices. arXiv
- Estimating Power, Performance, and Area for On-Sensor Deployment of AR/VR Workloads Using an Analytical Framework.
- Thermally Constrained Codesign of Heterogeneous 3-D Integration of Compute-in-Memory, Digital ML Accelerator, and RISC-V Cores for Mixed ML and Non-ML Workloads.
- Siracusa: A 16 nm Heterogenous RISC-V SoC for Extended Reality with AT-MRAM Neural Engine.
- RoboVisio: A Micro-Robot Vision Domain-Specific SoC for Autonomous Navigation Enabling Fully-on-Chip Intelligence via 2-MB eMRAM. PDF
2023
- Exploring Memory-Oriented Design Optimization of Edge AI Hardware for Extended Reality Applications.
- Siracusa: A Low-Power On-Sensor RISC-V SoC for Extended Reality Visual Processing in 16 nm CMOS.
- EyeCoD: Eye Tracking System Acceleration via FlatCam-based Algorithm and Hardware Co-design.
- Fully-Binarized Distance Computation Based On-Device Few-Shot Learning for XR Applications.
2022
- EyeCoD: Eye Tracking System Acceleration via FlatCam-based Algorithm and Accelerator Co-design. First Place, University Demo Best Demonstration at DAC 2022 PDFarXiv
- A 22 nm 3.5 TOPS/W Flexible Micro-Robotic Vision SoC with 2 MB eMRAM for Fully-on-Chip Intelligence. PDF
- Memory-Oriented Design-Space Exploration of Edge-AI Hardware for XR Applications.
- SplitNets: Designing Neural Architectures for Efficient Distributed Computing on Head-Mounted Systems. PDFarXiv
2020
- RRAM-DNN: An RRAM and Model-Compression Empowered All-Weights-on-Chip DNN Accelerator. PDF
- An Ultra-Low-Power Image Signal Processor for Hierarchical Image Recognition with Deep Neural Networks.
- AA-ResNet: Energy Efficient All-Analog ResNet Accelerator.
- Intelligent Vision Sensors for AR/VR.
- A 170 µW Image Signal Processor Enabling Hierarchical Image Recognition for Intelligence at the Edge.
- An All-Weights-on-Chip DNN Accelerator in 22 nm ULL Featuring 24×1 Mb eRRAM.
2019
- An 879 GOPS 243 mW 80 fps VGA Fully Visual CNN-SLAM Processor for Wide-Range Autonomous Exploration. PDF
- Energy-Efficient, Mobile Computer Vision and Machine Learning Processors.
- A 1920×1080 25 fps 2.4 TOPS/W Low-Power 6-D Vision Processor for Unified Optical Flow and Stereo Depth with Semi-Global Matching. Related SiPS algorithm work won First Place, Bob Owens Best Student Paper Award PDF
2018
- Low Complexity, Hardware-Efficient Neighbor-Guided SGM Optical Flow for Low-Power Mobile Vision Applications. PDF
- A 1920×1080 25 fps, 2.4 TOPS/W Unified Optical Flow and Depth 6D Vision Processor for Energy-Efficient, Low-Power Autonomous Navigation.
2017
- A 1920×1080 30-frames/s 2.3 TOPS/W Stereo-Depth Processor for Energy-Efficient Autonomous Navigation of Micro Aerial Vehicles.
- An Ultra-Wide Program, 122 pJ/bit Flash Memory Using Charge Recycling.
- A 1920×1080 30 fps 2.3 TOPS/W Stereo-Depth Processor for Robust Autonomous Navigation.
- A 288 µW Programmable Deep-Learning Processor with 270 kB On-Chip Weight Storage Using Non-Uniform Memory Hierarchy for Mobile Intelligence.
- A 1 Mb Embedded NOR Flash Memory with 39 µW Program Power for mm-Scale High-Temperature Sensor Nodes.
2016
- Hardware-Efficient Neighbor-Guided SGM Optical Flow for Low Power Vision Applications.
- Low Complexity Optical Flow Using Neighbor-Guided Semi-Global Matching.
- A 10 mm3 Inductive Coupling Radio for Syringe-Implantable Smart Sensor Nodes.
- A 10 mm3 Syringe-Implantable Near-Field Radio System on Glass Substrate.
2015
- A Dual-Slope Capacitance-to-Digital Converter Integrated in an Implantable Pressure-Sensing System.