(Coming) Estimating illumination for Augmented Reality on deformable objects
In this project, we track the deformable objects in real-time and at the same time estimate the irradiance map of the environment. We can use this irradiance map to realistically illuminate virtual objects using a piece of OpenGL shading script.
Augmented reality coloring book iOS App
Developed the first real-time highly optimized 3-D deformable surface tracking system on mobile devices for an augmented reality children coloring book application.
Deformable surface tracking and reconstruction from videos
Study to develop a fast 3-D deformable surface tracking system, to develop simultaneous dense image alignment and 3-D deformable shape reconstruction in presence of occlusions and low texture (in C++/Qt and Matlab).
Model-based tracking of rigid objects
Simulate a rocket taking off by moving the camera down. Track the pose of the rocket with respect to the camera over time. The tracking is performed by using an edge-based method.
Tracking small objects (a pen in the following video) with little image information using a global method that exploits most image information.
Kinect-external high resolution RGB camera calibration
Accquiring depth and RGB images using a Microsoft Kinect limits the resolution of the RGB camera to 640x480. For the purpose of obtaining high resolution RGB images for another computer vision algorithm, I attach a high resolution RGB camera next to the Kinect and calibrate this system. The calibration computes the relative pose between the external RGB camera and the depth sensor (i.e. IR camera). The calibration also computes a more accurate mapping from raw disparity to actual depth than the built-in mapping.
Using this calibrated system, we can obtain a 3D point cloud and a high resolution texture used for 3D model accquisition.
Successfully built a low cost gaze-tracking system, which enables users to use their eyes to control how PDF documents are presented (in C++/CLI).
Diagnosing breast cancer with pattern recognition techniques
Study and evaluate state-of-the-art techniques to segmentation, shape description, temporal enhancement description, and classification of MRI non-mass breast lesions for a computer-aided diagnosis system (in Matlab).
Integrated model for Vietnamese text recognition
Developed a complete, efficient, one of the first recognition systems for Vietnamese printed text by using advanced image processing techniques, well-designed feature extractions, multi–layer classifier with character grouping, in combination with Hidden Markov Model and language model (in C#).