Dat Ngo bio photo

Dat Ngo

PhD in Computer Vision @ EPFL, Switzerland

LinkedIn

Projects

(Coming) Estimating illumination for Augmented Reality on deformable objects

In this project, we track the deformable objects in real-time and at the same time estimate the irradiance map of the environment. We can use this irradiance map to realistically illuminate virtual objects using a piece of OpenGL shading script.

*Irradiance map estimation* Left: Input image with augmented contents. Right: Environment irradiance map.
*Irradiance map estimation* Left: Input image in another settings. Right: Environment irradiance map.

Augmented reality coloring book iOS App

Developed the first real-time highly optimized 3-D deformable surface tracking system on mobile devices for an augmented reality children coloring book application.

Deformable surface tracking and reconstruction from videos

Study to develop a fast 3-D deformable surface tracking system, to develop simultaneous dense image alignment and 3-D deformable shape reconstruction in presence of occlusions and low texture (in C++/Qt and Matlab).



Model-based tracking of rigid objects

Simulate a rocket taking off by moving the camera down. Track the pose of the rocket with respect to the camera over time. The tracking is performed by using an edge-based method.


Tracking small objects (a pen in the following video) with little image information using a global method that exploits most image information.


Kinect-external high resolution RGB camera calibration

Accquiring depth and RGB images using a Microsoft Kinect limits the resolution of the RGB camera to 640x480. For the purpose of obtaining high resolution RGB images for another computer vision algorithm, I attach a high resolution RGB camera next to the Kinect and calibrate this system. The calibration computes the relative pose between the external RGB camera and the depth sensor (i.e. IR camera). The calibration also computes a more accurate mapping from raw disparity to actual depth than the built-in mapping.

*Kinect & external camera calibration* Left: Kinect RGB camera image. Middle: Kinect Infrared camera image. Right: RGB high resolution camera image.


Using this calibrated system, we can obtain a 3D point cloud and a high resolution texture used for 3D model accquisition.

*Build a high quality textured model of a cushion*

Gaze-Tracking

Successfully built a low cost gaze-tracking system, which enables users to use their eyes to control how PDF documents are presented (in C++/CLI).

Diagnosing breast cancer with pattern recognition techniques

Study and evaluate state-of-the-art techniques to segmentation, shape description, temporal enhancement description, and classification of MRI non-mass breast lesions for a computer-aided diagnosis system (in Matlab).

*Breast tumor classification* Left: Benign - ductal and papillary hyperplasia. Right: Malignant - invasive ductal carcinoma.

Integrated model for Vietnamese text recognition

Developed a complete, efficient, one of the first recognition systems for Vietnamese printed text by using advanced image processing techniques, well-designed feature extractions, multi–layer classifier with character grouping, in combination with Hidden Markov Model and language model (in C#).