1 3D Scanning Based on Computer VisionBy:Hansen Chen Xiaobo Dong Xingqian Xu TA: Mustafa Mir 04/27/2012

2 Contents Introduction Motivation Review original DesignDescribe project build and function test Discuss Success and Challenges Recommendation Special Thanks

3 Introduction 3D scanning will move from industry to home.People would like to see 3D Models when shopping online. Project features: Computer Vision Technique Web camera Matlab

4 Motivation Economical --- using computer vision technique instead of laser. Interactive --- 3ds format. Fun Project --- We like it.

5 Review Original DesignWhat is changed?

6 Project build HardwareBoost converter with feedback control. Integrated Platform with camera and Led light control. 5 hours operating time with 2 AA batteries.

7 Boost Converter With feedback control

8 Microcontroller We use Microcontroller 430G2131 to control the PWM wave to the transistor, the microcontroller can modify the duty cycle from 15% up to 65% depending on the feedback voltage.

9 Project build Hardware (3)

10 Segmentation (1) Segmentation OverviewPrerequisite: Dark surrounding with constant white light background Input: Recorded Video Method: Intensity thresholding method (Otsu's method for threshold value) Output: Images for the objects’ shape in 36 different view points.

11 Segmentation inside boundary region Finding Image boundaryInput Video Finding Image boundary

12 Select the marker region and processingSegmentation (3) Calculating the angle for each frames given by the position of the markers Image Cleaning (Delete Noisy) Select the marker region and processing

13 Selecting the frames given by the anglesSegmentation (4) Selecting the frames given by the angles Output Reconstruction step

14 Angle Calculation(1) Detect the position of the Marker

15 Angle Calculation(2) By Theorems in geometry There is a relation between x,y and angle theta. r is the radius

16 3D Reconstruction Algorithm: use 360 degree projection view to reconstruct test object.

17 3D Reconstruction Step 1: Object Zoom as camera distance change

18 3D Reconstruction Step 2: 3D Matrix rotate to correct angle

19 3D Reconstruction Step 3: 3D Matrices merge into one

20 3DS formation Step 1: Writing the correct protocol:

21 3DS formation Step 2: Meshing (Layer Algorithm):

22 Matlab GUI Start Button Camera Select Lots of GUI Codes!!!Test Cases Fast Run Are honestly generated automatically by matlab

23 Successes Successful motor controlSegmentation algorithm success, accurate segmentation results are obtained 3D reconstruction algorithm success, 3D model can be reconstructed. 3ds formation file can be generated correctly.

24 Challenges Concave surfaces Environmental sensitiveObject off platform center Converting 3ds cubic structure file into mesh structure file

25 Verification Case Mouse

26 Verification Case Toy SpongeBob

27 Recommendation Implementation(if time allows) Cover caseMesh the output Front light to capture color information Application Online retailing Add on for 3D printer 3D gaming etc..

28 Special thanks Professor P. Scott Carney TA Mustafa MirGroup 36—Jing Guo, Yuqiao. Power Lab Kevin Colravy Professor Philip Krein Free Samples From TI