My Thesis - isl2.cp.eng.chula.ac.th

My Thesis - isl2.cp.eng.chula.ac.th

DEVELOPMENT OF A STEREOSCOPIC PROJECTION SYSTEM Thesis Proposal 1 V 2..2 INTRODUCTION TO 3D PROJECTION SYSTEMS 3D APPLICATIONS Medical Scientific Engineering Education Entertainment Military

Advertising 2 INTRODUCTION TO 3D PROJECTION SYSTEMS BUDGET FOR THE EXAMPLE SYSTEMS System Type Price (Bath) Volumetric 3D Display Volumetric 42-3D6W01 42" Wow

Autostereoscopic 59,600 HMD 55,920 i-visor FX601 Duality X3 (+ Cyviz Xpo 1024x768) 4,800,000 Polarizing 1,232,800

Mirage S+2K Shutter Glass 2,387,800 InFocus DepthQ NuVision + 2 pairs of 60GX glasses Shutter Glass 254,800 From www.inition.co.uk 3 PROJECT PREFACE

If you want a Stereoscopic System, But you have small budget. What is our alternative? 4 PROJECT PREFACE PROBLEM Commercial 3D stereoscopic systems are too expensive for average users because they require a customized projector. 245,800 Bath!!!

40,000 Bath , OK!! 5 PROJECT PREFACE IDEA If we can adapt a common projector to project 3D stereopsis without modifying them, the cost of the system can be reduced. 40,000 Bath , OK!! 6

PROJECT PREFACE OBJECTIVE The objective of this project is to develop a shutter-glass based stereoscopic upgrade kit for an off-the-shelf DLP projector. 40,000 Bath , OK!! 7 TYPE OF DISPLAYS 3D Display Autostereoscopic Stereoscopic Volumetric

Stereoscopic 8 VOLUMETRIC 9 PRINCIPLE OF STEREOSCOPIC Invented By Charles Wheatstone in 1838. Stereopsis is depth perception from binocular visions through exploitation of parallax. Use two correspondence images to create an illusion of depth. 3D Display Autostereoscopic

Stereoscopic Stereoscopic Volumetric 10 AUTOSTEREOSCOPIC Lenticular lens Sweeping light source 11 STEREOSCOPIC HMD (Head Mounted Display) 2-Color Anaglyph

Polarizing Glass Stereoscopic Display Technology Shutter Glass ChromaDepth AnaChrome 12 STEREOSCOPIC HMD HMD (Head Mounted Display) Disadvantage Low Resolution

Heavy ,Inconvenient Expensive ($1399-$145,000) 13 STEREOSCOPIC 2-COLOR ANAGLYPH 2-Color Anachrome anaglyph is an Anaglyph Variant Use Anaglyph two ofonly color in filters. the border of object,

and preserve the color in the center object. Advantage This technique can reduce color distortion. Simple Disadvantage Color Distortion 14 STEREOSCOPIC

CHROMADEPTH Use prism. Advantage Can be viewed without glasses. Disadvantage ChromaDepth Colorless

15 STEREOSCOPIC POLARIZING GLASS Advantage Polarized eyeglasses are cheap.

Disadvantage Not feasible to use with LCD projector. Viewers need to keep their head level to prevent left and right channels bleedover the opposite channel. Need a polarization preserving screen. 16 STEREOSCOPIC SHUTTER GLASS Create 3D Stereoscopic illusion by Switching projected picture for left and right eyes continuously.

The appeared image and shutter glasses have to be synchronize. 17 STEREOSCOPIC SHUTTER GLASS Shutter Glass Mechanical Shutter

18 Left Eye Right Eye 3D SYSTEMS COMPARISON TABLE Color Distortion HMD Anaglyph AnaChrome ChromaDepth

No (But Low Res) Medium Low High Polarizing No Shutter Glass No Cost Medium

Cheap Cheap Cheap Expensive (2 Projector) Medium (1 Projector) 19 TRACKING SYSTEM Raw Data Position & Orientation Post Recognition Measurement Data Fusion Projection Matrix Calculation

20 TRACKING SYSTEM Ultrasonic Electromagnetic Optical LaserTracker System Mechanical Tracker Marker Face Recognition 21 TRACKING SYSTEM Position Tracker System

Mechanical Tracker Ultrasonic Electromagnetic Optical Laser Marker Face Recognition 22 CONCEPT OF THE PROPOSED SYSTEM CONCLUSION

Commercial stereoscpic uses special custom made projector. Commercial Stereoscopic is Expensive. We can reduce cost if we can use a common off the shelf projector. Because, The shutter glass and appeared picture isnt sync. There are synchronization Problem when integrating common projector to We can fix this problem by building synchronization kit. 23

CONCEPT OF THE PROPOSED SYSTEM SYNCHRONIZATION PROBLEM The problem is , When we use common projector in projecting 3D stereoscopic signal, the projected picture isnt synchronized with the shutter glasses. Cause of problems The mechanism of DLP Projector Micromirror and its operation.

Color Wheel External Box Display Shutter Glass Shutter Glass Sync 24 CONCEPT OF THE PROPOSED SYSTEM CAUSE OF PROBLEM, DLP TECHNOLOGY DLP (Digital Lighting Processor) DMD (Digital Micromirror Device)

MEMS (Micro Electro-Mechanism) 25 CONCEPT OF THE PROPOSED SYSTEM SOLUTION The cause of the problem The interval in digital lighting processor causes the appeared frame on the screen delayed. Ghosting Effect Frame Dropped

Rainbow Effect, Especially on DLP Projector. Solution Change synchronization source from graphic card output signal to the marker on appeared picture on the screen. Dongle Shutter Glass Sync Display External Box Graphic Card Shutter Glass Sync Shutter Glass Sync 26

PROPOSED SYSTEM Com : Computer MIB : Marker Insertion Box Proj : Projector Tcam :Tracker Camera ODD : Opto Detection Device ShtCnt : Shutter glasses Control 27 PROPOSED SYSTEM COMPONENT DETAILS Components that have to be developed. MIB : Marker Insertion Box

Insert the marker in projected picture. There is switch on the box for reset, If the pictures from left and right eyes were swapped. ODD : Opto Detector Device Detect the appearance of the synchronization marker on screen, And transmit signal to the shutter glasses control box if there were a marker appeared. Easy to attached on Left-top of the screen. 28 PROPOSED SYSTEM COMPONENT DETAILS

ShtCnt : Shutter glasses Control Synchronize shutter glasses timing to the picture by detecting signal from ODD. Can slice timing from synchronization signal by using digital PLL. Tcam : Tracker Camera Track viewer head position by the shutter glasses attached camera. Locate head position by looking at the implanted LED marker on the screen. Can be fused with angular acceleration sensor. 29 PROPOSED SYSTEM

BUY OR BUILD Off the Shelf Tracking System Marker Insertion Box Proposed 3D Display System Developed Components Computer with

Stereosco pic Renderer DLP Projector Opto Detection Device Shutter Shutter Glass Glasses Controller 30 PROPOSED SYSTEM

BUDGET COMPARISON Proposed System Customized 31 * Tracker :InterSense IS-1200 VisTracker * Computer and Software are omited PROPOSED SYSTEM IMPLEMENTATION PLAN Proposed 3D Display System Display

Shut Synchronizationter Mar ker Inser tion Box Opto Glas s Cont rolle r Tracker

IR Tracker Tracking Software 32 PROPOSED SYSTEM MIB : FUNCTION Synchronization System Marker Insertion Box Opto Device(ODD)

The Detector inserted marker will be appear on top-left of the Shutter screen.Glass Controller ODD 33 PROPOSED SYSTEM MIB : IMPLEMENTATION Synchronization System Marker Insertion Box

Opto Detector Device(ODD) VSync Pixel Clock Generator Shutter Glass Controller Counting Circuit Horizontal HSync Counting Circuit Vertical Switch (a) Compare-Horizontal Compare-Vertical Comparator (b)

FPGA (c) (d) Marker VGA Source To Projector Switch 34 PROPOSED SYSTEM ODD

Synchronization System Frame Marker Insertion Opto Detector Device(ODD) Shutter Glass Controller Shutter Glass Controller Computer (WinSGL Scheme) 35

PROPOSED SYSTEM ODD : WINSGL Synchronization System Fix Frame-Dropped Problem. Long Delayed - Frame Synchronization SoftGenlock Short Delayed Signal Synchronization

Hardware GenLock (SGI / GeForce (SLI) / nVidia) Software (WinSGL) 36 PROPOSED SYSTEM SHUTTER GLASSES CONTROLLER Synchronization System Frame Marker Insertion Opto Detector Device(ODD) Shutter Glass Controller PLL

Implemented on Microcontroller. Shutter Glass Time Base N ODD Increase / Decrease Time base Sequential Circuit Glass Control

37 PROPOSED SYSTEM SHUTTER GLASSES CONTROL LCD Technology in shutter glasses Problem in controlling Shutter Glass Spectrum Transparency Ghosting Effect : LCD Responding 38 CONTROL

LCD TECHNOLOGY IN SHUTTER GLASSES LCD TN TFT (Liquid Crystal Display) (Twisted Nematic) (Transistor Film Transistor) 39 PROPOSED SYSTEM : SHUTTER GLASSES CONTROL LCD TECHNOLOGY IN SHUTTER GLASSES LCD TN

TFT (Liquid Crystal Display) (Twisted Nematic) (Transistor Film Transistor) Twist Direction Bipolarity Capacitance 40 Dead Band PROPOSED SYSTEM : SHUTTER GLASSES CONTROL GHOSTING EFFECT Slow response. LCD molecular momentum and capacitance.

Can be reduced by adding an Interval between control sequences. Proposed by Kunz ,2001 41 PROPOSED SYSTEM : SHUTTER GLASSES CONTROL IMPLEMENTATION PLAN Dead Band Generator PLL Shutter Glass

Time Base N ODD Increase / Decrease Time base Sequential Circuit Bipolar Generator Glass Control 42 PROPOSED SYSTEM

TRACKING SYSTEM Synchronization System Frame Marker Insertion Dongle, Snap on screen Device Shutter Glass Controller Head Tracker IR Marker Implanted Screen & IR Camera Vision Base Tracking

Software 43 PROPOSED SYSTEM TRACKING SYSTEM Vision based tracker system. Integrate angular acceleration sensor for a better respond. 44 PROPOSED SYSTEM : TRACKING SYSTEM IMPLEMENTATION Head Tracker

IR Marker Implanted Screen & IR Camera Vision Based Tracking Software Localization based on correspondences from the features in known environment. 45 PROJECT SCHEDULE Synchronization System ODD & Shutter Glass Controller Development MIB Improvement Tracking

Implement of Vision Tracker Software Building IR Marker Implanted Projector Screen Paper Works Publish Paper Conclusions System Testing 46 CONCLUSIONS I will Build a stereoscopic upgrading kit for DLP projector Opto

Integration of Tracking System A Marker Insertion Box Rendering Application Example IR Marker Implanted Screen Shutter Glass Controller Vision Based Tracking Software System Capability Display 3D object and with corrected volume. User will see objects at stationary position floating in the screen. 47 Thank you 48

The End 49 PROJECTS SCHEDULE 50 PROPOSED SYSTEM SYNCHRONIZATION SYSTEM : WINDOWS TIMMER What is WinSGL time base. And, How precision it is?

The WinSGL Timming retrieves from QueryPerformanceCounter Function. The time base frequency can retrieve from QueryPerformanceFrequency Function. Each computer has different timer resolution. For Example the timer resolution of this computer is 1/3579545 Hz = 0.279 uS 51

PROPOSED SYSTEM SYNCHRONIZATION SYSTEM : CHANGING GRAPHIC CARD SIGNAL STRUCTURE Changing of output VGA signal timing structure may cause the monitor malfunction. From Waschbusch, 2006 experiments. So, The most suitable method in changing timing without distortion of picture is the changing of vertical front porch. 52

PROPOSED SYSTEM SYNCHRONIZATION SYSTEM : CHANGING GRAPHIC CARD SIGNAL STRUCTURE Frame Structure Line Structure 53 PROPOSED SYSTEM 3D STEREOSCOPIC RENDERING OpenGL has stereoscopic rendering capability. Programmer can select which buffer to render using

glDrawBuffer(); Stereoscopic rendering buffer alias. GL_BACK_LEFT or GL_BACK_RIGHT There are 2 process in rendering stereoscopic on OpenGL 1. Select rendering buffer GL_BACK_LEFT or GL_BACK_RIGHT Ex glDrawBuffer(GL_BACK_LEFT); 2. Change projection matrix of left or right projection.

Ex gluLookAt(camera.vp.x + r.x, camera.vp.y + r.y, camera.vp.z + r.z, camera.vp.x + r.x + camera.vd.x, camera.vp.y + r.y + camera.vd.y, camera.vp.z + r.z + camera.vd.z, camera.vu.x, camera.vu.y, camera.vu.z); 54 PROPOSED SYSTEM 3D STEREOSCOPIC RENDERING The Difference of Symmetric & Asymmetric Frustum rendering In Toed-In camera which is an incorrect rendering of stereo image, Use Symmetric Frustum ,This incorrect create stress of depth perception. (Lacotte,1995)

Screen Left Camera Right Camera Projective Plane 55 PROPOSED SYSTEM 3D STEREOSCOPIC RENDERING A correct rendering use Asymmetric Frustum, which change the camera axis perpendicular to screen. Screen = Projective Plane

Left Camera Right Camera 56 PROPOSED SYSTEM 3D STEREOSCOPIC RENDERING Parallax Positive Parallax Zero Parallax Negative Parallax

Screen = Projective Plane Screen = Projective Plane Screen = Projective Plane Left Camera Left Camera Left Camera Right Camera Right Camera Right Camera

57 PROPOSED SYSTEM SYNCHRONIZATION SYSTEM : GENLOCK Can Sync Display Signal. Using Special Hardware. Very expensive. 58 PROPOSED SYSTEM SYNCHRONIZATION SYSTEM : SOFTGENLOCK Proposed by Schaeffer, 2000 Using LAN, Long Delay time. Able to Sync Rendering Sequence of multiple Displays. Guarantee 100 ms

Cannot Sync in Signal Level 59 PROPOSED SYSTEM SYNCHRONIZATION SYSTEM : SOFTGENLOCK Proposed by Allard, 2002 Using LAN (Myrinet) , 50uS Guarantee. System needs Real Time OS. Cannot be used in WindowXP. Alternative System has been proposed by Allard 2003 Using Parallel Port, 50uS Guarantee. Can be used in Non-Realtime OS.

60 PROPOSED SYSTEM SYNCHRONIZATION SYSTEM : WINSGL Proposed by Waschbusch, 2006 Can synchronize signals from multiple Graphic cards. Can be used in WindowsXP Using Special API Library . PowerStrip Using Software Phase Lock Loop (PLL) technique. PLL is a Proportional-Integral (PI) feedback system. 61

PROPOSED SYSTEM SYNCHRONIZATION SYSTEM : WINSGL Mechanic of WinSGL (M. Waschbsch,2006) 62 POLARIZATION OF LIGHT Circular Elliptical Linear 63 CONCEPT OF THE PROPOSED SYSTEM

CAUSE OF PROBLEM, DLP TECHNOLOGY DLP (Digital Lighting Processor) 64 PROPOSED SYSTEM : SHUTTER GLASSES CONTROL LCD SPECTRUM TRANSPARENCY The transparency in different colors are difference. Investigated By Woods ,2002 The transparencies in same spectrum on different time are difference. Showing a Non-Linear Characteristic.

65 PROPOSED SYSTEM Com : Computer MIB : Marker Insertion Box Proj : Projector Tcam :Tracker Camera ODD : Opto Detection Dongle ShtCnt : Shutter glasses Control 66 PROPOSED SYSTEM This

project consists of the development of four devices which are , Marker Insertion Box Opto Detector Dongle attached on the projected screen Shutter Glasses mobile Controller. Vision- Inertia fusioned head tracking system. 67

Recently Viewed Presentations

  • How is gentrification impacting contemporary ... - LSE London

    How is gentrification impacting contemporary ... - LSE London

    Resisting Gentrification in EC. SOCIAL MEDIA. After years of campaigning and through collective action the organisations listed managed to defer the Elephant and Castle Town Centre Application on 30thJanuary 2018. First Planning Committee Meeting that voted against the development was...
  • U.S. Landmark Supreme Court Cases - coach tomlin

    U.S. Landmark Supreme Court Cases - coach tomlin

    Gregg V. Georgia (1976) Reaffirmed the Supreme Court's acceptance of the use of the death penalty in the United States, upholding, in particular, the death sentence imposed on Troy Leon Gregg. Gregg V. Georgia The Court also found that the...
  • eciconference.com

    eciconference.com

    -- Romans 1:16; ESV The gospel - treasure in jars of clay But we have this treasure in jars of clay, to show that the surpassing power belongs to God and not to us.
  • SNOOKER - phil.uni-siegen.de

    SNOOKER - phil.uni-siegen.de

    Favourite to make it through the top half of the draw after the early exits of Stephen Hendry and Ronnie O'Sullivan, he duly obliged as victories over Tony Drago (10-2), Alan McManus (13-4), Jimmy White (13-7) and Joe Swail (17-12)...
  • Loan Servicing in today's environment - RegList

    Loan Servicing in today's environment - RegList

    Loss Mitigation & Servicing Transfer Overview. Servicers must identify In-Flight Loss Mit as of Servicing Transfer Date. General Requirements . Loss Mit rights / protections available before transfer continue to apply after transfer. Unique Requirements. Comply with Loss Mit timeframes...
  • National Housing Trust Fund Tennessee Community Programs Division

    National Housing Trust Fund Tennessee Community Programs Division

    Eligible Applicants. For-profit or non-profit Developers. Public Housing Authorities. The Applicant . must be the sole general partner or the sole managing member of the ownership entity or own 100% of the stock of a corporate ownership entity.
  • Misleading Graphs - laurenrussellatwheeler.weebly.com

    Misleading Graphs - laurenrussellatwheeler.weebly.com

    The "classic" types of misleading graphs include cases where: The vertical scale is too big or too small, or skips numbers, or doesn't start at zero. The graph isn't labeled properly. Data is left out. But some real life misleading...
  • CUSD Programs

    CUSD Programs

    Sign language. Oral. Auditory. Individual and small group therapies in speech, language and auditory are included within this program. Mainstreaming and reverse mainstreaming will be a part of this program. Individual needs will be met as a part of this...