Wednesday, September 3, 2014

Google Cardboard & 3DUI


Google Cardboard, HMD 

  • I purchased two set of Google Cardboard about a week ago.
  • The cardboard test app from Google was nice, but the app is getting slower and slower every time I run the app...weird.
  • Anyway, I made the first simple test scene for it using Unity3D.
  • The simple side-by-side scene configuration method is described in HERE
  • I also combined camera manipulation method using gyro sensor data from smart device. HERE is nice and short introduction for it.
Test scene containing desk, sphere and capsule(occluded)
Rendered image in smart phone.

View from single lens

3D City Modeling using Panoramic Images and Digital Map, Using constraint

Pre-processing, Tilt correction, Cont'd

  • I developed the simple code for unsupervised tilt correction(perspective correction?) of panoramic image.
  • First the "Line segment detector" in vpdetection library has been applied on each panoramic image
  • By calculating the slope of line segments, define the subset of line segments that can be considered as vertical line segments.
Vertical line segments are indicated as red line



    • I define the amount of tilt for each line segment as length multiplied by the difference of x coordinate position of start and end point.
    Amount of tilt in original image. Mean : 1.6431

    •  Like described in the previous post, each pixel of the image can be mapped to the point on the unit sphere, so calculate the mapped point of all start and end points.
    • Then find lambda(rotation angle along x axis) and phi(rotation angle along  y axis) that is argmin for the sum of amount of tilt for vertical line segments.
    • Apply rotation to the entire image by given lambda and phi.

    Amount of tilt in rotated image. Mean : 1.0062