# Resolving Scale Ambiguity Via XSlit Aspect Ratio Analysis

###### Abstract

In perspective cameras, images of a frontal-parallel 3D object preserve its aspect ratio invariant to its depth. Such an invariance is useful in photography but is unique to perspective projection. In this paper, we show that alternative non-perspective cameras such as the crossed-slit or XSlit cameras exhibit a different depth-dependent aspect ratio (DDAR) property that can be used to 3D recovery. We first conduct a comprehensive analysis to characterize DDAR, infer object depth from its AR, and model recoverable depth range, sensitivity, and error. We show that repeated shape patterns in real Manhattan World scenes can be used for 3D reconstruction using a single XSlit image. We also extend our analysis to model slopes of lines. Specifically, parallel 3D lines exhibit depth-dependent slopes (DDS) on their images which can also be used to infer their depths. We validate our analyses using real XSlit cameras, XSlit panoramas, and catadioptric mirrors. Experiments show that DDAR and DDS provide important depth cues and enable effective single-image scene reconstruction.

## 1 Introduction

A single perspective image exhibits scale ambiguity: 3D objects of difference sizes can have images of an identical size under perspective projection, as shown in Fig. 1. In photography and architecture, the forced perspective technique employs this optical illusion to make an object appear farther away, closer, larger or smaller than its actual size while preserving the aspect ratio. Fig. 2 shows an example in the film “the Lord of the Rings” where characters apparently standing next to each other would be displaced by several feet in depth from the camera. For computer vision, however, such an invariance provides little help, if not harm, to scene reconstruction.

Prior approaches on resolving the scale ambiguity range from imposing shape priors [3, 10], extracting local descriptors [16] to analyzing the vanishing points [13]. In this paper, we approach the problem from a different angle: we analyze aspect ratio changes of an object with respect to its depth. Consider a frontal-parallel rectangle of size located away from the sensor and where is the camera’s focal length. Under perspective projection, its image is an rectangle similar to R of size . This implies that the aspect ratio of and remain the same. The property can termed as aspect-ratio invariance (ARI). ARI is an important property of perspective projection. ARI, however, no longer holds under non-centric projections, exhibiting depth-dependent aspect-ratio (DDAR).

In this paper, we explore DDAR in a special type of non-centric cameras called the crossed-slit or XSlit camera [29]. Earlier work in XSlit imaging includes the pushbroom camera used in satellite imaging and XSlit panoramas by stitching a sequence of perspective images. The General Linear Camera theory [28] has shown that the XSlit camera is generic enough to describe a broad range of non-centric cameras. In fact, pushbroom, orthographic and perspective cameras can all be viewed as special XSlit entities. Geometrically, an XSlit camera collects rays that simultaneously pass through two oblique (neither parallel nor coplanar) slits in 3D space, in contrast to a pinhole camera whose rays pass through a common 3D point. Ye et al.[27] has further proposed a practical realization by relaying a pair of cylindrical lenses coupled with slit-shaped apertures.

We show that the XSlit camera exhibits DDAR that can help resolve scale ambiguity. Consider two 3D rectangles of an identical size lying at different depth with their images being and respectively. Different from the pinhole case, the AR of and will be different, as shown in Fig. 1. We first develop a comprehensive analysis to characterize DDAR in the XSlit camera. This derivation leads to a simple but effective graph-cut based scheme to recover object depths from a single XSlit image and an effective formulation to model recoverable depth range, sensitivity, and errors. In particular, we show how to exploit repeated shape patterns exhibiting in real Manhattan World scenes to conduct 3D reconstruction.

Our DDAR analysis can further be extended to model the slopes of lines. Specifically, for parallel 3D lines of a common direction, we show that as far as the direction is different from both slits, their projections will exhibit depth-dependent slopes or DDS, i.e., the projected 2D lines will have different slopes depending on their depths. DDS and DDAR can be combined to further improve 3D reconstruction accuracy. We validate our theories and algorithms on both synthetic and real data. For real scenes, we experiment on different types of XSlit images including the ones captured by the XSlit lens [27] and synthesized as stitched panoramas [21]. In addition, our scheme can be applied to catadioptric mirrors by modeling reflections off the mirrors as XSlit images. Experiments show that DDAR and DDS provide important depth cues and enable effective single-image scene reconstruction.

## 2 Related Work

Our work is most related to Manhattan World reconstruction and non-centric imaging.

A major task of computer vision is to infer 3D geometry of scenes using as fewer images as possible. Tremendous efforts have focused on recovering a special class of scene called the Manhattan World (MW) [4]. MW is composed of repeated planar surfaces and parallel lines aligned with three mutually orthogonal principal axes and fits well to many man-made (interior/exterior) environments. Under the MW assumption, one can simultaneously conduct 3D scene reconstruction [6, 10] and camera calibration [22].

MW generally exhibits repeated line patterns but lacks textures and therefore traditional stereo matching is less suitable for reconstruction. Instead, prior-based modeling is more widely adopted. For example, Furukawa et al. [10] assign a plane to each pixel and then apply graph-cut on discretized plane parameters. Other monocular cues such as the vanishing points [5] and the reference planes (e.g. the ground) have also been used to better approximate scene geometry. Hoime et al. [12, 11] use image attributes (color, edge orientation, etc.) to label image regions with different geometric classes (sky, ground, and vertical) and then “pop-up” the vertical regions to generate visually pleasing 3D reconstructions. Similar approaches have been used to handle indoor scenes [6]. Machine learning techniques have also been used to infer depths from image features and the location and orientation of planar regions [19, 20]. Lee et al. [14] and Flint et al. [9] search for the most feasible combination of line segments for indoor MW understanding.

Our paper explores a different and previously overlooked properties of MW: the scene contains multiple objects with an identical aspect ratio or size (e.g., windows) but lie at different depths. In a perspective view, these patterns will map to 2D images of an identical aspect ratio. In contrast, we show that the aspect ratio changes with respect to depth if one adopts a non-centric or multi-perspective camera. Such imaging models widely exist in nature, e.g., a compound insect eye, reflections and refractions of curved specular surfaces, images seen through volumetric gas such as a mirage, etc. Rays in these cameras generally do not pass through a common CoP and hence do not follow pinhole geometry. Consequently, they lose some nice properties of the perspective camera (e.g., lines no longer project to lines); at the same time they also gain some unique properties such as the coplanar common points [25], special shaped curves [26], etc. In this paper, we focus on the depth-dependent aspect ratio (DDAR) property for inferring 3D geometry.

The special non-centric camera we employ here is the crossed-slit or XSlit camera. An XSlit camera collects rays simultaneously passing through two oblique lines (slits) in 3D space. The projection geometry of an XSlit has been examined in various forms in previous studies, e.g., as projection model in [29], as general linear constraints in [28], and as ray regulus in [18]. For long the XSlit camera has been restricted to a theoretical model as it is physically difficult to acquire ray geometry following the slit structure. The only exception is the XSlit panoramas [23, 17] where an XSlit panorama can be stitched from a translational sequence of images or more precisely a 3D light field [15]. Recently, Ye et al.[27] presented a practical XSlit camera. Their approach relays two cylindrical lenses with perpendicular axes, each coupled with a slit shaped aperture to achieve in-focus imaging.

## 3 Depth Dependent Aspect Ratio

We first analyze how aspect ratio of an object changes with respect to its depth in an XSlit camera. We call this property Depth-Dependent Aspect Ratio or DDAR.

### 3.1 XSlit Camera Geometry

A XSlit camera collects rays that pass through two oblique slits (neither coplanar nor parallel) simultaneously. For simplicity, we align the sensor plane to be parallel to both slits and corresponds to the x-y plane. Such a setup is consistent with the real XSlit design [27] and the XSlit panoramas [29]. Further, we assume the origin of the coordinate system corresponds to the intersection of the two slits’ orthogonal projections on the sensor plane, as shown in Fig. 3. The two slits lie at depth and and have angle and w.r.t the -axis, where and . Under this setup, the components along the two slits are 0. And the - directions are and that spans space.

Previous approaches study projection using XSlit projection matrix [29], light field parametrization[28], and linear oblique[17]. Since our analysis focuses on aspect ratio, we introduce a simpler projection model analogous to pinhole projection. Consider a 3D point to . The process can be described as follows: first decompose the - components of into two basis vectors, , and write it as . Next project individual component to . Each component can be viewed as pinhole projection as they are parallel to either slits. Finally obtain the mapping from to .

We first represent on the basis of and

We then project and independently. Notice the two components are at depth . And is parallel to slit 1 and is parallel to slit 2. Their projections imitate the pinhole projection except that the focal lengths are different:

(1) |

Notice the XSlit mapping is linear, we can combine and to compute .

and are also the linear representations of on basis of and .

### 3.2 Aspect Ratio Analysis

Equation 1 reveals that and are projected to and with different scale on the two directions parallel to the slits. In other words, with the change of depth, the ratio will be change accordingly. Specifically, we can compute the ratio as:

(2) |

This is fundamentally different from the pinhole/perspective case where the ratio remains static across depth. To understand why it is the case, recall that the pinhole camera can be viewed as a special XSlit camera where the two slits intersect, i.e., they are at the same depth . In that case, Eqn. degenerates to , i.e., the aspect ratio is invariant to depth.

For the rest of the paper, we use to represent the base aspect ratio and represents the aspect ratio after XSlit projection. From Eqn. 2, we can derive the depth from the aspect ratio as:

(3) |

#### Monotonicity:

Given a fixed XSlit camera, Eqn. 3 reveals that the AR monotonically decreases with respect to . In fact, we can compute the derivative of with respect to :

(4) |

Since , we have , i.e., the depth decrease monotonically with . In fact the minimum and the maximum ARs correspond to:

(5) |

#### Depth Sensitivity:

Another important we address here is depth sensitivity. We compute the partial derivative of respect to for ranging from to and we have:

(6) |

The sensitivity is the absolute value of and it decrease monotonically for . This implies that as objects get further away, the depth accuracy recoverable from the AR also decreases. According to Eqn. 6, the sensitivity is positively related to and . Farther separated slits and greater ratio between two slits distances corresponds to higher sensitivity. This phenomenon resembles classical stereo matching using two perspective cameras where the deeper the object, the smaller the disparity and the less accuracy that stereo matching can produce.

#### Depth Range:

We can further compute the maximum discernable depth . To do so, we first compute when as . Next we change with , the smallest ratio change that is discernable in image. We have . The lower bound of is , is the image width or height, without considering subpixel accuracy. Sine the depth changes monotonically with , the maximum discernable depth is correspond to . Finally we compute the depth use Eqn. 3:

(7) |

Eqn. 7 indicates that the larger slit distance ratio and bigger separating distance of two slits correspond to a larger discernable depth range.

## 4 Depth Inference from DDAR

Our analysis reveals that if we know in prior, i.e., the base aspect of the object, we can directly infer the object’s depth from its aspect ratio in the XSlit camera. A typical example is using an Parallel-Orthogonal XSlit camera (PO-XSlit) to capture an up-right rectangle. In a PO-XSlit camera, the slits are orthogonal and axis aligned. In this case, directly corresponds to the aspect ratio of the rectangle and corresponds to the observed AR of the project rectangle.

The simplest case is to capture a up-right square whose aspect ratio . From the AR change, we can directly infer its depth using Eqn. 3. In practice, we do not know the AR of the object in prior. However, many natural scenes contain (rectangular) objects of identical sizes (e.g., windows of buildings) and we can infer their depth even without knowing their ground truth AR.

#### Shape Prior

Specifically, consider rectangles of an identical but unknown sizes and hence ARs. Assume they lie at different depths . According to Eqn. 1, we have two equations for each rectangle:

(8) |

Where , , and are unknowns. And and are computed from the image. For identical rectangles, we have unknowns and equations. The problem can be solved using SVD when two or more identical rectangles are present. Fig. 4 shows several examples using our technique recovering depth of multiple cards of an identical size. The depth along with the exact scale can be extracted from a single XSlit image under the shape prior.

#### Depth Prior

If the objects are of identical aspect ratios but of different sizes, still exhibit ambiguity. Then according to Eqn. 2, there are equations and unknowns (assume objects). One useful prior that can be imposed here is the distribution of depth of objects. In real scenes, objects are likely to br evenly distributed. For example, if we assume that these rectangles are with equal distance along the direction.

In this scenario/case, we obtain the AR equation for each object:

(9) |

Furthermore, the equal distance prior gives us the constraint , for . For objects in the scene, we have equations, and unknowns. The problem is determined if we have 3 rectangles in the scene. And it’s over-determined if we have more than 3 objects.

It is very important to note that inferring depth under the same setting is not possible in the perspective camera case. In pinhole image and , hence Eqn. 8 and Eqn. 9 degenerate. As shown in the introduction, scaling the scene and adjusting the distance from the scene to the pinhole camera accordingly will result in a same projected image as the ground truth scene dose.

### 4.1 Line Slope Analysis

Section 4 reveals that inferring depth from DDAR is that we need to obtain some prior knowledge of either the base AR or the depth distribution of multiple identities. Further, the rectangular shape needs to be in the up-right position to align with the two slits. In this section, we extend the AR analysis to study the slope of lines and we show that this analysis leads to a more effective depth inference scheme.

We treat a line frontal parallel to the XSlit camera as the diagonal of a parallelogram (rectangle in PO-XSlit case), whose sides are along the two slits directions. Given a line with slope and a point on it, then we have of is on the line. We can map it to a line with slope on XSlit image, which and map to points and respectively. According to definition of , we can decompose the segment - onto two slits direction and take the ratio of the two component to get :

(10) |

Eqn. 10 and 3 reveals that we can directly infer the depth of the line from its slope. Similar to the aspect ratio case, such inference cannot be conducted in the pinhole camera since the frontal parallel line slope is invariant to depth.

The analysis above applies only to lines parallel to XSlit camera. For lines unparallel to the camera, previous studies have shown that they map to curves, or more precisely hyperbolas [26]. However, our analysis can still be applied by computing the tangent direction on the hyperbolas, where each tangent direction can be mapped to a unique depth. This can be viewed as approximating a line as piecewise segments frontal-parallel to the camera where each segment’s depth can be computed from its projected slope. The complete derivation is included in the supplementary materials.

### 4.2 Scene Reconstruction

Based on our theories, we present a new framework on single-image Manhattan scene reconstruction using the XSlit camera. The main idea here is to integrate depth cues from DDAR (for up-right rectangle objects) and from line slopes (for other lines and rectangles) under a unified depth inference framework. Further, the initial depth estimation scheme can only infer depths on pixels lying on the boundaries of the objects, it is important to propagate the estimation to all pixels in order to obtain the complete depth map.

Our approach is to first infer the depth for the lines or repeat objects from DDAR. Next we cluster pixels into small homogenous patches or superpixels [8]. The use of superpixels not only reduce the computational cost and but also preserves consistency across the regions, i.e the pixels in a homogeneous region such as walls of a building tend to have a similar depth. Finally, we model optimal depth estimation/propagtion as a Markov Random Field (MRF). The initial depth value for superpixel is computed by blending the depths inferred from DDAR according to their geodesic distance to . And then we the smooth out based on distance variations and color consistency. This procedure can be modeled as a Markov Random Field (MRF), where the data term: . And the smoothness term is: , is the weight account for distance variations and color consistency. Finally we estimate the depth map by optimizing the energy function: , represents the superpixel neighborhood. The problem can be solved using the graph-cut algorithm [2].

## 5 Experiments

We experiment our approach on both synthetic and real scenes. For synthetic scenes, we render images using 3ds Max. For real scenes, we acquire images using the XSlit lens as well as synthesize XSlit panoramas from video sequences.

#### Synthetic Results.

We first render an XSlit images of a scene containing repeated shapes (Fig. 6). The architecture consists of concentric arches of depths ranging from 900cm to 2300cm. We assume that the actual aspect ratio of the arches is 1, i.e., a circle. We position a PO-XSlit camera with cm and cm frontal parallel to the arches and the images of the arches are ellipses of different aspect ratios. Notice that in the pinhole case, they will be map to circles. We first detect ellipses using Hough transform and then measure their aspect ratios using the major and minor axes. Finally, we use the ratios to recover their depths using Eqn. 3. Our recovered depths for the near and far arches are 906.6cm and 2281.0cm, i.e., the errors are less than 2%.

Next we render two XSlit panoramas, one for the corridor and the second for the facade. Both scenes exhibit strong linear structures with many horizontal and vertical lines. Our analysis shows that for lines to exhibit DDS, they should not align with either slit. Therefore, we rotate the POXSlit, i.e., and . For the corridor scene, the XSlit camera has a setting of cm, cm and for the facade scene, cm, cm. We first use the LSD scheme[24] to extract 2D lines from the XSlit images and cluster them into groups of horizontal and vertical (in 3D) lines. This is done by thresholding their aspect ratios Eqn. 5. For lines in each group, we compute their depths using Eqn. 10 and 3. This results in a sparse depth map. To recover the full depth map, we apply the MRF (Sec. 4.2) and the final result is shown in Fig. 7. Our technique is able to recover different depth layers while preserving linear structures. For comparison, we render a single perspective image and apply the learning-based scheme Make3D [20]. Make3D can detect several coarse layers but cannot detect fine details as ours since these linear structures appear identical in slope in a perspective image but exhibit different slopes in an XSlit image.

#### Real Results.

We explore several approaches to acquire XSlit images of a real scene: by a real XSlit lens and through panorama synthesis. For the former, we use an XSlit lens [26]. The design resembles the original anamorphoser proposed by Ducos du Hauron that replaces the pinhole in the camera with a pair of narrow, perpendicularly crossed slits. Similar to the way of using a spherical thin lens to increase light throughput in a pinhole camera, the XSlit lens relay perpendicular cylindrical lenses, one for each slit. In our experiments, we use two cylindrical lenses with focal lengths 2.5cm (closer to the sensor) and 7.5cm (farther away from the sensor) respectively. The distance between the two slits is adjustable between 5cm and 12cm and the slit apertures have a width of 1mm.

We first capture a checkerboard at known depths and compare the measured AR and our predicted AR using Eqn. 3. We test three different slit configurations, , and . Fig. 9 shows that the predicted AR curve fits well with the ground truth. In particular, as an object gets farther away from the sensor, its AR also changes slower. Further, the larger the baseline is, the larger the aspect ratio variations across the same depth range, as predicted by our theory.

Next, we verify our DDS analysis using images captured the XSlit camera. In Fig. 10, we position a Lego house model in front of the XSlit camera (cm and cm). We rotate the XSlit camera by 45 degrees so that the 3D lines on the house will not align with either slit. Fig. 10(a) shows the acquired image. Next, we conduct line fitting and slope estimation similar to the synthetic case for estimating the depths of the detected lines. Fig. 10(a) highlights the detected lines and their depths (using color) and Fig. 10(b) shows the complete depth map using the MRF solution. The results shows that major depth layers are effectively recovered. The error on the top-right corner is caused by the lacking of line structures.

A major limitation using the XSlit camera is its small baseline (between the two slits). Our analysis shows that the maximum recoverable depth range depends on this baseline. Further, since images captured by the XSlit camera exhibits noise and strong defocus blurs, the actual recoverable depth range is even smaller. For example, our analysis shows that with baseline , two cards are placed at and will have undistinguishable ARs. Their ratio difference reach the lower bound that determined by pixel size. For outdoor scenes, we resort to XSlit panorama synthesis.

To produce XSlit panoramas, Zomet et al. [29] capture a sequence of images by translating a pinhole camera along a linear trajectory at a constant velocity. In a similar vein, Seitz and Adams et al. acquire the image sequence by mounting the camera on a car facing towards the street. Additional registration steps [1] can be applied to rectify the input images. Next, linearly varying columns across the images are selected and stitched together. Fig. 8 shows the procedure of generating a XSlit image using a regular camera.

Fig. 11 shows the XSlit panorama synthesized from an image sequence captured by a moving camera. We linearly increase the column index in terms of frame number and stitch these columns to form an XSlit image. The moving path of the camera is 55cm long. And the camera is tilt with 20 angle. The resulting two slits are at -1.8cm and 41cm respectively.

Recent ray geometry studies [7] show that reflections of certain types of catadioptric mirror can be approximated as an XSlit image. In Fig. 12, we position a perspective camera facing towards a cylindrical mirror and Fig. 12(b) shows that DDAR can both be observed on the acquired image. In particular, we put multiple cubes of an identical size at different depths and their aspect ratios change dramatically. This is because two virtual slits of the catadioptric mirror are separated far away where DDAR is more significant than the XSlit camera case. .

## 6 Conclusion and Further Work

We have comprehensively studied the aspect ratio (AR) distortion in XSlit cameras and exploited its unique depth-dependent property for 3D inference. Our studies have shown that unlike perspective camera that preserves AR under depth variations, AR changes monotonically with respect to depth in an XSlit camera, i.e., 3D objects of an identical size will exhibit significantly different AR under different depths. This has led to new depth-from-AR schemes using a single XSlit image even if the original AR of an object is unknown. We have further shown that similar to AR variations, the slope of projected 3D lines will also vary with respect to depth, and we have developed theories to characterize such variations based on AR analysis. Finally, AR and line slope analysis can be integrated for 3D reconstruction and we have experimented on real XSlit images captured by an XSlit camera, synthesized from panorama stitching, and captured using a catadioptric mirror to validate our framework.

There are a number of future directions we plan to explore. Our cylindrical lens based XSlit has a small baseline (i.e., the distance between the two slits) and therefore can only acquire AR changes within a short range. Constructing a large baseline XSlit camera will be costly as it is difficult to fabricate large form cylindrical lens. A more feasible solution would be adopt a cylindrical catadioptric mirror where the reflection image can be approximated as an XSlit image. In the future, we will explore effective schemes for correcting both geometric distortion and blurs due to imperfect mirror geometry. We will also investigate integrating our AR based solution into prior based frameworks to enhance reconstruction quality. For example, a hybrid XSlit-perspective camera pair can be constructed. Finally, since AR distortions commonly exhibit in synthesized panoramas as shown in the paper, we plan to study effective image-based distortion correction techniques to produce perspectively sound panoramas analogous to [1].

## References

- [1] A. Agarwala, M. Agrawala, M. F. Cohen, D. Salesin, and R. Szeliski. Photographing long scenes with multi-viewpoint panoramas. ACM Trans. Graph., 25(3):853–861, 2006.
- [2] Y. Boykov and V. Kolmogorov. An experimental comparison of min-cut/max-flow algorithms for energy minimization in vision. Pattern Analysis and Machine Intelligence, IEEE Transactions on, 26(9):1124–1137, 2004.
- [3] R. Cabral and Y. Furukawa. Piecewise planar and compact floorplan reconstruction from images. In Computer Vision and Pattern Recognition (CVPR), 2014 IEEE Conference on, pages 628–635. IEEE, 2014.
- [4] J. M. Coughlan and A. L. Yuille. Manhattan world: Compass direction from a single image by bayesian inference. In Computer Vision, 1999. The Proceedings of the Seventh IEEE International Conference on, volume 2, pages 941–947. IEEE, 1999.
- [5] A. Criminisi, I. Reid, and A. Zisserman. Single view metrology. International Journal of Computer Vision, 40(2):123–148, 2000.
- [6] E. Delage, H. Lee, and A. Y. Ng. A dynamic bayesian network model for autonomous 3d reconstruction from a single indoor image. In Computer Vision and Pattern Recognition, 2006 IEEE Computer Society Conference on, volume 2, pages 2418–2428. IEEE, 2006.
- [7] Y. Ding, J. Yu, and P. Sturm. Recovering specular surfaces using curved line images. In Computer Vision and Pattern Recognition, 2009. CVPR 2009. IEEE Conference on, pages 2326–2333. IEEE, 2009.
- [8] P. F. Felzenszwalb and D. P. Huttenlocher. Efficient graph-based image segmentation. International Journal of Computer Vision, 59(2):167–181, 2004.
- [9] A. Flint, C. Mei, D. Murray, and I. Reid. A dynamic programming approach to reconstructing building interiors. In Computer Vision–ECCV 2010, pages 394–407. Springer, 2010.
- [10] Y. Furukawa, B. Curless, S. M. Seitz, and R. Szeliski. Reconstructing building interiors from images. In Computer Vision, 2009 IEEE 12th International Conference on, pages 80–87. IEEE, 2009.
- [11] D. Hoiem, A. A. Efros, and M. Hebert. Automatic photo pop-up. ACM Transactions on Graphics (TOG), 24(3):577–584, 2005.
- [12] D. Hoiem, A. A. Efros, and M. Hebert. Geometric context from a single image. In Computer Vision, 2005. ICCV 2005. Tenth IEEE International Conference on, volume 1, pages 654–661. IEEE, 2005.
- [13] J. Košecká and W. Zhang. Video compass. In Computer VisionECCV 2002, pages 476–490. Springer, 2002.
- [14] D. C. Lee, M. Hebert, and T. Kanade. Geometric reasoning for single image structure recovery. In Computer Vision and Pattern Recognition, 2009. CVPR 2009. IEEE Conference on, pages 2136–2143. IEEE, 2009.
- [15] M. Levoy and P. Hanrahan. Light field rendering. In ACM SIGGRAPH, pages 31–42, 1996.
- [16] J. Novatnack and K. Nishino. Scale-dependent 3d geometric features. In Computer Vision, 2007. ICCV 2007. IEEE 11th International Conference on, pages 1–8. IEEE, 2007.
- [17] T. Pajdla. Geometry of two-slit camera. Rapport Technique CTU-CMP-2002-02, Center for Machine Perception, Czech Technical University, Prague, 2002.
- [18] J. Ponce. What is a camera? In Computer Vision and Pattern Recognition, 2009. CVPR 2009. IEEE Conference on, pages 1526–1533. IEEE, 2009.
- [19] A. Saxena, S. H. Chung, and A. Y. Ng. Learning depth from single monocular images. In Advances in Neural Information Processing Systems, pages 1161–1168, 2005.
- [20] A. Saxena, M. Sun, and A. Y. Ng. Learning 3-d scene structure from a single still image. In Computer Vision, 2007. ICCV 2007. IEEE 11th International Conference on, pages 1–8. IEEE, 2007.
- [21] Y. Y. Schechner and S. K. Nayar. Generalized mosaicing. In Computer Vision, 2001. ICCV 2001. Proceedings. Eighth IEEE International Conference on, volume 1, pages 17–24. IEEE, 2001.
- [22] G. Schindler and F. Dellaert. Atlanta world: An expectation maximization framework for simultaneous low-level edge grouping and camera calibration in complex man-made environments. In Computer Vision and Pattern Recognition, 2004. CVPR 2004. Proceedings of the 2004 IEEE Computer Society Conference on, volume 1, pages I–203. IEEE, 2004.
- [23] S. M. Seitz and J. Kim. The space of all stereo images. International Journal of Computer Vision, 48(1):21–38, 2002.
- [24] R. G. Von Gioi, J. Jakubowicz, J.-M. Morel, and G. Randall. Lsd: a line segment detector. Image Processing On Line, 2(3):5, 2012.
- [25] W. Yang, Y. Ji, J. Ye, S. S. Young, and J. Yu. Coplanar common points in non-centric cameras. In Computer Vision–ECCV 2014, pages 220–233. Springer, 2014.
- [26] J. Ye, Y. Ji, and J. Yu. Manhattan scene understanding via xslit imaging. In Computer Vision and Pattern Recognition (CVPR), 2013 IEEE Conference on, pages 81–88. IEEE, 2013.
- [27] J. Ye, Y. Ji, and J. Yu. A rotational stereo model based on xslit imaging. In Computer Vision (ICCV), 2013 IEEE International Conference on, pages 489–496, Dec 2013.
- [28] J. Yu and L. McMillan. General linear cameras. In ECCV, 2004.
- [29] A. Zomet, D. Feldman, S. Peleg, and D. Weinshall. Mosaicing new views: the crossed-slits projection. IEEE TPAMI, 25(6):741–754, June 2003.