<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD Journal Publishing DTD v3.0 20080202//EN" "https://jats.nlm.nih.gov/nlm-dtd/publishing/3.0/journalpublishing3.dtd">
<article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" article-type="research-article" dtd-version="3.0" xml:lang="en">
<front>
<journal-meta>
<journal-id journal-id-type="publisher">ISPRS-Annals</journal-id>
<journal-title-group>
<journal-title>ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences</journal-title>
<abbrev-journal-title abbrev-type="publisher">ISPRS-Annals</abbrev-journal-title>
<abbrev-journal-title abbrev-type="nlm-ta">ISPRS Ann. Photogramm. Remote Sens. Spatial Inf. Sci.</abbrev-journal-title>
</journal-title-group>
<issn pub-type="epub">2194-9050</issn>
<publisher><publisher-name>Copernicus Publications</publisher-name>
<publisher-loc>Göttingen, Germany</publisher-loc>
</publisher>
</journal-meta>
<article-meta>
<article-id pub-id-type="doi">10.5194/isprs-annals-III-2-121-2016</article-id>
<title-group>
<article-title>DIRECT IMAGE-TO-GEOMETRY REGISTRATION USING MOBILE SENSOR DATA</article-title>
</title-group>
<contrib-group><contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>Kehl</surname>
<given-names>C.</given-names>
</name>
<xref ref-type="aff" rid="aff1">
<sup>1</sup>
</xref>
<xref ref-type="aff" rid="aff2">
<sup>2</sup>
</xref>
</contrib>
<contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>Buckley</surname>
<given-names>S. J.</given-names>
</name>
<xref ref-type="aff" rid="aff1">
<sup>1</sup>
</xref>
</contrib>
<contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>Gawthorpe</surname>
<given-names>R. L.</given-names>
</name>
<xref ref-type="aff" rid="aff2">
<sup>2</sup>
</xref>
</contrib>
<contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>Viola</surname>
<given-names>I.</given-names>
</name>
<xref ref-type="aff" rid="aff4">
<sup>4</sup>
</xref>
</contrib>
<contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>Howell</surname>
<given-names>J. A.</given-names>
</name>
<xref ref-type="aff" rid="aff3">
<sup>3</sup>
</xref>
</contrib>
</contrib-group><aff id="aff1">
<label>1</label>
<addr-line>Uni Research AS - Centre for Integrated Petroleum Research (CIPR), Allégaten 41, 5007 Bergen, Norway</addr-line>
</aff>
<aff id="aff2">
<label>2</label>
<addr-line>Department of Earth Science, University of Bergen, Allégaten 41, 5007 Bergen, Norway</addr-line>
</aff>
<aff id="aff3">
<label>3</label>
<addr-line>Department of Geology &amp; Petroleum Geology, University of Aberdeen, AB24 3UE Aberdeen, UK</addr-line>
</aff>
<aff id="aff4">
<label>4</label>
<addr-line>Inst. of Computer Graphics and Algorithms, Technical University of Vienna, 1040 Vienna, Austria</addr-line>
</aff>
<pub-date pub-type="epub">
<day>02</day>
<month>06</month>
<year>2016</year>
</pub-date>
<volume>III-2</volume>
<fpage>121</fpage>
<lpage>128</lpage>
<permissions>
<copyright-statement>Copyright: &#x000a9; 2016 C. Kehl et al.</copyright-statement>
<copyright-year>2016</copyright-year>
<license license-type="open-access">
<license-p>This work is licensed under the Creative Commons Attribution 3.0 Unported License. To view a copy of this licence, visit <ext-link ext-link-type="uri"  xlink:href="https://creativecommons.org/licenses/by/3.0/">https://creativecommons.org/licenses/by/3.0/</ext-link></license-p>
</license>
</permissions>
<self-uri xlink:href="https://isprs-annals.copernicus.org/articles/III-2/121/2016/isprs-annals-III-2-121-2016.html">This article is available from https://isprs-annals.copernicus.org/articles/III-2/121/2016/isprs-annals-III-2-121-2016.html</self-uri>
<self-uri xlink:href="https://isprs-annals.copernicus.org/articles/III-2/121/2016/isprs-annals-III-2-121-2016.pdf">The full text article is available as a PDF file from https://isprs-annals.copernicus.org/articles/III-2/121/2016/isprs-annals-III-2-121-2016.pdf</self-uri>
<abstract>
<p>Adding supplementary texture and 2D image-based annotations to 3D surface models is a useful next step for domain specialists
to make use of photorealistic products of laser scanning and photogrammetry. This requires a registration between the new camera
imagery and the model geometry to be solved, which can be a time-consuming task without appropriate automation. The increasing
availability of photorealistic models, coupled with the proliferation of mobile devices, gives users the possibility to complement their
models in real time. Modern mobile devices deliver digital photographs of increasing quality, as well as on-board sensor data, which
can be used as input for practical and automatic camera registration procedures. Their familiar user interface also improves manual
registration procedures. This paper introduces a fully automatic pose estimation method using the on-board sensor data for initial
exterior orientation, and feature matching between an acquired photograph and a synthesised rendering of the orientated 3D scene as
input for fine alignment. The paper also introduces a user-friendly manual camera registration- and pose estimation interface for mobile
devices, based on existing surface geometry and numerical optimisation methods. The article further assesses the automatic algorithm’s
accuracy compared to traditional methods, and the impact of computational- and environmental parameters. Experiments using urban
and geological case studies show a significant sensitivity of the automatic procedure to the quality of the initial mobile sensor values.
Changing natural lighting conditions remain a challenge for automatic pose estimation techniques, although progress is presented here.
Finally, the automatically-registered mobile images are used as the basis for adding user annotations to the input textured model.</p>
</abstract>
<counts><page-count count="8"/></counts>
</article-meta>
</front>
<body/>
<back>
</back>
</article>