Hierarchical Modeling of Street Trees Using Mobile Laser Scanning
<p>Workflow of the proposed hierarchical tree modeling approach.</p> "> Figure 2
<p>Schematic of skeleton line connection adjustment (A is a node to be processed and the parent node of A need to be adjusted from B to C).</p> "> Figure 3
<p>Schematic of branching node processing: (<b>a</b>) Branching node before processing; (<b>b</b>) Branching node after processing. C and D need to be merged by the angle criterion. The new node C’ is generated by the average position of C and D and becomes the parent node of A, which needs to be adjusted for the angle condition. The parent node of A is finally changed from C’ to B.</p> "> Figure 4
<p>Schematic diagram of the parent–child node radius (<math display="inline"><semantics> <mi>P</mi> </semantics></math> is the parent node of the node <math display="inline"><semantics> <mrow> <mi>C</mi> <mn>1</mn> <mo>;</mo> <mo> </mo> <mi>L</mi> <mn>1</mn> </mrow> </semantics></math>, <math display="inline"><semantics> <mrow> <mi>L</mi> <mn>2</mn> </mrow> </semantics></math>, <math display="inline"><semantics> <mrow> <mi>L</mi> <mn>3</mn> </mrow> </semantics></math> and <math display="inline"><semantics> <mrow> <mi>L</mi> <mn>4</mn> </mrow> </semantics></math> are the lengths of each skeleton line).</p> "> Figure 5
<p>Schematic of local triangulation in the gap between segments of a tree trunk. The point of <math display="inline"><semantics> <mrow> <msub> <mi>C</mi> <mi>i</mi> </msub> </mrow> </semantics></math> needs to be interpolated around the circle of the flat cones.</p> "> Figure 6
<p>Point clouds of the study and segmented street trees.</p> "> Figure 7
<p>Skeleton line extraction from tree point clouds: (<b>a</b>) Tree point clouds; (<b>b</b>) Initial tree skeleton; (<b>c</b>) Optimized tree skeleton.</p> "> Figure 8
<p>Comparison of skeleton branch before and after connection adjustment: (<b>a</b>) Tree points; (<b>b</b>) Before optimization; (<b>c</b>) After optimization.</p> "> Figure 9
<p>Comparison of skeleton line processing by different angle condition: (<b>a</b>) is skeleton lines before processing; (<b>b</b>) is the branch node processing result by <math display="inline"><semantics> <mrow> <mo>Δ</mo> <mi>θ</mi> </mrow> </semantics></math> = 15°; and (<b>c</b>) is the branch node processing result by <math display="inline"><semantics> <mrow> <mo>Δ</mo> <mi>θ</mi> </mrow> </semantics></math> = 30°, which has noticeable difference with the original tree shape.</p> "> Figure 10
<p>Branch modeling results before and after using the local triangulation method: (<b>a</b>) branches model before gap filling; (<b>b</b>) branches model after gap filling.</p> "> Figure 11
<p>Tree reconstruction results at different levels of detail: (<b>a</b>) level 0 branches; (<b>b</b>) level 1 branches; (<b>c</b>) level 2 branches; (<b>d</b>) level 3 branches; (<b>e</b>) level 4 branches; and (<b>f</b>) level 5 branches.</p> "> Figure 12
<p>Modeling results of all street trees in the study area.</p> "> Figure 13
<p>Street tree point clouds overlaid on a row of selected tree models: (<b>a</b>) tree point clouds; (<b>b</b>) tree model results; (<b>c</b>) tree points overlaid on models.</p> "> Figure 14
<p>Tree branch diameter and modeling error (in mm) with respect to the level of details for six trees ((<b>a</b>–<b>f</b>) for tree 1–6 respectively).</p> "> Figure 15
<p>Comparison of modeling results with respect to different point densities: (<b>a</b>) original tree point clouds; (<b>b</b>) tree points thinned by 50%; (<b>c</b>) tree points thinned by 75%; (<b>d</b>) model from the original tree point clouds; (<b>e</b>) model from the tree points thinned by 50%; (<b>f</b>) model from the tree points thinned by 75%.</p> "> Figure 16
<p>Two trees for comparison of tree skeleton line extraction results: (<b>a</b>) Tree point clouds; (<b>b</b>) skeleton lines by the method [<a href="#B15-remotesensing-12-02321" class="html-bibr">15</a>]; (<b>c</b>) skeleton lines by the method [<a href="#B22-remotesensing-12-02321" class="html-bibr">22</a>]; (<b>d</b>) skeleton lines by our method.</p> ">
Abstract
:1. Introduction
2. Methods
2.1. Extraction of Tree Skeleton Lines
2.1.1. Initial Skeleton Lines Extraction
- (1)
- Individual tree points are organized into a connected undirected graph , in which represents the point cloud of the tree and represents the edge between points. The Euclidean distance between two points is defined as the weight of the edge. When two points are not connected, its weight is initialized as infinite.
- (2)
- Take the point with the lowest height as the root node of the tree and an unprocessed point as the target node. Mark the root node as the parent node of the tree. Then, set the distance of the edge to root node as zero and initiate the distances of edges between other points as infinity. Since tree point clouds are surface points of the tree, the root node found by the lowest height is a ‘pseudo’ root node of the tree, which is not the center position of the root. In order to eliminate this effect, the subsequent processing will use the original tree point to fit the true position of the root node.
- (3)
- Find the child node unmarked that is closest to the parent node in the connected graph and mark it as the current node.
- (4)
- Find all the next child nodes for the current node and then compare the sum of the distance from the root node to the current node and the distance from the current node to the next child node with the distance from the root node to the next child node. If the former distance is smaller than the latter one, update the path and repeat step (3), otherwise go to step (5).
- (5)
- Find the next unmarked child node that is closest to the root node and mark it as the current node, then repeat step (4); if the target node is reached, then the shortest path between the root node and the target node is obtained.
- (6)
- Repeat step (2) to step (5), when each point of the tree has one shortest path to the root node, then the shortest path search is completed.
2.1.2. Tree Skeleton Line Ranking
Algorithm 1: The main skeleton line ranking |
Input: S, initial tree skeleton lines; r, tree root node index; Node, tree skeleton node; |
Output: M, the queue of the main skeleton line; |
Initialize: branch node array b_mark[[] as unprocessed; |
Su, updated tree skeleton lines; |
1-level branch node stack L1; |
for each skeleton line in S do |
for each node i do |
if b_mark[i] unprocessed then |
set b_mark[i] processed; |
else |
set b_mark[i] branchnode; |
break; |
end if |
end for |
end for |
for each skeleton line in S do |
for each node i do |
Su<-i; |
if b_mark[i] is branchnode then |
Break; |
end if |
end for |
end for |
for each skeleton line in Su do |
for each node i do |
if b_mark[i] is branchnode and i has minimum path to r then |
minID=i; |
end if |
end for |
L1<-minID; |
end for |
for each skeleton line in Su do |
for j>= SearchID(L1) & j<= r do |
M<-Node(j); |
end for |
end for |
2.1.3. Skeleton Line Optimization
- (1)
- Connection adjustment
- (2)
- Branch node processing
2.2. Tree Modeling
2.2.1. Branch Radius Estimation
2.2.2. Update the Position and Radius of the Skeleton Node
2.2.3. Tree Branch Modeling
3. Tests and Results
4. Evaluation and Discussion
5. Conclusions
Author Contributions
Funding
Acknowledgments
Conflicts of Interest
References
- Lindenmayer, A. Mathematical models for cellular interaction in development parts I and II. J. Theor. Biol. 1968, 18, 280–315. [Google Scholar] [CrossRef]
- Prusinkiewicz, P.; Lindenmayer, A.; Hanan, J. Development models of herbaceous plants for computer imagery purposes. ACM SIGGRAPH Comput. Graph. 1988, 22, 141–150. [Google Scholar] [CrossRef]
- Wither, J.; Boudon, F.; Cani, M.-P.; Godin, C. Structure from silhouettes: A new paradigm for fast sketch-based design of trees. Comput. Graph. Forum 2009, 28, 541–550. [Google Scholar] [CrossRef] [Green Version]
- Makoto, O.; Shigeru, O.; Takeo, I. Interactive design of botanical trees using freehand sketches and example-based editing. Comput. Graphics Forum 2005, 24, 487–496. [Google Scholar]
- Teng, C.-H.; Chen, Y.-S.; Hsu, W.-H. Constructing a 3D trunk model from two images. Graph. Model 2007, 69, 33–56. [Google Scholar] [CrossRef] [Green Version]
- Quan, L.; Tan, P.; Zeng, G.; Yuan, L.; Wang, J.; Kang, S.B. Image-based plant modeling. ACM Trans. Graph. 2006, 25, 599–604. [Google Scholar] [CrossRef]
- Zhu, C.; Zhang, X.; Hu, B.-G.; Jaeger, M. Reconstruction of tree crown shape from scanned data. In Proceedings of the Technologies for E-Learning and Digital Entertainment, Third International Conference, Nanjing, China, 25–27 June 2008; Volume 5093, pp. 745–756. [Google Scholar]
- Rutzinger, M.; Pratihast, A.K.; Elberink, S.O.; Vosselman, G. Tree modelling from mobile laser scanning data-sets. Photogramm. Rec. 2011, 26, 361–372. [Google Scholar] [CrossRef]
- Bucksch, A.; Lindenbergh, R.C. CAMPINO—A skeletonization method for point cloud processing. ISPRS J. Photogramm. Remote. Sens. 2008, 63, 115–127. [Google Scholar] [CrossRef]
- Bucksch, A.; Lindenbergh, R.; Menenti, M. SkelTre: Robust skeleton extraction from imperfect point clouds. Vis. Comput. 2010, 26, 13–20. [Google Scholar] [CrossRef] [Green Version]
- Su, Z.; Zhao, Y.; Zhao, C.; Guo, X.; Li, Z. Skeleton extraction for tree models. Math. Comput. Model. 2011, 54, 1115–1120. [Google Scholar] [CrossRef]
- Zhang, D.; Yun, T.; Xue, L.; Luo, Y. Reconstruction algorithm with complex topology of tree branches. J. Nanjing Norm. Univ. (Nat. Sci. Ed.) 2015, 38, 128–136. (In Chinese) [Google Scholar]
- Cao, J.; Tagliasacchi, A.; Olson, M.; Zhang, H.; Su, Z. Point Cloud Skeletons via Laplacian Based Contraction. In Proceedings of the IEEE International Conference on Shape Modeling and Applications, Aix-en-Provence, France, 21–23 June 2010; pp. 187–197. [Google Scholar] [CrossRef] [Green Version]
- Verroust, A.; Lazarus, F. Extracting skeletal curves from 3D scattered data. Vis. Comput. 2000, 16, 15–25. [Google Scholar] [CrossRef]
- Xu, H.; Gossett, N.; Chen, B. Knowledge and heuristic-based modeling of laser-scanned trees. ACM Trans. Graph. 2007, 26, 19. [Google Scholar] [CrossRef]
- Huang, H.; Tang, L.; Chen, C. A 3D individual tree modeling technique based on terrestrial LiDAR point cloud data. In Proceedings of the 2015 2nd IEEE International Conference on Spatial Data Mining and Geographical Knowledge Services (ICSDM), Fuzhou, China, 8–10 July 2015; pp. 152–156. [Google Scholar]
- Borchert, R.; Slade, N.A. Bifurcation Ratios and the Adaptive Geometry of Trees. Int. J. Plant Sci. 1981, 142, 394–401. [Google Scholar] [CrossRef]
- Yan, D.-M.; Wintz, J.; Mourrain, B.; Wang, W.; Boudon, F.; Godin, C. Efficient and robust reconstruction of botanical branching structure from laser scanned points. In Proceedings of the 2009 11th IEEE International Conference on Computer-Aided Design and Computer Graphics (CAD/CG 09), Huangshan, China, 19–21 August 2009; pp. 572–575. [Google Scholar]
- Livny, Y.; Yan, F.L.; Olson, M.; Chen, B.Q.; Zhang, H.; El-Sana, J. Automatic reconstruction of tree skeleton from point clouds. ACM Trans. Graph. 2010, 29, 1–8. [Google Scholar] [CrossRef] [Green Version]
- Balsa-Barreiro, J.; Fritsch, D. Generation of visually aesthetic and detailed 3D models of historical cities by using laser scanning and digital photogrammetry. Digit. Appl. Archaeol. Cult. Herit. 2018, 8, 57–64. [Google Scholar] [CrossRef]
- Chen, L.C.; Teo, T.; Shao, Y.; Lai, Y. Fusion of LIDAR data and optical imagery for building modeling. Int. Arch. Photogramm. Remote Sens. 2004, 35, 732–737. [Google Scholar]
- Wang, Z.; Zhang, L.; Fang, T.; Mathiopoulos, P.T.; Qu, H.; Chen, N.; Wang, Y. A structure-aware global optimization method for reconstructing 3-d tree models from terrestrial laser scanning data. IEEE Trans. Geosci. Remote Sens. 2014, 52, 5653–5669. [Google Scholar] [CrossRef]
- Wang, Z.; Zhang, L.; Fang, T.; Tong, X.; Mathiopoulos, P.T.; Zhang, L.; Mei, J. A local structure and direction-aware optimization approach for three-dimensional tree modeling. IEEE Trans. Geosci. Remote Sens. 2016, 54, 4749–4757. [Google Scholar] [CrossRef]
- Mei, J.; Zhang, L.; Wu, S.; Wang, Z.; Zhang, L. 3D tree modeling from incomplete point clouds via optimization and L 1 -MST. Int. J. Geogr. Inf. Sci. 2016, 31, 1–23. [Google Scholar] [CrossRef]
- Axelsson, P. DEM generation from laser scanner data using adaptive TIN models. ISPRS J. Photogramm. Remote Sens. 2000, 33, 110–117. [Google Scholar]
- Chen, M.; Wan, Y.; Wang, M.; Xu, J. Automatic Stem Detection in Terrestrial Laser Scanning Data with Distance-Adaptive Search Radius. IEEE Trans. Geosci. Remote Sens. 2018, 56, 2968–2979. [Google Scholar] [CrossRef]
- Zhong, R.; Wei, J.; Su, W.; Chen, Y.F. A method for extracting trees from vehicle-borne laser scanning data. Math. Comput. Model. 2013, 58, 733–742. [Google Scholar] [CrossRef]
- Kaasalainen, S.; Kukko, A.; Lindroos, T.; Ahokas, E.; Litkey, P.; Kaartinen, H.; Hyyppa, J. Brightness Measurements and Calibration with Airborne and Terrestrial Laser Scanners. IEEE Trans. Geosci. Remote Sens. 2008, 46, 528–534. [Google Scholar] [CrossRef]
- Kaasalainen, S.; Jaakkola, A.; Kaasalainen, M.; Krooks, A.; Kukko, A. Analysis of Incidence Angle and Distance Effects on Terrestrial Laser Scanner Intensity: Search for Correction Methods. Remote. Sens. 2011, 3, 2207–2221. [Google Scholar] [CrossRef] [Green Version]
- West, G.B.; Brown, J.H.; Enquist, B.J. A general model for the structure and allometry of plant vascular systems. Nature 1999, 400, 664–667. [Google Scholar] [CrossRef]
- Murray, C.D. A relationship between circumference and weight in trees and its bearing on branching angles. J. Gen. Physiol. 1927, 10, 725–729. [Google Scholar] [CrossRef]
- Yang, M.; Wan, Y.; Liu, X.; Xu, J.; Wei, Z.; Chen, M.; Sheng, P. Laser data based automatic recognition and maintenance of road markings from MLS system. Opt. Laser Technol. 2018, 107, 192–203. [Google Scholar] [CrossRef]
- Balsa-Barreiro, J.; Lerma, J.L. Empirical study of variation in lidar point density over different land covers. Int. J. Remote. Sens. 2014, 35, 3372–3383. [Google Scholar] [CrossRef]
- Lari, Z.; Habib, A. New Approaches for Estimating the Local Point Density and its Impact on Lidar Data Segmentation. Photogramm. Eng. Remote. Sens. 2013, 79, 195–207. [Google Scholar] [CrossRef]
- Guo, Q.; Li, W.; Yu, H.; Alvarez, O. Effects of Topographic Variability and Lidar Sampling Density on Several DEM Interpolation Methods. Photogramm. Eng. Remote. Sens. 2010, 76, 701–712. [Google Scholar] [CrossRef] [Green Version]
Tree ID | Point Spacing (mm) | Computing Time (s) | Errors in Different Levels of Detail (mm) | ||||||
---|---|---|---|---|---|---|---|---|---|
L0 | L1 | L2 | L3 | L4 | L5 | L6 | |||
1 (dark red) | 57.8 | 16.7 | 8.7 | 19.2 | 26.3 | 28.4 | 30.9 | 30.8 | 29.5 |
2 (red) | 46.9 | 9.1 | 8.1 | 18.1 | 25.6 | 28.1 | 31.4 | 31.8 | 28.5 |
3 (orange) | 45.9 | 8.1 | 10.2 | 18.3 | 28.4 | 29.7 | 33.9 | 37.6 | 39.5 |
4 (yellow) | 50.4 | 10.6 | 10.5 | 19.8 | 27.3 | 29.9 | 32.2 | 34.1 | 28.4 |
5 (green) | 57.5 | 16.2 | 11.4 | 21.4 | 26.9 | 28.5 | 31.6 | 33.9 | 29.8 |
6 (blue) | 56.2 | 15.8 | 11.8 | 20.1 | 31.5 | 35.7 | 36.3 | 35.7 | 32.9 |
Tree ID | Model | Errors (Reference-Model) | ||||
---|---|---|---|---|---|---|
Diameter | Length | Diameter | Length | |||
R-Node | 0-Node | R-Node | 0-Node | |||
1 | 192 | 164 | 2406 | −23 | −16 | 22 |
2 | 214 | 194 | 2799 | −12 | 21 | 19 |
3 | 278 | 266 | 2499 | 27 | 5 | −8 |
4 | 188 | 182 | 2494 | −4 | −2 | 22 |
5 | 206 | 194 | 2516 | −8 | −16 | −48 |
6 | 198 | 180 | 2729 | −16 | 4 | 98 |
Mean | 15 | 11 | 36 | |||
Root Mean Square Error (RMSE): | 17 | 13 | 47 |
© 2020 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).
Share and Cite
Xu, J.; Shan, J.; Wang, G. Hierarchical Modeling of Street Trees Using Mobile Laser Scanning. Remote Sens. 2020, 12, 2321. https://doi.org/10.3390/rs12142321
Xu J, Shan J, Wang G. Hierarchical Modeling of Street Trees Using Mobile Laser Scanning. Remote Sensing. 2020; 12(14):2321. https://doi.org/10.3390/rs12142321
Chicago/Turabian StyleXu, Jingzhong, Jie Shan, and Ge Wang. 2020. "Hierarchical Modeling of Street Trees Using Mobile Laser Scanning" Remote Sensing 12, no. 14: 2321. https://doi.org/10.3390/rs12142321
APA StyleXu, J., Shan, J., & Wang, G. (2020). Hierarchical Modeling of Street Trees Using Mobile Laser Scanning. Remote Sensing, 12(14), 2321. https://doi.org/10.3390/rs12142321