A Review of the Bayesian Occupancy Filter
<p>Relationship among Bayesian Occupancy Filter (BOF) techniques, institutions, authors, and publication dates. <math display="inline"> <semantics> <msup> <mrow/> <mn>1</mn> </msup> </semantics> </math> University of Alcalá de Henares; <math display="inline"> <semantics> <msup> <mrow/> <mn>2</mn> </msup> </semantics> </math> University of Edinburgh; <math display="inline"> <semantics> <msup> <mrow/> <mn>3</mn> </msup> </semantics> </math> University of Cluj-Napoca.</p> "> Figure 2
<p>Taxonomy of Bayesian Occupancy Filter.</p> "> Figure 3
<p>Diagram of prediction and estimation paradigm with the observation input [<a href="#B15-sensors-17-00344" class="html-bibr">15</a>]. Reproduced with permission from reference [<a href="#B15-sensors-17-00344" class="html-bibr">15</a>]. Copyright 2008 International Journal of Vehicle Autonomous Systems.</p> "> Figure 4
<p>BOF representation from [<a href="#B13-sensors-17-00344" class="html-bibr">13</a>]: A two-dimensional grid where each cell has an occupancy value and a histogram of possible velocities. Reproduced with permission from reference [<a href="#B13-sensors-17-00344" class="html-bibr">13</a>]. Copyright 2014 IEEE.</p> "> Figure 5
<p>Aliasing problem: the area of an object counted in occupied cell number is not constant for each position of the object in the grid. Reproduced with permission from reference [<a href="#B30-sensors-17-00344" class="html-bibr">30</a>]. Copytight 2006 Inria.</p> "> Figure 6
<p>Comparison of prediction results for different filtering techniques after several timesteps proposed by Gindele et al. [<a href="#B16-sensors-17-00344" class="html-bibr">16</a>] (Bayesian Occupancy Filter Using prior Map knowledge (BOFUM)). Reproduced with permission from reference [<a href="#B16-sensors-17-00344" class="html-bibr">16</a>]. Copyright 2009 IEEE. The image (<b>a</b>) shows the knowledge of the environment, (<b>b</b>) presents the initial occupancy and (<b>c</b>) the prediction without uncertainties. In the second row (<b>e</b>) represents the simple BOF prediction using only uncertainties. The BOFUM application is depicted in (<b>f</b>) without knowledge and in (<b>g</b>) and incorporating the knowledge. The legend shows the occupation probability normalized between 0 and 1.</p> "> Figure 7
<p>Proposed representation in Hybrid Sampling Bayesian Occupancy Filter (HSBOF) [<a href="#B13-sensors-17-00344" class="html-bibr">13</a>]: a two-dimensional grid, to each cell we assigned an occupancy value, a static coefficient <math display="inline"> <semantics> <mrow> <mi>P</mi> <mo stretchy="false">(</mo> <mi>V</mi> <mo>=</mo> <mn>0</mn> <mo stretchy="false">)</mo> </mrow> </semantics> </math> and a set of particles drawn along <math display="inline"> <semantics> <mrow> <mi>P</mi> <mo stretchy="false">(</mo> <mi>V</mi> <mo>=</mo> <mi>v</mi> <mo>|</mo> <mi>V</mi> <mo>≠</mo> <mn>0</mn> <mo stretchy="false">)</mo> </mrow> </semantics> </math>. Reproduced with permission from reference [<a href="#B13-sensors-17-00344" class="html-bibr">13</a>]. Copyright 2014 IEEE.</p> "> Figure 8
<p>Fast Clustering-Tracking algorithm scheme extracted from Meckhnacha et al. [<a href="#B32-sensors-17-00344" class="html-bibr">32</a>]. Reproduced with permission from reference [<a href="#B32-sensors-17-00344" class="html-bibr">32</a>]. Copyright 2008 Springer.</p> ">
Abstract
:1. Introduction
2. The Bayesian Occupancy Filter
2.1. BOF-Taxonomy
2.2. BOF Formal Introduction
- C is an index that identifies each 2D cell of the grid.
- A is an index that identifies each possible antecedent of the cell c over all the cells in the 2D grid.
- where is the random variable of the sensor measurement relative to the cell c.
- where v is the random variable of the velocities for the cell c and its possible values are discretized into n cases.
- where O represents the random variable of the state of c being either occupied or empty. represents the random variable of the state of an antecedent cell of c through the possible motion through c. For a given velocity and a given time step , it is possible to define an antecedent for c = (x, y) as = .
- is the distribution over all the possible antecedents of the cell c. It is chosen to be uniform because the cell is considered reachable from all the antecedents with equal probability. Consequently, given k antecedents, each one has a probability = .
- is the distribution over all the possible velocities of a certain antecedent of the cell c; its parametric form is a histogram.
- is a distribution that explains whether c is reachable from [A = a] with the velocity []. In discrete spaces, this distribution is considered a Dirac with value equal to 1 if and only if and , which follows a dynamic model of constant velocity. This Dirac distribution is used in the BOF4D literature, nevertheless, other general distribution approaches could be used.
- is the distribution over the occupancy of the antecedents. It gives the probability of the possible previous step of the current cell. Given the antecedents, this probability explains probability that the previous occupancy is reliable with the current antecedents.
- is the conditional distribution over the occupancy of the current cell, which depends on the occupancy state of the previous cell. It is defined as a transition matrix: , which allows the system to use the null acceleration hypothesis as an approximation; in this matrix, ε is a parameter representing the probability that the object in c does not follow the null acceleration model.
- is the conditional distribution over the sensor measurement values. It depends on the state of the cell, the velocity of the cell and obviously the position of the cell. This models the reliability of a reading in the sensor knowing the current occupancy, and velocities.
3. Sensor Data Pre-Processing
4. Refinements
4.1. Dynamic Environments
4.2. Collision Cones
4.3. Non-Constant Velocity
4.4. Motion Detection
5. Variants and Complements
5.1. BOFUM
- Changing the terrain is unlikely due to the robotics or ADAS scenario. The function models the likelihood of one cell being the antecedent of another.
- In the case of moving off the lane: if the target or the antecedent cell are non-lane terrains, it is assumed the object is likely to be a pedestrian, in which case there is no preferred direction and the term weight is set to 1.
- In the case of moving on the lane: vehicles are usually moving along the lane, and the probability of moving out or changing lanes is low, which is modeled using the term weight.
5.2. Optical Flow Based Velocity Estimation (OF-BOF)
5.3. Sequential Monte Carlo Bayesian Occupancy Filter
5.4. HSBOF
5.5. Fast Clustering-Tracking Algorithm
- New object appears, so new identifiers are needed.
- A known cluster.
- Cells with a previous ID are assigned to a new identifier.
6. High Level Applications and Implementation Aspects
7. Comparison and Use Cases
- Computational cost, considering both the speed and the memory usage.
- Parallelization opportunities, referring to the potential speed-up of the algorithm with HW accelerators.
- Velocity estimation of each cell.
- Robustness against aliasing problems derived of the grid discretization.
- Ability to properly represent the grid empty space.
- Ratio between the accuracy of the cell occupancy probability and the unexpected noise appearing in non-occupied cells.
- Need of prior knowledge of the environment.
- Compactness of the representation model.
- Handling and tracking of moving objects.
7.1. Use Cases
8. Concluding Remarks
Acknowledgments
Author Contributions
Conflicts of Interest
References
- Moravec, H.P. Sensor Fusion in Certainty Grids for Mobile Robots. AI Mag. 1988, 9, 61–74. [Google Scholar]
- Elfes, A. Using occupancy grids for mobile robot perception and navigation. Computer 1989, 22, 46–57. [Google Scholar] [CrossRef]
- Azorín-López, J.; Saval-Calvo, M.; Fuster-Guilló, A.; García-Rodríguez, J. Human Behaviour Recognition based on Trajectory Analysis using Neural Networks. In Proceedings of the 2013 International Joint Conference on Neural Networks (IJCNN), Dallas, TX, USA, 4–9 August 2013; pp. 99–105.
- Coue, C.; Fraichard, T.; Bessiere, P.; Mazer, E. Using Bayesian Programming for multi-sensor multi-target tracking in automotive applications. In Proceedings of the 2003 IEEE International Conference on Robotics and Automation (Cat. No. 03CH37422), Taipei, Taiwan, 14–19 September 2003; pp. 2104–2109.
- Kurdej, M.; Moras, J.; Cherfaoui, V.; Bonnifait, P. Map-Aided Fusion Using Evidential Grids for Mobile Perception in Urban Environment; Springer: Berlin/Heidelberg, Germany, 2012; pp. 343–350. [Google Scholar]
- Moras, J.; Cherfaoui, V.; Bonnifait, P. Evidential grids information management in dynamic environments. In Proceedings of the 2014 17th International Conference on Information Fusion (FUSION), Salamanca, Spain, 7–10 July 2014; pp. 1–7.
- Coué, C. Modèle Bayésien Pour L’analyse Multimodale D’environnementsdynamiques et Encombrés: Application à L’assistance à la Conduite en Milieu Urbain. Ph.D. Thesis, Institut National Polytechnique de Grenoble-INPG, Grenoble, France, 2003. [Google Scholar]
- Coue, C.; Fraichard, T.; Bessiere, P.; Mazer, E. Multi-sensor data fusion using Bayesian programming: An automotive application. In Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and System, Lausanne, Switzerland, 30 September–4 October 2002; Volume 1, pp. 141–146.
- Coué, C.; Pradalier, C.; Laugier, C.; Fraichard, T.; Bessière, P. Bayesian Occupancy Filtering for Multitarget Tracking: An Automotive Application. Int. J. Robot. Res. 2006, 25, 19–30. [Google Scholar] [CrossRef]
- Danescu, R.; Oniga, F.; Nedevschi, S. Particle grid tracking system for stereovision based environment perception. In Proceedings of the 2010 IEEE Intelligent Vehicles Symposium, La Jolla, CA, USA, 21–24 June 2010; pp. 987–992.
- Danescu, R.; Oniga, F.; Nedevschi, S. Modeling and Tracking the Driving Environment With a Particle-Based Occupancy Grid. IEEE Trans. Intell. Trans. Syst. 2011, 12, 1331–1342. [Google Scholar] [CrossRef]
- Llamazares, Á.; Ivan, V.; Molinos, E.; Ocaña, M.; Vijayakumar, S. Dynamic Obstacle Avoidance Using Bayesian Occupancy Filter and Approximate Inference. Sensors 2013, 13, 2929–2944. [Google Scholar] [CrossRef] [PubMed]
- Negre, A.; Rummelhard, L.; Laugier, C. Hybrid sampling Bayesian Occupancy Filter. In Proceedings of the 2014 IEEE Intelligent Vehicles Symposium, Ypsilanti, MI, USA, 8–11 June 2014; pp. 1307–1312.
- Chen, C.; Tay, C.; Laugier, C.; Mekhnacha, K. Dynamic Environment Modeling with Gridmap: A Multiple-Object Tracking Application. In Proceedings of the 2006 9th International Conference on Control, Automation, Robotics and Vision, Grand Hyatt, Singapore, 5–8 December 2006; pp. 1–6.
- Tay, M.; Mekhnacha, K.; Chen, C.; Yguel, M.; Laugier, C. An efficient formulation of the Bayesian occupation filter for target tracking in dynamic environments. Int. J. Veh. Auton. Syst. 2008, 6, 155–171. [Google Scholar] [CrossRef]
- Gindele, T.; Brechtel, S.; Schroder, J.; Dillmann, R. Bayesian Occupancy grid Filter for dynamic environments using prior map knowledge. In Proceedings of the 2009 IEEE Intelligent Vehicles Symposium, Xi’an, China, 3–5 June 2009; pp. 669–676.
- Brechtel, S.; Gindele, T.; Dillmann, R. Recursive importance sampling for efficient grid-based occupancy filtering in dynamic environments. In Proceedings of the 2010 IEEE International Conference on Robotics and Automation, Anchorage, AK, USA, 3–8 May 2010; pp. 3932–3938.
- Baig, Q.; Perrollaz, M.; Nascimento, J.B.D.; Laugier, C. Using fast classification of static and dynamic environment for improving Bayesian occupancy filter (BOF) and tracking. In Proceedings of the 2012 12th International Conference on Control Automation Robotics & Vision (ICARCV), Guangzhou, China, 5–7 December 2012; pp. 656–661.
- Laugier, C.; Paromtchik, I.E.; Perrollaz, M.; Yong, M.Y.; Yoder, J.; Tay, C.; Mekhnacha, K.; Negre, A. Probabilistic Analysis of Dynamic Scenes and Collision Risks Assessment to Improve Driving Safety. IEEE Intell. Trans. Syst. Mag. 2011, 3, 4–19. [Google Scholar] [CrossRef]
- Baig, Q.; Perrollaz, M.; Botelho, J.; Laugier, C. Fast classification of static and dynamic environment for Bayesian Occupancy Filter (BOF). In Proceedings of the IROS12 4th Workshop on Planning, Perception and Navigation for Intelligent Vehicles, Vilamoura, Portugal, 7 October 2012.
- Baig, Q.; Perrollaz, M.; Laugier, C. A Robust Motion Detection Technique for Dynamic Environment Monitoring: A Framework for Grid-Based Monitoring of the Dynamic Environment. IEEE Robotics Autom. Mag. 2014, 21, 40–48. [Google Scholar] [CrossRef]
- Fleuret, F.; Berclaz, J.; Lengagne, R.; Fua, P. Multicamera People Tracking with a Probabilistic Occupancy Map. IEEE Trans. Pattern Anal. Mach. Intell. 2008, 30, 267–282. [Google Scholar] [CrossRef] [PubMed]
- Fulgenzi, C. Autonomous Navigation in Dynamic Uncertain Environment Using Probabilistic Models of Perception and Collision Risk Prediction. Ph.D. Thesis, Institut National Polytechnique de Grenoble, Grenoble, France, 2009. [Google Scholar]
- Fulgenzi, C.; Spalanzani, A.; Laugier, C. Dynamic Obstacle Avoidance in uncertain environment combining PVOs and Occupancy Grid. In Proceedings of the 2007 IEEE International Conference on Robotics and Automation, Roma, Italy, 10–14 April 2007; pp. 1610–1616.
- Mekhnacha, K.; Raulo, D. Robust multi-target sensing/tracking in the Bayesian Occupancy Filter framework. In Proceedings of the Journees Francophone sur les Reseaux Bayesiens, Lyon, France, 29–30 May 2008.
- Ros, J.; Mekhnacha, K. Multi-sensor human tracking with the Bayesian Occupancy Filter. In Proceedings of the 2009 16th International Conference on Digital Signal Processing, Santorini, Greece, 5–7 July 2009; pp. 1–8.
- Ros, J.; Mekhnacha, K. A generative model for 3D range sensors in the Bayesian Occupancy filter framework: Application for fusion in smart home monitoring. In Proceedings of the 2010 13th International Conference on Information Fusion, Edinburgh, UK, 26–29 July 2010; pp. 1–8.
- Rummelhard, L.; Nègre, A.; Perrollaz, M.; Laugier, C. Probabilistic Grid-Based Collision Risk Prediction for Driving Application. In Proceedings of the 14th International Symposium on Experimental Robotics, Marrakech and Essaouira, Morocco, 15–18 June 2014; Hsieh, A.M., Khatib, O., Kumar, V., Eds.; Springer: New York, NY, USA, 2016; pp. 821–834. [Google Scholar]
- Tay, M.K.; Mekhnacha, K.; Yguel, M.; Coué, C.; Pradalier, C.; Laugier, C.; Fraichard, T.; Bessière, P. The Bayesian Occupation Filter. In Probabilistic Reasoning and Decision Making in Sensory-Motor Systems; Bessière, P., Laugier, C., Siegwart, R., Eds.; Springer: Berlin/Heidelberg, Germany, 2008; pp. 77–98. [Google Scholar]
- Yguel, M.; Tay, C.; Mekhnacha, K.; Laugier, C. Velocity Estimation on the Bayesian Occupancy Filter for Multi-Target Tracking; Technical Report; Grenoble-Rhône Alpes; INRIA: Montbonnot, France, 2006. [Google Scholar]
- Mekhnacha, K.; Mao, Y.; Raulo, D.; Laugier, C. Bayesian occupancy filter based “Fast Clustering-Tracking” algorithm. In Proceedings of the IEEE/RSJ IROS 2008 Workshop on Safe Navigation, Nice, Italy, 22–26 September 2008.
- Mekhnacha, K.; Mao, Y.; Raulo, D.; Laugier, C. The “Fast Clustering-Tracking” Algorithm in the Bayesian Occupancy Filter Framewok. In Multisensor Fusion and Integration for Intelligent Systems; Springer: Berlin/Heidelberg, Germany, 2008; pp. 201–219. [Google Scholar]
- Nuss, D.; Yuan, T.; Krehl, G.; Stuebler, M.; Reuter, S.; Dietmayer, K. Fusion of laser and radar sensor data with a sequential Monte Carlo Bayesian occupancy filter. In Proceedings of the 2015 IEEE Intelligent Vehicles Symposium (IV), Seoul, Korea, 28 June–1 July 2015; pp. 1074–1081.
- Oh, S.I.; Kang, H.B. A Modified Sequential Monte Carlo Bayesian Occupancy Filter Using Linear Opinion Pool for Grid Mapping. In Proceedings of the 2015 IEEE International Conference on Computer Vision Workshop (ICCVW), Santiago, Chile, 7–13 December 2015; pp. 192–198.
- Adarve, J.D.; Perrollaz, M.; Makris, A.; Laugier, C. Computing occupancy grids from multiple sensors using linear opinion pools. In Proceedings of the 2012 IEEE International Conference on Robotics and Automation, St. Paul, MN, USA, 14–18 May 2012; pp. 4074–4079.
- Perrollaz, M.; Yoder, J.D.; Spalanzani, A.; Laugier, C. Using the disparity space to compute occupancy grids from stereo-vision. In Proceedings of the 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems, Taipei, Taiwan, 18–22 October 2010; pp. 2721–2726.
- Perrollaz, M.; Spalanzani, A.; Aubert, D. Probabilistic representation of the uncertainty of stereo-vision and application to obstacle detection. In Proceedings of the 2010 IEEE Intelligent Vehicles Symposium, La Jolla, CA, USA, 21–24 June 2010; pp. 313–318.
- Perrollaz, M.; Yoder, J.D.; Laugier, C. Using obstacles and road pixels in the disparity-space computation of stereo-vision based occupancy grids. In Proceedings of the 13th International IEEE Conference on Intelligent Transportation Systems, Madeira Island, Portugal, 19–22 September 2010; pp. 1147–1152.
- Perrollaz, M.; Yoder, J.D.; Negre, A.; Spalanzani, A.; Laugier, C. A Visibility-Based Approach for Occupancy Grid Computation in Disparity Space. IEEE Trans. Intell. Transp. Syst. 2012, 13, 1383–1393. [Google Scholar] [CrossRef]
- Yoder, J.D.; Perrollaz, M.; Paromtchik, I.E.; Mao, Y.; Laugier, C. Experiments in Vision-Laser Fusion Using the Bayesian Occupancy Filter; Springer: Berlin Heidelberg, Germany, 2014; pp. 899–907. [Google Scholar]
- Yguel, M.; Aycard, O.; Laugier, C. Efficient GPU-based construction of occupancy grids using several laser range-finders. Int. J. Veh. Auton. Syst. 2008, 6, 48–83. [Google Scholar] [CrossRef]
- Rakotovao, T.A.; Puschini, D.P.; Mottin, J.; Rummelhard, L.; Negre, A.; Laugier, C. Intelligent Vehicle Perception: Toward the Integration on Embedded Many-core. In Proceedings of the 6th Workshop on Parallel Programming and Run-Time Management Techniques for Many-Core Architectures (PARMA-DITAM’15), Amsterdam, The Netherlands, 19–21 January 2015; ACM Press: New York, NY, USA, 2015; pp. 7–12. [Google Scholar]
- Rakotovao, T.; Mottin, J.; Puschini, D.; Laugier, C. Real-time power-efficient integration of multi-sensor occupancy grid on many-core. In Proceedings of the 2015 IEEE International Workshop on Advanced Robotics and Its Social Impacts (ARSO), Lyon, France, 1–3 July 2015; pp. 1–6.
- Melpignano, D.; Benini, L.; Flamand, E.; Jego, B.; Lepley, T.; Haugou, G.; Clermidy, F.; Dutoit, D. Platform 2012, a many-core computing accelerator for embedded SoCs. In Proceedings of the 49th Annual Design Automation Conference on DAC’12, San Francisco, CA, USA, 3–7 June 2012; ACM Press: New York, NY, USA, 2012; p. 1137. [Google Scholar]
BOF | BOF4D | BOFUM | BOFUG | OF-BOF | SMC-BOF | HSBOF | |
---|---|---|---|---|---|---|---|
Computational cost | ++ | 0 | + | ++ | + | ++ | +++ |
Parallelization opportunities | ++ | +++ | ++ | ++ | + | + | ++ |
Velocity estimation | 0 | ++ | +++ | +++ | ++ | +++ | +++ |
Aliasing/discretization robustness | 0 | 0 | ++ | ++ | 0 | +++ | +++ |
Empty space representation | +++ | +++ | +++ | +++ | +++ | + | +++ |
Accuracy/noise ratio | + | + | ++ | ++ | + | +++ | +++ |
Prior knowledge needed | +++ | +++ | 0 | 0 | +++ | +++ | +++ |
Representation model compactness | + | + | ++ | ++ | + | +++ | ++ |
Moving objects handling | 0 | ++ | +++ | +++ | + | +++ | +++ |
Auto. | Robot | People | Object | Clustering | Mapping | Data | |
---|---|---|---|---|---|---|---|
Driving | Guidance | Tracking | Avoidance | Fusion | |||
Adarve et al. [35] | X | X | |||||
Baig et al. [18,20,21] | X | X | |||||
Brechtel et al. [17] | X | X | |||||
Chen et al. [14] | X | X | |||||
Coue et al. [4,7,8] | X | X | |||||
Coué et al. [9] | X | X | |||||
Danescu et al. [10] | X | X | |||||
Danescu et al. [11] | X | X | X | ||||
Elfes [2] | X | X | X | ||||
Fleuret et al. [22] | X | X | |||||
Fulgenzi [23] | X | X | X | X | X | ||
Fulgenzi et al. [24] | X | X | |||||
Gindele et al. [16] | X | ||||||
Laugier et al. [19] | X | X | X | ||||
Llamazares et al. [12] | X | X | |||||
Mekhnacha et al. [31,32] | X | X | |||||
Mekhnacha and Raulo [25] | X | X | X | ||||
Moravec [1] | X | X | X | ||||
Negre et al. [13] | X | ||||||
Nuss et al. [33] | X | X | |||||
Oh and Kang [34] | X | X | |||||
Perrollaz et al. [36,37,38,39] | X | ||||||
Ros and Mekhnacha [27] | X | X | X | ||||
Ros and Mekhnacha [26] | X | X | |||||
Rummelhard et al. [28] | X | X | |||||
Tay et al. [15] | X | X | |||||
Tay et al. [29] | X | X | X | ||||
Yguel et al. [30] | X | ||||||
Yoder et al. [40] | X | X |
© 2017 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license ( http://creativecommons.org/licenses/by/4.0/).
Share and Cite
Saval-Calvo, M.; Medina-Valdés, L.; Castillo-Secilla, J.M.; Cuenca-Asensi, S.; Martínez-Álvarez, A.; Villagrá, J. A Review of the Bayesian Occupancy Filter. Sensors 2017, 17, 344. https://doi.org/10.3390/s17020344
Saval-Calvo M, Medina-Valdés L, Castillo-Secilla JM, Cuenca-Asensi S, Martínez-Álvarez A, Villagrá J. A Review of the Bayesian Occupancy Filter. Sensors. 2017; 17(2):344. https://doi.org/10.3390/s17020344
Chicago/Turabian StyleSaval-Calvo, Marcelo, Luis Medina-Valdés, José María Castillo-Secilla, Sergio Cuenca-Asensi, Antonio Martínez-Álvarez, and Jorge Villagrá. 2017. "A Review of the Bayesian Occupancy Filter" Sensors 17, no. 2: 344. https://doi.org/10.3390/s17020344
APA StyleSaval-Calvo, M., Medina-Valdés, L., Castillo-Secilla, J. M., Cuenca-Asensi, S., Martínez-Álvarez, A., & Villagrá, J. (2017). A Review of the Bayesian Occupancy Filter. Sensors, 17(2), 344. https://doi.org/10.3390/s17020344