CN111241948B - Method and system for all-weather ship identification - Google Patents
Method and system for all-weather ship identification Download PDFInfo
- Publication number
- CN111241948B CN111241948B CN202010001169.4A CN202010001169A CN111241948B CN 111241948 B CN111241948 B CN 111241948B CN 202010001169 A CN202010001169 A CN 202010001169A CN 111241948 B CN111241948 B CN 111241948B
- Authority
- CN
- China
- Prior art keywords
- ship
- vessel
- image
- distance
- determining
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/10—Terrestrial scenes
- G06V20/13—Satellite images
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/04—Architecture, e.g. interconnection topology
- G06N3/045—Combinations of networks
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/08—Learning methods
- G06N3/084—Backpropagation, e.g. using gradient descent
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- General Physics & Mathematics (AREA)
- General Health & Medical Sciences (AREA)
- General Engineering & Computer Science (AREA)
- Biophysics (AREA)
- Computational Linguistics (AREA)
- Data Mining & Analysis (AREA)
- Evolutionary Computation (AREA)
- Artificial Intelligence (AREA)
- Molecular Biology (AREA)
- Computing Systems (AREA)
- Biomedical Technology (AREA)
- Life Sciences & Earth Sciences (AREA)
- Mathematical Physics (AREA)
- Software Systems (AREA)
- Health & Medical Sciences (AREA)
- Astronomy & Astrophysics (AREA)
- Remote Sensing (AREA)
- Multimedia (AREA)
- Traffic Control Systems (AREA)
Abstract
Description
技术领域Technical field
本公开涉及图像处理技术领域,特别涉及一种全天候识别船舶的方法和系统。The present disclosure relates to the field of image processing technology, and in particular to a method and system for identifying ships around the clock.
背景技术Background technique
海运的运输速度比航空运输慢,但是单次运输量远远大于航空运输,对货物的适应性较好,并且运输费用也比航空运输低,因此海运已成为国际贸易的主要运输方式。随着海运规模的不断扩大,大型港口城市和海运枢纽城市的港口每天都有大量的船只进入和离开,导致港口区域拥挤,船只之间存在碰撞的隐患。而且越来越多的超大型集装箱货轮投入使用,海运的安全问题逐渐凸显。The transport speed of sea transport is slower than that of air transport, but the single transport volume is much larger than that of air transport, it is better adaptable to cargo, and the transport cost is lower than that of air transport. Therefore, sea transport has become the main mode of transportation in international trade. As the scale of maritime transport continues to expand, a large number of ships enter and leave the ports of large port cities and maritime hub cities every day, leading to congestion in the port area and the risk of collisions between ships. Moreover, as more and more ultra-large container ships are put into use, safety issues in maritime transportation have gradually become prominent.
在能见度较好的日间,港口领航员可以指挥船只有序进港,加上船只舰桥的巡逻人员会观察周围的船只,因此船只的安全可以得到保障。但是在能见度较低的夜间,上述方法不再使用,船只的安全无法保障。虽然雷达可以扫描出周围船只,但是雷达的价格非常昂贵,无法普及在民用货船上。During the day when visibility is good, port pilots can direct ships to enter the port in an orderly manner, and patrol officers on the ship's bridge will observe surrounding ships, so the safety of ships can be ensured. However, at night when visibility is low, the above methods are no longer used, and the safety of the ship cannot be guaranteed. Although radar can scan surrounding ships, radar is very expensive and cannot be widely used on civilian cargo ships.
发明内容Contents of the invention
本公开实施例提供了一种全天候识别船舶的方法和系统,可以利用成本较低的图像获取设备,并配合图像处理技术,有效识别周围船只,保障船只安全,特别适用于没有普及雷达的民用货船。所述技术方案如下:Embodiments of the present disclosure provide a method and system for all-weather identification of ships, which can use low-cost image acquisition equipment and cooperate with image processing technology to effectively identify surrounding ships and ensure ship safety. It is especially suitable for civilian cargo ships without widespread radar. . The technical solutions are as follows:
一方面,本公开实施例提供了一种全天候识别船舶的方法,所述方法包括:On the one hand, embodiments of the present disclosure provide a method for identifying ships around the clock. The method includes:
获取第一船舶周围的多张图像,所述多张图像的拍摄时间各不相同;Obtaining multiple images around the first ship, the multiple images being taken at different times;
采用深度学习算法在各张所述图像中识别船舶,得到第二船舶在各张所述图像中的位置;Use a deep learning algorithm to identify the ship in each of the images, and obtain the position of the second ship in each of the images;
根据所述第二船舶在各张所述图像中的位置,确定所述第二船舶的危险等级;Determine the danger level of the second ship according to the position of the second ship in each of the images;
根据所述第二船舶的危险等级,发出警报。Based on the danger level of the second ship, an alarm is issued.
可选地,所述获取第一船舶周围的多张图像,包括:Optionally, the acquisition of multiple images around the first ship includes:
获取所述第一船舶周围的环境信息;Obtain environmental information around the first ship;
根据所述环境信息,确定所述第一船舶周围的能见度等级;determining a visibility level around the first ship based on the environmental information;
当所述能见度等级达到设定标准时,控制摄像头连续拍摄所述第一船舶周围的多张图像;When the visibility level reaches the set standard, control the camera to continuously capture multiple images around the first ship;
当所述能见度等级没达到设定标准时,控制激光云台连续拍摄所述第一船舶周围的多张图像。When the visibility level does not reach the set standard, the laser pan/tilt is controlled to continuously capture multiple images around the first ship.
可选地,所述采用深度学习算法在各张所述图像中识别出第二船舶,包括:Optionally, using a deep learning algorithm to identify the second ship in each of the images includes:
从所述图像中提取图像特征;extract image features from the image;
根据所述图像特征,生成候选区域;Generate candidate regions based on the image features;
根据所述图像特征和所述候选区域,提取区域特征;extract regional features according to the image features and the candidate regions;
根据所述区域特征,确定所述候选区域的类别,得到所述第二船舶在所述图像中的位置。According to the regional characteristics, the category of the candidate region is determined, and the position of the second ship in the image is obtained.
可选地,所述根据所述第二船舶在各张所述图像中的位置,确定所述第二船舶的危险等级,包括:Optionally, determining the risk level of the second ship based on the position of the second ship in each of the images includes:
根据所述第二船舶在所述图像中的位置,确定所述第二船舶在所述图像的拍摄时间与所述第一船舶之间的距离;Determine the distance between the second ship and the first ship at the shooting time of the image based on the position of the second ship in the image;
根据所述第二船舶在各张所述图像的拍摄时间与所述第一船舶之间的距离,确定所述第二船舶的航向和航速;Determine the course and speed of the second ship based on the distance between the second ship and the first ship at the shooting time of each of the images;
根据所述第二船舶的航向、航速、以及与所述第一船舶之间的距离,确定所述第二船舶的危险等级。The danger level of the second ship is determined based on the course, speed, and distance of the second ship from the first ship.
可选地,所述根据所述第二船舶的危险等级,发出警报,包括:Optionally, issuing an alarm according to the danger level of the second ship includes:
按照危险等级从高到低的顺序,依次输出多个所述第二船舶的航向、航速、以及与所述第一船舶之间的距离进行报警。In order from high to low risk levels, the headings, speeds, and distances to the first ship of multiple second ships are sequentially output to generate alarms.
另一方面,本公开实施例提供了一种全天候识别船舶的系统,所述系统包括:On the other hand, embodiments of the present disclosure provide an all-weather ship identification system, which system includes:
获取模块,用于获取第一船舶周围的多张图像,所述多张图像的拍摄时间各不相同;An acquisition module, configured to acquire multiple images around the first ship, where the multiple images were taken at different times;
识别模块,用于采用深度学习算法在各张所述图像中识别船舶,得到第二船舶在各张所述图像中的位置;An identification module used to use a deep learning algorithm to identify the ship in each of the images and obtain the position of the second ship in each of the images;
定级模块,用于根据所述第二船舶在各张所述图像中的位置,确定所述第二船舶的危险等级;A rating module, configured to determine the risk level of the second ship based on the position of the second ship in each of the images;
报警模块,用于根据所述第二船舶的危险等级,发出警报。An alarm module is used to issue an alarm according to the danger level of the second ship.
可选地,所述获取模块包括:Optionally, the acquisition module includes:
信息获取子模块,用于获取所述第一船舶周围的环境信息;An information acquisition submodule, used to acquire environmental information around the first ship;
等级确定子模块,用于根据所述环境信息,确定所述第一船舶周围的能见度等级;A level determination submodule, configured to determine the visibility level around the first ship based on the environmental information;
拍摄控制子模块,用于当所述能见度等级达到设定标准时,控制摄像头连续拍摄所述第一船舶周围的多张图像;当所述能见度等级没达到设定标准时,控制激光云台连续拍摄所述第一船舶周围的多张图像。The shooting control submodule is used to control the camera to continuously shoot multiple images around the first ship when the visibility level reaches the set standard; when the visibility level does not reach the set standard, control the laser pan/tilt to continuously shoot all images. Multiple images of the surroundings of the first ship.
可选地,所述识别模块包括:Optionally, the identification module includes:
卷积层,用于从所述图像中提取图像特征;a convolutional layer for extracting image features from said image;
区域建议网络,用于根据所述图像特征,生成候选区域;A region proposal network, used to generate candidate regions based on the image features;
池化层,用于根据所述图像特征和所述候选区域,提取区域特征;A pooling layer, used to extract regional features based on the image features and the candidate regions;
分类器,用于根据所述区域特征,确定所述候选区域的类别,得到所述第二船舶在所述图像中的位置。A classifier, configured to determine the category of the candidate area according to the area characteristics and obtain the position of the second ship in the image.
可选地,所述定级模块包括:Optionally, the rating module includes:
第一确定子模块,用于根据所述第二船舶在所述图像中的位置,确定所述第二船舶在所述图像的拍摄时间与所述第一船舶之间的距离;A first determination sub-module configured to determine the distance between the second ship and the first ship at the shooting time of the image based on the position of the second ship in the image;
第二确定子模块,用于根据所述第二船舶在各张所述图像的拍摄时间与所述第一船舶之间的距离,确定所述第二船舶的航向和航速;a second determination sub-module, configured to determine the course and speed of the second ship based on the distance between the second ship and the first ship at the shooting time of each of the images;
第三确定子模块,用于根据所述第二船舶的航向、航速、以及与所述第一船舶之间的距离,确定所述第二船舶的危险等级。The third determination sub-module is used to determine the risk level of the second ship based on the course, speed, and distance of the second ship from the first ship.
可选地,所述报警模块用于,Optionally, the alarm module is used to:
按照危险等级从高到低的顺序,依次输出多个所述第二船舶的航向、航速、以及与所述第一船舶之间的距离进行报警。In order from high to low risk levels, the headings, speeds, and distances to the first ship of multiple second ships are sequentially output to generate alarms.
本公开实施例提供的技术方案带来的有益效果是:The beneficial effects brought by the technical solutions provided by the embodiments of the present disclosure are:
通过获取第一船舶周围在不同时间拍摄的多张图像,并采用深度学习算法在各张图像中识别船舶,可以得到第一船舶周围的第二船舶在各张图像中的位置。根据第二船舶在各张图像中的位置,可以得到第二船舶的危险等级,根据第二船舶的危险等级发出警报,有利于第一船舶避免与第二船舶碰撞,保障船舶的安全。而且图像获取设备和图像处理设备的价格远低于雷达,可以大幅度降低船舶识别系统的实现成本,特别适用于没有普及雷达的民用货船。By acquiring multiple images taken at different times around the first ship, and using a deep learning algorithm to identify the ship in each image, the position of the second ship around the first ship in each image can be obtained. According to the position of the second ship in each image, the danger level of the second ship can be obtained. An alarm is issued according to the danger level of the second ship, which helps the first ship avoid collision with the second ship and ensures the safety of the ship. Moreover, the price of image acquisition equipment and image processing equipment is much lower than that of radar, which can greatly reduce the implementation cost of ship identification system, and is especially suitable for civilian cargo ships without widespread radar.
附图说明Description of the drawings
为了更清楚地说明本公开实施例中的技术方案,下面将对实施例描述中所需要使用的附图作简单地介绍,显而易见地,下面描述中的附图仅仅是本公开的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动的前提下,还可以根据这些附图获得其他的附图。In order to more clearly illustrate the technical solutions in the embodiments of the present disclosure, the drawings needed to be used in the description of the embodiments will be briefly introduced below. Obviously, the drawings in the following description are only some embodiments of the present disclosure. For those of ordinary skill in the art, other drawings can also be obtained based on these drawings without exerting creative efforts.
图1是本公开实施例提供的一种全天候识别船舶的方法的应用场景图;Figure 1 is an application scenario diagram of an all-weather ship identification method provided by an embodiment of the present disclosure;
图2是本公开实施例提供的一种全天候识别船舶的方法的流程图;Figure 2 is a flow chart of an all-weather ship identification method provided by an embodiment of the present disclosure;
图3是本公开实施例提供的另一种全天候识别船舶的方法的流程图;Figure 3 is a flow chart of another method for identifying ships all day long provided by an embodiment of the present disclosure;
图4是本公开实施例提供的Faster RCNN算法模型的结构示意图;Figure 4 is a schematic structural diagram of the Faster RCNN algorithm model provided by the embodiment of the present disclosure;
图5是本公开实施例提供的卷积层的结构示意图;Figure 5 is a schematic structural diagram of a convolutional layer provided by an embodiment of the present disclosure;
图6是本公开实施例提供的区域建议网络的结构示意图;Figure 6 is a schematic structural diagram of a region recommendation network provided by an embodiment of the present disclosure;
图7是本公开实施例提供的分类器的结构示意图;Figure 7 is a schematic structural diagram of a classifier provided by an embodiment of the present disclosure;
图8是本公开实施例提供的一种全天候识别船舶的系统的结构示意图。Figure 8 is a schematic structural diagram of an all-weather ship identification system provided by an embodiment of the present disclosure.
具体实施方式Detailed ways
为使本公开的目的、技术方案和优点更加清楚,下面将结合附图对本公开实施方式作进一步地详细描述。In order to make the purpose, technical solutions and advantages of the present disclosure clearer, the embodiments of the present disclosure will be described in further detail below in conjunction with the accompanying drawings.
图1为本公开实施例提供的一种全天候识别船舶的方法的应用场景图。参见图1,第一船舶10周围有多个第二船舶20,多个第二船舶20都存在与第一船舶10碰撞的隐患,需要第一船舶10识别出来并注意避开。由于多个第二船舶20的航向、航速、以及与第一船舶10之间的距离各不相同,因此多个第二船舶20与第一船舶10碰撞的几率大小不同。Figure 1 is an application scenario diagram of an all-weather ship identification method provided by an embodiment of the present disclosure. Referring to FIG. 1 , there are multiple second ships 20 surrounding the first ship 10 . Each of the multiple second ships 20 has the potential to collide with the first ship 10 , which needs to be recognized by the first ship 10 and avoided. Since the courses, speeds, and distances between the plurality of second ships 20 and the first ship 10 are different, the probability of collision between the plurality of second ships 20 and the first ship 10 is different.
本公开实施例提供了一种全天候识别船舶的方法。图2为本公开实施例提供的一种全天候识别船舶的方法的流程图。参见图2,该方法包括:Embodiments of the present disclosure provide a method for identifying ships around the clock. Figure 2 is a flow chart of a method for identifying ships all day long provided by an embodiment of the present disclosure. Referring to Figure 2, the method includes:
步骤101:获取第一船舶周围的多张图像,多张图像的拍摄时间各不相同。Step 101: Acquire multiple images around the first ship, and the multiple images are taken at different times.
在本实施例中,第一船舶为需要识别出周围船舶避免碰撞的船舶。第一船舶周围是指以第一船舶为圆心,设定距离(如15km)为半径的区域。In this embodiment, the first ship is a ship that needs to identify surrounding ships to avoid collision. The area around the first ship refers to the area with the first ship as the center and a set distance (such as 15km) as the radius.
步骤102:采用深度学习算法在各张图像中识别船舶,得到第二船舶在各张图像中的位置。Step 102: Use a deep learning algorithm to identify the ship in each image and obtain the position of the second ship in each image.
在本实施例中,第二船舶为位于第一船舶周围的船舶。In this embodiment, the second ship is a ship located around the first ship.
步骤103:根据第二船舶在各张图像中的位置,确定第二船舶的危险等级。Step 103: Determine the danger level of the second ship based on the position of the second ship in each image.
步骤104:根据第二船舶的危险等级,发出警报。Step 104: Issue an alarm according to the danger level of the second ship.
本公开实施例通过获取第一船舶周围在不同时间拍摄的多张图像,并采用深度学习算法在各张图像中识别船舶,可以得到第一船舶周围的第二船舶在各张图像中的位置。根据第二船舶在各张图像中的位置,可以得到第二船舶的危险等级,根据第二船舶的危险等级发出警报,有利于第一船舶避免与第二船舶碰撞,保障船舶的安全。而且图像获取设备和图像处理设备的价格远低于雷达,可以大幅度降低船舶识别系统的实现成本,特别适用于没有普及雷达的民用货船。By acquiring multiple images taken at different times around the first ship and using a deep learning algorithm to identify the ship in each image, the embodiment of the present disclosure can obtain the position of the second ship around the first ship in each image. According to the position of the second ship in each image, the danger level of the second ship can be obtained. An alarm is issued according to the danger level of the second ship, which helps the first ship avoid collision with the second ship and ensures the safety of the ship. Moreover, the price of image acquisition equipment and image processing equipment is much lower than that of radar, which can greatly reduce the implementation cost of ship identification system, and is especially suitable for civilian cargo ships without widespread radar.
本公开实施例提供了另一种全天候识别船舶的方法,是图2所示的全天候识别船舶的方法的一种可选的实现方式。图3为本公开实施例提供的另一种全天候识别船舶的方法的流程图。参见图3,该方法包括:The embodiment of the present disclosure provides another all-weather method for identifying ships, which is an optional implementation of the method for all-weather identification of ships shown in Figure 2 . Figure 3 is a flow chart of another method for identifying ships all day long provided by an embodiment of the present disclosure. Referring to Figure 3, the method includes:
步骤201:获取第一船舶周围的环境信息。Step 201: Obtain environmental information around the first ship.
在本实施例中,环境信息可以包括光照强度和湿度。光照强度的大小会直接影响到能见度的高低,同时湿度的大小会影响到雾的形成、以及灰尘等杂质的扩散,间接影响到能见度的高度。因此,获取光照强度和湿度作为环境信息,有利于准确确定能见度等级。In this embodiment, the environmental information may include light intensity and humidity. The intensity of light will directly affect the level of visibility. At the same time, the level of humidity will affect the formation of fog and the diffusion of impurities such as dust, which indirectly affects the height of visibility. Therefore, obtaining light intensity and humidity as environmental information is beneficial to accurately determine visibility levels.
可选地,该步骤201可以包括:Optionally, this step 201 may include:
采用光线感应器测量第一船舶周围的光照强度;Use a light sensor to measure the light intensity around the first ship;
采用湿度传感器、水分测定仪和气象雷达中的一种测量第一船舶周围的湿度。The humidity around the first ship is measured using one of a humidity sensor, a moisture meter, and a weather radar.
步骤202:根据环境信息,确定第一船舶周围的能见度等级。Step 202: Determine the visibility level around the first ship based on the environmental information.
在本实施例中,能见度等级可以包括非恶劣环境和恶劣环境。在实际应用中,可以直接采用是否达到设定标准来划分能见度等级。能见度等级达到设定标准,此时能见度较高,属于非恶劣环境;能见度等级没达到设定标准,此时能见度较低,属于恶劣环境。In this embodiment, visibility levels may include non-harsh environment and harsh environment. In practical applications, visibility levels can be divided directly by whether the set standards are met. When the visibility level reaches the set standard, the visibility is high and the environment is non-harsh. If the visibility level does not reach the set standard, the visibility is low and the environment is harsh.
可选地,该步骤202可以包括:Optionally, this step 202 may include:
当第一船舶周围的光照强度在设定强度以上,且第一船舶周围的湿度在设定湿度以下时,确定第一船舶周围的能见度等级达到设定标准;When the light intensity around the first ship is above the set intensity and the humidity around the first ship is below the set humidity, it is determined that the visibility level around the first ship reaches the set standard;
当第一船舶周围的光照强度在设定强度以下,或第一船舶周围的湿度在设定湿度以上时,确定第一船舶周围的能见度等级没达到设定标准。When the light intensity around the first ship is below the set intensity, or the humidity around the first ship is above the set humidity, it is determined that the visibility level around the first ship has not reached the set standard.
当光照强度和湿度同时达到要求时才判定能见度等级达到设定标准,对能见度等级的要求较高,有利于保证摄像头拍摄图像的清晰度。When the light intensity and humidity meet the requirements at the same time, the visibility level is judged to have reached the set standard. The higher requirements for the visibility level are conducive to ensuring the clarity of the images captured by the camera.
示例性地,设定强度可以为100lux,设定湿度可以为50%;设定标准可以为光照强度在100lux以上,且湿度在50%以下。For example, the set intensity can be 100 lux and the set humidity can be 50%; the set standard can be that the light intensity is above 100 lux and the humidity is below 50%.
步骤203:当能见度等级达到设定标准时,控制摄像头连续拍摄第一船舶周围的多张图像,多张图像的拍摄时间各不相同。Step 203: When the visibility level reaches the set standard, control the camera to continuously shoot multiple images around the first ship, and the shooting times of the multiple images are different.
在实际应用中,摄像头可以为广角摄像头,以满足不同区域的拍摄需要。In practical applications, the camera can be a wide-angle camera to meet the shooting needs of different areas.
步骤204:当能见度等级没达到设定标准时,控制激光云台连续拍摄第一船舶周围的多张图像,多张图像的拍摄时间各不相同。Step 204: When the visibility level does not reach the set standard, control the laser pan/tilt to continuously shoot multiple images around the first ship, and the shooting times of the multiple images are different.
在本实施例中,依次执行步骤201、步骤202和步骤203,或者依次执行步骤201、步骤202和步骤204,可以实现获取第一船舶周围的多张图像。In this embodiment, by executing step 201, step 202 and step 203 in sequence, or executing step 201, step 202 and step 204 in sequence, multiple images around the first ship can be acquired.
在实际应用中,上述过程可以由设备自动控制,也可以人为切换图像获取设备拍摄第一船舶周围的图像。图像获取设备可以设置在第一船舶的桅杆上,也可以第一船舶的船体周围,如每个侧面都设置至少一个图像获取设备。对于船体较长的第一船舶,可以在侧面按照一定的间隔设置多个图像获取设备。In practical applications, the above process can be automatically controlled by the device, or the image acquisition device can be manually switched to capture images around the first ship. The image acquisition device may be disposed on the mast of the first ship, or around the hull of the first ship, for example, at least one image acquisition device may be disposed on each side. For the first ship with a longer hull, multiple image acquisition devices can be arranged at certain intervals on the side.
本公开实施例通过获取第一船舶周围的环境信息,确定第一船舶周围的能见度等级,并根据能见度等级是否达到设定标准,在第一船舶周围的能见度较低时控制适用于恶劣环境的激光云台拍摄第一船舶周围的图像,保证拍摄图像的清晰度能够识别出船舶,而在第一船舶周围的能见度较高时控制摄像头拍摄第一船舶周围的图像,保证拍摄图像的清晰度能够识别出船舶的情况下,避免激光云台长时间工作,延长激光云台的使用寿命。The embodiment of the present disclosure determines the visibility level around the first ship by obtaining the environmental information around the first ship, and controls the laser suitable for harsh environments when the visibility around the first ship is low based on whether the visibility level reaches the set standard. The PTZ captures images around the first ship to ensure that the captured images are clear enough to identify the ship, and when the visibility around the first ship is high, the camera is controlled to capture images around the first ship to ensure that the captured images are clear enough to be identified When leaving the ship, avoid long-term working of the laser gimbal to extend the service life of the laser gimbal.
步骤205:采用深度学习算法在各张图像中识别船舶,得到第二船舶在各张图像中的位置。该步骤205在步骤203或者步骤204之后执行。Step 205: Use a deep learning algorithm to identify the ship in each image and obtain the position of the second ship in each image. This step 205 is performed after step 203 or step 204.
在本实施例中,可以采用快速局域卷积神经网络(英文:faster regionconvolutional neural networks,简称:Faster RCNN)算法在图像中识别船舶,有效提高检测速度,能够及时发现碰撞威胁进行报警,保障船舶的安全。In this embodiment, a fast region convolutional neural network (English: faster region convolutional neural networks, abbreviation: Faster RCNN) algorithm can be used to identify ships in images, effectively improving the detection speed, detecting collision threats in a timely manner, and providing alarms to ensure the safety of ships. safety.
可选地,该步骤205可以包括:Optionally, this step 205 may include:
从图像中提取图像特征;Extract image features from images;
根据图像特征,生成候选区域;Generate candidate regions based on image features;
根据图像特征和候选区域,提取区域特征;Extract regional features based on image features and candidate areas;
根据区域特征,确定候选区域的类别,得到第二船舶在图像中的位置。According to the regional characteristics, the category of the candidate area is determined, and the position of the second ship in the image is obtained.
上述步骤可以在现有Faster RCNN算法的基础上实现,实现比较方便。The above steps can be implemented on the basis of the existing Faster RCNN algorithm, which is more convenient to implement.
图4为本公开实施例提供的Faster RCNN算法模型的结构示意图。参见图4,FasterRCNN算法的模型包括卷积层(英文:conv layers)31、区域建议网络(英文:regionproposal networks,简称:PRN)32、池化层(英文:roi pooling)33和分类器(英文:classification)34。卷积层31从图像(英文:image)30中提取出图像的特征信息(英文:image feature maps),分别输出到区域建议网络32和池化层33。区域建议网络32根据图像特征,生成候选区域(英文:region proposals)并输出到池化层33。池化层33根据图像的特征信息和候选区域,提取出候选区域的特征信息(英文:proposal feature maps)并输出到分类器34。分类器34根据候选区域的特征信息,确定候选区域的类别,从而目标在图像中的位置。Figure 4 is a schematic structural diagram of the Faster RCNN algorithm model provided by the embodiment of the present disclosure. Referring to Figure 4, the model of the FasterRCNN algorithm includes convolutional layers (English: conv layers) 31, region proposal networks (English: regionproposal networks, abbreviation: PRN) 32, pooling layers (English: roi pooling) 33 and classifiers (English: roi pooling) 33 :classification)34. The convolution layer 31 extracts image feature information (English: image feature maps) from the image (English: image) 30 and outputs them to the region proposal network 32 and the pooling layer 33 respectively. The region proposal network 32 generates candidate regions (English: region proposals) based on image features and outputs them to the pooling layer 33 . The pooling layer 33 extracts feature information (English: proposal feature maps) of the candidate area based on the feature information of the image and the candidate area and outputs it to the classifier 34. The classifier 34 determines the category of the candidate area and thus the position of the target in the image based on the feature information of the candidate area.
图5为本公开实施例提供的卷积层的结构示意图。参见图5,卷积层31可以包括多个卷积核41、多个激活函数(英文:rectified linear unit,简称:relu)42和多个池化层43。卷积核41可以感知局部特征;激活函数42可以增加神经网络模型的非线性;池化层43可以对特征进行聚合统计。示例性地,如图5所示,卷积层31可以包括13个卷积核41、13个激活函数42和4个池化层43,按照图像的处理顺序,依次为卷积核41、激活函数42、卷积核41、激活函数42、池化层43、卷积核41、激活函数42、卷积核41、激活函数42、池化层43、卷积核41、激活函数42、卷积核41、激活函数42、卷积核41、激活函数42、池化层43、卷积核41、激活函数42、卷积核41、激活函数42、卷积核41、激活函数42、池化层43、卷积核41、激活函数42、卷积核41、激活函数42、卷积核41、激活函数42。Figure 5 is a schematic structural diagram of a convolution layer provided by an embodiment of the present disclosure. Referring to FIG. 5 , the convolution layer 31 may include multiple convolution kernels 41 , multiple activation functions (English: rectified linear unit, relu for short) 42 and multiple pooling layers 43 . The convolution kernel 41 can perceive local features; the activation function 42 can increase the nonlinearity of the neural network model; and the pooling layer 43 can aggregate statistics on features. For example, as shown in Figure 5, the convolution layer 31 may include 13 convolution kernels 41, 13 activation functions 42 and 4 pooling layers 43. According to the order of image processing, the convolution kernel 41, activation function Function 42, convolution kernel 41, activation function 42, pooling layer 43, convolution kernel 41, activation function 42, convolution kernel 41, activation function 42, pooling layer 43, convolution kernel 41, activation function 42, convolution Kernel 41, activation function 42, convolution kernel 41, activation function 42, pooling layer 43, convolution kernel 41, activation function 42, convolution kernel 41, activation function 42, convolution kernel 41, activation function 42, pooling layer 43, convolution kernel 41, activation function 42, convolution kernel 41, activation function 42, convolution kernel 41, activation function 42.
图6为本公开实施例提供的区域建议网络的结构示意图。参见图6,区域建议网络32先采用卷积核41和激活函数42进行处理,并生成大量的候选框(英文:anchors)之后分成两路:一路经过卷积核41之后,采用softmax逻辑回归函数44进行分类,判定候选框属于前景(英文:positive)还是后景(英文:negative),而softmax逻辑回归函数前后设置重塑层(英文:reshape layer)45是为了便于softmax逻辑回归函数分类;另一路经过卷积核41之后,通过边框回归(英文:bounding box regression)计算候选框的偏移量。建议层(英文:proposal layer)46基于候选框的分类结果和偏移量,得到候选区域。Figure 6 is a schematic structural diagram of a region recommendation network provided by an embodiment of the present disclosure. Referring to Figure 6, the region proposal network 32 first uses the convolution kernel 41 and the activation function 42 for processing, and generates a large number of candidate frames (English: anchors), and then is divided into two paths: after passing through the convolution kernel 41, the softmax logistic regression function is used 44 is classified to determine whether the candidate frame belongs to the foreground (English: positive) or the background (English: negative), and a reshape layer (English: reshape layer) 45 is set before and after the softmax logistic regression function to facilitate the classification of the softmax logistic regression function; another After passing through the convolution kernel 41, the offset of the candidate box is calculated through bounding box regression. The proposal layer (English: proposal layer) 46 obtains the candidate area based on the classification result and offset of the candidate frame.
图7为本公开实施例提供的分类器的结构示意图。参见图7,分类器34可以包括全连接层47,全连接层47可以建立上一层的各个神经元与下一层的所有神经元的连接。示例性地,如图7所示,分类器34先依次采用全连接层47、激活函数42、全连接层47、激活函数42处理之后分成两路:一路经过全连接层47之后,作为结果输出;另一路经过全连接层47之后,采用softmax逻辑回归函数44进行分类,并通过边框回归计算候选框的偏移量,以提高候选区域的精度。Figure 7 is a schematic structural diagram of a classifier provided by an embodiment of the present disclosure. Referring to Figure 7, the classifier 34 may include a fully connected layer 47, which may establish connections between each neuron of the upper layer and all the neurons of the next layer. Illustratively, as shown in Figure 7, the classifier 34 first processes the fully connected layer 47, the activation function 42, the fully connected layer 47, and the activation function 42 and then divides it into two paths: one path passes through the fully connected layer 47 and is output as the result. ; After the other path passes through the fully connected layer 47, the softmax logistic regression function 44 is used for classification, and the offset of the candidate frame is calculated through border regression to improve the accuracy of the candidate area.
可选地,在步骤205之前,该方法还可以包括:Optionally, before step 205, the method may also include:
获取已标注船舶所在位置的多张图像;Obtain multiple images with the location of the marked ship;
采用已标注船舶所在位置的多张图像,对深度学习算法的模型进行训练。The model of the deep learning algorithm is trained using multiple images with the location of the ship marked.
在实际应用中,可以采用反向传播算法对深度学习算法模型中的参数进行迭代更新,直到迭代次数达到设定次数或者损失函数在设定范围内。In practical applications, the back propagation algorithm can be used to iteratively update the parameters in the deep learning algorithm model until the number of iterations reaches the set number or the loss function is within the set range.
可选地,在步骤205之后,该方法还可以包括:Optionally, after step 205, the method may also include:
对第一船舶周围的多张图像进行存储;Store multiple images around the first ship;
根据第一船舶周围的多张图像,对深度学习算法的模型进行更新。The model of the deep learning algorithm is updated based on multiple images around the first ship.
利用实际应用过程中获取的图像,再次训练深度学习算法,使更新后的深度学习算法更符合实际情况,提高识别的准确度。Use the images obtained during the actual application to train the deep learning algorithm again, so that the updated deep learning algorithm is more consistent with the actual situation and improves the accuracy of recognition.
在实际应用中,多张图像可以存储在工业硬盘中,以在高盐度、高湿度、高温或者低温等恶劣环境下工作,并且可以存储海量的数据。In practical applications, multiple images can be stored in industrial hard drives to work in harsh environments such as high salinity, high humidity, high temperature or low temperature, and can store massive amounts of data.
在实际应用中,采用第一船舶周围的多张图像对深度学习算法的模型进行训练的过程,与采用已标注船舶所在位置的多张图像对深度学习算法的模型进行训练的过程类似,在此不再详述。In practical applications, the process of training the model of the deep learning algorithm using multiple images around the first ship is similar to the process of training the model of the deep learning algorithm using multiple images with the location of the ship marked. Here, No more details.
可选地,该方法还可以包括:Optionally, the method may also include:
采用深度学习算法确定第二船舶的类型。A deep learning algorithm is used to determine the type of the second ship.
采用深度学习算法在图像中识别船舶出的同时,还可以确定出船舶的类型,不需要人为根据雷达扫描出的障碍物形状进行判断。While using deep learning algorithms to identify ships in images, it can also determine the type of ship, without the need for human judgment based on the shape of obstacles scanned by radar.
在实际应用中,还可以根据第二船舶的类型,确定第二船舶的危险等级。例如,在其它参数都相同的情况下,按照吨位从大到小的顺序对第二船舶进行排序。In practical applications, the risk level of the second ship can also be determined according to the type of the second ship. For example, when other parameters are the same, the second ships are sorted in descending order of tonnage.
步骤206:根据第二船舶在各张图像中的位置,确定第二船舶的危险等级。Step 206: Determine the danger level of the second ship based on the position of the second ship in each image.
可选地,该步骤206可以包括:Optionally, this step 206 may include:
第一步,根据第二船舶在图像中的位置,确定第二船舶在图像的拍摄时间与第一船舶之间的距离;The first step is to determine the distance between the second ship and the first ship at the time when the image was taken based on the position of the second ship in the image;
第二步,根据第二船舶在各张图像的拍摄时间与第一船舶之间的距离,确定第二船舶的航向和航速;The second step is to determine the course and speed of the second ship based on the distance between the second ship and the first ship at the shooting time of each image;
第三步,根据第二船舶的航向、航速、以及与第一船舶之间的距离,确定第二船舶的危险等级。The third step is to determine the danger level of the second ship based on its course, speed, and distance from the first ship.
根据第二船舶在各张图像中的位置,可以得到第二船舶的航向、航速、以及与第一船舶之间的距离,进而分析出第二船舶与第一船舶碰撞的几率,得到的第二船舶的危险等级符合实际情况,准确率较高。According to the position of the second ship in each image, the course, speed, and distance between the second ship and the first ship can be obtained, and then the probability of collision between the second ship and the first ship can be analyzed, and the second ship can be obtained The hazard level of the ship is consistent with the actual situation and the accuracy is high.
在实际应用中,第一步可以包括:In practical applications, the first step may include:
根据第二船舶在图像中的位置,得到第二船舶与第一船舶在图像中的距离;According to the position of the second ship in the image, the distance between the second ship and the first ship in the image is obtained;
根据图像中的距离和图像的缩放比例,得到第二船舶与第一船舶之间的实际距离。According to the distance in the image and the zoom ratio of the image, the actual distance between the second ship and the first ship is obtained.
例如,第二船舶与第一船舶在图像中的距离为10cm,图像的比例为1:10000,则第二船舶与第一船舶之间的实际距离为1km。For example, if the distance between the second ship and the first ship in the image is 10cm and the scale of the image is 1:10000, then the actual distance between the second ship and the first ship is 1km.
示例性地,第二步可以包括:For example, the second step may include:
当第二船舶与第一船舶之间的距离减小时,确定第二船舶的航向朝向第一船舶;When the distance between the second ship and the first ship decreases, determining the course of the second ship toward the first ship;
当第二船舶与第一船舶之间的距离增大时,确定第二船舶的航向背离第一船舶。When the distance between the second ship and the first ship increases, it is determined that the course of the second ship is away from the first ship.
例如,第二船舶与第一船舶之间的距离从10km减小到5km,则第二船舶的航向朝向第一船舶;又如,第二船舶与第一船舶之间的距离从5km增大到10km,则第二船舶的航向背离第一船舶。For example, if the distance between the second ship and the first ship decreases from 10km to 5km, the course of the second ship will be towards the first ship; another example, if the distance between the second ship and the first ship increases from 5km to 10km, the course of the second ship deviates from the first ship.
在实际应用中,第二步可以包括:In practical applications, the second step can include:
根据第二船舶与第一船舶之间的距离变化和图像的拍摄间隔,计算第二船舶的航速。The speed of the second ship is calculated based on the change in distance between the second ship and the first ship and the shooting interval of the images.
例如,根据第二船舶与第一船舶之间的距离减小0.1km,图像的拍摄间隔为5s,则第二船舶的航速为72km/h。For example, if the distance between the second ship and the first ship is reduced by 0.1 km and the image shooting interval is 5 seconds, the speed of the second ship is 72 km/h.
可选地,在第三步可以包括:Optionally, the third step can include:
根据第二船舶与第一船舶之间的距离和多个档位的距离范围,确定第二船舶所属的档位;Determine the gear to which the second ship belongs based on the distance between the second ship and the first ship and the distance range of the multiple gears;
确定第二船舶的航向和航速,对同一档位的第二船舶进行排序。Determine the course and speed of the second ship, and sort the second ships in the same gear.
示例性地,在高级威胁的档位中,第二船舶与第一船舶之间的距离在5km以下;在中级威胁的档位中,第二船舶与第一船舶之间的距离在5km~10km之间;在低级威胁的档位中,第二船舶与第一船舶之间的距离在10km~15km之间;在无威胁的档位中,第二船舶与第一船舶之间的距离在15km以上。For example, in the high-level threat level, the distance between the second ship and the first ship is less than 5km; in the medium-level threat level, the distance between the second ship and the first ship is between 5km and 10km. between; in the low-level threat level, the distance between the second ship and the first ship is between 10km and 15km; in the non-threat level, the distance between the second ship and the first ship is 15km above.
在同一档位的第二船舶中,朝向第一船舶的第二船舶排在背向第一船舶的第二船舶的前面。Among the second ships in the same gear, the second ship facing toward the first ship is arranged in front of the second ship facing away from the first ship.
在同一档位且朝向相同的第二船舶中,按照航速从大到小的顺序排列。Among the second ships in the same gear and facing the same direction, they are arranged in descending order of speed.
步骤207:根据第二船舶的危险等级,发出警报。Step 207: Issue an alarm according to the danger level of the second ship.
可选地,该步骤207可以包括:Optionally, this step 207 may include:
按照危险等级从高到低的顺序,依次输出多个第二船舶的航向、航速、以及与第一船舶之间的距离进行报警。In order from high to low risk levels, the courses, speeds, and distances to the first ship of multiple second ships are sequentially output to generate alarms.
按照危险等级从高到低的顺序依次报警,有利于第一船舶第一时间避开碰撞几率最大的第二船舶,有效保障船舶的安全。Alarms are issued in sequence from high to low risk levels, which will help the first ship avoid the second ship with the highest probability of collision as soon as possible, effectively ensuring the safety of the ship.
在实际应用中,发出警报的设备可以单独设置在第一船舶的舰桥内,也可以设置在第一船舶的警报系统内。In practical applications, the device that sends the alarm can be separately installed in the bridge of the first ship, or can also be installed in the alarm system of the first ship.
本公开实施例提供了一种全天候识别船舶的系统,适用于实现图2或图3所示的全天候识别船舶的方法。图8为本公开实施例提供的一种全天候识别船舶的系统的结构示意图。参见图8,该系统包括:The embodiment of the present disclosure provides an all-weather ship identification system, which is suitable for implementing the all-weather ship identification method shown in Figure 2 or Figure 3 . Figure 8 is a schematic structural diagram of an all-weather ship identification system provided by an embodiment of the present disclosure. Referring to Figure 8, the system includes:
获取模块301,用于获取第一船舶周围的多张图像,多张图像的拍摄时间各不相同;The acquisition module 301 is used to acquire multiple images around the first ship, and the multiple images are taken at different times;
识别模块302,用于采用深度学习算法在各张图像中识别船舶,得到第二船舶在各张图像中的位置;The identification module 302 is used to identify the ship in each image using a deep learning algorithm and obtain the position of the second ship in each image;
定级模块303,用于根据第二船舶在各张图像中的位置,确定第二船舶的危险等级;The rating module 303 is used to determine the risk level of the second ship based on the position of the second ship in each image;
报警模块304,用于根据第二船舶的危险等级,发出警报。The alarm module 304 is used to issue an alarm according to the danger level of the second ship.
本公开实施例Embodiments of the present disclosure
可选地,获取模块301可以包括:Optionally, the acquisition module 301 may include:
信息获取子模块,用于获取第一船舶周围的环境信息;Information acquisition submodule, used to acquire environmental information around the first ship;
等级确定子模块,用于根据环境信息,确定第一船舶周围的能见度等级;The level determination submodule is used to determine the visibility level around the first ship based on environmental information;
拍摄控制子模块,用于当能见度等级达到设定标准时,控制摄像头连续拍摄第一船舶周围的多张图像;当能见度等级没达到设定标准时,控制激光云台连续拍摄第一船舶周围的多张图像。The shooting control submodule is used to control the camera to continuously shoot multiple images around the first ship when the visibility level reaches the set standard; when the visibility level does not reach the set standard, control the laser pan/tilt to continuously shoot multiple images around the first ship. image.
可选地,识别模块302可以包括:Optionally, the identification module 302 may include:
卷积层,用于从图像中提取图像特征;Convolutional layers, used to extract image features from images;
区域建议网络,用于根据图像特征,生成候选区域;Region proposal network, used to generate candidate regions based on image features;
池化层,用于根据图像特征和候选区域,提取区域特征;The pooling layer is used to extract regional features based on image features and candidate regions;
分类器,用于根据区域特征,确定候选区域的类别,得到第二船舶在图像中的位置。The classifier is used to determine the category of the candidate area based on the area characteristics and obtain the position of the second ship in the image.
可选地,定级模块303可以包括:Optionally, the rating module 303 may include:
第一确定子模块,用于根据第二船舶在图像中的位置,确定第二船舶在图像的拍摄时间与第一船舶之间的距离;The first determination sub-module is used to determine the distance between the second ship and the first ship at the shooting time of the image based on the position of the second ship in the image;
第二确定子模块,用于根据第二船舶在各张图像的拍摄时间与第一船舶之间的距离,确定第二船舶的航向和航速;The second determination sub-module is used to determine the course and speed of the second ship based on the distance between the second ship and the first ship at the shooting time of each image;
第三确定子模块,用于根据第二船舶的航向、航速、以及与第一船舶之间的距离,确定第二船舶的危险等级。The third determination sub-module is used to determine the risk level of the second ship based on the course, speed, and distance of the second ship from the first ship.
可选地,报警模块304可以用于,Optionally, the alarm module 304 can be used to,
按照危险等级从高到低的顺序,依次输出多个第二船舶的航向、航速、以及与第一船舶之间的距离进行报警。In order from high to low risk levels, the courses, speeds, and distances to the first ship of multiple second ships are sequentially output to generate alarms.
可选地,获取模块301还可以用于,Optionally, the acquisition module 301 can also be used to:
获取已标注船舶所在位置的多张图像。Obtain multiple images with the vessel's location annotated.
相应地,该系统还可以包括:Accordingly, the system may also include:
训练模块,用于采用已标注船舶所在位置的多张图像,对深度学习算法的模型进行训练。The training module is used to train the model of the deep learning algorithm using multiple images with the location of the ship marked.
可选地,该系统还可以包括:Optionally, the system can also include:
存储模块,用于对第一船舶周围的多张图像进行存储;A storage module used to store multiple images around the first ship;
更新模块,用于根据第一船舶周围的多张图像,对深度学习算法的模型进行更新。The update module is used to update the model of the deep learning algorithm based on multiple images around the first ship.
需要说明的是:上述实施例提供的全天候识别船舶的系统在全天候识别船舶时,仅以上述各功能模块的划分进行举例说明,实际应用中,可以根据需要而将上述功能分配由不同的功能模块完成,即将系统的内部结构划分成不同的功能模块,以完成以上描述的全部或者部分功能。另外,上述实施例提供的全天候识别船舶的系统与全天候识别船舶的方法实施例属于同一构思,其具体实现过程详见方法实施例,这里不再赘述。It should be noted that when the system for identifying ships all-weather in the above embodiments is used to identify ships all-weather, the division of the above-mentioned functional modules is only used as an example. In practical applications, the above functions can be allocated to different functional modules as needed. Completion means dividing the internal structure of the system into different functional modules to complete all or part of the functions described above. In addition, the all-weather ship identification system provided by the above embodiments and the all-weather ship identification method embodiments belong to the same concept. The specific implementation process can be found in the method embodiments and will not be described again here.
上述本公开实施例序号仅仅为了描述,不代表实施例的优劣。The above serial numbers of the embodiments of the present disclosure are only for description and do not represent the advantages and disadvantages of the embodiments.
本领域普通技术人员可以理解实现上述实施例的全部或部分步骤可以通过硬件来完成,也可以通过程序来指令相关的硬件完成,所述的程序可以存储于一种计算机可读存储介质中,上述提到的存储介质可以是只读存储器,磁盘或光盘等。Those of ordinary skill in the art can understand that all or part of the steps to implement the above embodiments can be completed by hardware, or can be completed by instructing relevant hardware through a program. The program can be stored in a computer-readable storage medium. The above-mentioned The storage media mentioned can be read-only memory, magnetic disks or optical disks, etc.
以上所述仅为本公开的可选实施例,并不用以限制本公开,凡在本公开的精神和原则之内,所作的任何修改、等同替换、改进等,均应包含在本公开的保护范围之内。The above are only optional embodiments of the present disclosure and are not intended to limit the present disclosure. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present disclosure shall be included in the protection of the present disclosure. within the range.
Claims (8)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202010001169.4A CN111241948B (en) | 2020-01-02 | 2020-01-02 | Method and system for all-weather ship identification |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202010001169.4A CN111241948B (en) | 2020-01-02 | 2020-01-02 | Method and system for all-weather ship identification |
Publications (2)
Publication Number | Publication Date |
---|---|
CN111241948A CN111241948A (en) | 2020-06-05 |
CN111241948B true CN111241948B (en) | 2023-10-31 |
Family
ID=70865848
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202010001169.4A Active CN111241948B (en) | 2020-01-02 | 2020-01-02 | Method and system for all-weather ship identification |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN111241948B (en) |
Families Citing this family (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN111846127B (en) * | 2020-06-30 | 2022-10-28 | 中海油能源发展股份有限公司 | Image recognition monitoring system for preventing ship touch in offshore oil tanker export operation |
Citations (18)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2003178131A (en) * | 2001-12-11 | 2003-06-27 | Tadashi Goino | Risk control method and system |
JP2005353032A (en) * | 2004-05-12 | 2005-12-22 | National Maritime Research Institute | Ship navigation support device |
CN101655562A (en) * | 2009-09-11 | 2010-02-24 | 深圳市高伦技术有限公司 | Anti-collision alarming radar system and device for ships |
KR20110037069A (en) * | 2009-10-05 | 2011-04-13 | 한국해양대학교 산학협력단 | Vessel Collision Hazard Indicator and Vessel Collision Hazard Method |
CN102039992A (en) * | 2009-10-14 | 2011-05-04 | 古野电气株式会社 | Navigation assisting device |
CN102147981A (en) * | 2010-12-20 | 2011-08-10 | 成都天奥信息科技有限公司 | Method for warning of warning region of shipborne automatic identification system |
KR20120033853A (en) * | 2010-09-30 | 2012-04-09 | 창원대학교 산학협력단 | Ship collision avoidance and recognition system |
KR101193687B1 (en) * | 2011-04-18 | 2012-10-22 | 창원대학교 산학협력단 | Sailing control system for avoiding ship collision |
KR101378859B1 (en) * | 2013-02-01 | 2014-03-31 | 삼성중공업 주식회사 | Apparatus and method for discriminating dangerous ship and pirate ship eradication system using it |
CN104050329A (en) * | 2014-06-25 | 2014-09-17 | 哈尔滨工程大学 | Method for detecting degree of risk of ship collision |
CN104535066A (en) * | 2014-12-19 | 2015-04-22 | 大连海事大学 | A method and system for overlaying sea targets and electronic charts in shipborne infrared video images |
KR20150139323A (en) * | 2014-06-03 | 2015-12-11 | 목포대학교산학협력단 | Method for preventing the ship collision using both satellite communications and ad-hoc communications |
KR101805564B1 (en) * | 2017-06-12 | 2018-01-18 | (주)지인테크 | Alarm system for prevent ship collision and method thereby |
CN107972662A (en) * | 2017-10-16 | 2018-05-01 | 华南理工大学 | To anti-collision warning method before a kind of vehicle based on deep learning |
CN108550281A (en) * | 2018-04-13 | 2018-09-18 | 武汉理工大学 | A kind of the ship DAS (Driver Assistant System) and method of view-based access control model AR |
CN108557030A (en) * | 2018-03-16 | 2018-09-21 | 汝州华超新能源科技有限公司 | A kind of ship sea operation monitoring method and monitoring system |
CN109697892A (en) * | 2019-02-22 | 2019-04-30 | 湖北大学 | A kind of ship collision risk intelligent early-warning method of space-time perception |
CN110441017A (en) * | 2019-07-19 | 2019-11-12 | 武汉理工大学 | A kind of Collision Accidents of Ships pilot system and test method |
-
2020
- 2020-01-02 CN CN202010001169.4A patent/CN111241948B/en active Active
Patent Citations (18)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2003178131A (en) * | 2001-12-11 | 2003-06-27 | Tadashi Goino | Risk control method and system |
JP2005353032A (en) * | 2004-05-12 | 2005-12-22 | National Maritime Research Institute | Ship navigation support device |
CN101655562A (en) * | 2009-09-11 | 2010-02-24 | 深圳市高伦技术有限公司 | Anti-collision alarming radar system and device for ships |
KR20110037069A (en) * | 2009-10-05 | 2011-04-13 | 한국해양대학교 산학협력단 | Vessel Collision Hazard Indicator and Vessel Collision Hazard Method |
CN102039992A (en) * | 2009-10-14 | 2011-05-04 | 古野电气株式会社 | Navigation assisting device |
KR20120033853A (en) * | 2010-09-30 | 2012-04-09 | 창원대학교 산학협력단 | Ship collision avoidance and recognition system |
CN102147981A (en) * | 2010-12-20 | 2011-08-10 | 成都天奥信息科技有限公司 | Method for warning of warning region of shipborne automatic identification system |
KR101193687B1 (en) * | 2011-04-18 | 2012-10-22 | 창원대학교 산학협력단 | Sailing control system for avoiding ship collision |
KR101378859B1 (en) * | 2013-02-01 | 2014-03-31 | 삼성중공업 주식회사 | Apparatus and method for discriminating dangerous ship and pirate ship eradication system using it |
KR20150139323A (en) * | 2014-06-03 | 2015-12-11 | 목포대학교산학협력단 | Method for preventing the ship collision using both satellite communications and ad-hoc communications |
CN104050329A (en) * | 2014-06-25 | 2014-09-17 | 哈尔滨工程大学 | Method for detecting degree of risk of ship collision |
CN104535066A (en) * | 2014-12-19 | 2015-04-22 | 大连海事大学 | A method and system for overlaying sea targets and electronic charts in shipborne infrared video images |
KR101805564B1 (en) * | 2017-06-12 | 2018-01-18 | (주)지인테크 | Alarm system for prevent ship collision and method thereby |
CN107972662A (en) * | 2017-10-16 | 2018-05-01 | 华南理工大学 | To anti-collision warning method before a kind of vehicle based on deep learning |
CN108557030A (en) * | 2018-03-16 | 2018-09-21 | 汝州华超新能源科技有限公司 | A kind of ship sea operation monitoring method and monitoring system |
CN108550281A (en) * | 2018-04-13 | 2018-09-18 | 武汉理工大学 | A kind of the ship DAS (Driver Assistant System) and method of view-based access control model AR |
CN109697892A (en) * | 2019-02-22 | 2019-04-30 | 湖北大学 | A kind of ship collision risk intelligent early-warning method of space-time perception |
CN110441017A (en) * | 2019-07-19 | 2019-11-12 | 武汉理工大学 | A kind of Collision Accidents of Ships pilot system and test method |
Non-Patent Citations (1)
Title |
---|
基于深度学习的水面无人船前方船只图像识别方法;王贵槐;谢朔;初秀民;洛天骄;;船舶工程(04);全文 * |
Also Published As
Publication number | Publication date |
---|---|
CN111241948A (en) | 2020-06-05 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
KR102777495B1 (en) | Autonomous navigation method using image segmentation | |
US12067764B2 (en) | Brake light detection | |
CN110531376B (en) | Obstacle detection and tracking method for port unmanned vehicle | |
Possatti et al. | Traffic light recognition using deep learning and prior maps for autonomous cars | |
CN109409283B (en) | Method, system and storage medium for tracking and monitoring sea surface ship | |
US12198418B2 (en) | System and method for measuring the distance to an object in water | |
US10818172B2 (en) | Method, device and system for processing startup of preceding vehicle | |
Wu et al. | Applying a functional neurofuzzy network to real-time lane detection and front-vehicle distance measurement | |
KR20210090572A (en) | Device and method for monitoring a berthing | |
CN107845104A (en) | A kind of method, associated processing system, passing vehicle detecting system and vehicle for detecting passing vehicle | |
KR102265980B1 (en) | Device and method for monitoring ship and port | |
CN110060508A (en) | A kind of ship automatic testing method for inland river bridge zone | |
CN111967396A (en) | Processing method, device and equipment for obstacle detection and storage medium | |
WO2021030477A1 (en) | Support structure mounting sensing devices for sensing port operations | |
CN111241948B (en) | Method and system for all-weather ship identification | |
Qiu et al. | Intelligent highway lane center identification from surveillance camera video | |
WO2023009180A1 (en) | Lidar-based object tracking | |
TWI743637B (en) | Traffic light recognition system and method thereof | |
CN113920731B (en) | A real-time identification method of traffic operation risk based on UAV | |
CN115100903A (en) | Highway curve bidirectional early warning system based on YOLOV3 target detection algorithm | |
CN115690743A (en) | Airport gate stand intrusion detection method based on deep learning | |
Singh et al. | High accuracy lane line detection system using enhanced yolo v3 | |
Álvarez et al. | Perception advances in outdoor vehicle detection for automatic cruise control | |
Al Khafaji et al. | Traffic Signs Detection and Recognition Using A combination of YOLO and CNN | |
CN117644815B (en) | Blind zone alarming method, device, equipment and system based on intelligent car lamp system |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant |