CN114333134B - Cabin management method, device, equipment and storage medium - Google Patents
Cabin management method, device, equipment and storage medium Download PDFInfo
- Publication number
- CN114333134B CN114333134B CN202210228323.0A CN202210228323A CN114333134B CN 114333134 B CN114333134 B CN 114333134B CN 202210228323 A CN202210228323 A CN 202210228323A CN 114333134 B CN114333134 B CN 114333134B
- Authority
- CN
- China
- Prior art keywords
- human body
- cabin
- preset
- bone
- bone feature
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02P—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
- Y02P90/00—Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
- Y02P90/02—Total factory control, e.g. smart factories, flexible manufacturing systems [FMS] or integrated manufacturing systems [IMS]
Landscapes
- Radiation Pyrometers (AREA)
Abstract
The invention belongs to the field of artificial intelligence and discloses a cabin management method, a cabin management device, cabin management equipment and a storage medium. The method comprises the following steps: acquiring an infrared thermal imaging image acquired by an infrared camera device in a cabin; carrying out target detection on the infrared thermal imaging image according to a preset human body recognition model, and judging whether human body characteristics exist in the infrared thermal imaging image according to a target detection result; when the human body features exist, extracting the bone features of the infrared thermal imaging image according to a preset bone feature extraction model to obtain a bone feature set; and determining the human body movement rate according to the skeletal feature set, and opening the cabin door when the human body movement rate is greater than a preset rate threshold. Compared with the existing mode that a user living in a cabin can only open the cabin door in a complicated unlocking mode, the mode disclosed by the invention can intelligently open the cabin door when the door lock is damaged or the unlocking is complicated, so that the safety of the user is ensured and the experience feeling is improved.
Description
Technical Field
The invention relates to the technical field of artificial intelligence, in particular to a cabin management method, device, equipment and storage medium.
Background
With the rapid development of economy and the pursuit of spirits by people, more people prefer to travel out during holidays. In the process of travelling, the most inevitable is exactly to have lived, especially to the visitor who takes a cruise ship to travel, the cabin of living is indispensable thing, but the cabin is the narrow and small space of closed most, and the experience that can influence the user of living in more or less, to some special users, probably also can lead to the emergence of incident because of self reason and environmental reason, and some hatch doors are for promoting the security, and the door process of opening the cabin is loaded down with trivial details, and user experience is not high. Therefore, how to improve the living experience of the cabin and ensure the safety of the user becomes a problem to be solved urgently.
The above is only for the purpose of assisting understanding of the technical aspects of the present invention, and does not represent an admission that the above is prior art.
Disclosure of Invention
The invention mainly aims to provide a cabin management method, a cabin management device, cabin management equipment and a cabin management storage medium, and aims to solve the technical problems that in the prior art, a cabin door lock is damaged or an unlocking mode is complicated, so that a user is dangerous in a cabin or the user experience is not high.
In order to achieve the above object, the present invention provides a cabin management method, comprising the steps of:
acquiring an infrared thermal imaging image acquired by an infrared camera device in a cabin;
carrying out target detection on the infrared thermal imaging image according to a preset human body recognition model, and judging whether human body characteristics exist in the infrared thermal imaging image according to a target detection result;
when the human body features exist, extracting the bone features of the infrared thermal imaging image according to a preset bone feature extraction model to obtain a bone feature set;
and determining the human body movement rate according to the skeletal feature set, and opening the cabin door when the human body movement rate is greater than a preset rate threshold.
Optionally, when the human body features exist, performing bone feature extraction on the infrared thermal imaging image according to a preset bone feature extraction model to obtain a bone feature set, where the step includes:
when the human body characteristics exist, acquiring a target image frame corresponding to the infrared thermal imaging image;
extracting the bone features of the target image frame according to a preset bone feature extraction model to obtain a bone feature image corresponding to the target image frame;
and constructing the bone feature set according to the bone feature image.
Optionally, the step of extracting the bone features of the target image frame according to a preset bone feature extraction model to obtain a bone feature image corresponding to the target image frame includes:
determining key parts of the human body in the target image frame according to a preset bone feature extraction model;
and connecting the key parts according to a preset connection strategy to obtain a bone feature image corresponding to the target image frame.
Optionally, after the step of performing target detection on the infrared thermal imaging image according to a preset human body recognition model and determining whether human body features exist in the infrared thermal imaging image according to a target detection result, the method further includes:
when the human body features exist, determining the temperature distribution information of the human body according to the human body features;
determining the highest temperature of the human body according to the temperature distribution information;
and when the highest temperature is greater than a preset temperature threshold value, early warning is carried out.
Optionally, the determining a human body movement rate according to the skeletal feature set, and after the step of opening the hatch door when the human body movement rate is greater than a preset rate threshold, further includes:
acquiring the air exchange rate in the cabin collected by an air speed sensor arranged at a preset position;
judging whether the ventilation rate is smaller than a preset wind speed threshold value or not;
and when the ventilation rate is smaller than the preset wind speed threshold value, prompting a user to adjust the ventilation power.
Optionally, before the step of acquiring the infrared thermal imaging image acquired by the infrared camera device in the cabin, the method further includes:
when a check-in instruction is received, acquiring check-in time and adjustment parameter information according to the check-in instruction, wherein the adjustment parameter information comprises a target temperature and a target humidity;
acquiring the current temperature and the current humidity in a cabin;
determining temperature adjusting time length according to the current temperature and the target temperature;
determining humidity adjusting time length according to the current humidity and the target humidity;
and determining the starting time and the target mode of the air conditioner in the cabin according to the temperature adjusting time, the humidity adjusting time and the check-in time so as to adjust the environment of the cabin.
Optionally, before the step of acquiring the infrared thermal imaging image acquired by the infrared camera in the cabin, the method further includes:
acquiring environmental information outside the cabin;
determining the external temperature according to the environment information, and judging whether the external temperature is greater than a preset early warning threshold value;
and when the external temperature is greater than the preset early warning threshold value, early warning is carried out.
Further, to achieve the above object, the present invention also provides a cabin management apparatus, comprising:
the acquisition module is used for acquiring an infrared thermal imaging image acquired by an infrared camera device in the cabin;
the target detection module is used for carrying out target detection on the infrared thermal imaging image according to a preset human body recognition model and judging whether human body characteristics exist in the infrared thermal imaging image according to a target detection result;
the bone feature extraction module is used for extracting bone features of the human body according to a preset bone feature extraction model when the human body features exist, so as to obtain a bone feature set;
and the human body movement rate determining module is used for determining the human body movement rate according to the bone feature set, and when the human body movement rate is greater than a preset rate threshold, the hatch door is opened.
In addition, to achieve the above object, the present invention also provides a cabin management apparatus, including: a memory, a processor, and a cabin management program stored on the memory and executable on the processor, the cabin management program configured to implement the steps of the cabin management method as described above.
Furthermore, to achieve the above object, the present invention also proposes a storage medium having a cabin management program stored thereon, which when executed by a processor implements the steps of the cabin management method as described above.
The invention obtains an infrared thermal imaging image collected by an infrared camera device in a cabin; carrying out target detection on the infrared thermal imaging image according to a preset human body recognition model, and judging whether human body characteristics exist in the infrared thermal imaging image according to a target detection result; when the human body features exist, extracting the bone features of the infrared thermal imaging image according to a preset bone feature extraction model to obtain a bone feature set; and determining the human body movement rate according to the skeletal feature set, and opening the cabin door when the human body movement rate is greater than a preset rate threshold. Compared with the existing mode that a user living in the cabin can only open the cabin door through a complicated unlocking mode, the mode disclosed by the invention can automatically open the cabin door when the door lock is damaged or the user has difficulty and can not unlock the cabin door, so that the safety of the user is ensured.
Drawings
Fig. 1 is a schematic structural diagram of a cabin management device of a hardware operating environment according to an embodiment of the present invention;
FIG. 2 is a schematic flow chart of a first embodiment of a cabin management method of the present invention;
FIG. 3 is a skeletal characterization view of a first embodiment of a cabin management method of the present invention;
FIG. 4 is a schematic flow chart of a cabin management method according to a second embodiment of the present invention;
fig. 5 is a block diagram showing the structure of the cabin management apparatus according to the first embodiment of the present invention.
The implementation, functional features and advantages of the objects of the present invention will be further explained with reference to the accompanying drawings.
Detailed Description
It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
Referring to fig. 1, fig. 1 is a schematic structural diagram of a cabin management device in a hardware operating environment according to an embodiment of the present invention.
As shown in fig. 1, the cabin management apparatus may include: a processor 1001, such as a Central Processing Unit (CPU), a communication bus 1002, a user interface 1003, a network interface 1004, and a memory 1005. Wherein a communication bus 1002 is used to enable connective communication between these components. The user interface 1003 may include a Display screen (Display), an input unit such as a Keyboard (Keyboard), and the optional user interface 1003 may also include a standard wired interface, a wireless interface. The network interface 1004 may optionally include a standard wired interface, a Wireless interface (e.g., a Wireless-Fidelity (WI-FI) interface). The Memory 1005 may be a Random Access Memory (RAM) or a Non-Volatile Memory (NVM), such as a disk Memory. The memory 1005 may alternatively be a storage device separate from the processor 1001.
Those skilled in the art will appreciate that the configuration shown in fig. 1 does not constitute a limitation of the cabin management apparatus and may include more or fewer components than shown, or some components in combination, or a different arrangement of components.
As shown in fig. 1, a memory 1005, which is a storage medium, may include therein an operating system, a network communication module, a user interface module, and a cabin management program.
In the cabin management apparatus shown in fig. 1, the network interface 1004 is mainly used for data communication with a network server; the user interface 1003 is mainly used for data interaction with a user; the processor 1001 and the memory 1005 in the cabin management apparatus of the present invention may be provided in the cabin management apparatus, and the cabin management apparatus calls the cabin management program stored in the memory 1005 through the processor 1001 and executes the cabin management method provided by the embodiment of the present invention.
Based on the cabin management device, an embodiment of the present invention provides a cabin management method, and referring to fig. 2, fig. 2 is a flowchart illustrating a first embodiment of the cabin management method according to the present invention.
In this embodiment, the cabin management method includes the following steps:
step S10: and acquiring an infrared thermal imaging image acquired by an infrared camera device in the cabin.
It should be noted that the execution subject of the embodiment may be a computing service device with data processing, network communication and program running functions, such as a mobile phone, a tablet computer, a personal computer, etc., or an electronic device or cabin management device capable of implementing the above functions. The present embodiment and the following embodiments will be described below by taking the cabin management apparatus as an example.
It should be noted that the cabin may include a room with a small space, such as a general cabin or a capsule room. The infrared camera device can be an infrared camera which is installed in the cabin in advance. The infrared thermal imaging image may be an infrared image in the cabin acquired by the infrared camera device.
It is understood that deep space, whether arctic glaciers, or flames, humans, or even extremely cold universes, will have infrared radiation as long as their temperature is above absolute zero-273 ℃, as a result of the thermal movement of molecules within the object. The radiation energy is proportional to the fourth power of the temperature, and the radiation wavelength is inversely proportional to the temperature. The infrared imaging technology is based on the detected radiation energy of the object. The thermal image of the target object is converted by the system processing and displayed in gray scale or pseudo color, and the temperature distribution of the measured target is obtained, so that the state of the object is judged. The thermal imaging functions as: the prompting of inflammation, early warning of tumor, prompting of peripheral nerve diseases, analysis of other difficult and complicated diseases, tracking of curative effect and the like.
Further, in order to improve the experience of the user, before the step S10, the method further includes: when a check-in instruction is received, acquiring check-in time and adjustment parameter information according to the check-in instruction, wherein the adjustment parameter information comprises a target temperature and a target humidity; acquiring the current temperature and the current humidity in a cabin; determining temperature adjusting time according to the current temperature and the target temperature; determining humidity adjusting time length according to the current humidity and the target humidity; and determining the starting time and the target mode of the air conditioner in the cabin according to the temperature adjusting time, the humidity adjusting time and the check-in time so as to adjust the environment of the cabin.
It should be noted that the check-in instruction may be a command including check-in time, adjustment parameter information, and cabin identification submitted by cabin management personnel or users on line. The temperature adjustment period may be a period required to adjust the actual temperature of the cabin from the current temperature to the target temperature. The humidity adjustment period may be a period required to adjust the actual humidity of the cabin from the current humidity to the target humidity. The air conditioner on time may be a time when an air conditioner in the cabin is automatically turned on. The target mode is a mode after the air conditioner is started, and can comprise modes such as refrigeration, heating and humidity adjustment.
In a specific implementation, the check-in command received by the cabin management device comprises a check-in time of 14:00, and the adjustment parameter information comprises a target temperature of 20% and a target humidity of 50%. The current temperature in the cabin is 10% and the current humidity is 30%. And determining the temperature adjusting time length to be 10 minutes according to the current temperature and the target temperature. The method comprises the steps of determining the humidity adjusting time to be 5 minutes according to the current humidity and the target humidity, determining that the air conditioner should be started 10 minutes before entering the residence according to the temperature adjusting time and the humidity adjusting time, starting the heating mode to adjust the temperature when the air conditioner is started, and starting the humidity adjusting 5 minutes before entering the residence, so that the starting time of the air conditioner is 13:50, the target mode is that the heating mode is started firstly, and the humidity adjusting is started after 5 minutes.
Further, in order to ensure the safety of the user, before the step S10, the method further includes: acquiring environmental information outside the cabin; determining the external temperature according to the environment information, and judging whether the external temperature is greater than a preset early warning threshold value; and when the external temperature is greater than the preset early warning threshold value, early warning is carried out.
It should be noted that the environment may be environment information outside the cabin, and may include an external temperature outside the cabin. The preset early warning threshold value can be a preset threshold value, when the external temperature is higher than the preset early warning threshold value, a fire disaster outside the cabin can be judged, early warning needs to be timely carried out, and the safety of users in the cabin is guaranteed.
Step S20: and carrying out target detection on the infrared thermal imaging image according to a preset human body recognition model, and judging whether human body characteristics exist in the infrared thermal imaging image according to a target detection result.
It should be noted that the preset human body recognition model may be a model which is obtained by training a neural network model through sample data and can recognize whether human body features exist in the infrared thermal imaging image. Specifically, the target detection can be performed on the infrared thermal imaging image collected by the infrared camera device in real time through a preset human body recognition model, whether human body characteristics exist in the infrared thermal imaging image or not is judged, and a detection result is output and can comprise the detection of the human body characteristics or the non-detection of the human body characteristics.
Further, in order to improve the user experience and ensure the user safety, after the step S20, the method may further include: when the human body features exist, determining the temperature distribution information of the human body according to the human body features; determining the highest temperature of the human body according to the temperature distribution information; and when the highest temperature is greater than a preset temperature threshold value, early warning is carried out.
It should be noted that the temperature distribution information may be temperature information of a region corresponding to a human body feature in the infrared thermal imaging image, and includes temperatures of different regions in the human body. The highest temperature of the human body can be obtained according to the temperature distribution information. The preset temperature threshold may be a preset threshold. The maximum temperature of the human body can be medically, when the maximum temperature of the human body is larger than the preset temperature threshold value, the human body can be judged to be dangerous, and early warning can be performed in a preset early warning mode, for example, a cabin door is opened, a cabin manager is notified, a cabin door induction lamp is lightened, and the like.
Step S30: and when the human body features exist, extracting the bone features of the infrared thermal imaging image according to a preset bone feature extraction model to obtain a bone feature set.
It should be noted that the preset bone feature extraction model may be a preset model capable of extracting bone features, such as an opencast network model. The method can mark key parts of the human body in the image, such as joint parts, and further connect the key parts to form a skeleton characteristic diagram of the human body. Referring to fig. 3, fig. 3 is a bone feature map of the first embodiment of the cabin management method according to the present invention, where the bone feature set may be a bone feature map set composed of bone feature maps corresponding to different image frames in the infrared thermal imaging image.
Step S40: and determining the human body movement rate according to the skeletal feature set, and opening the cabin door when the human body movement rate is greater than a preset rate threshold.
It should be noted that, the determination of the human body movement rate according to the bone feature set may be determined according to the number of bone feature maps in the bone feature set and the relative positions of human bones in two adjacent bone feature maps. For example, arranging the bone feature maps in the bone feature map set according to a time sequence, comparing whether the position relations of human bones in the two adjacent bone feature maps in the bone feature maps are consistent or not, if not, judging that the human body moves in the two bone feature maps, and acquiring the target quantity of the human body moving in the two adjacent bone feature maps in the bone feature map set. And obtaining the human body movement rate according to the target number divided by the number of the bone feature maps. The preset speed threshold is a preset speed threshold, and when the human body movement speed is greater than the preset speed threshold, the cabin door is opened. The step of comparing whether the position relationships of the human bones in the two adjacent bone feature maps are consistent or not can be directly comparing the two adjacent bone feature maps, judging whether the two adjacent bone feature maps are the same or whether the similarity is greater than a preset similarity threshold, and judging that the position relationships of the human bones in the two adjacent bone feature maps are consistent when the similarity is greater than the preset similarity threshold. The preset similarity threshold may be a preset similarity threshold. Calculating the similarity of the two skeleton feature maps can be to obtain the RGB value of each pixel point in the two skeleton feature maps, compare whether the RGB values of the corresponding pixel points in the two skeleton feature maps are the same, if so, mark as a target pixel, determine the similarity according to the number of the target pixels and the total number of pixels of the skeleton feature maps, and can be to divide the number of the target pixels by the total number of pixels of the skeleton feature maps.
In a specific implementation, for example, the number of the bone feature maps is 6, the similarity between the first bone feature map and the second bone feature map is 80%, the similarity between the second bone feature map and the third bone feature map is 87%, the similarity between the third bone feature map and the fourth bone feature map is 95%, the similarity between the fourth bone feature map and the fifth bone feature map is 92%, the similarity between the fifth bone feature map and the sixth bone feature map is 85%, and the preset similarity threshold is set to 90%, so that the number of the objects, in which the human body can be determined to have movement, in the two adjacent bone feature maps in the bone feature map set is 3. And dividing the target number by the number of the bone feature maps to obtain the human body movement rate of 50%. And if the preset speed threshold value is 40%, opening the cabin door. Or when the moving speed of the human body is greater than the preset speed threshold, sending a preset prompt message to inquire whether the user needs to open the cabin door, opening the cabin door when the user does not receive a reply within a preset time period, and executing the command of the user if the user replies the command within the preset time period.
Further, in order to promote the living environment in the cabin and ensure the circulation of air in the enclosed cabin, after step S40, the method may include: acquiring the air exchange rate in the cabin collected by an air speed sensor arranged at a preset position; judging whether the ventilation rate is smaller than a preset wind speed threshold value or not; and when the ventilation rate is smaller than the preset wind speed threshold value, prompting a user to adjust the ventilation power.
It should be noted that, in order to avoid that the cabin ventilator is damaged to cause air in the cabin to be not circulated, the air speed at the air outlet of the ventilator acquired by the air speed sensor, that is, the ventilation rate, is acquired in the embodiment. When the ventilation rate is smaller than the preset wind speed threshold value, the fact that the ventilation device is damaged or the ventilation power is too low to cause that air in the room does not circulate can be judged, and at the moment, a user is prompted to adjust the ventilation power. The preset wind speed threshold value is a preset wind speed value.
The method comprises the steps of obtaining an infrared thermal imaging image collected by an infrared camera device in a cabin; carrying out target detection on the infrared thermal imaging image according to a preset human body recognition model, and judging whether human body characteristics exist in the infrared thermal imaging image according to a target detection result; when the human body features exist, extracting the bone features of the infrared thermal imaging image according to a preset bone feature extraction model to obtain a bone feature set; and determining the human body movement rate according to the skeletal feature set, and opening the cabin door when the human body movement rate is greater than a preset rate threshold. Compared with the existing mode that a user living in a cabin can only open the cabin door through a complicated unlocking mode, the mode of the embodiment can automatically open the cabin door when the door lock is damaged or the user has difficulty and cannot unlock the cabin door, and the safety of the user is guaranteed. This embodiment also can be used to intelligence and unblanks, and the user removes or rocks the arm at infrared camera device collection within range, can open the hatch door, promotes user experience and feels and also avoids the contact.
Referring to fig. 4, fig. 4 is a schematic flow chart of a cabin management method according to a second embodiment of the present invention.
Based on the first embodiment described above, in the present embodiment, the step S30 includes:
step S301: and when the human body characteristics exist, acquiring a target image frame corresponding to the infrared thermal imaging image.
It should be noted that the target image frame may be an image frame corresponding to an infrared thermal imaging image when a human body is present.
In specific implementation, when the human body characteristics exist in the acquired infrared thermal imaging image, the cabin management device acquires the image acquired by the infrared thermal imaging image and having the human body characteristics, and acquires a target image frame corresponding to the image according to the image.
Step S302: and carrying out bone feature extraction on the target image frame according to a preset bone feature extraction model to obtain a bone feature image corresponding to the target image frame.
It should be noted that the preset bone feature extraction model may be an image capable of extracting human bones in the image, and the extracted bone feature image may refer to fig. 3.
Further, in order to illustrate how to obtain the bone feature image corresponding to the target image frame, the step S302 may include: determining key parts of the human body in the target image frame according to a preset bone feature extraction model; and connecting the key parts according to a preset connection strategy to obtain a bone feature image corresponding to the target image frame.
It should be noted that the key parts of the human body may be joints corresponding to the human body with a certain degree of freedom, such as neck, shoulder, elbow, wrist, waist, knee, ankle, etc., and the key parts of the human body in the target image frame may be extracted through a convolutional network. The preset connection strategy can be a strategy for correctly connecting the key parts through the distribution position relation in the target image frame to form a bone feature image.
Step S303: and constructing the bone feature set according to the bone feature image.
It should be noted that, the constructing the bone feature set according to the bone feature image may be to construct the bone feature set according to the order of the target image frames and the corresponding bone feature images in order, so as to be used for determining the human body movement rate according to the bone feature set subsequently.
In the embodiment, when the human body characteristics exist, a target image frame corresponding to the infrared thermal imaging image is acquired; extracting the bone features of the target image frame according to a preset bone feature extraction model to obtain a bone feature image corresponding to the target image frame; and constructing the bone feature set according to the bone feature image. In this embodiment, a preset bone feature extraction model is used to extract bone features of the target image frame, so as to obtain a bone feature image corresponding to the target image frame, and further construct the bone feature set according to the bone feature image. The human skeleton feature set can be constructed according to the target image frame when a human body exists in the cabin, so that the moving speed of the human body is accurately identified, the cabin door is intelligently opened, and the user experience is improved.
Referring to fig. 5, fig. 5 is a block diagram showing the structure of the cabin management apparatus according to the first embodiment of the present invention.
As shown in fig. 5, a cabin management device according to an embodiment of the present invention includes:
the acquiring module 10 is used for acquiring an infrared thermal imaging image acquired by an infrared camera device in the cabin;
the target detection module 20 is configured to perform target detection on the infrared thermal imaging image according to a preset human body recognition model, and determine whether human body features exist in the infrared thermal imaging image according to a target detection result;
the bone feature extraction module 30 is configured to, when the human body features exist, perform bone feature extraction on the human body features according to a preset bone feature extraction model to obtain a bone feature set;
and the human body movement rate determining module 40 is used for determining the human body movement rate according to the skeletal feature set, and opening the cabin door when the human body movement rate is greater than a preset rate threshold.
The method comprises the steps of obtaining an infrared thermal imaging image collected by an infrared camera device in a cabin; carrying out target detection on the infrared thermal imaging image according to a preset human body recognition model, and judging whether human body characteristics exist in the infrared thermal imaging image according to a target detection result; when the human body features exist, extracting the bone features of the infrared thermal imaging image according to a preset bone feature extraction model to obtain a bone feature set; and determining the human body movement rate according to the skeletal feature set, and opening the cabin door when the human body movement rate is greater than a preset rate threshold. Compared with the existing mode that a user living in a cabin can only open the cabin door through a complicated unlocking mode, the mode of the embodiment can automatically open the cabin door when the door lock is damaged or the user has difficulty and cannot unlock the cabin door, and the safety of the user is guaranteed.
It should be noted that the above-described work flows are only exemplary, and do not limit the scope of the present invention, and in practical applications, a person skilled in the art may select some or all of them to achieve the purpose of the solution of the embodiment according to actual needs, and the present invention is not limited herein.
In addition, the technical details that are not described in detail in this embodiment may refer to the parameter operation method provided in any embodiment of the present invention, and are not described herein again.
A second embodiment of the cabin management apparatus of the present invention is proposed based on the first embodiment of the cabin management apparatus of the present invention described above.
In this embodiment, the bone feature extraction module 30 is further configured to obtain a target image frame corresponding to the infrared thermal imaging image when the human body feature exists; extracting the bone features of the target image frame according to a preset bone feature extraction model to obtain a bone feature image corresponding to the target image frame; and constructing the bone feature set according to the bone feature image.
Further, the bone feature extraction module 30 is further configured to determine a key part of the human body in the target image frame according to a preset bone feature extraction model; and connecting the key parts according to a preset connection strategy to obtain a bone feature image corresponding to the target image frame.
Further, the target detection module 20 is further configured to determine temperature distribution information of the human body according to the human body characteristics when the human body characteristics exist; determining the highest temperature of the human body according to the temperature distribution information; and when the highest temperature is greater than a preset temperature threshold value, early warning is carried out.
Further, the human body movement rate determining module 40 is further configured to obtain an air exchange rate in the cabin, which is acquired by an air speed sensor installed at a preset position; judging whether the ventilation rate is smaller than a preset wind speed threshold value or not; and when the ventilation rate is smaller than the preset wind speed threshold value, prompting a user to adjust the ventilation power.
Further, the obtaining module 10 is further configured to obtain check-in time and adjustment parameter information according to the check-in instruction when the check-in instruction is received, where the adjustment parameter information includes a target temperature and a target humidity; acquiring the current temperature and the current humidity in a cabin; determining temperature adjusting time length according to the current temperature and the target temperature; determining humidity adjusting time length according to the current humidity and the target humidity; and determining the starting time and the target mode of the air conditioner in the cabin according to the temperature adjusting time, the humidity adjusting time and the check-in time so as to adjust the environment of the cabin.
Further, the obtaining module 10 is further configured to obtain environmental information outside the cabin; determining the external temperature according to the environment information, and judging whether the external temperature is greater than a preset early warning threshold value; and when the external temperature is greater than the preset early warning threshold value, early warning is carried out.
Other embodiments or specific implementation manners of the cabin management device of the present invention may refer to the above method embodiments, and are not described herein again.
Furthermore, an embodiment of the present invention further provides a storage medium, where the storage medium stores a cabin management program, and the cabin management program, when executed by a processor, implements the steps of the cabin management method described above.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or system that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or system. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or system that comprises the element.
The above-mentioned serial numbers of the embodiments of the present invention are merely for description and do not represent the merits of the embodiments.
Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solutions of the present invention may be embodied in the form of a software product, which is stored in a storage medium (e.g., a rom/ram, a magnetic disk, an optical disk) and includes instructions for enabling a terminal device (e.g., a mobile phone, a computer, a server, an air conditioner, or a network device) to execute the method according to the embodiments of the present invention.
The above description is only a preferred embodiment of the present invention, and not intended to limit the scope of the present invention, and all modifications of equivalent structures and equivalent processes, which are made by using the contents of the present specification and the accompanying drawings, or directly or indirectly applied to other related technical fields, are included in the scope of the present invention.
Claims (10)
1. A cabin management method, characterized in that the cabin management method comprises the steps of:
acquiring an infrared thermal imaging image acquired by an infrared camera device in a cabin;
carrying out target detection on the infrared thermal imaging image according to a preset human body recognition model, and judging whether human body characteristics exist in the infrared thermal imaging image according to a target detection result;
when the human body features exist, extracting the bone features of the infrared thermal imaging image according to a preset bone feature extraction model to obtain a bone feature set;
determining the human body movement rate according to the skeletal feature set, and opening a cabin door when the human body movement rate is greater than a preset rate threshold;
the step of determining the human body movement rate from the set of skeletal features comprises:
arranging the bone characteristic graphs in the bone characteristic set according to a time sequence to obtain an arrangement result;
comparing whether the position relations of the human bones in the two adjacent bone feature graphs in the bone feature graphs are consistent or not according to the arrangement result;
if the two skeleton characteristic graphs are not consistent, judging that the human body moves in the two skeleton characteristic graphs, and acquiring the target quantity of the human body movement in the two adjacent skeleton characteristic graphs in the skeleton characteristic graph set;
obtaining the human body movement rate according to the target number divided by the total number of the skeleton characteristic graphs;
the step of comparing whether the position relations of the human bones in the two adjacent bone feature maps in the bone feature maps are consistent or not according to the arrangement result comprises the following steps:
comparing the two adjacent bone feature graphs according to the arrangement result, judging whether the similarity of the two adjacent bone feature graphs is greater than a preset similarity threshold value, and judging that the position relations of human bones in the two adjacent bone feature graphs in the bone feature graphs are consistent when the similarity is greater than the preset similarity threshold value;
and when the similarity is less than or equal to the preset similarity threshold, judging that the position relations of the human bones in the two adjacent bone characteristic graphs in the bone characteristic graphs are inconsistent.
2. The cabin management method according to claim 1, wherein the step of extracting the bone features of the infrared thermal imaging image according to a preset bone feature extraction model to obtain a bone feature set when the human body features exist comprises:
when the human body characteristics exist, acquiring a target image frame corresponding to the infrared thermal imaging image;
extracting the bone features of the target image frame according to a preset bone feature extraction model to obtain a bone feature image corresponding to the target image frame;
and constructing the bone feature set according to the bone feature image.
3. The cabin management method according to claim 2, wherein the step of extracting the bone features of the target image frame according to a preset bone feature extraction model to obtain a bone feature image corresponding to the target image frame comprises:
determining key parts of the human body in the target image frame according to a preset bone feature extraction model;
and connecting the key parts according to a preset connection strategy to obtain a bone feature image corresponding to the target image frame.
4. The cabin management method according to claim 1, wherein after the step of performing target detection on the infrared thermography image according to a preset human body recognition model and determining whether human body features exist in the infrared thermography image according to a target detection result, the method further comprises:
when the human body features exist, determining the temperature distribution information of the human body according to the human body features;
determining the highest temperature of the human body according to the temperature distribution information;
and when the highest temperature is greater than a preset temperature threshold value, early warning is carried out.
5. The cabin management method according to claim 1, wherein the step of determining a human movement rate based on the set of skeletal features, and after the step of opening a cabin door when the human movement rate is greater than a preset rate threshold, further comprises:
acquiring the air exchange rate in the cabin collected by an air speed sensor arranged at a preset position;
judging whether the ventilation rate is smaller than a preset wind speed threshold value or not;
and when the ventilation rate is smaller than the preset wind speed threshold value, prompting a user to adjust the ventilation power.
6. The cabin management method according to any one of claims 1 to 5, wherein the step of acquiring the infrared thermal imaging image acquired by the infrared camera in the cabin further comprises, before:
when a check-in instruction is received, acquiring check-in time and adjustment parameter information according to the check-in instruction, wherein the adjustment parameter information comprises a target temperature and a target humidity;
acquiring the current temperature and the current humidity in a cabin;
determining temperature adjusting time length according to the current temperature and the target temperature;
determining humidity adjusting time length according to the current humidity and the target humidity;
and determining the starting time and the target mode of the air conditioner in the cabin according to the temperature adjusting time, the humidity adjusting time and the check-in time so as to adjust the environment of the cabin.
7. The cabin management method according to any one of claims 1 to 5, wherein the step of acquiring the infrared thermal imaging image acquired by the infrared camera in the cabin further comprises, before:
acquiring environmental information outside the cabin;
determining the external temperature according to the environment information, and judging whether the external temperature is greater than a preset early warning threshold value;
and when the external temperature is greater than the preset early warning threshold value, early warning is carried out.
8. A cabin management device, comprising:
the acquisition module is used for acquiring an infrared thermal imaging image acquired by an infrared camera device in the cabin;
the target detection module is used for carrying out target detection on the infrared thermal imaging image according to a preset human body recognition model and judging whether human body characteristics exist in the infrared thermal imaging image according to a target detection result;
the skeleton feature extraction module is used for extracting skeleton features of the human body according to a preset skeleton feature extraction model when the human body features exist, so that a skeleton feature set is obtained;
the human body movement rate determining module is used for determining the human body movement rate according to the skeleton feature set, and when the human body movement rate is larger than a preset rate threshold value, a cabin door is opened;
the human body movement rate determining module is further used for arranging the bone feature maps in the bone feature set according to a time sequence to obtain an arrangement result; comparing whether the position relations of the human bones in the two adjacent bone feature graphs in the bone feature graphs are consistent or not according to the arrangement result; if the two skeleton characteristic graphs are not consistent, judging that the human body moves in the two skeleton characteristic graphs, and acquiring the target quantity of the human body movement in the two adjacent skeleton characteristic graphs in the skeleton characteristic graph set; obtaining the human body movement rate according to the target number divided by the total number of the skeleton characteristic graphs;
the human body movement rate determining module is further used for comparing the two adjacent bone feature maps according to the arrangement result, judging whether the similarity of the two adjacent bone feature maps is greater than a preset similarity threshold value, and judging that the position relations of the human bones in the two adjacent bone feature maps in the bone feature maps are consistent when the similarity is greater than the preset similarity threshold value; and when the similarity is less than or equal to the preset similarity threshold, judging that the position relations of the human bones in the two adjacent bone characteristic graphs in the bone characteristic graphs are inconsistent.
9. Cabin management apparatus, characterized in that it comprises: memory, a processor and a cabin management program stored on the memory and executable on the processor, the cabin management program being configured to implement the steps of the cabin management method according to any one of claims 1 to 7.
10. A storage medium, characterized in that it has stored thereon a cabin management program which, when executed by a processor, implements the steps of the cabin management method according to any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210228323.0A CN114333134B (en) | 2022-03-10 | 2022-03-10 | Cabin management method, device, equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210228323.0A CN114333134B (en) | 2022-03-10 | 2022-03-10 | Cabin management method, device, equipment and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN114333134A CN114333134A (en) | 2022-04-12 |
| CN114333134B true CN114333134B (en) | 2022-05-31 |
Family
ID=81033245
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210228323.0A Active CN114333134B (en) | 2022-03-10 | 2022-03-10 | Cabin management method, device, equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114333134B (en) |
Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104575003A (en) * | 2013-10-23 | 2015-04-29 | 北京交通大学 | Method for detecting vehicle speed based on road monitoring videos |
Family Cites Families (15)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101776907A (en) * | 2010-01-05 | 2010-07-14 | 曲平 | Household intelligent control system |
| CN106780864A (en) * | 2016-11-28 | 2017-05-31 | 徐海恩 | Gate control system based on skeleton identification technology |
| TWI611355B (en) * | 2016-12-26 | 2018-01-11 | 泓冠智能股份有限公司 | Barrier Door Controlling System and Barrier Door Controlling Method |
| CN107942836A (en) * | 2017-12-28 | 2018-04-20 | 深圳春沐源控股有限公司 | The control method and control device of hotel guest room, computer installation and storage medium |
| CN108222749B (en) * | 2017-12-29 | 2020-10-02 | 安徽慧视金瞳科技有限公司 | Intelligent automatic door control method based on image analysis |
| US11274020B2 (en) * | 2018-01-12 | 2022-03-15 | Otis Elevator Company | Door operation controller |
| CN108628218A (en) * | 2018-05-31 | 2018-10-09 | 深圳春沐源控股有限公司 | room management method and device |
| CN108706429A (en) * | 2018-06-12 | 2018-10-26 | 佛山市灏金赢科技有限公司 | A kind of elevator door closing control system and control method |
| CN108806152A (en) * | 2018-06-13 | 2018-11-13 | 哈尔滨罗斯科技有限公司 | A kind of security alarm device and method based on image |
| CN109774413B (en) * | 2019-01-23 | 2021-04-13 | 中国联合网络通信集团有限公司 | Vehicle air conditioner control method, vehicle air conditioner control system |
| CN110363140B (en) * | 2019-07-15 | 2022-11-11 | 成都理工大学 | A real-time recognition method of human action based on infrared images |
| CN110377075B (en) * | 2019-07-19 | 2020-11-24 | 重庆工商职业学院 | Indoor intelligent temperature control system |
| CN111104554B (en) * | 2019-12-23 | 2022-08-16 | 南京甄视智能科技有限公司 | Automatic door control method and system based on contour detection and head and shoulder detection |
| CN111680562A (en) * | 2020-05-09 | 2020-09-18 | 北京中广上洋科技股份有限公司 | Human body posture identification method and device based on skeleton key points, storage medium and terminal |
| CN111710088A (en) * | 2020-07-29 | 2020-09-25 | 美国西北仪器公司 | Entrance guard system with body temperature detection function |
-
2022
- 2022-03-10 CN CN202210228323.0A patent/CN114333134B/en active Active
Patent Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104575003A (en) * | 2013-10-23 | 2015-04-29 | 北京交通大学 | Method for detecting vehicle speed based on road monitoring videos |
Non-Patent Citations (1)
| Title |
|---|
| 林璐璐,姜荣剑等.基于全方位视觉的自动门安全和节能检测技术.《计算机应用》.2014,第6卷(第34期),全文. * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN114333134A (en) | 2022-04-12 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11380182B2 (en) | Property control and configuration based on thermal imaging | |
| Meivel et al. | Mask Detection and Social Distance Identification Using Internet of Things and Faster R‐CNN Algorithm | |
| US11403899B2 (en) | Smart door system | |
| EP3779772A1 (en) | Trajectory tracking method and apparatus, and computer device and storage medium | |
| US20220344044A1 (en) | User-customized skin diagnosis system and method | |
| US20160328894A1 (en) | Managing multi-user access to controlled locations in a facility | |
| CN111916219A (en) | Intelligent safety early warning method, device and electronic system for inspection and quarantine | |
| CN112386225A (en) | Beauty consultation information providing apparatus and beauty consultation information providing method | |
| US10880303B2 (en) | Real-time COVID-19 outbreak identification with non-invasive, internal imaging for dual biometric authentication and biometric health monitoring | |
| CN113723257A (en) | Event short video generation method, system, device and storage medium | |
| CN113160475A (en) | Access control method, device, equipment and computer readable storage medium | |
| CN111227789A (en) | Human health monitoring method and device | |
| CN114333134B (en) | Cabin management method, device, equipment and storage medium | |
| CN117152871A (en) | Control method, system, electronic equipment and medium for combination of lamplight and access control | |
| CN113190819A (en) | Authentication method and device based on living body fusion characteristics and computer equipment | |
| CN109977804A (en) | Control method, device, computer equipment and the storage medium of pet intelligent door | |
| CN108647600B (en) | Face recognition method, face recognition device and computer-readable storage medium | |
| Hou et al. | Occupant-centric cabin thermal sensation assessment system based on low-cost thermal imaging | |
| KR102402684B1 (en) | Method for providing an information of self skin condition based on big data in non-facing environment | |
| CN113743379B (en) | Light-weight living body identification method, system, device and medium for multi-modal characteristics | |
| US8929613B2 (en) | Device and method for internally and externally assessing whitelists | |
| CN112749607B (en) | Image recognition method and device based on artificial intelligence | |
| CN114299652A (en) | Access control verification method, system, equipment and storage medium | |
| Uddin et al. | Artificial intelligence based domotics using multimodal security | |
| CN113963400A (en) | Image processing method, image processing device, electronic equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |