CN108639056A - Driving state detection method and device and mobile terminal - Google Patents

Abstract

The embodiment of the application discloses a driving state detection method and device and a mobile terminal. The method comprises the following steps: when the mobile terminal detects that the vehicle is in a driving state, acquiring facial feature parameters of a driver; detecting whether the driver is in a first driving state based on the facial feature parameters; if the driver is detected to be in the first driving state, sending out warning information; and the warning information is cancelled when the mobile terminal detects that the vehicle running state meets the cancellation condition. According to the method, when the driver is detected to be in the first driving state, the warning information is sent, and the warning information is cancelled when the mobile terminal detects that the driving state of the vehicle meets the cancellation condition, so that when fatigue driving of the driver is detected, the warning information can be cancelled when the cancellation condition is met, the driver is effectively prompted, the safety of the driver is guaranteed, and the safety of the driving process is improved.

Description

Driving state detection method, device and mobile terminal

technical field

The present application relates to the technical field of mobile terminals, and more specifically, to a driving state detection method, device and mobile terminal.

Background technique

Along with the popularization of automobile, automobile is adopted by broad masses as a kind of convenient and fast means of transportation. Subsequently, there are more and more incidents of driver fatigue driving. In order to improve driving safety, it is usually possible to configure some devices for detecting the driving state. However, the detection method adopted by the device cannot provide a strong guarantee for the driver to drive the vehicle safely.

Contents of the invention

In view of the above problems, the present application proposes a driving state detection method, device and mobile terminal, so as to improve the safety of the driving process.

In a first aspect, the present application provides a method for detecting a driving state, which is applied to a mobile terminal, the method comprising: when the mobile terminal detects that the vehicle is in a driving state, acquiring the facial feature parameters of the driver; based on the facial features The parameter detects whether the driver is in the first driving state; if it is detected that the driver is in the first driving state, a warning message is sent; the warning message is canceled when the mobile terminal detects that the vehicle driving state satisfies the cancellation condition.

In a second aspect, the present application provides a driving state detection device running on a mobile terminal. The device includes: a facial feature acquisition unit, which is used to acquire the driver's facial feature parameters when the vehicle is in a driving state; fatigue state A detection unit, configured to detect whether the driver is in the first driving state based on the facial feature parameters; an alarm issuing unit, configured to issue an alarm message if the fatigue state detection unit detects that the driver is in the first driving state; The warning canceling unit is used for canceling the warning information when it is detected that the driving state of the vehicle satisfies the cancellation condition.

In a third aspect, the present application provides a mobile terminal, including one or more processors and memory; one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the The one or more processors are executed, and the one or more programs are configured to execute the above method.

In a fourth aspect, the present application provides a computer-readable storage medium, the computer-readable storage medium includes a stored program, wherein the above method is executed when the program is running.

A driving state detection method, device, and mobile terminal provided by the present application obtain the facial feature parameters of the driver when the vehicle is detected to be in the driving state, and then detect whether the driver is in the first driving mode based on the facial feature parameters. state, if it is detected that the driver is in the first driving state, a warning message will be issued, and the warning message will be canceled when the mobile terminal detects that the vehicle stops, so that when the driver is detected to be driving fatigued, it can pass The warning information can only be canceled when the cancellation condition is met, and the driver can be effectively prompted to ensure the safety of the driver and improve the safety of the driving process.

These or other aspects of the present application will be more concise and understandable in the description of the following embodiments.

Description of drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings that need to be used in the description of the embodiments will be briefly introduced below. Obviously, the drawings in the following description are only some embodiments of the present application. For those skilled in the art, other drawings can also be obtained based on these drawings without any creative effort.

Fig. 1 shows a network environment diagram of a driving state detection method proposed by the present application;

Fig. 2 shows the flow chart of another kind of driving state detection method that the present application proposes;

Fig. 3 shows a schematic diagram of a prompt box in a driving state detection method proposed by the present application;

FIG. 4 shows a schematic diagram of another prompt box in a driving state detection method proposed by the present application;

Fig. 5 shows a structural block diagram of a screen control device proposed by the present application;

FIG. 6 shows a structural block diagram of another screen control device proposed by the present application;

FIG. 7 shows a structural block diagram of a mobile terminal proposed by the present application;

Fig. 8 shows a structural block diagram of a mobile terminal of the present application for executing the driving state detection method according to the embodiment of the present application.

Detailed ways

The following will clearly and completely describe the technical solutions in the embodiments of the application with reference to the drawings in the embodiments of the application. Apparently, the described embodiments are only some of the embodiments of the application, not all of them. Based on the embodiments in this application, all other embodiments obtained by persons of ordinary skill in the art without creative efforts fall within the protection scope of this application.

Fatigue driving is one of the main factors causing traffic accidents. According to the report, the number of deaths in traffic accidents reaches 10,000 every year. According to traffic accident statistics, more than 30% of highway traffic accidents and 15% to 20% of railway traffic accidents are related to fatigue driving. Fatigue driving seriously threatens people's lives and property safety. Early warning will effectively reduce road traffic accidents caused by fatigue driving. Therefore, research on fatigue driving detection technology is of great significance to improve road traffic safety.

With the development of science and technology, people pay more attention to improving the safety of the driving process by monitoring some physiological states of the driver or other attitude parameters through electronic equipment. However, the inventor found that the detection method adopted by the device cannot provide a strong guarantee for the driver to drive the vehicle safely. Therefore, the inventor proposes a driving state detection method, device and mobile terminal for improving the safety of the driving process in the present application.

Various embodiments of the present application will be described in detail below with reference to the accompanying drawings.

Please refer to FIG. 1, a driving state detection method provided by the present application is applied to a mobile terminal, and the method includes:

Step S110: when the mobile terminal detects that the vehicle is in a driving state, acquire the driver's facial feature parameters.

Wherein, the mobile terminal can determine whether the vehicle where it is located is in a driving state through various methods. As one manner, when the mobile terminal detects that the navigation application program installed on it turns on the navigation mode or starts navigation, it is determined that the vehicle is in a driving state. Among them, if the mobile terminal collects the facial feature parameters of the driver in real time at the beginning of navigation, more power will be consumed. Moreover, at the beginning of driving, the driver is not prone to driving fatigue, and driving fatigue is more likely to occur when the vehicle is running straight for a long period of time. As a way, the mobile terminal detects that the installed When the navigation application program turns on the navigation mode or starts navigation, and further detects that there is a straight section exceeding a preset length in the path after the current position on the navigation path, it starts to acquire the facial feature parameters of the driver. Wherein, the straight road section is a road section that does not need to change lanes or turn a right-angle turn in the included path.

As another manner, the mobile terminal may determine that the vehicle where it is located is in a driving state when detecting that the mobile terminal is shaking at a preset frequency. It can be understood that when the vehicle is in a driving state, it will be in a state of relative shaking, and the shaking frequency will fluctuate within a certain range, then when the mobile terminal detects that it is shaking within a certain range, it can determine the vehicle it is in. Already in a formal state.

When it is detected that the vehicle is in a driving state, the mobile terminal starts to acquire the facial feature parameters of the driver. Wherein, the facial feature parameters include but are not limited to the driver's blink frequency, mouth shape changes, and head drooping state.

In order to facilitate the mobile terminal to accurately identify the facial feature parameters of the driver, without mistakenly taking the facial feature parameters of other faces in the collected images as the driver's facial feature parameters, as a way, it can be used in fixed mobile When terminal, point the image acquisition component of the mobile terminal towards the driver's location. Furthermore, it is also possible to pre-register a plurality of face images in the mobile terminal, and set an identification for each face image. Then in this case, as a way, the user can select the driver’s face image from the stored face images through the face image identification before driving, so that the mobile terminal has a When there are multiple faces, the facial feature parameters of the driver during the current vehicle driving can be identified from the multiple faces. In this case, the mobile terminal can force the driver to select the face image of the driver who is driving this time through the identification corresponding to the face image before driving, so that the mobile terminal can identify it. Wherein, the mandatory manner may be continuously emitting beeps, or continuously emitting voice prompts, and the like.

In addition, as another way, when there are multiple faces in the acquired image, the mobile terminal can re-acquire an image with multiple faces with depth information, so that the frontmost face can be identified by the depth information. That is, the face closest to the mobile terminal is recognized as the face of the driver, so as to ensure that the facial feature parameters of the driver can be accurately obtained. In the case of detecting the depth information, the face image of the driver may be further determined in combination with the area occupied by the face image in the entire collected image. Usually, the mobile terminal is placed facing the driver, so in the image collected by the mobile terminal, if there are multiple faces, the area occupied by the driver's face image is larger than the area occupied by other face images. big. Then as a way, the mobile terminal can further determine that the occupied area of the frontmost face image identified through the depth information is larger than that of other face images when it is determined that there are multiple face images in the collected image. When the occupied area is large, the face image is used as the face image of the driver, so as to collect the facial feature parameters of the driver.

Step S120: Detecting whether the driver is in the first driving state based on the facial feature parameters.

In the case where the acquired facial feature parameters include data such as blinking frequency, mouth shape changes, and head drooping state. In the process of detecting whether the driver is in the first driving state, at least one of the following detections will be carried out: detecting whether the blinking frequency of the driver meets the preset frequency; detecting whether the driver's mouth shape change process meets the preset frequency; A change process is set; it is detected whether the drooping state of the driver's head satisfies the preset drooping state.

It should be noted that for how to detect the user's blinking, mouth shape changes, and head drooping state, etc., existing technologies can be used.

Step S130: if it is detected that the driver is in the first driving state, send out a warning message.

In the case based on the detection step shown in step S120, when it is detected that the blink frequency of the driver meets the preset frequency; the change process of the driver's mouth shape meets the preset change process; and the driver's When the head drooping state satisfies at least one of the preset drooping states, it is determined that the driver is in the first driving state, that is, it is determined that the driver is in fatigue driving.

Step S140: the warning message is canceled when the mobile terminal detects that the driving state of the vehicle satisfies the cancellation condition.

Wherein, for the warning information sent by the mobile terminal, in order to ensure that the warning information can be confirmed and reliable, a warning is sent to the driver. Only when the mobile terminal detects that the driving state of the vehicle satisfies the cancellation condition, the warning information can be canceled.

A driving state detection method provided by the present application is to obtain the facial feature parameters of the driver when the vehicle is detected to be in the driving state, and then detect whether the driver is in the first driving state based on the facial feature parameters. The driver is in the first driving state, and the warning information is issued, and the warning information is canceled when the mobile terminal detects that the vehicle is stopped, so that when the driver is detected to be driving fatigued, the warning information can be passed under the conditions of cancellation In order to cancel the warning information, the driver can be effectively prompted to ensure the safety of the driver and improve the safety of the driving process.

Please refer to Figure 2, a driving state detection method provided by the present application is applied to a mobile terminal, and the method includes:

Step S210: when the mobile terminal detects that the vehicle is in a driving state, acquire the facial feature parameters of the driver.

Step S220: Detecting whether the driver is in the first driving state based on the facial feature parameters.

Step S230: If it is detected that the driver is in the first driving state, a prompt box is displayed on the display screen of the mobile terminal, and a warning message is displayed in the prompt box; When the terminal detects that the driving status of the vehicle meets the cancellation conditions, it will be canceled.

Among them, if the driver is in a fatigue driving state and still continues to drive, it will easily lead to accidents. In order to ensure that the warning message can really and reliably play a warning effect, and will not be closed by the driver or other personnel while the vehicle is still running, in this example, the mobile terminal can display a prompt box, and the prompt box will be in the The topmost layer of the display screen of the mobile terminal will cover the previously displayed content, and display the warning information in the prompt box. Moreover, the prompt box can only be canceled when the mobile terminal detects that the driving state of the vehicle satisfies the cancellation condition.

As shown in FIG. 3 , the mobile terminal may display a prompt box 231 and display warning information in the prompt box 231 . As for the prompt box 231 , no control for closing the prompt box is displayed. In order to ensure the warning effect, when the mobile terminal detects that the driving state of the vehicle satisfies the cancellation condition, it cancels the display of the prompt box. Wherein, when the mobile terminal detects that the driving state of the vehicle satisfies the cancellation condition, it can automatically close the prompt box, or as shown in FIG. Box 231. In order to improve the warning effect, as a way, the background of the prompt box can be set to a brighter color such as red or orange.

Step S240: the warning information is canceled when the mobile terminal detects that the driving state of the vehicle satisfies the cancellation condition.

As a manner, the cancellation condition includes: detecting that the driver leaves the driving seat and/or detecting that the mobile terminal is in a stationary state. Among them, whether the driver leaves the driving seat can be detected by means of image recognition or by collecting distance values. Specifically, when the mobile terminal detects that there is no face image in the picture captured by the front camera, it determines that the driver has left the driving seat. Similar to the image collected by the mobile terminal described in the foregoing content that includes multiple face images, the driver's face image can still be determined in the aforementioned manner. The collected image contains the driver's face image, and when it is detected that the previously determined driver's face image does not exist in the collected image, it is determined that the driver has left the driving seat.

Furthermore, when the driver sits in the driving position and leaves the driving position, the distance value collected by the set distance sensor in the mobile terminal is different, and when it is detected that the driver is sitting in the driving position, The distance value collected by the mobile terminal is smaller, because the beam of the sensing distance emitted by the mobile terminal will be reflected faster to the mobile terminal when the driver is sitting in the driving seat, therefore, the detection distance of the mobile terminal When the distance value collected by the sensor is greater than the preset value, it is determined that the driver has left the driving seat.

It should be noted that when the warning message is displayed in the form of a prompt box, the cancellation conditions for canceling the prompt box and the warning message are the same, and when the warning message is canceled, the prompt box will also be canceled.

It should be noted that when the mobile terminal is a terminal with a voice communication function, when the mobile terminal receives an incoming call, it usually plays a ring tone to remind the user to answer it, and the ring tone itself has the effect of reminding the user, that is, If the user is in a state of fatigue driving, the ring tone can remind the user so that the user can be more awake. As a method, if the mobile terminal receives an incoming call while the mobile terminal is displaying the prompt box, and it is determined that the mobile terminal has turned on the ringtone for the incoming call, the incoming call interface will still be displayed on the top layer, that is, the incoming call interface will cover the prompt box , so that the prompt box will not affect the normal incoming call answering. If the mobile terminal receives an incoming call, and it is determined that the mobile terminal has not turned on the fixed ring tone, then in order not to affect the normal user's answering, and still maintain an alarm to the user, the screen of the mobile terminal can be divided into two parts, one part One part displays the incoming call interface, while the other part displays the prompt box and the warning information in the prompt box.

A driving state detection method provided by the present application is to obtain the facial feature parameters of the driver when the vehicle is detected to be in the driving state, and then detect whether the driver is in the first driving state based on the facial feature parameters. The driver is in the first driving state, and the warning information is issued, and the warning information is canceled when the mobile terminal detects that the vehicle is stopped, so that when the driver is detected to be driving fatigued, the warning information can be passed under the conditions of cancellation In order to cancel the warning information, the driver can be effectively prompted to ensure the safety of the driver and improve the safety of the driving process.

Please refer to FIG. 5 , a driving state detection device 300 provided by the present application runs on a mobile terminal, and the device 300 includes: a facial feature acquisition unit 310 , a fatigue state detection unit 320 , an alarm issuing unit 330 and an alarm canceling unit 340 .

The facial feature acquisition unit 310 is configured to acquire the facial feature parameters of the driver when it is detected that the vehicle is in a driving state.

As one manner, the facial feature acquiring unit 310 is configured to acquire the driver's facial feature parameters when detecting that the vehicle is in a driving state.

As a method, the facial feature acquisition unit 310 is specifically used to detect whether the driver's blink frequency meets the preset frequency, detect whether the driver's mouth shape change process meets the preset change process, and detect the driver's Whether the head drooping state satisfies the preset drooping state.

Correspondingly, if it is detected that the driver is in the first driving state, the facial feature parameters meet at least one of the following conditions: detecting that the driver's blinking frequency meets a preset frequency; detecting that the driver's The change process of the mouth shape satisfies the preset change process; and it is detected that the drooping state of the driver's head satisfies the preset drooping state.

The fatigue state detection unit 320 is configured to detect whether the driver is in the first driving state based on the facial feature parameters.

The warning sending unit 330 is configured to send a warning message if the fatigue state detection unit detects that the driver is in the first driving state.

The warning cancellation unit 340 is used for canceling the warning information when it is detected that the driving state of the vehicle satisfies the cancellation condition.

Please refer to FIG. 6 , a driving state detection device 400 provided by the present application runs on a server, and the device 400 includes: a facial feature acquisition unit 410 , a fatigue state detection unit 420 , a pop-up display unit 430 , and an alarm information display unit 440 and an alarm cancellation unit 450 .

The facial feature acquisition unit 410 is configured to acquire the facial feature parameters of the driver when it is detected that the vehicle is in a driving state.

The fatigue state detection unit 420 is configured to detect whether the driver is in the first driving state based on the facial feature parameters.

The bullet box display unit 430 is configured to display a prompt box on the display screen of the mobile terminal if it is detected that the driver is in the first driving state.

The warning information display unit 440 is configured to display warning information in the prompt box.

The warning canceling unit 450 is used for canceling the warning information when it is detected that the driving state of the vehicle satisfies the cancellation condition.

Wherein, as a manner, the cancellation condition includes: detecting that the driver leaves the driving seat; or detecting that the mobile terminal is in a stationary state. As a method, when the mobile terminal detects that there is no face image in the picture collected by the front camera, it judges that the driver has left the driving seat; or when the mobile terminal detects that the distance value collected by the distance sensor is greater than the preset value, it judges that the driving the driver leaves the driver's seat.

To sum up, the driving state detection method, device, and mobile terminal provided by the present application obtain the facial feature parameters of the driver when the vehicle is detected to be in the driving state, and then detect the driver’s facial feature parameters based on the facial feature parameters. Whether it is in the first driving state, if it is detected that the driver is in the first driving state, a warning message is issued, and the warning message is canceled when the mobile terminal detects that the vehicle stops, so that when the driver is detected to be fatigued When driving, the warning information can be canceled only when the cancellation condition is satisfied, and the driver can be effectively prompted to ensure the safety of the driver and improve the safety of the driving process.

A mobile terminal provided by the present application will be described below with reference to FIG. 7 and FIG. 8 .

Referring to FIG. 7 , based on the above-mentioned driving state detection method and device, the embodiment of the present application further provides a mobile terminal 100 capable of executing the aforementioned driving state detection method. The mobile terminal 100 includes an electronic body part 10 , and the electronic body part 10 includes a casing 12 and a first screen 120 disposed on the casing 12 . The housing 12 can be made of metal, such as steel or aluminum alloy. In this embodiment, the first screen 120 and the second screen 121 generally include a display panel 111 , and may also include circuits for responding to touch operations on the display panel 111 . The display panel 111 may be a liquid crystal display panel (Liquid Crystal Display, LCD), and in some embodiments, the display panel 111 is also a touch screen 109 .

As shown in FIG. 8, in an actual application scenario, the mobile terminal 100 can be used as a smart phone terminal. In this case, the electronic main body 10 usually includes one or more (only shown in the figure a) A processor 102 , a memory 104 , an RF (Radio Frequency, radio frequency) module 106 , an audio circuit 110 , a sensor 114 , an input module 118 , and a power module 122 . Those skilled in the art can understand that the present application does not limit the structure of the electronic body part 10 . For example, the electronic body part 10 may also include more or fewer components than shown in the figure, or have a different configuration than that shown in the figure.

Those skilled in the art can understand that, relative to the processor 102 , all other components belong to peripherals, and the processor 102 is coupled to these peripherals through a plurality of peripheral interfaces 124 . The peripheral interface 124 can be implemented based on the following standards: Universal Asynchronous Receiver/Transmitter (UART), General Purpose Input Output (GPIO), Serial Peripheral Interface (Serial Peripheral Interface) , SPI), inter-integrated circuit (Inter-Integrated Circuit, I2C), but not limited to the above standards. In some examples, the peripheral interface 124 may only include a bus; in other examples, the peripheral interface 124 may also include other components, such as one or more controllers, for example for connecting the display panel 111 display controller or memory controller for connecting memory. In addition, these controllers can also be separated from the peripheral interface 124 and integrated in the processor 102 or corresponding peripherals.

The memory 104 can be used to store software programs and modules, and the processor 102 executes various functional applications and data processing by running the software programs and modules stored in the memory 104 . The memory 104 may include high-speed random access memory, and may also include non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. In some examples, the memory 104 may further include a memory that is remotely located relative to the processor 102 , and these remote memories may be connected to the electronic main body 10 or the first screen 120 through a network. Examples of the aforementioned networks include, but are not limited to, the Internet, intranets, local area networks, mobile communication networks, and combinations thereof.

The RF module 106 is used to receive and send electromagnetic waves, realize mutual conversion between electromagnetic waves and electrical signals, and communicate with communication networks or other devices. The RF module 106 may include various existing circuit elements for performing these functions, such as antennas, radio frequency transceivers, digital signal processors, encryption/decryption chips, Subscriber Identity Module (SIM) cards, memory, etc. . The RF module 106 can communicate with various networks such as the Internet, intranet, wireless network or communicate with other devices through the wireless network. The wireless network mentioned above may include a cellular telephone network, a wireless local area network or a metropolitan area network. The above-mentioned wireless network can use various communication standards, protocols and technologies, including but not limited to Global System for Mobile Communication (GSM), Enhanced Data GSM Environment (EDGE), wideband code Division multiple access technology (wideband code division multiple access, W-CDMA), code division multiple access technology (Code division access, CDMA), time division multiple access technology (time division multiple access, TDMA), wireless fidelity technology (Wireless, Fidelity, WiFi) (such as IEEE802.10A, IEEE 802.11b, IEEE802.11g and/or IEEE 802.11n), VoIP (Voice over internet protocal, VoIP), Worldwide Interoperability for Microwave Access, Wi-Max), other protocols for mail, instant messaging, and short messages, and any other suitable communication protocols, even those that have not yet been developed.

The audio circuit 110 , the speaker 101 , the sound jack 103 , and the microphone 105 jointly provide an audio interface between the user and the electronic main body 10 or the first screen 120 . Specifically, the audio circuit 110 receives sound data from the processor 102 , converts the sound data into electrical signals, and transmits the electrical signals to the speaker 101 . The speaker 101 converts electrical signals into sound waves that can be heard by human ears. The audio circuit 110 also receives electrical signals from the microphone 105, converts the electrical signals into sound data, and transmits the sound data to the processor 102 for further processing. Audio data may be retrieved from the memory 104 or via the RF module 106 . In addition, audio data can also be stored in the memory 104 or sent through the RF module 106 .

The sensor 114 is arranged in the electronic main body 10 or in the first screen 120, examples of the sensor 114 include but are not limited to: light sensor, operation sensor, pressure sensor, infrared heat sensor, distance sensor, Gravity acceleration sensor, and other sensors.

Specifically, the light sensor may include a light sensor 114F and a pressure sensor 114G. Among them, the pressure sensor 114G may be a sensor for detecting pressure generated by pressing on the mobile terminal 100 . That is, the pressure sensor 114G detects pressure generated by contact or press between the user and the mobile terminal, eg, pressure generated by contact or press between the user's ear and the mobile terminal. Therefore, the pressure sensor 114G can be used to determine whether contact or pressure occurs between the user and the mobile terminal 100, and the magnitude of the pressure.

Please refer to FIG. 8 again. Specifically, in the embodiment shown in FIG. 8 , the light sensor 114F and the pressure sensor 114G are disposed adjacent to the display panel 111 . The light sensor 114F can turn off the display output of the processor 102 when an object approaches the first screen 120 , for example, when the electronic main body 10 moves to the ear.

As a kind of motion sensor, the acceleration of gravity sensor can detect the magnitude of acceleration in various directions (generally three axes), and can detect the magnitude and direction of gravity when it is stationary, and can be used to identify the application of the posture of the mobile terminal 100 (such as horizontal and vertical Screen switching, related games, magnetometer attitude calibration), vibration recognition related functions (such as pedometer, tap), etc. In addition, the electronic main body 10 can also be equipped with other sensors such as gyroscope, barometer, hygrometer, thermometer, etc., which will not be repeated here.

In this embodiment, the input module 118 may include the touch screen 109 arranged on the first screen 120, and the touch screen 109 may collect user's touch operations on or near it (for example, the user uses a finger, stylus operation of any suitable object or accessory on the touch screen 109 or near the touch screen 109), and drive the corresponding connection device according to the preset program. Optionally, the touch screen 109 may include a touch detection device and a touch controller. Wherein, the touch detection device detects the user's touch orientation, detects the signal brought by the touch operation, and transmits the signal to the touch controller; the touch controller receives the touch information from the touch detection device, and The touch information is converted into touch point coordinates, and then sent to the processor 102, and can receive and execute commands sent by the processor 102. In addition, the touch detection function of the touch screen 109 can be realized by adopting resistive, capacitive, infrared and surface acoustic wave and other classification types. In addition to the touch screen 109, in other modified implementation manners, the input module 118 may also include other input devices, such as keys. The keys may include, for example, character keys for inputting characters, and control keys for triggering control functions. Examples of the control buttons include a "return to main screen" button, a power on/off button, and the like.

The first screen 120 is used to display information input by the user, information provided to the user, and various graphical user interfaces of the electronic main body 10. These graphical user interfaces can be composed of graphics, text, icons, numbers, video and Any combination thereof may be used. In one example, the touch screen 109 may be disposed on the display panel 111 so as to form an integral body with the display panel 111 .

The power module 122 is used to provide power supply to the processor 102 and other components. Specifically, the power module 122 may include a power management system, one or more power sources (such as batteries or alternating current), a charging circuit, a power failure detection circuit, an inverter, a power status indicator light, and any other components related to the electronic body. Components related to the generation, management and distribution of power in the section 10 or the first screen 120 .

The mobile terminal 100 further includes a locator 119, and the locator 119 is used to determine the actual location of the mobile terminal 100. In this embodiment, the locator 119 uses a positioning service to realize the positioning of the mobile terminal 100. The positioning service should be understood as obtaining the position information (such as longitude and latitude coordinates) of the mobile terminal 100 through a specific positioning technology. ), a technology or service that marks the position of a positioned object on an electronic map.

It should be understood that the above-mentioned mobile terminal 100 is not limited to a smart phone terminal, but refers to a computer device that can be used on the move. Specifically, the mobile terminal 100 refers to a mobile computer device equipped with an intelligent operating system, and the mobile terminal 100 includes but is not limited to a smart phone, a smart watch, a tablet computer, and the like.

In the description of this specification, descriptions referring to the terms "one embodiment", "some embodiments", "example", "specific examples", or "some examples" mean that specific features described in connection with the embodiment or example , structure, material or characteristic is included in at least one embodiment or example of the present application. In this specification, the schematic representations of the above terms are not necessarily directed to the same embodiment or example. Furthermore, the described specific features, structures, materials or characteristics may be combined in any suitable manner in any one or more embodiments or examples. In addition, those skilled in the art can combine and combine different embodiments or examples and features of different embodiments or examples described in this specification without conflicting with each other.

In addition, the terms "first" and "second" are used for descriptive purposes only, and cannot be interpreted as indicating or implying relative importance or implicitly specifying the quantity of indicated technical features. Thus, the features defined as "first" and "second" may explicitly or implicitly include at least one of these features. In the description of the present application, "plurality" means at least two, such as two, three, etc., unless otherwise specifically defined.

Any process or method descriptions in flowcharts or otherwise described herein may be understood to represent modules, segments or portions of code comprising one or more executable instructions for implementing specific logical functions or steps of the process , and the scope of preferred embodiments of the present application includes additional implementations in which functions may be performed out of the order shown or discussed, including in substantially simultaneous fashion or in reverse order depending on the functions involved, which shall It should be understood by those skilled in the art to which the embodiments of the present application belong.

The logic and/or steps represented in the flowcharts or otherwise described herein, for example, can be considered as a sequenced listing of executable instructions for implementing logical functions, can be embodied in any computer-readable medium, For use with instruction execution systems, devices, or devices (such as computer-based systems, systems including processors, or other systems that can fetch instructions from instruction execution systems, devices, or devices and execute instructions), or in conjunction with these instruction execution systems, devices or equipment used. For the purposes of this specification, a "computer-readable medium" may be any device that can contain, store, communicate, propagate or transmit a program for use in or in conjunction with an instruction execution system, device or device. More specific examples (non-exhaustive list) of computer readable media include the following: electrical connection with one or more wires (mobile terminal), portable computer disk case (magnetic device), random access memory (RAM), Read Only Memory (ROM), Erasable and Editable Read Only Memory (EPROM or Flash Memory), Fiber Optic Devices, and Portable Compact Disc Read Only Memory (CDROM). In addition, the computer-readable medium may even be paper or other suitable medium on which the program can be printed, since the program can be read, for example, by optically scanning the paper or other medium, followed by editing, interpretation or other suitable processing if necessary. processing to obtain the program electronically and store it in computer memory.

It should be understood that each part of the present application may be realized by hardware, software, firmware or a combination thereof. In the embodiments described above, various steps or methods may be implemented by software or firmware stored in memory and executed by a suitable instruction execution system. For example, if implemented in hardware, as in another embodiment, it can be implemented by any one or combination of the following techniques known in the art: Discrete logic circuits, ASICs with suitable combinational logic gates, programmable gate arrays (PGAs), field programmable gate arrays (FPGAs), etc.

Those of ordinary skill in the art can understand that all or part of the steps carried by the methods of the above embodiments can be completed by instructing related hardware through a program, and the program can be stored in a computer-readable storage medium. During execution, one or a combination of the steps of the method embodiments is included. In addition, each functional unit in each embodiment of the present application may be integrated into one processing module, each unit may exist separately physically, or two or more units may be integrated into one module. The above-mentioned integrated modules can be implemented in the form of hardware or in the form of software function modules. If the integrated modules are realized in the form of software function modules and sold or used as independent products, they can also be stored in a computer-readable storage medium.

The storage medium mentioned above may be a read-only memory, a magnetic disk or an optical disk, and the like. Although the embodiments of the present application have been shown and described above, it can be understood that the above embodiments are exemplary and should not be construed as limitations on the present application, and those skilled in the art can make the above-mentioned The embodiments are subject to changes, modifications, substitutions and variations.

Finally, it should be noted that: the above embodiments are only used to illustrate the technical solutions of the present application, but not to limit them; although the present application has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that: it can still Modifications are made to the technical solutions described in the foregoing embodiments, or equivalent replacements are made to some of the technical features; and these modifications or replacements do not drive the essence of the corresponding technical solutions away from the spirit and scope of the technical solutions of the various embodiments of the present application.

Claims (10)

1. A driving state detection method, characterized in that being applied to a mobile terminal, said method comprising: When the mobile terminal detects that the vehicle is in a driving state, it acquires the facial feature parameters of the driver; Detecting whether the driver is in a first driving state based on the facial feature parameters; If it is detected that the driver is in the first driving state, a warning message is sent; The warning information is canceled when the mobile terminal detects that the driving state of the vehicle satisfies the cancellation condition. 2. The method according to claim 1, wherein when the mobile terminal detects that the vehicle is in a driving state, the step of obtaining the facial feature parameters of the driver comprises: When the mobile terminal detects that the mobile terminal is in a navigation state and/or detects that the mobile terminal is in a shaking state, it acquires facial feature parameters of the driver. 3. The method according to claim 1, wherein the step of sending a warning message if it is detected that the driver is in the first driving state comprises: If it is detected that the driver is in the first driving state, a prompt box is displayed on the display screen of the mobile terminal, and an alarm message is displayed in the prompt box; wherein, the prompt box is detected in the mobile terminal. The vehicle is canceled when the driving status meets the cancellation conditions. 4. The method according to any one of claims 1-3, wherein the cancellation conditions include: It is detected that the driver leaves the driving seat; Or it is detected that the mobile terminal is in a stationary state. 5. The method according to claim 4, wherein when the mobile terminal detects that there is no face image in the picture collected by the front camera, it is judged that the driver has left the driving seat; Or when the mobile terminal detects that the distance value collected by the distance sensor is greater than the preset value, it is judged that the driver has left the driving seat. 6. The method according to claim 1, wherein the step of detecting whether the driver is in the first driving state based on the facial feature parameters comprises: Detecting whether the blinking frequency of the driver satisfies a preset frequency; Detecting whether the change process of the driver's mouth shape satisfies the preset change process; Detecting whether the drooping state of the driver's head satisfies a preset drooping state. 7. The method according to claim 6, wherein if it is detected that the driver is in the first driving state, the facial feature parameters satisfy at least one of the following conditions: Detecting that the blinking frequency of the driver satisfies a preset frequency; Detecting that the change process of the driver's mouth shape satisfies a preset change process; and Detecting that the drooping state of the driver's head satisfies a preset drooping state. 8. A driving state detection device, characterized in that, running on a mobile terminal, said device comprising: A facial feature acquisition unit, configured to acquire the driver's facial feature parameters when the vehicle is detected to be in a driving state; A fatigue state detection unit, configured to detect whether the driver is in a first driving state based on the facial feature parameters; an alarm issuing unit, configured to issue an alarm message if the fatigue state detection unit detects that the driver is in the first driving state; The warning canceling unit is used for canceling the warning information when it is detected that the driving state of the vehicle satisfies the cancellation condition. 9. A mobile terminal, comprising one or more processors and memory; One or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs are configured to perform claim 1 -7 any of the methods described. 10. A computer-readable storage medium having program code executable by a processor, wherein the computer-readable storage medium comprises a stored program, wherein claims 1-7 are performed when the program is run any of the methods described.