CN104486509B - A kind of mobile terminal and its control method - Google Patents

Abstract

In order to solve the security problem of the user using the mobile terminal while walking, the present invention proposes a control method for the mobile terminal, which includes the following steps: identifying whether the controlled function is running in the foreground of the mobile terminal; performing image acquisition, and after data processing, Determine the walking state; when the controlled function is running in the foreground and is in the walking state, an alarm is issued; when the controlled function is running in the foreground and is in the walking state, it interferes with the user interface. The invention enables the user to receive a warning when using the mobile terminal while walking, and controls the currently running user interface function to hide or terminate, forcing the user's attention away from the mobile terminal and improving the safety of the user using the mobile terminal.

Description

A mobile terminal and its control method

technical field

The invention belongs to the field of mobile communication, in particular to a mobile terminal and a method for controlling the mobile terminal.

Background technique

Mobile terminals (mobile phones) have penetrated into daily life and work, and are devices that people carry and use with them.

A camera is usually included in a mobile terminal. The camera projects the generated optical image onto the sensor, converts it into an electrical signal, undergoes signal processing, and finally converts it into an image on the screen. The camera has a front camera and a rear camera. The continuous video signal is transmitted to the screen by the rear camera, which becomes the background of the mobile terminal application. It is possible for the user to know the surrounding environment through the screen background while using the mobile terminal.

However, using a mobile terminal at an inappropriate time and place can bring danger to the user and those around him. Especially at present, smart mobile terminals have been widely used, have rich user interfaces, many human-computer interaction functions, and support a large number of multimedia information playback, games, page browsing and editing functions, and sometimes users are immersed in them. A common phenomenon is that the user is looking at the mobile terminal while walking or even crossing the road. Once the user does not notice the surrounding road conditions, the user may encounter dangers such as falling, stepping into the air, colliding, or even a traffic accident . Therefore, there are security problems when users use mobile terminals while walking. It is necessary to develop effective technical means to reduce and eliminate incorrect usage methods of users, so as to avoid personal injuries caused by users using devices.

Contents of the invention

In order to solve the security problem of a user using a mobile terminal in a walking state, the present invention proposes a mobile terminal and a control method thereof.

The mobile terminal control method of the present invention comprises the following steps:

Identify whether the controlled function is running in the foreground of the mobile terminal;

Carry out image acquisition, after data processing, determine the walking state;

The controlled function runs in the foreground and is in a walking state, and sends an alarm when the time exceeds T1;

The controlled function runs in the foreground and is in a walking state, and when the time exceeds T2, it interferes with the user interface.

As a further optimized embodiment of the method of the present invention, the image collection step further includes: collecting environmental images through a camera to generate image data; the data processing step further includes: characterizing the image data at different times Compare, statistically analyze the moving speed of the feature points in the image, and estimate the average moving speed V m/s; the step of determining the walking state further includes: judging whether V is within the speed range of people walking, for example, 0.1<V<1.1, If yes, it is determined to be in a walking state.

The mobile terminal of the present invention includes a user pattern recognition module 1, a walking state monitoring module 2, an alarm module 3, and a safety control module 4, wherein

The user pattern identification module 1 identifies whether the controlled function is running in the foreground of the mobile terminal;

The walking state monitoring module 2 carries out image acquisition, and through data processing, determines the walking state;

The controlled function runs in the foreground and is in a walking state, and when the time exceeds T1, the alarm module 3 sends out an alarm;

The controlled function runs in the foreground and is in a walking state. When the time exceeds T2, the security control module 4 interferes with the user interface.

In the mobile terminal and its control method of the present invention, the controlled functions include but not limited to: video player function, short message function, email function, text editor function, picture display function, web browser function, input frame function, game software function, video editing software function, document processing software function, instant messaging software function, picture editing software function, e-commerce software function, mobile payment software function, financial transaction software function, social software function or Various.

In the mobile terminal and its control device of the present invention, the way of issuing an alarm includes one or more of text, audio, video, graphics, vibration, light, and the like.

In the mobile terminal and its control device of the present invention, the manner of interfering with the user interface includes at least one of the following:

converting said controlled function to run in the background;

suspend or terminate said controlled functions;

Start an application with less human-computer interaction functions, such as a screen saver;

Change the display parameters of the display screen, such as chromaticity and brightness;

Functions related to human-computer interaction, such as touch screen recognition, are prohibited.

The present invention enables the user to receive warnings from the mobile terminal when using the mobile terminal while walking, prompting the user to pay attention to safety; furthermore, when the user cannot overcome the temptation to use the mobile terminal under dangerous conditions, the mobile terminal controls the function of the currently running user interface to hide or Terminate, forcing the user's attention away from the mobile terminal. These functions are automatically implemented by the mobile terminal, which improves the security of the user using the mobile terminal.

Description of drawings

Fig. 1 is a flowchart of a mobile terminal control method

Fig. 2 is the embodiment of walking state monitoring process

Fig. 3 represents the embodiment of mobile terminal of the present invention

Fig. 4 represents the embodiment of walking state monitoring module 2

Detailed ways

Fig. 1 is the flowchart of mobile terminal control method, comprises the following steps

Step 100, user mode identification: identifying whether the controlled function is running in the foreground of the mobile terminal;

Step 200, walking state monitoring: start the camera to collect images, and determine the walking state after data processing;

Step 300, alarm: the controlled function is running in the foreground and is in a walking state, and when the time exceeds T1, an alarm is issued;

Step 400, security control: the controlled function runs in the foreground and is in a walking state, and when the time exceeds T2, interfere with the user interface. For example, hide the currently running user interface, or terminate the currently running function.

Fig. 2 is the embodiment of walking state monitoring, further comprises the following steps:

Step 201, image collection: collecting environmental images through the camera to generate image data;

Step 202, data processing: comparing the features of the image data at different times, statistically analyzing the moving speed of the feature points in the image, and estimating the average moving speed V m/s;

Step 203 , determine the walking state: determine whether V is within the speed range of a person walking, for example, 0.1<V<1.1, and if so, determine the walking state.

Fig. 3 shows the functional modules included in the mobile terminal of the present invention. The mobile terminal of the present invention includes a user pattern recognition module 1, a walking state monitoring module 2, an alarm module 3, and a safety control module 4, wherein:

The user pattern identification module 1 identifies whether the controlled function is running in the foreground of the mobile terminal;

The walking state monitoring module 2 carries out image acquisition, and through data processing, determines the walking state;

The controlled function runs in the foreground and is in a walking state, and when the time exceeds T1, the alarm module 3 sends out an alarm;

The controlled function runs in the foreground and is in a walking state. When the time exceeds T2, the security control module 4 interferes with the user interface.

FIG. 4 shows an embodiment of the walking state monitoring module 2, which includes a camera 21, a data processing unit 22, and a walking state recognition unit 23. The camera 21 collects environmental images to generate image data; the data processing unit 22 compares the features of the image data at different times, statistically analyzes the moving speed of the feature points in the image, and estimates the average moving speed V m/s; the walking The state recognition unit 23 judges whether V is within the speed range of a person walking, for example, 0.1<V<1.1, and if so, determines the walking state, and sends a trigger signal to the alarm module 3 and the safety control module 4 .

Throughout the description, the "walking state" refers to the user carrying the mobile terminal is walking as judged by the device and method of the present invention. The speed range of people walking is preset in the walking state monitoring module 2, for example, includes slow walking and fast running.

In this specification, T1>0 and T2>0. Generally, the solution of the present invention does not limit the relationship between T1 and T2. As the best embodiment of the present invention, T2>T1 is taken, and the alarm is issued before the interference is implemented.

In the mobile terminal and its control method described in this specification, some functions of the mobile terminal are pre-defined as controlled functions. The controlled functions refer to those programs that may attract the user's attention for a long time because the user needs to read or distinguish the content of the display screen of the mobile terminal when running in the foreground, or requires the user to perform manual input or editing operations function. For example, the controlled functions are some functions provided by the mobile terminal operating system (video player, short message, email, text editor, picture display, web browser, input box, etc.), or user application programs Functions provided (short message, email, picture display, web browser, game software, video editing software, text editing software, document processing software, instant messaging software, picture editing software, mobile e-commerce software, mobile payment software, financial One or more of trading software, social software and other functions). The controlled functions can be configured and selected by the user.

The functions of the user pattern recognition module 1 of the present invention include identifying the running application programs in the foreground, or running software functions, such as mobile terminal browsing mode, text input, voice input, dialing, answering, etc. How to judge that mobile terminal is running some application software functions in the foreground in detail below, for example: a short message application (SMSapplication) is running in the foreground, then judges that the user is viewing the short message; if a web browser (webbrowser) is running in the foreground, Then it is judged that the user is browsing the webpage; to judge whether the user is dialing, answering and talking, take the Android operating system as an example, the GetCallState method in the TelephonyManager class is in execution, and the returned parameters can indicate that the mobile terminal is in the calling state.

The present invention aims to realize the safe application of the mobile terminal. Preferably, the basic call function in the walking state is not prohibited. When it is found that the functions of the specific application program are telephone dialing, answering, and calling, it is not necessary to further detect and judge these functions. Optionally, when it is found that the specific applications are audio playback, radio, etc., the present invention does not need to further detect and judge these functions.

The function of the alarm module 3 in the present invention. According to the specific application used by the user, if the function of the program running in the foreground is a controlled function, one or more ways to issue an alarm include text, audio, video, graphics, vibration, light, etc., to remind the user: Operating or watching mobile terminals at any time is dangerous.

The timing of sending out the alarm is: sending out the warning immediately, or sending out the warning after a period of delay, that is to say, T1 in the step of giving out the warning is different due to different controlled functions.

As a preferred embodiment of the present invention, when the identified controlled function includes at least one of games, web page browsing, video playback, short message input, text editing or graphic editing, an alarm is given immediately. At this time, T1 is close to 0.

For some controlled functions, such as displaying short messages and instant messaging messages, this function module does not need to prompt immediately after recognition. If the use time is very short, for example, the display screen will be turned off after less than 4 seconds, then no alarm will be issued. . But if the time is longer, such as more than 4 seconds, an alarm will be issued. At this time T1 = 4 seconds.

As a further optimized embodiment of the present invention, when it is identified that the functions running in the foreground are phone dialing, answering, and talking, no alarm is issued.

As a further optimized embodiment of the present invention, when it is identified that the functions running in the foreground are audio playback, radio, etc., no alarm is issued.

Examples of security controls are further given below. In the mobile terminal and its control device of the present invention, said interference on the user interface includes at least one of the following methods:

Solution 1: Convert the controlled function to run in the background. As a further optimized embodiment, after the walking state ends for a period of time T3 (for example T3 = 10 seconds), the controlled function resumes running in the foreground.

Solution 2: Suspend or terminate the controlled function. As a further optimized embodiment, when suspending or terminating the controlled function, T2>T1 (for example, T1=4 seconds, T2=10 seconds).

Solution 3: Start an application program with few human-computer interaction functions, such as display screen protection. The new application program works instead of the program of the controlled function, with the purpose of interfering with the user's current operation and forcing the user's attention to divert. For example, a display screen saver is started to cover the display screen with colors and pictures. As a further optimized embodiment, the application program is automatically terminated after running for a period of time T4 (eg T4=10 seconds).

Solution 4: Change the display parameters of the display screen. As a specific embodiment of this program, one or more of the display parameters such as brightness, chroma, and contrast of the display screen are changed, or even the driving signal of the display screen is turned off; as another embodiment of the program, the display parameters of the display screen are changed User interface display area.

Solution 5: Prohibit calling functions related to human-computer interaction, such as touch screen recognition. A specific method for invalidating the software function related to human-computer interaction invoked by the application program is to set the start-up prohibition flag when the program implementing the function related to human-computer interaction contains a start-up prohibition flag.

An embodiment in which mobile terminal control is realized through an operating system. A service built into the operating system that implements the process of detection and/or control. The steps of user pattern recognition 100, walking state monitoring 200, alarm 300, and safety control 400 are implemented by the operating system.

For example, the operating system controls the application program being executed. For example, in the Android operating system, the state transition message is sent to the program occupying the main screen (that is, in the Resumed state) through the Intent command, and the application program is converted to the Paused state or the Stopped state; The operating system is able to reclaim all resources used by the application, stopping the application completely.

An embodiment in which the mobile terminal is controlled by an application program. The application with walking status reminder function is not part of the operating system, but an independent third-party application. The steps of user pattern recognition, walking state monitoring, alarm and safety control are realized by application programs.

Give an example to illustrate the method for the application program to intervene in other application programs that are running, such as using the GetRecentTasks method of the ActivityManager class in the Android operating system to identify the application program running in the foreground; functionality from one application to another.

To further understand the embodiments of the present invention, for example, the improved video player program invokes the walking state monitoring function of the operating system, and when the walking state is found, the player sends out a prompt and pauses the playback. For another example, some instant messaging applications call the walking state monitoring function of the operating system when the user performs text editing and input, and send an alarm if found to be in the walking state. The embodiment of the present invention is especially suitable for the instant communication tool, so that it can only perform voice dialogue function while walking. IM, wechat, QQ, contacts, microblog, etc. can all be improved by the method of the present invention.

Each module of the present invention can be realized by a combination of CPU system, programmable logic circuit, memory, sensor, etc., and load operating system and application program. Described operating system is such as Android, iOS, blackberry, other alternative programs, and the operating system specially made or improved for realizing the scheme of the present invention; Described application program especially comprises the application program that some users may use continuously for a long time, such as video Players, web browsers, reading software, social software, etc., and application programs specially produced or improved to realize the solution of the present invention.

Claims (10)

1. a kind of method for controlling mobile terminal, which is characterized in that comprise the steps of：

Identify function controlled whether in mobile terminal front stage operation；The function controlled refers to the user in front stage operation and carries out Manually input, edit operation, the function that the content of mobile terminal display screen is read or differentiated；

Image Acquisition is carried out, by data processing, determines walking states；The step of described image gathers further includes：Pass through Camera gathers ambient image, generates image data；The step of data processing, further includes：Described at different moments Image data carries out feature comparison, the speed that characteristic point moves in statistical analysis image, estimates average translational speed V meter per seconds；Institute The step of stating definite walking states further includes：V is judged whether in the velocity interval when people walks, if so, being determined as Walking states；

For the function controlled in front stage operation and in walking states, the time sends alarm when being more than T1；

The function controlled is implemented to disturb when the time is more than T2 in front stage operation and in walking states to user interface；

After the walking states end time T3, the function controlled recovers front stage operation.

2. method for controlling mobile terminal as described in claim 1, which is characterized in that

0.1<V<1.1。

3. a kind of mobile terminal, which is characterized in that comprising user mode identification module, walking states monitoring modular, alarm module, Safety control module, wherein

Whether the user mode identification module identifies function controlled in mobile terminal front stage operation；The function controlled, refers to During front stage operation user manually entered, edit operation, the work(that the content of mobile terminal display screen is read or differentiated Energy；

The walking states monitoring modular carries out Image Acquisition, by data processing, determines walking states；Described image acquisition Step further includes：Ambient image is gathered by camera, generates image data；The step of data processing, further wraps Contain：Feature comparison is carried out to described image data at different moments, the speed that characteristic point moves in statistical analysis image, estimation is flat Equal translational speed V meter per seconds；The step of definite walking states, further includes：Judge V whether the speed model when people walks In enclosing, if so, being determined as walking states；

The function controlled is in front stage operation and in walking states, and when the time is more than T1, the alarm module sends alarm；

The function controlled is in front stage operation and in walking states, and when the time is more than T2, the safety control module is to user Implement interference in interface；

After the walking states end time T3, the function controlled recovers front stage operation.

4. mobile terminal as claimed in claim 3, which is characterized in that the function controlled includes video player function, short disappears Cease function, e-mail function, text editor function, picture display function, web browser function, input frame function, trip Play software function, Video editing software function, Document processing software function, instant communication software function, photo-editing software work( Energy, E-business Software function, mobile payment software function, financial transaction software function, one kind in social software function or It is a variety of.

5. mobile terminal as claimed in claim 3, which is characterized in that the mode for sending alarm includes text, audio, regards Frequently, the one or more in figure, vibration, light.

6. the mobile terminal as described in claim 3~5 is any, which is characterized in that the mode for implementing interference to user interface Comprising：The function controlled is converted as running background.

7. the mobile terminal as described in claim 3~5 is any, which is characterized in that the mode for implementing interference to user interface Comprising：Suspend or terminate the function controlled.

8. the mobile terminal as described in claim 3~5 is any, which is characterized in that the mode for implementing interference to user interface Comprising：Start the few application program of a human-computer interaction function.

9. the mobile terminal as described in claim 3~5 is any, which is characterized in that the mode for implementing interference to user interface Comprising：Change the display parameters of display screen.

10. the mobile terminal as described in claim 3~5 is any, which is characterized in that the mode for implementing interference to user interface Comprising：Forbid the function related with human-computer interaction.