KR102272489B1 - Smartphone with an application for monitoring smartphone with input cursor flicker analysis while driving a vehicle and system for collecting an evidence to use smartphone - Google Patents

Abstract

The present invention is a smartphone monitoring app while driving through an input window cursor blink analysis that can collect information that can prove that the driver is currently using a smartphone through the input window cursor blink analysis while solving the smartphone security problem issue And it relates to a system for collecting evidence of smartphone use while driving including him.

Description

A smartphone equipped with a smartphone monitoring app while driving through an input window cursor blink analysis and a smartphone usage evidence collection system including the same while driving COLLECTING AN EVIDENCE TO USE SMARTPHONE}

The present invention relates to a smart phone, and more particularly, to a smart phone equipped with a smart phone monitoring app while driving through an input window cursor blink analysis, and a smart phone use evidence collection system including the same while driving.

Smartphones provide various functions such as phone calls, wireless Internet, text messages, and games. Smartphones have a wide range of uses, and as a result, the incidence of accidents due to smartphone use while driving is increasing. Even if an accident occurs due to negligence in driving due to the use of a smartphone while driving, insurance companies have no way to prove this, so they pay huge auto insurance payments every year.

Insurance products such as UBI (Usage-Based Insurance) have been developed to reduce the occurrence of automobile accidents due to negligence of driving insurance policyholders. Driving habit-linked insurance (UBI) is an insurance that reduces insurance premiums by analyzing drivers' driving habits with big data. In other words, driving habit-linked insurance is a product that calculates insurance premiums by collecting driving-related information, such as driving distance, moving place, rapid acceleration, rapid deceleration, or sharp turns. Reduce or increase insurance premiums. In Patent Publication No. 10-2012-0087338 (published on August 7, 2012) and registered patent No. 10-1036268 (date of registration: May 16, 2011), differentiated car insurance premiums are provided for each subscriber according to the subscriber's vehicle driving information. Content to be calculated is disclosed.

However, from an insurance company's point of view, it is much more advantageous to reduce car insurance payments by proving that the accident occurred due to the driver's negligence due to the use of a smartphone while driving in the case of an actual car accident, rather than UBI. Accordingly, insurance companies need technology that can collect evidence of smartphone use while driving.

Meanwhile, it is implemented so that no information is shared between different programs (eg, text message, Daum app, Naver app, Kookmin mobile app, IBK mobile app, etc.) in Android and iOS, which are operating programs of smartphones. This is because of security issues such as security card number, authentication number, and resident number during mobile banking using a smartphone.

Therefore, according to the security policy of Android or iOS, which is the operating program of the smartphone, it is impossible to know at all whether the user activated the text message, the Daum app, the Naver app, the Kookmin mobile app, or the IBK mobile app. It was not possible to develop an app to collect

Publication No. 10-2012-0087338 (published date: 2012.08.07) Registered Patent No. 10-1036268 (Registration Date: 2011.05.16)

The present invention has been proposed to solve the above problems, and while solving the smartphone security problem, an input capable of collecting information that can prove that the driver is currently using a smartphone through analysis of the blinking of the input window cursor A smartphone equipped with a smartphone monitoring app while driving through window cursor blink analysis and a smartphone usage evidence collection system including the same are provided.

The present invention provides a smartphone equipped with a smartphone monitoring app while driving through an input window cursor blink analysis that enables both an operator and an auto insurance company to obtain operating profit, and a smartphone usage evidence collection system including the same while driving.

In order to achieve the above object, the smartphone monitoring app while driving according to the present invention is mounted on a smartphone connected to the operation server and the Internet network, and the driver collects evidence of using the smartphone while driving the vehicle. It is a smartphone monitoring app.

A smartphone equipped with a smartphone monitoring app while driving according to the present invention detects a vehicle speed value using a GPS speed input from a GPS sensor mounted on the smartphone, and includes location information input from the GPS sensor and the a driving detection module for determining whether the vehicle is running by determining that the vehicle is running when the detected speed value of the vehicle is greater than or equal to a preset reference value; a screen capture module for capturing the screen of the smartphone according to pre-stored screen capture control information when detection information indicating that the vehicle is being driven is input from the driving detection module;

Analyze whether the cursor is blinking in a specific area of the smartphone screen input from the screen capture module, and if it is determined that the cursor is blinking in a specific area of the smartphone screen as a result of the analysis, the smartphone screen image including the cursor image is displayed as a smart a usage evidence detection module that stores the phone usage evidence in the storage unit; and a usage record information processing module for transmitting the smartphone screen image including the cursor image stored in the storage unit to the operation server.

The usage evidence detection module of a smartphone equipped with a smartphone monitoring app while driving according to the present invention is the first among the plurality of images when a plurality of images in which the cursor blinks are sequentially input to a specific area of the smartphone screen It is determined whether there are images in which the cursor having a position different from the cursor position in the input image is blinking, and if the determination result is affirmative, it is characterized by deleting the images in which the cursor having a position different from the cursor position in the first input image is blinking. .

The usage record information processing module of the smartphone equipped with the smartphone monitoring app while driving according to the present invention is characterized in that it transmits the smartphone screen image including the cursor image stored in the storage unit to the car black box.

The smartphone usage evidence collection system while driving according to another aspect of the present invention receives and stores usage history information including a smartphone screen image including smartphone identification information and a cursor image from a smartphone and stores the stored usage history information a usage record information processing unit that calculates the number of times of smartphone use while driving;

Based on the usage record information including the smartphone screen image including the smartphone identification information and the cursor image, it is determined whether the smartphone monitoring app installed in the smartphone is operating normally during driving for a specific time, and the determination result is negative It includes a monitoring processing unit for generating an alarm message including the back smart phone identification information and transmitting it to the manager terminal.

As described above, in a smartphone equipped with a smartphone monitoring app while driving through an input window cursor blinking analysis according to the present invention as described above, when a plurality of images in which the cursor blinks are sequentially input to a specific area of the smartphone screen, the plurality of images Among them, it is determined whether there are images with a blinking cursor having a position different from the cursor position in the first input image, and if the result is affirmative, it is implemented to delete images with a cursor position different from the cursor position in the first input image. As a result, information that can prove that the driver is currently using a smartphone can be collected through analysis of the blinking of the cursor in the input window while solving the smartphone security issue.

In addition, insurance companies can offer premium discounts to drivers who install smartphone monitoring apps on their smartphones while driving, and have the effect of preventing reckless use of insurance money in the event of an accident. On the other hand, the operation server operator has the effect that the insurance company can provide additional services to the user by providing the information of the user who uses the smartphone monitoring app while driving according to the present invention to the insurance company.

The following drawings attached to the present specification illustrate preferred embodiments of the present invention, and serve to further understand the technical spirit of the present invention together with the detailed description of the present invention to be described later. should not be construed as being limited only to
1 is an exemplary diagram for explaining the entire system of the present invention.
2 is an exemplary diagram for explaining the configuration of the smartphone monitoring app 200 while driving through the analysis of the blinking of the cursor input window mounted on the smartphone according to the present invention.
3 is a flowchart of a method for monitoring a smartphone equipped with a smartphone monitoring app while driving through an input window cursor blink analysis according to the present invention.
4 is an exemplary diagram for explaining a screen captured by a smartphone equipped with a smartphone monitoring app while driving through an input window cursor blink analysis according to the present invention.
5 and 6 are other exemplary views for explaining a screen captured by a smartphone equipped with a smartphone monitoring app while driving through an input window cursor blink analysis according to the present invention.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, the present invention will be described in detail through preferred embodiments described above and additional aspects with reference to the accompanying drawings so that those skilled in the art can easily understand and reproduce the present invention.

The terms used herein are used only to describe specific embodiments, and are not intended to limit the present invention. The singular expression includes the plural expression unless the context clearly dictates otherwise. As used herein, terms such as “comprise” or “have” are intended to designate that a feature, number, step, operation, component, part, or combination thereof described herein is present, but one or more other features It is to be understood that it does not preclude the possibility of the presence or addition of numbers, steps, operations, components, parts, or combinations thereof.

Unless defined otherwise, all terms used herein, including technical or scientific terms, have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs. Terms such as those defined in a commonly used dictionary should be interpreted as having a meaning consistent with the meaning in the context of the related art, and should not be interpreted in an ideal or excessively formal meaning unless explicitly defined in the present specification. does not

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, the present invention will be described in detail through preferred embodiments described above and additional aspects with reference to the accompanying drawings so that those skilled in the art can easily understand and reproduce the present invention.

As shown in FIG. 1, the smartphone usage evidence collection system according to the present invention includes an app server 140 and an operation server 300 connected to the Internet network, and a plurality of smart phones. The Internet network includes a wired or wireless Internet network.

The app server 140 stores, for example, an app that enables the display unit to display multimedia contents that have been provided through the Internet, such as music, movies, and books, on a smartphone with a relatively small display unit. The app server 140 provides a smartphone monitoring app while driving when there is a download request from the smartphone.

A smartphone includes a memory, a control unit, and peripheral devices in which executable programs and data are stored. The peripheral device may be implemented including a wireless communication unit, an A/V (Audio/Video) input unit, a user input unit, an output unit, a power supply unit, and a gyro sensor or an acceleration sensor. The wireless communication unit includes a mobile communication module, a wireless Internet module, a Bluetooth module, a radio frequency identification (RFID) module, an infrared data association (IrDA) module, an ultra wideband (UWB) module, a short-distance communication module including a ZigBee module, and a smart As a module for acquiring the location of the phone, it may be implemented by including a location information module including a Global Position System (GPS) sensor.

As shown in FIG. 2 , the smartphone monitoring app 200 while driving mounted on the smartphone is largely a driving detection module 210 , a screen capture module 220 , a usage evidence detection module 230 , and usage record information. It may be implemented including the processing module 240 .

The driving detection module 210 detects whether the vehicle is driving by using a detection signal input from a detection sensor mounted on the smartphone. The driving detection module 210 uses a detection signal input from at least one of a GPS sensor, a gyro sensor, and an acceleration sensor mounted on the smartphone. For example, the driving detection module 210 detects the speed value of the vehicle using the GPS speed input from the GPS sensor, and if the speed value of the vehicle is greater than or equal to a preset reference value, it is determined that the vehicle is running, and indicates that the vehicle is running. Detection information to notify can be output.

For example, the preset reference value may be set according to location information obtained through GPS information. For example, in front of a school, you have to drive at a speed of 30 km or less, so the preset reference value may be 10 km, and a speed value less than 60 km on a highway and 30 km less than the speed limit in a driving speed limit section may be the reference value.

As another example, the driving detection module 210 may be implemented to synthesize detection signals input from the GPS sensor, the gyro sensor, and the acceleration sensor to determine that the vehicle is driving, and output detection information indicating that the vehicle is driving.

The screen capture module 220 captures the screen of the smartphone according to the pre-stored screen capture control information when detection information indicating that the vehicle is being driven is input from the driving detection module 210 . For example, the screen capture control information may be, for example, control information for capturing the screen of a smartphone at an interval of 3 seconds. The screen capture module 220 may store screen capture control information set by a smartphone user or an operation server administrator. The screen capture control information may be set differently for each driver or for each driver group.

The image input from the screen capture module 220 is a screen capture image of a smartphone, and may be, for example, a lock screen, a standby screen including an app icon, a wireless Internet connection screen, a text input screen, and the like.

The usage evidence detection module 230 determines whether the driver is using the smartphone from the smartphone screen capture image input from the screen capture module 220 . As an example, the usage evidence detection module 230 determines whether there is a keypad image 42 in a specific area of the smartphone screen 41 input from the screen capture module 220 as shown in FIG. 4 , and the determination result If positive, the screen capture image of the smartphone is saved as evidence of use. That is, the usage evidence detection module 230 is implemented to determine the operation of the smartphone, which is not helpful for driving, as a screen capture image.

The usage evidence detection module 230 is another example, when a wireless Internet connection screen is input after a lock screen image is input, or a wireless Internet connection screen is input after a standby screen image including an app icon is input. You can assume that you are using it. The usage evidence detection module 230 may store the screen capture image of the smartphone in the car black box. The screen capture image of the smartphone is stored in the car black box to prevent data from being damaged even in the event of an accident.

5 and 6, the usage evidence detection module 230 determines whether there is a keypad image 52 in a specific area of the smartphone screen 51 input from the screen capture module 220, and if yes It may be implemented to store the smartphone screen capture image as evidence of use.

As another example, the usage evidence detection module 230 analyzes whether a cursor is blinking in a specific area of the smartphone screen 51 input from the screen capture module 220 , and as a result of the analysis, a specific area of the smartphone screen 51 . For example, if it is determined that the cursor is blinking in the input window 53, it may be implemented to store the smartphone screen image including the cursor image in the storage unit as smartphone usage evidence. The cursor indicating the text input position is a blinking underline or a vertical bar in the shape of a rectangle.

Furthermore, the usage evidence detection module 230 is implemented to collect information that can prove that the driver is currently using the smartphone by analyzing the blinking of the cursor present in the input window 53 to solve the smartphone security problem issue. can be

For example, when a plurality of images in which the cursor blinks are sequentially input to a specific area of the smartphone screen 51 , for example, the input window 53 , the usage evidence detection module 230 is the first input image among the plurality of images. It is determined whether there are images in which the cursor having a position different from the cursor position in the image is blinking, and if the determination result is affirmative, it is implemented to delete the images in which the cursor having a position different from the cursor position in the first input image blinks.

Referring to FIGS. 5 and 6 , it can be seen that the positions of the blinking cursors in the input window 53 are different. That is, when the user opens an Internet site and touches the input window 53 , the cursor blinks in the input window 53 . Usually, the cursor is displayed like a rectangular vertical bar. Although the size and blinking cycle of the cursor are slightly different for each mobile app, since it is displayed in the input window in all mobile apps, it is used as information proving that the driver is currently using a smartphone can be utilized

The usage evidence detection module 230 includes a shape analysis program that analyzes the size and blinking cycle of the cursor in the smartphone screen image. The position of the cursor is positioned backward from the initial position when the user inputs a character, and the usage evidence detection module 230 is implemented to detect a change in the position of the cursor. In general, when the cursor moves, the user is entering a character. Since such character input is information that should never be exposed to the outside, the evidence-of-use detection module 230 is implemented to delete images in which a cursor having a position different from the cursor position in the first input image blinks.

The usage record information processing module 240 transmits the image stored in the usage evidence detection module 230 to the operation server. The usage record information processing module 240 may transmit data through a wireless Internet network.

The operation server 300 connected through the Internet network with the smartphone on which the smartphone monitoring app 200 is mounted while driving includes a usage record information processing unit 310 , a monitoring processing unit 320 , and a member management unit 330 .

The usage record information processing unit 310 receives and stores usage record information including smart phone identification information from the smart phone, and calculates the number of times of smart phone use while driving by using the stored usage record information.

The monitoring processing unit 320 determines whether the smartphone monitoring app is operating normally while driving mounted on the smartphone for a specific time based on the usage record information including the smartphone identification information, and if the determination result is negative, the smartphone identification information An alarm message is created and transmitted to the manager terminal.

The member management unit 330 stores, edits, or stores driver information, smartphone identification information, app version information, and group information for smartphone monitoring while driving in the storage unit with a smartphone equipped with a smartphone monitoring app while driving. Delete.

3 is a flowchart of a method for monitoring a smartphone equipped with a smartphone monitoring app while driving according to the present invention.

A smartphone equipped with a smartphone monitoring app while driving according to the present invention first receives a detection signal input from a GPS sensor, a gyro sensor, and an acceleration sensor mounted on the smartphone (S31). A smartphone equipped with a smartphone monitoring app while driving according to the present invention detects the speed value of the vehicle using the GPS speed input from the GPS sensor, and if the speed value of the vehicle is greater than or equal to a preset reference value, it is determined that the vehicle is running, , outputs detection information indicating that the vehicle is driving (S32).

For example, the preset reference value may be set according to location information obtained through GPS information. For example, in front of a school, you have to drive at a speed of 30 km or less, so the preset reference value may be 10 km, and a speed value less than 60 km on a highway and 30 km less than the speed limit in a driving speed limit section may be the reference value.

The smartphone equipped with the smartphone monitoring app while driving according to the present invention captures the screen of the smartphone according to the pre-stored screen capture control information when detection information indicating that the vehicle is driving is input, and the driver from the smartphone screen capture image It is analyzed whether a smartphone is being used (S33).

For example, the screen capture control information may be, for example, control information for capturing the screen of a smartphone at an interval of 3 seconds. The screen capture module 220 may store screen capture control information set by a smartphone user or an operation server administrator. The screen capture control information may be set differently for each driver or for each driver group.

As an example, in a smartphone equipped with a smartphone monitoring app while driving according to the present invention, as shown in FIG. 4 , a cursor image is displayed in a specific area of the smartphone screen 41 input from the smartphone screen capture image, for example, in the input window. It is determined whether there is an included smartphone screen image (S34), and if the determination result is affirmative, the smartphone screen capture image is stored as evidence of use (S35).

A smartphone equipped with a smartphone monitoring app while driving according to the present invention is another example, a wireless Internet connection screen after a lock screen image is input, or a wireless Internet connection screen after a standby screen image including an app icon is input When this is input, it can be determined that the driver is using the smartphone. A smartphone equipped with a smartphone monitoring app while driving according to the present invention may store a smartphone screen capture image in a vehicle black box. The screen capture image of the smartphone is stored in the car black box to prevent data from being damaged even in the event of an accident.

A smartphone equipped with a smartphone monitoring app while driving according to the present invention transmits the stored image to the operation server (S36).

So far, the present specification has been described with reference to the embodiments shown in the drawings so that those of ordinary skill in the art to which the present invention pertains can easily understand and reproduce the present invention, but this is merely exemplary, and the Those of ordinary skill in the art will understand that various modifications and equivalent other embodiments are possible from the embodiments of the present invention. Therefore, the true technical protection scope of the present invention should be defined only by the appended claims.

Claims (4)

It is a smartphone equipped with a GPS sensor and a smartphone monitoring app while driving that collects evidence that the driver used the smartphone while driving.
The speed value of the vehicle is detected using the GPS speed input from the GPS sensor mounted on the smartphone, and when the location information input from the GPS sensor and the detected vehicle speed value are greater than or equal to a preset reference value, the vehicle is running a driving detection module for determining whether the vehicle is driving;
a screen capture module for capturing the screen of the smartphone according to pre-stored screen capture control information when detection information indicating that the vehicle is being driven is input from the driving detection module;
It is analyzed whether the cursor is blinking in a specific area of the smartphone screen input from the screen capture module, and if it is determined that the cursor is blinking in a specific area of the smartphone screen as a result of the analysis, the smartphone screen image including the cursor image is displayed as a smart a usage evidence detection module that stores the phone usage evidence in the storage unit; and
What includes a usage record information processing module for transmitting a smartphone screen image including a cursor image stored in the storage unit to an operation server,
A smartphone equipped with a smartphone monitoring app while driving through analysis of cursor blinking in the input window, characterized by The method according to claim 1,
The usage evidence detection module,
When a plurality of images in which the cursor blinks are sequentially input to a specific area of the smartphone screen, it is determined whether there are images in which the cursor blinks having a position different from the cursor position in the first input image among the plurality of images, and the result of the determination If yes, deleting images with a blinking cursor having a position different from the cursor position in the first input image,
A smartphone equipped with a smartphone monitoring app while driving through analysis of cursor blinking in the input window, characterized by 3. The method according to claim 2,
The usage record information processing module,
Transmitting the smartphone screen image including the cursor image stored in the storage unit to the car black box,
A smartphone equipped with a smartphone monitoring app while driving through analysis of cursor blinking in the input window, characterized by As a smartphone usage evidence collection system while driving, comprising an operating server connected through an Internet network with a smartphone equipped with the smartphone monitoring app while driving according to any one of claims 1 to 3,
The operating server is:
A usage record information processing unit for receiving and storing usage record information including a smartphone screen image including smart phone identification information and a cursor image from the smart phone, and calculating the number of times of smart phone use while driving using the stored usage record information Wow,
Based on the usage record information including the smartphone screen image including the smartphone identification information and the cursor image, it is determined whether the smartphone monitoring app mounted on the smartphone is operating normally during driving for a specific time, and the determination result is negative Including a monitoring processing unit for generating an alarm message including the back smart phone identification information and transmitting it to the manager terminal,
A system for collecting evidence of smartphone use while driving.

Images