A kind of method, apparatus and terminal of fingerprint collecting
This application claims on February 03rd, 2017 submission Patent Office of the People's Republic of China, application No. is the 201710063710.2, priority of the Chinese patent application of entitled " a kind of method and terminal of fingerprint collecting ", entire contents are hereby incorporated by reference in the application.
Technical field
This application involves field of image processing more particularly to the method, apparatus and terminal of a kind of fingerprint collecting.
Background technique
Fingerprint identification technology is the biometrics identification technology being most widely used now by fingerprint contrast verification identity.Safety in order to better improve, fingerprint recognition are used in more and more widely on such as mobile phone terminal device.Based on reliability, industrial design (Industrial Design, ID) appearance, water proof and dust proof etc. consider, mobile phone providers tend to the scheme that fingerprint device (such as fingerprint sensor) is placed using the display screen of full screen and at the cover-plate glass of display screen (Cover Glass) at present, such as mobile phone example shown in figure 1, the cover-plate glass 101 of display screen is lower to dig blind hole, then fingerprint device 102 is placed below blind hole, when fingerprint device 102 acquires fingerprint, the finger of user is not directly contacted with fingerprint device 102.
Currently, through the above scheme the poor problem of the generally existing whole image quality of collected fingerprint.The fragility of glass makes when using glass as cover plate materials it is required that glass is with certain thickness, this will lead to the increase of fingerprint device Yu user's finger distance, and then leading to the decrease of signal, decrease and the aliasing in space of signal will make collected fingerprint image quality apparent loss (for example show as part chaser in fingerprint image and do not see) occur;In addition, the out-of-flatness of glass then will lead to, inequality signal is even, and part is partially black or partially white, and the reasons such as dust then will lead to the increase of the bad point on fingerprint image during the fitting of glass.Such as Fig. 2 shows an example of current relatively conventional fingerprint image, includes bad point 201 in the example fingerprint image, uneven 202 and do not see region 203.
It can be seen that above-mentioned various situations will lead to, collected fingerprint image quality is poor, increases the difficulty of fingerprint recognition, has a negative impact to the experience of user fingerprints discrimination, be easy to cause can not typing, authentication failed the problems such as.Thus, how to solve the above problems, promote the quality of fingerprint image, urgently industry is studied to increase the success rate of fingerprint recognition.
Summary of the invention
The application provides the method, apparatus and terminal of a kind of fingerprint collecting, to promote fingerprint image quality, to increase the success rate of fingerprint recognition.
In a first aspect, this method is applied to place the terminal of fingerprint device under the cover-plate glass of display screen, and region corresponding with the fingerprint device is fingerprint collecting area on the cover-plate glass this application provides a kind of fingerprint collecting method, this method comprises:
The terminal obtains the user fingerprint image of the fingerprint device acquisition, wherein the user fingerprint image includes non-fingerprint category feature, it include that bad point and/or image grayscale are uneven in the non-fingerprint category feature;
The non-fingerprint category feature information of the terminal test fingerprint image according to the pre-stored data, calibrates the user fingerprint image;
Wherein, the test fingerprint image is the fingerprint image that the terminal is got using the fingerprint measuring head of a surfacing in the fingerprint collecting area in advance.
It can be seen that by the above-mentioned means, what the fingerprint device that terminal is placed under the cover-plate glass for getting display screen acquired
After user fingerprint image, by can be with the non-fingerprint category feature information of test fingerprint image according to the pre-stored data, user fingerprint image is calibrated, to be effectively reduced since the factors such as cover-plate glass and processing technology are to adverse effect caused by user fingerprint image quality, the quality of user fingerprint image is promoted, fingerprint recognition success rate is increased.
It in one possible implementation, include bad point in the non-fingerprint category feature;The non-fingerprint category feature information of the terminal test fingerprint image according to the pre-stored data, calibrates the user fingerprint image, comprising:
The bad point information of the terminal test fingerprint image according to the pre-stored data, removes the bad point of the user fingerprint image.
In one possible implementation, the bad point information of terminal test fingerprint image according to the pre-stored data, removes the bad point of the user fingerprint image, comprising:
The terminal determines the bad point of the test fingerprint image, and determine the location of pixels and gray value of the bad point of the test fingerprint image according to the gray value of point each in the test fingerprint image;
The point being located on the location of pixels in the user fingerprint image is determined as the bad point of the user fingerprint image by the terminal;
The gray value of the bad point of the user fingerprint image is subtracted the gray value for the bad point being located on same pixel position in the test fingerprint image, the user fingerprint image after being calibrated by the terminal.
By the above-mentioned means, terminal will remove the bad point due to caused by the factors such as dust during cover-plate glass fitting in user fingerprint image, to promote the quality of user fingerprint image.
In one possible implementation, the terminal determines the bad point of the test fingerprint image according to the gray value of point each in the test fingerprint image, comprising:
The terminal calculates the difference between the gray value of the point and the gray value of the first reference point to the every bit in the test fingerprint image, and first reference point is the right consecutive points of the point;
If the difference between the gray value of the point and the gray value of first reference point is greater than preset threshold, then the terminal is when the difference of the point and the average gray value of the test fingerprint image is greater than the difference of the average gray value of first reference point and the test fingerprint image, the point is determined as to a bad point of the test fingerprint image, otherwise first reference point is determined as to a bad point of the test fingerprint image.
In one possible implementation, the terminal determines the bad point of the test fingerprint image according to the gray value of point each in the test fingerprint image, comprising:
The terminal calculates the difference between the gray value of the point and the gray value of the second reference point to the every bit in the test fingerprint image, and second reference point is the lower consecutive points of the point;
If the difference between the gray value of the point and the gray value of second reference point is greater than preset threshold, then the terminal is when the difference of the point and the average gray value of the test fingerprint image is greater than the difference of the average gray value of second reference point and the test fingerprint image, the point is determined as to a bad point of the test fingerprint image, otherwise second reference point is determined as to a bad point of the test fingerprint image.
It in one possible implementation, include that image grayscale is uneven in the non-fingerprint category feature;
The non-fingerprint category feature information of the terminal test fingerprint image according to the pre-stored data, calibrates the user fingerprint image, comprising:
The uneven information of image grayscale of the terminal test fingerprint image according to the pre-stored data, calibrates the gray value of each point in the user fingerprint image.
In one possible implementation, the uneven information of image grayscale of terminal test fingerprint image according to the pre-stored data, calibrates the gray value of each point in the user fingerprint image, comprising:
The terminal determines that the gray scale of the test fingerprint image is inclined according to the gray value of every bit in the test fingerprint image
Inclined-plane, and determine the inclination angle of the gray scale inclined surface and the intersecting lens of the gray scale inclined surface and standard water plane;
The terminal calibrates the every bit in the user fingerprint image according to the subpoint of the gray scale inclination angle and this in the standard water plane to the distance of the intersecting lens to the gray value of the point.
By the above-mentioned means, terminal will calibrate the image grayscale non-uniform phenomenon due to caused by uneven or ink the factors such as uneven of cover-plate glass in user fingerprint image, to promote the quality of user fingerprint image.
Second aspect, this application provides a kind of device of fingerprint collecting, which is applied to place the terminal of fingerprint device under the cover-plate glass of display screen, and region corresponding with the fingerprint device is fingerprint collecting area on the cover-plate glass, which includes:
Module is obtained, for obtaining the user fingerprint image of the fingerprint device acquisition, wherein the user fingerprint image includes non-fingerprint category feature, it include that bad point and/or image grayscale are uneven in the non-fingerprint category feature;
Calibration module calibrates the user fingerprint image for the non-fingerprint category feature information of test fingerprint image according to the pre-stored data;
Wherein, the test fingerprint image is the fingerprint image that the terminal is got using the fingerprint measuring head of a surfacing in the fingerprint collecting area in advance.
It in one possible implementation, include bad point in the non-fingerprint category feature;
The calibration module, is specifically used for: the bad point information of test fingerprint image according to the pre-stored data removes the bad point of the user fingerprint image.
In one possible implementation, the calibration module, is specifically used for:
According to the gray value of point each in the test fingerprint image, the bad point of the test fingerprint image is determined, and determine the location of pixels and gray value of the bad point of the test fingerprint image;
The point being located on the location of pixels in the user fingerprint image is determined as to the bad point of the user fingerprint image;
The gray value that the gray value of the bad point of the user fingerprint image is subtracted to the bad point being located on same pixel position in the test fingerprint image, the user fingerprint image after being calibrated.
In one possible implementation, the calibration module, is specifically used for:
To the every bit in the test fingerprint image, the difference between the gray value of the point and the gray value of the first reference point is calculated, first reference point is the right consecutive points of the point;
If the difference between the gray value of the point and the gray value of first reference point is greater than preset threshold, when being then greater than the difference of average gray value of first reference point and the test fingerprint image in the difference of the point and the average gray value of the test fingerprint image, the point is determined as to a bad point of the test fingerprint image, otherwise first reference point is determined as to a bad point of the test fingerprint image.
In one possible implementation, the calibration module, is specifically used for:
To the every bit in the test fingerprint image, the difference between the gray value of the point and the gray value of the second reference point is calculated, second reference point is the lower consecutive points of the point;
If the difference between the gray value of the point and the gray value of second reference point is greater than preset threshold, when being then greater than the difference of average gray value of second reference point and the test fingerprint image in the difference of the point and the average gray value of the test fingerprint image, the point is determined as to a bad point of the test fingerprint image, otherwise second reference point is determined as to a bad point of the test fingerprint image.
It in one possible implementation, include that image grayscale is uneven in the non-fingerprint category feature;
The calibration module, is specifically used for: the uneven information of image grayscale of the test fingerprint image according to the pre-stored data calibrates the gray value of each point in the user fingerprint image.
In one possible implementation, the calibration module, is specifically used for:
According to the gray value of every bit in the test fingerprint image, the gray scale inclined surface of the test fingerprint image is determined, and determine the inclination angle of the gray scale inclined surface and the intersecting lens of the gray scale inclined surface and standard water plane;
Every bit in the user fingerprint image calibrates the gray value of the point according to the subpoint of the gray scale inclination angle and this in the standard water plane to the distance of the intersecting lens.
The implementation of any realization described device of the above-mentioned second aspect of the present invention or second aspect and beneficial effect can implementation with the above-mentioned first aspect of the present invention or any realization the method for first aspect and beneficial effect can be with cross-reference, overlaps will not be repeated.
The third aspect, this application provides a kind of terminals, the terminal includes: processor, memory, fingerprint device and display screen, wherein the display screen includes cover-plate glass, the fingerprint device is placed under the cover-plate glass, and region corresponding with the fingerprint device is fingerprint collecting area on the cover-plate glass;Wherein:
The fingerprint device, for acquiring fingerprint image;
The memory, for storing computer instruction;
The processor is executed for the computer instruction by calling the memory storage:
The user fingerprint image of the fingerprint device acquisition is obtained, wherein the user fingerprint image includes non-fingerprint category feature, it include that bad point and/or image grayscale are uneven in the non-fingerprint category feature;
The non-fingerprint category feature information of test fingerprint image according to the pre-stored data, calibrates the user fingerprint image;
Wherein, the test fingerprint image is the fingerprint image that the terminal is got using the fingerprint measuring head of a surfacing in the fingerprint collecting area in advance.
It in one possible implementation, include bad point in the non-fingerprint category feature;
The processor, is specifically used for: the bad point information of test fingerprint image according to the pre-stored data removes the bad point of the user fingerprint image.
In one possible implementation, the processor, is specifically used for:
According to the gray value of point each in the test fingerprint image, the bad point of the test fingerprint image is determined, and determine the location of pixels and gray value of the bad point of the test fingerprint image;
The point being located on the location of pixels in the user fingerprint image is determined as to the bad point of the user fingerprint image;
The gray value that the gray value of the bad point of the user fingerprint image is subtracted to the bad point being located on same pixel position in the test fingerprint image, the user fingerprint image after being calibrated.
In one possible implementation, the processor, is specifically used for:
To the every bit in the test fingerprint image, the difference between the gray value of the point and the gray value of the first reference point is calculated, first reference point is the right consecutive points of the point;
If the difference between the gray value of the point and the gray value of first reference point is greater than preset threshold, when being then greater than the difference of average gray value of first reference point and the test fingerprint image in the difference of the point and the average gray value of the test fingerprint image, the point is determined as to a bad point of the test fingerprint image, otherwise first reference point is determined as to a bad point of the test fingerprint image.
In one possible implementation, the processor, is specifically used for:
To the every bit in the test fingerprint image, the difference between the gray value of the point and the gray value of the second reference point is calculated, second reference point is the lower consecutive points of the point;
If the difference between the gray value of the point and the gray value of second reference point is greater than preset threshold, it is greater than the average ash of second reference point and the test fingerprint image in the difference of the point and the average gray value of the test fingerprint image
When the difference of angle value, which is determined as to a bad point of the test fingerprint image, otherwise second reference point is determined as to a bad point of the test fingerprint image.
It in one possible implementation, include that image grayscale is uneven in the non-fingerprint category feature;
The processor, is specifically used for: the uneven information of image grayscale of the test fingerprint image according to the pre-stored data calibrates the gray value of each point in the user fingerprint image.
In one possible implementation, the processor, is specifically used for:
According to the gray value of every bit in the test fingerprint image, the gray scale inclined surface of the test fingerprint image is determined, and determine the inclination angle of the gray scale inclined surface and the intersecting lens of the gray scale inclined surface and standard water plane;
Every bit in the user fingerprint image calibrates the gray value of the point according to the subpoint of the gray scale inclination angle and this in the standard water plane to the distance of the intersecting lens.
The implementation of any realization terminal of the above-mentioned third aspect of the present invention or the third aspect and beneficial effect can implementation with the above-mentioned first aspect of the present invention or any realization the method for first aspect and beneficial effect can be with cross-reference, overlaps will not be repeated.
Fourth aspect, present invention also provides a kind of computer readable storage mediums, including instruction, when run on a computer, so that computer executes the implementation of any realization the method such as the above-mentioned first aspect of the present invention or first aspect.
Detailed description of the invention
Fig. 1 is the schematic diagram that current mobile phone acquires fingerprint;
Fig. 2 is the schematic diagram of the fingerprint image acquired at present;
Fig. 3 is the schematic block diagram of the part-structure of the mobile phone 300 of some embodiments of the invention;
Fig. 4 is the flow diagram of the method for the fingerprint collecting that some embodiments of the invention provide;
Fig. 5 is the schematic diagram in some embodiments of the invention using fingerprint measuring head to obtain test fingerprint image;
Fig. 6 is the device connection schematic diagram in some embodiments of the invention in terminal;
Fig. 7 is the schematic diagram for passing through the obtained test fingerprint image of fingerprint measuring head in some embodiments of the invention;
Fig. 8 is that terminal acquires the flow diagram of information in factory's producing line in some embodiments of the invention;
Fig. 9 is the flow diagram calibrated in some embodiments of the invention to user fingerprint image;
Figure 10 is that terminal calibrates user fingerprint image and authenticates the flow diagram of user in some embodiments of the invention;
Figure 11 (a) is the schematic diagram of pixel and the pixel being connected with the pixel right side in some embodiments of the invention;
Figure 11 (b) be some embodiments of the invention in pixel and with the schematic diagram for the pixel being connected under the pixel;
Figure 12 (a) is the non-uniform schematic diagram of test fingerprint image grayscale in some embodiments of the invention;
Figure 12 (b) is the non-uniform section schematic diagram of test fingerprint image grayscale in some embodiments of the invention;
Figure 13 (a) is the schematic diagram of the user fingerprint image before some embodiments of the invention alignment;
Figure 13 (b) is the schematic diagram of the user fingerprint image after some embodiments of the invention alignment;
Figure 14 is the structural schematic diagram of the device of fingerprint collecting provided in some embodiments of the invention;
Figure 15 is the structural schematic diagram of terminal provided by some embodiments of the invention.
Specific embodiment
With reference to the accompanying drawing, the embodiment of the present invention is described.
For the industrial design scheme for placing fingerprint device under the cover-plate glass of display screen as shown in Figure 1, the embodiment of the invention provides a kind of method, apparatus of fingerprint collecting and terminals, to solve the fingerprint that fingerprint device acquires under such design scheme
The problem of image is influenced by the factors such as the thickness of cover-plate glass and the processing technology of entirety and better quality can not be presented.
Fingerprint device collected user fingerprint image should reflect the fingerprint characteristic (or the biocompatibility characteristics that can be understood as user fingerprints) of user, for example, the ridge of user fingerprints and paddy, to achieve the purpose that identification and certification user.And for the terminal for placing fingerprint device under the cover-plate glass of display screen, fingerprint device is inevitably influenced by factors such as the thickness of cover-plate glass and processing technologys when acquiring fingerprint image, cause occur some non-fingerprint category features in collected fingerprint image, such as due to dust during glass gluing and caused by there are bad points on image, for another example as the out-of-flatness of the out-of-flatness of glass or fitting and caused by image grayscale it is uneven etc..
In view of the above problem, in the fingerprint collecting scheme provided by the embodiment of the present invention, test fingerprint image is previously stored in terminal, this fingerprint test image is the fingerprint image got in advance using the fingerprint measuring head of a surfacing in the fingerprint collecting area (i.e. region corresponding with fingerprint device on the cover-plate glass of the terminal display screen) of the terminal, it can be seen that this fingerprint test image will include the non-fingerprint category feature information such as the bad point as caused by the factors such as cover-plate glass and processing technology, image grayscale be uneven;In turn, terminal is after the user fingerprint image for the fingerprint device acquisition placed under getting cover-plate glass, pass through the non-fingerprint category feature information of test fingerprint image according to the pre-stored data, the user fingerprint image for including non-fingerprint category feature is calibrated, it will be effectively reduced since the factors such as cover-plate glass and processing technology are to adverse effect caused by user fingerprint image quality, the quality of user fingerprint image is promoted, fingerprint recognition success rate is increased.
Specifically for example, in some embodiment of the invention, terminal can remove the bad point of the user fingerprint image with the bad point information of test fingerprint image according to the pre-stored data;Terminal can calibrate the gray value of each point in the user fingerprint image with the uneven information of image grayscale of test fingerprint image according to the pre-stored data.
The application combination fingerprint device describes each embodiment.Fingerprint device can refer to the device for acquiring fingerprint image, such as fingerprint sensor.
For example, fingerprint sensor can be formed by capacitance type sensing element arrays, the recordable voltage changed with capacity coupled capacitor of each capacitance type sensing element of the array, finger is capacitively coupled to each capacitance type sensing element of fingerprint sensor, so that fingerprint sensor can sense the capacitor between each capacitance type sensing element and finger flat and then determine the signal recorded at each capacitance type sensing element, to obtain the fingerprint image of user.The resolution ratio of fingerprint device is with the distance between the density of sensing element, fingerprint device and finger and covers dielectric thickness of fingerprint device and changes.The increase of dielectric thickness, it will so that the signal between finger and fingerprint device is decayed.
Such as by taking the ridge of user fingerprints and paddy as an example, the ridge of fingerprint is closer with fingerprint sensor, the capacitor that capacitance type sensing element at respective pixel location generates is higher, thus generate higher signal, the paddy of fingerprint and fingerprint sensor distance are farther out, the capacitor that capacitance type sensing element at respective pixel location generates is lower, thus generates lower signal, passes through the finger print information of the different reflection users of signal.User fingerprint image specifically may include one group of gray value, to provide the fingerprint feature information about user's finger.These fingerprint characteristics can be stored as registering the fingerprint of user in database for using later, or can be compared with the information in fingerprint of registration user stored in database, to identify and authenticate user.
It should be pointed out that fingerprint device can couple in a capacitive manner, otherwise (such as electromagnetic mode) finger of user can also be coupled to;In addition, fingerprint device can also with execute to the optical sensing of user fingerprints, infrared sensing or other sensing elements in conjunction with or work in combination, the application is not construed as limiting this.
The application, which is combined, describes each embodiment with the terminal for placing fingerprint device feature under the cover-plate glass of display screen.
For example, terminal described in this application may include mobile phone, tablet computer, personal digital assistant (Personal Digital Assistant, PDA), point-of-sale terminal (Point of Sales, POS), vehicle-mounted computer, desktop computer, notebook etc..
Taking the terminal as an example, Fig. 3 shows the schematic block diagram of the part-structure of the mobile phone 300 of some embodiments according to the present invention.With reference to Fig. 3, mobile phone 300 includes: radio frequency (Radio Frequency, RF) circuit 310, memory 320, place
Manage the components such as device 330, sensor 340, display screen 350, other input equipments 360, input/output (I/O) subsystem 370, voicefrequency circuit 380 and power supply 390.These components can be communicated by one or more communication bus or signal wire.
It should be understood that yes, handset structure shown in Fig. 3 does not constitute the restriction to mobile phone, it may include perhaps combining certain components than illustrating more or fewer components and perhaps splitting certain components or different component layouts.Each component in handset structure shown in Fig. 3 can be realized with hardware, software mode or combination thereof, including one or more signal processings and/or specific integrated circuit.
RF circuit 310 can be used for receiving and sending messages or communication process in, signal sends and receivees, and particularly, after the downlink information of base station is received, handles to processor 330;In addition, the data for designing uplink are sent to base station.In general, RF circuit includes but is not limited to antenna, at least one amplifier, transceiver, coupler, low-noise amplifier, duplexer etc..In addition, RF circuit 310 can also be communicated with network and other equipment by wireless communication.Any communication standard or agreement can be used in the wireless communication, including but not limited to global system for mobile communications, general packet radio service, CDMA, wideband code division multiple access, long term evolution (Long Term Evolution, LTE), Email, short message service etc..
Memory 320 can be used for storing software program and module, and processor 330 is stored in the software program and module of memory 320 by operation, thereby executing the various function application and data processing of mobile phone 300.Memory 320 can mainly include storing program area and storage data area, wherein storing program area can application program needed for storage program area, at least one function etc.;Storage data area, which can be stored, uses created data etc. according to mobile phone 300.In addition, memory 320 may include high-speed random access memory, it can also include nonvolatile memory, a for example, at least disk memory, flush memory device or other volatile solid-state parts.
Processor 330 is the control centre of mobile phone 300, utilize the various pieces of various interfaces and connection whole mobile phone, by running or executing the software program and/or module that are stored in memory 320, and call the data being stored in memory 320, the various functions and processing data for executing mobile phone 300, to carry out integral monitoring to mobile phone.Optionally, processor 330 may include one or more processing units;Optionally, processor 330 can integrate application processor (Application Processor, AP) and modem processor, wherein, the main processing operation system of application processor, user interface and application program etc., modem processor mainly handles wireless communication.It is understood that above-mentioned modem processor can not also be integrated into processor 330.
Mobile phone 300 may also include at least one sensor 340, such as the application fingerprint device as described above, to obtain the fingerprint image of user.The other sensors such as the optical sensor, motion sensor, pressure sensor, gyroscope, barometer, hygrometer, thermometer, the infrared sensor that can also configure as mobile phone 100, details are not described herein.
Display screen 350 can be used for showing visual output to user, include the various menus of display information input by user, the information and mobile phone 300 that are supplied to user, can also provide input interface and output interface between equipment and user, receive user's input.Display screen 350 may include display panel 351 and touch panel 352.Display panel 351 can be configured using forms such as liquid crystal display, Organic Light Emitting Diodes.Touch panel 352, also referred to as touch-sensitive screen etc., the on it or neighbouring contact of collectable user or Touchless manipulation (for example user uses the operations of objects or attachment on touch panel 352 or near touch panel 352 such as finger, stylus), and corresponding attachment device is driven according to preset formula.
It should be noted that, although being not shown in Fig. 3, cover-plate glass is covered on the display screen 350 of mobile phone 300, it is not perforated in the face of the cover-plate glass and user's finger contacts, and the face of object fingerprint device is by part skiving (blind hole), one kind that the application fingerprint device as described above can be used as sensor 340 is placed under cover-plate glass (such as example shown in figure 1), region corresponding with the fingerprint device can be used as fingerprint collecting area on cover-plate glass, to acquire user fingerprints.
Ink layer is also placed between the top surface of fingerprint device and the bottom surface of cover-plate glass, such as can be in cover-plate glass
Bottom surface on printing ink layer so that cover-plate glass is opaque, so that fingerprint device is invisible for a user.
Other input equipments 360 may include physical button (push button, rocker buttons etc.), dial, slide switch, control stick, click idler wheel, light mouse, number for receiving input or character information, and generate key signals input related with the user setting of mobile phone 300 and function control.
I/O subsystem 370 is used to control the external equipment of input and output, may include other input device controls devices 371, sensor controller 372, display controller 373.Other one or more input device controls devices 371 can receive signal from other input equipments 360 and/or send signal to other input equipments 360.Display controller 373 can receive signal from display screen 350 and/or send signal to display screen 350.Sensor controller 372 can receive signal from one or more sensor 340 and/or send signal to one or more sensor 340.
Mobile phone 300 further includes voicefrequency circuit 380, loudspeaker 381, microphone 382, can provide the audio interface between user and mobile phone 300;To the power supply 390 (such as battery) that all parts are powered, power supply can be logically contiguous by power-supply management system and processor 330, to realize the functions such as management charging, electric discharge and power consumption by power-supply management system;Camera, bluetooth module etc., details are not described herein.
In addition, in the description of the present application, term "and/or" refers to and includes that one or more associated any or all of project listed may combine;The vocabulary such as term " first ", " second " are only used for distinguishing the purpose of description, are not understood to indicate or imply relative importance, can not be interpreted as indication or suggestion sequence.
It is directed to the terminal of the above-mentioned technology characteristics for having and placing fingerprint device under the cover-plate glass of display screen, the embodiment of the invention provides a kind of schemes of fingerprint collecting, to promote the quality of fingerprint image.Fig. 4 shows the flow diagram of the method for the fingerprint collecting of some embodiments of the invention offer, which can be realized by the combination of hardware, software programming or software and hardware, and specifically may be implemented in the terminal for being placed with fingerprint device under the cover-plate glass of display screen.For example may be implemented on mobile phone 300 shown in Fig. 3, region corresponding with fingerprint device is fingerprint collecting area on the cover-plate glass of display screen 350, acquires fingerprint by fingerprint device, reads the instruction in memory 320 by processor 330 to execute process shown in Fig. 4.
As shown in figure 4, the process comprises the following steps that
Step 401: terminal obtains the user fingerprint image of fingerprint device acquisition, and wherein user fingerprint image includes non-fingerprint category feature, includes that bad point and/or image grayscale are uneven in the non-fingerprint category feature;
Step 402: the non-fingerprint category feature information of terminal test fingerprint image according to the pre-stored data calibrates user fingerprint image.
In some embodiment of the invention, when the fingerprint device being placed under cover-plate glass senses that the finger of user is covered on cover-plate glass fingerprint collecting area corresponding with the fingerprint device, user fingerprint image will be obtained;This fingerprint test image can include the non-fingerprint category features such as bad point, image grayscale be uneven due to factors such as cover-plate glass and processing technologys;The non-fingerprint category feature information that terminal passes through test fingerprint image according to the pre-stored data, the user fingerprint image is calibrated, it will be effectively reduced since above-mentioned factor is to adverse effect caused by user fingerprint image quality, reach the quality for promoting user fingerprint image, increases the effect of the success rate of Fingerprint Lock identification.
Wherein, the test fingerprint image used when terminal calibrates user fingerprint image specifically can be the fingerprint image that terminal uses the fingerprint measuring head an of surfacing to get in fingerprint collecting area in advance.
It should be noted that, based on the considerations of simplifying processing in practical application, the application essentially describes the fingerprint measuring head of surfacing, and fingerprint measuring head also can have the lines of rule, those skilled in the art is after comprehension scheme provided herein, it should it is readily conceivable that similar scheme.
In addition, fingerprint measuring head should also be conductive with human finger similarly in order to enable fingerprint device can incude fingerprint measuring head and obtain test fingerprint image.
In some embodiment of the invention, fingerprint measuring head can also be configured with pressure (simulate real finger covering operation), and the operating parameters such as covering duration when executing covering;In addition, the effective area (area contacted with cover-plate glass) of fingerprint measuring head, can be configured to equal or larger with fingerprint collecting area corresponding with fingerprint device on cover-plate glass.
In some embodiment of the invention, the process that terminal obtains test fingerprint image can occur before terminal is dispatched from the factory.For example the test environment to obtain test fingerprint image can be configured in the end (for example equipment has been completed when entering factory checking stage) of terminal device production line.
Specifically, in some embodiment of the invention, configurable terminal is after getting test fingerprint image, the test fingerprint image is stored into the non-erasable storage region into terminal, alternatively, in some embodiment of the invention, can also be configured the extraction that terminal carries out non-fingerprint category feature information to accessed test fingerprint image, the non-fingerprint category feature information extracted is stored to the storage region non-erasable into terminal, such as the region that storage can not be deleted to recovery factory.By the way that above- mentioned information are saved in the non-erasable storage region in terminal, so that terminal can calibrate the collected user fingerprint image of fingerprint device institute in subsequent use process using above- mentioned information.
For example, Fig. 5 shows the schematic diagram for obtaining test fingerprint image in some embodiments of the invention using fingerprint measuring head.
As shown in Figure 5, fingerprint device 502 is placed under the cover-plate glass of 501 display screen of terminal, the fingerprint measuring head 500 of surfacing covers fingerprint collecting corresponding with fingerprint device 502 area on the cover-plate glass of 501 display screen of terminal, and then fingerprint device 502 incudes fingerprint measuring head 500 and collects test fingerprint image.
Fig. 6 shows the device connection schematic diagram in some embodiments of the invention in terminal.
As shown in fig. 6, the AP 503 in terminal 501 can get the 502 collected test fingerprint image of institute of fingerprint device by bus;Specifically, AP 503 can provide credible running environment (Trusted execution environment, TEE) 504, handling the collected test fingerprint images of the institute of fingerprint device 502, for example pass through the non-fingerprint category feature information of preset algorithm extraction test fingerprint class image.
Fig. 7 shows the schematic diagram for passing through the obtained test fingerprint image of fingerprint measuring head in some embodiments of the invention.
As shown in fig. 7, including the bad point 701 due to caused by the thickness and technological factor of cover-plate glass, the non-fingerprint category feature such as image grayscale uneven 702 in the test fingerprint example images;
In turn, terminal 501 can according to test fingerprint image zooming-out to including non-fingerprint category feature information, and the information preservation that extraction obtains is being restored the region that can not be deleted of dispatching from the factory, for the calibration in subsequent terminal use process to user fingerprint image, finish test procedure.
In particular embodiments of the invention, every terminal to be dispatched from the factory can be configured on the production link of terminal and requires to be tested separately through similar to test environment as shown in Figure 5, to obtain the non-fingerprint category feature information in test fingerprint image;It may be configured with the algorithm for extracting non-fingerprint category feature information in terminal, after making fingerprint device get test fingerprint image by fingerprint measuring head, after extracting by preset algorithm to the non-fingerprint characteristic category information in test fingerprint image, it is saved in the non-erasable region of complete machine factory reset.
For example, Fig. 8 shows the flow diagram of the terminal acquisition information in factory's producing line in some embodiments of the invention.
As shown in Figure 8, after starting testing process on plant produced line, terminal waits fingerprint measuring head to push (801), fingerprint device collects test fingerprint image (802) after fingerprint measuring head pushes, terminal and then the non-fingerprint category feature information (803) that test fingerprint image is generated based on test fingerprint image, and further the non-fingerprint category feature information preservation of obtained test fingerprint image can not be deleted region (804) in recovery factory, terminate process.
It can be seen that, above-described embodiment through the invention, the non-fingerprint category feature information of test fingerprint image will be previously stored in terminal, in turn, after terminal gets user fingerprint image by step 401, it can execute described in step 402, the non-fingerprint category feature information of test fingerprint image according to the pre-stored data, calibrate user fingerprint image.
For example, connecting example based on the device in terminal in some embodiments of the invention shown in fig. 6, Fig. 9 shows the flow diagram calibrated in some embodiments of the invention to user fingerprint image.
As shown in figure 9, AP503 is handled the non-fingerprint category feature information of available test fingerprint image, and is stored the information into database after test fingerprint image is passed to AP 503 by bus by fingerprint device 502;User fingerprint image can be passed to AP 503 by bus by fingerprint device 502, the non-fingerprint category feature information that AP 503 can read the test fingerprint image of storage in the database in turn calibrates user fingerprint image, the user fingerprint image after being calibrated.
User fingerprint image after calibration can further be used for user's identification, the detailed processes such as user authentication, to improve the accuracy rate of user's identification and user authentication.User fingerprint image is calibrated and authenticates the flow diagram of user for example, Figure 10 shows terminal in some embodiments of the invention.
As shown in Figure 10, after terminal is used and starts the certification of user fingerprint image, the finger down (1001) of terminal waiting user, user's finger presses rear fingerprint device and collects user fingerprint image (1002), terminal is calibrated (1003) to the collected user fingerprint image of institute based on the non-fingerprint category feature information of pre-stored test fingerprint image in turn, and then user authentication (1004) can be carried out based on the fingerprint image after calibration, for example the fingerprint image after calibration can be passed to user authentication algorithm to authenticate to user, accuracy rate is authenticated to improve.
Specifically, in some embodiment of the invention, causing the collected fingerprint image of fingerprint device for factors such as dusts during being bonded as cover-plate glass, there are as bad point the case where non-fingerprint category feature, terminal can be with the bad point information of test fingerprint image according to the pre-stored data, the bad point of user fingerprint image is removed, to achieve the purpose that calibrate user fingerprint image.
In some embodiment of the invention, after the bad point information of test fingerprint image can be the bad point for determining test fingerprint image according to the gray value of point each in test fingerprint image by terminal, the location of pixels and gray value of the bad point for the test fingerprint image determined;
In turn, the point being located on location of pixels indicated in the bad point information of test fingerprint image in user fingerprint image can be determined as the bad point of user fingerprint image by terminal;And the gray value of the bad point of user fingerprint image is subtracted to the gray value of the bad point being located on same pixel position indicated in the bad point information of test fingerprint image, the user fingerprint image after being calibrated.
Specifically, in some embodiment of the invention, terminal can determine the bad point of test fingerprint image according to the gray value of point each in test fingerprint image through but not limited to following manner:
Terminal calculates the difference between the gray value of the point and the gray value of the first reference point to the every bit in test fingerprint image, and the first reference point here is specially the right consecutive points of the point;
If the difference between the gray value of the point and the gray value of the first reference point is greater than preset threshold, then terminal is when the difference of the point and the average gray value of test fingerprint image is greater than the difference of the average gray value of the first reference point and test fingerprint image, the point is determined as to a bad point of test fingerprint image, otherwise the first reference point is determined as to a bad point of test fingerprint image.
Specifically, in some embodiment of the invention, terminal can also determine the bad point of test fingerprint image according to the gray value of point each in test fingerprint image through but not limited to following manner:
Terminal calculates the difference between the gray value of the point and the gray value of the second reference point to the every bit in test fingerprint image, and the second reference point here is the lower consecutive points of the point;
If the difference between the gray value of the point and the gray value of the second reference point is greater than preset threshold, then terminal is when the difference of the point and the average gray value of test fingerprint image is greater than the difference of the average gray value of the second reference point and test fingerprint image, the point is determined as to a bad point of test fingerprint image, otherwise by the second reference point be determined as one of test fingerprint image it is bad
Point.
In some embodiment of the invention, above two mode can also integrate use, to quickly determine out the bad point of test fingerprint image.
For example, Figure 11 (a) shows the schematic diagram that terminal in some embodiments of the invention determines bad point using pixel and the pixel being connected with the pixel right side;Figure 11 (b) shows the schematic diagram that terminal in some embodiments of the invention determines bad point using pixel and with the pixel being connected under the pixel.
Specifically, (gray value is represented sequentially as I to each point (i, j) with point (i+1, j) the progress gray value comparison below the point (i, j+1) and the point on the right of the point(i, j)、I(i, j+1)、I(i+1, j)), if gray value differences are more than threshold value fgrav, it will deviate from entire image average gray value (IMean) serious that point is labeled as bad point, to mark the isolated bad point of entire image;
The above process can be described as follows with formula:
IfAnd further confirm that | I(i,j)-Imean| > | I(i,j+1)-Imean| when, point (i, j) is confirmed as bad point;Otherwise confirming | I(i,j)-Imean| < | I(i,j+1)-Imean| when, point (i, j+1) is confirmed as bad point;
IfAnd further confirm that | I(i,j)-Imean| > | I(i+1,j)-Imean| when, point (i, j) is confirmed as bad point;Otherwise confirming | I(i,j)-Imean| < | I(i+1,j)-Imean| when, point (i+1, j) is confirmed as bad point.
Specifically, in some embodiment of the invention, the case where image grayscale uneven such non-fingerprint category feature for causing the collected fingerprint image of fingerprint device by uneven or ink the factors such as uneven of cover-plate glass, terminal can test fingerprint image according to the pre-stored data the uneven information of image grayscale, calibrate user fingerprint image in each point gray value.
Specifically, in some embodiment of the invention, the uneven information of the image grayscale of test fingerprint image can be the gray value by terminal according to every bit in test fingerprint image, behind the gray scale inclined surface for determining test fingerprint image, the inclination angle for the gray scale inclined surface determined and the intersecting lens of the gray scale inclined surface and standard water plane;
In turn, the uneven information of image grayscale of terminal test fingerprint image according to the pre-stored data, can calibrate the gray value of each point in user fingerprint image in the following manner:
Terminal calibrates the every bit in user fingerprint image according to the subpoint of above-mentioned gray scale inclination angle and this in standard water plane to the distance of above-mentioned intersecting lens to the gray value of the point.
Such as by taking fingerprint device is above-mentioned capacitive fingerprint sensing device as an example, Figure 12 (a) shows the non-uniform schematic diagram of test fingerprint image grayscale that fingerprint device acquires in some embodiments of the invention;Figure 12 (b) is the section schematic diagram of Figure 12 (a).
As shown in Figure 12 (a) and 12 (b), z-axis indicates that the semaphore that the sensing element of fingerprint device is sensed, x, y indicate the position of sensing original part, and origin is the minimum point of semaphore;
It can be seen that, due to glass or the technologic inhomogeneities of printing ink to manufacture, the capacitor a reference value of different location can be variant on the sensing original part array of fingerprint device, the collected test fingerprint image of fingerprint device gray value of different pixels position acquisition under identical triggering is caused to have deviation, so that the gray scale of fingerprint image generates certain gray scale inclination, the gray scale inclined surface as shown by Figure 12 (a) will can determine the intersecting lens at the corresponding inclination angle in gray scale inclined surface and the gray scale inclined surface and standard water plane according to the gray scale inclined surface.
Specifically, in some embodiment of the invention, terminal is according to the gray value of every bit in test fingerprint image, and behind the gray scale inclined surface for determining test fingerprint image, the intersecting lens of the gray scale inclined surface and standard water plane determined is represented by phase
Intersection function: row*x+col*y=0;
In turn, to the every bit in test fingerprint image, terminal can pass through formulaDetermine that the point projects to the subpoint of standard water plane to the distance of above-mentioned intersecting lens, it is assumed that using z indicate the point on each inclined surface to horizontal plane distance, it can be seen that z=tan (θ) * d, i.e.,To determine the corresponding inclination angle of every bit in test fingerprint image according to z and d.
In some embodiment of the invention, to the every bit in user fingerprint image, terminal, can be so as to be calibrated (for example carrying out multiplying etc. using the tan value at inclination angle) to the gray value of the point after determining the distance of the corresponding inclination angle of point (θ) and the point to intersecting lens (row*x+col*y=0).
Further, in some embodiments of the invention, terminal is in the non-fingerprint category feature information according to test fingerprint image, after being calibrated to user fingerprint image, further user fingerprint image can also be handled, former grayscale image is become into a width clearly two-value point and line chart, to realize the accurate extraction of fingerprint characteristic.Processing may include having image segmentation, enhancing, filtering, binaryzation and refinement, and the application will not be described further herein.
For example, based on test fingerprint image accessed by terminal in some embodiments of the invention illustrated in fig. 7, Figure 13 (a) shows the schematic diagram for the user fingerprint image that identical terminal is got in some embodiments of the invention.It can be seen that including bad point and the uneven such non-fingerprint category feature of gray scale in user fingerprint image shown in Figure 13 (a).
Figure 13 (b) shows the schematic diagram of the user fingerprint image after terminal calibrates user fingerprint image by the non-fingerprint category feature information of test fingerprint image according to the pre-stored data in some embodiments of the invention after obtained calibration.
It can be seen that bad point is not present in user fingerprint image after calibrating shown in Figure 13 (b), while gray scale inhomogeneities is adjusted, and picture quality is enhanced, the fingerprint category feature of user fingerprints, such as valley and a ridge, fairly obvious.
In summary, it can be seen that for the terminal for placing fingerprint device under the cover-plate glass of display screen, fingerprint collecting scheme provided by above-described embodiment through the invention, will test fingerprint image according to the pre-stored data non-fingerprint category feature information, calibrate user fingerprint image;And specifically, the fingerprint measuring head an of surfacing can be used to obtain test fingerprint image for terminal.Such as, it can make the preparatory collecting test fingerprint image of terminal using the fingerprint measuring head of plane in plant produced line, and extract and store the non-fingerprint category feature information of test fingerprint image, user fingerprint image is calibrated using the non-fingerprint category feature information of pre-stored test fingerprint image when SS later gets user fingerprint image in, to be effectively reduced since the factors such as cover-plate glass and processing technology are to adverse effect caused by user fingerprint image quality, reach the quality for promoting user fingerprint image, increases the effect of fingerprint recognition success rate.
Based on same inventive concept, present invention also provides a kind of device of fingerprint collecting, functional module in the device specifically being implemented in combination with by hardware, software or software and hardware, which can be applied to the terminal that fingerprint device is placed under the cover-plate glass of display screen.For example it can be applied on mobile phone 300 illustrated in fig. 3.
Figure 14 shows the structural schematic diagram of the device of fingerprint collecting provided in some embodiments of the invention.
As shown in figure 14, which includes:
Module 1401 is obtained, for obtaining the user fingerprint image of fingerprint device acquisition, wherein the user fingerprint image includes non-fingerprint category feature, it include that bad point and/or image grayscale are uneven in the non-fingerprint category feature;
Calibration module 1402 calibrates user fingerprint image for the non-fingerprint category feature information of test fingerprint image according to the pre-stored data;
Wherein, test fingerprint image is the fingerprint image that terminal is got in the fingerprint measuring head using a surfacing in the fingerprint collecting area of the terminal in advance, and fingerprint collecting area here is region corresponding with fingerprint device on cover-plate glass.
It in some embodiment of the invention, include bad point in non-fingerprint category feature;The calibration module 1402, is specifically used for:
The bad point information of test fingerprint image according to the pre-stored data, removes the bad point of the user fingerprint image.
In some embodiment of the invention, the calibration module 1402, is specifically used for:
According to the gray value of point each in the test fingerprint image, the bad point of the test fingerprint image is determined, and determine the location of pixels and gray value of the bad point of the test fingerprint image;
The point being located on the location of pixels in the user fingerprint image is determined as to the bad point of the user fingerprint image;
The gray value that the gray value of the bad point of the user fingerprint image is subtracted to the bad point being located on same pixel position in the test fingerprint image, the user fingerprint image after being calibrated.
In some embodiment of the invention, the calibration module 1402, is specifically used for:
To the every bit in the test fingerprint image, the difference between the gray value of the point and the gray value of the first reference point is calculated, first reference point is the right consecutive points of the point;
If the difference between the gray value of the point and the gray value of first reference point is greater than preset threshold, when being then greater than the difference of average gray value of first reference point and the test fingerprint image in the difference of the point and the average gray value of the test fingerprint image, the point is determined as to a bad point of the test fingerprint image, otherwise first reference point is determined as to a bad point of the test fingerprint image.
In some embodiment of the invention, the calibration module 1402, is specifically used for:
To the every bit in the test fingerprint image, the difference between the gray value of the point and the gray value of the second reference point is calculated, second reference point is the lower consecutive points of the point;
If the difference between the gray value of the point and the gray value of second reference point is greater than preset threshold, when being then greater than the difference of average gray value of second reference point and the test fingerprint image in the difference of the point and the average gray value of the test fingerprint image, the point is determined as to a bad point of the test fingerprint image, otherwise second reference point is determined as to a bad point of the test fingerprint image.
It in some embodiment of the invention, include that image grayscale is uneven in non-fingerprint category feature;The calibration module 1402, is specifically used for: the uneven information of image grayscale of the test fingerprint image according to the pre-stored data calibrates the gray value of each point in the user fingerprint image.
In some embodiment of the invention, the calibration module 1402, is specifically used for:
According to the gray value of every bit in the test fingerprint image, the gray scale inclined surface of the test fingerprint image is determined, and determine the inclination angle of the gray scale inclined surface and the intersecting lens of the gray scale inclined surface and standard water plane;
Every bit in the user fingerprint image calibrates the gray value of the point according to the subpoint of the gray scale inclination angle and this in the standard water plane to the distance of the intersecting lens.
Specifically, the device of the fingerprint collecting as provided by the above embodiment of the present invention is similar to the principle that embodiment of the method provided by present invention solves the problems, such as, thus the specific implementation of the device of fingerprint collecting provided by the above embodiment of the present invention and beneficial effect can implementation with method provided by present invention and beneficial effect cross-reference, overlaps will not be repeated.
It is schematical to the division of module in the embodiment of the present application, only a kind of logical function partition, there may be another division manner in actual implementation, in addition, each functional module in each embodiment of the application can integrate in a processor, it is also possible to physically exist alone, can also be integrated in two or more modules in a module.Above-mentioned integrated module both can take the form of hardware realization, can also be realized in the form of software function module.
Based on same inventive concept, present invention also provides a kind of terminals.Figure 15 shows the structural schematic diagram of terminal provided by some embodiments of the invention.
As shown in figure 15, the terminal 1500 may include have processor 1501, memory 1502, fingerprint device 1503 with
And the display screen not being shown in FIG. 15, wherein display screen includes cover-plate glass, and fingerprint device 1503 is placed under cover-plate glass, and region corresponding with fingerprint device 1503 is fingerprint collecting area on cover-plate glass;
Wherein, fingerprint device 1503, for acquiring fingerprint image;Memory 1502, for storing computer instruction;
Processor 1501 can be used for the computer instruction by calling memory 1502 to store, the method for executing fingerprint collecting provided by present invention.
Specifically, the situation that the cover-plate glass of 1500 display screen of terminal can be as shown in Figure 1 is complete plane in user oriented side, blind hole has been dug in 1503 side of object fingerprint device, to place fingerprint device 1503;Alternatively, the cover-plate glass of 1500 display screen of terminal can also be complete plane in user oriented side and 1503 side of object fingerprint device, fingerprint device 1503 is placed below cover-plate glass.
Specifically, processor 1501 can be a central processing module, or be digital processing module etc..Memory 1502 can be nonvolatile memory, such as hard disk or solid state hard disk etc., can also be volatile memory, such as random access memory.Memory can be used for carry or store have instruction or data structure form desired program code and can by any other medium of computer access, but not limited to this.
The terminal as provided by the above embodiment of the present invention is similar to the principle that embodiment of the method provided by present invention solves the problems, such as, thus the specific implementation of terminal provided by the above embodiment of the present invention and beneficial effect can implementation with method provided by present invention and beneficial effect cross-reference, details are not described herein by the application.
The specific connection medium between above-mentioned processor 1501, memory 1502 and fingerprint device 1503 is not limited in the embodiment of the present application.The embodiment of the present application in Figure 15 to be connected as example by bus between processor 1501, memory 1502 and fingerprint device 1503, Figure 15 is indicated using a hollow double arrowed line, it is not intended that only a bus or a type of bus, connection type between other components, it is only to be schematically illustrated, does not regard it as and be limited.Bus can be divided into address bus, data/address bus, control bus etc..
The embodiment of the invention also provides a kind of readable storage medium storing program for executing, and for being stored as the software instruction of execution needed for executing above-mentioned processor, it includes the programs for execution needed for executing above-mentioned processor.
It should be understood by those skilled in the art that, embodiments herein can provide as method, system or computer program product.Therefore, the form of complete hardware embodiment, complete software embodiment or embodiment combining software and hardware aspects can be used in the application.Moreover, the form for the computer program product implemented in the computer-usable storage medium (including but not limited to magnetic disk storage, CD-ROM, optical memory etc.) that one or more wherein includes computer usable program code can be used in the application.
The application is that reference is described according to the flowchart and/or the block diagram of the present processes, equipment (system) and computer program product.It should be understood that the combination of process and/or box in each flow and/or block and flowchart and/or the block diagram that can be realized by computer program instructions in flowchart and/or the block diagram.These computer program instructions be can provide to the processor of general purpose computer, special purpose computer, Embedded Processor or other programmable data processing devices to generate a machine, so that generating by the instruction that computer or the processor of other programmable data processing devices execute for realizing the device for the function of specifying in one or more flows of the flowchart and/or one or more blocks of the block diagram.
These computer program instructions, which may also be stored in, to be able to guide in computer or other programmable data processing devices computer-readable memory operate in a specific manner, so that instruction stored in the computer readable memory generates the manufacture including command device, which realizes the function of specifying in one or more flows of the flowchart and/or one or more blocks of the block diagram.
These computer program instructions also can be loaded onto a computer or other programmable data processing device so that on a computer or other programmable device execute series of operation steps to generate computer implemented processing, thus computer or other
The instruction executed on programmable device provides the step of for realizing the function of specifying in one or more flows of the flowchart and/or one or more blocks of the block diagram.
Obviously, those skilled in the art can carry out various modification and variations without departing from scope of the present application to the application.If then the application is also intended to include these modifications and variations in this way, these modifications and variations of the application belong within the scope of the claim of this application and its equivalent technologies.