Embodiment
Example embodiment is described more fully with referring now to accompanying drawing.However, example embodiment can be with a variety of shapes
Formula is implemented, and is not understood as limited to example set forth herein;On the contrary, thesing embodiments are provided so that the disclosure will more
Fully and completely, and by the design of example embodiment those skilled in the art is comprehensively conveyed to.Accompanying drawing is only the disclosure
Schematic illustrations, be not necessarily drawn to scale.Identical reference represents same or similar part in figure, thus
Repetition thereof will be omitted.
Implement in addition, described feature, structure or characteristic can be combined in any suitable manner one or more
In mode.In the following description there is provided many details so as to provide fully understanding for embodiment of this disclosure.So
And, it will be appreciated by persons skilled in the art that the technical scheme of the disclosure can be put into practice and one in the specific detail is omitted
Or more, or can be using other methods, constituent element, device, step etc..In other cases, it is not shown in detail or describes
Known features, method, device, realization, material are operated to avoid that a presumptuous guest usurps the role of the host so that each side of the disclosure becomes mould
Paste.
Some block diagrams shown in accompanying drawing are functional entitys, not necessarily must be with physically or logically independent entity phase
Correspondence.These functional entitys can be realized using software form, or in one or more hardware modules or integrated circuit in fact
These existing functional entitys, or realize that these functions are real in heterogeneous networks and/or processor device and/or microcontroller device
Body.
Embodiment described in following exemplary embodiment does not represent all realities consistent with the utility model
Apply mode.On the contrary, they be only with it is being described in detail in such as appended claims, of the present utility model in terms of some it is consistent
The example of apparatus and method.
Fig. 1 schematically shows a kind of square of smart machine with augmented reality according to disclosure example embodiment
Figure.
As shown in figure 1, the smart machine 10 with augmented reality can include:Image sensing component 110, inertial sensor
Component 120, the first data transmission blocks 130 and the first data reception module 140.
Wherein image sensing component 110 can be used for obtaining the image information in view area.
For example, image sensing component 110 can using monocular cam, binocular camera, three mesh shooting it is first-class in appoint
Meaning is a kind of.
Here image sensing component 110 is mainly used in obtaining the image information in its visual range.Wherein binocular camera shooting
Anthropoid eyes, can determine distance by the disparity computation of two images.
Inertia sensing device assembly 120 can be used for the azimuth information for detecting described image sensory package.
For example, inertia sensing device assembly 120 can include in accelerometer, gyroscope, magnetometer etc. any one or
Person is a variety of.In one embodiment, wherein the magnetometer and/or gyroscope are used for the direction letter for detecting described image sensory package
Cease and be vertically to the earth's core axis of orientation angle information.
First data transmission blocks 130, which can be used for sending described image information and the azimuth information to an electronics, to be set
It is standby, wherein the electronic equipment carries out scene Recognition according to described image information and the azimuth information and obtains analysis result.
Wherein, the electronic equipment can be the arbitrary electricity such as smart mobile phone, tablet personal computer, desktop computer, server
Sub- equipment, the disclosure is not construed as limiting to this.The electronic equipment carries out scene according to described image information and the azimuth information
Recognize and obtain the detailed of analysis result and realize that step may be referred to the embodiment shown in following Fig. 3, will not be described in detail herein.
First data reception module 140 can be used for receiving the analysis result that the electronic equipment is returned.
In the exemplary embodiment, the data that the first data transmission blocks 130 and the first data reception module 140 are realized are received
Hair function can be realized by the way of wireline cable or radio communication.Wireless mode can include:Wifi connected modes;Or
Person's bluetooth connection mode;Or infrared connection mode etc..
Wherein, smart machine 10 can be intelligent glasses, the smart machine for aiding in automatic Pilot etc., and the disclosure is not made to this
Limit.Carried out in the following embodiments so that smart machine 10 is intelligent glasses, the electronic equipment is smart mobile phone as an example detailed
Describe in detail bright.
Illustrate the intelligent glasses in the present exemplary embodiment with reference to Fig. 2A -2C, wherein Fig. 2A schematically shows root
According to a kind of stereogram of intelligent glasses of disclosure example embodiment;Fig. 2 B schematically show the intelligent glasses shown in Fig. 2A
Rearview;Fig. 2 C schematically show the upward view of the intelligent glasses shown in Fig. 2A.
In the exemplary embodiment, the intelligent glasses can include:Mirror holder 1, including the picture frame 11 of left and right two;Eyeglass 2,
It is arranged in the picture frame 11 of left and right two of mirror holder 1;The temple 3 of left and right two, its two ends respectively with mirror holder 1 are hinged;Inertia sensing
Device assembly (not shown) includes many sub- sensors, and the multiple sub- sensor can be respectively arranged at following at least one
Place:Mirror holder 1, eyeglass 2, temple 3.
It should be noted that in the exemplary embodiment, eyeglass 2 is detachably arranged in picture frame 2, you can by mirror
Whether piece 2 is taken off, there is eyeglass 2 to have no effect on the realization of the utility model purpose in disclosure embodiment.
In one embodiment, eyeglass 2 can be the eyeglass with display screen functions, can show that smart mobile phone is sent thereon
Video or picture or word etc..
In the exemplary embodiment, the inertia sensing device assembly can include accelerometer, gyroscope, magnetometer etc..
Crystal modification this characteristic that wherein described accelerometer make use of it internal to cause due to acceleration.Due to this
Individual deformation can produce voltage, as long as calculating the relation produced between voltage and the acceleration applied, it is possible to by acceleration
Change into voltage output.Certainly, also many other methods make acceleration transducer, such as capacity effect, thermal effect
Should, luminous effect, but its most basic principle, which is all due to acceleration, to be produced some medium and is deformed, and is deformed by measuring its
Measure and change into voltage output with interlock circuit.On the one hand, it can be measured due to acceleration caused by gravity by accelerometer,
So as to calculate the angle of inclination of the intelligent glasses with respect to the horizontal plane.It can be used for judging wearing for the intelligent glasses
Whether the walking postures of person tilt.On the other hand, by analyzing dynamic acceleration, the speed of intelligent glasses movement can be analyzed
Degree, the i.e. speed of travel of the wearer of intelligent glasses.
The gyroscope can use three-axis gyroscope, and the operation principle of three-axis gyroscope is by measuring three-dimensional system of coordinate
Angle between the vertical axis and equipment of interior gyrorotor, and angular speed is calculated, differentiate that object exists by angle and angular speed
The motion state of three dimensions.Three-axis gyroscope can determine 6 direction (compound directions such as up, down, left, right, before and after simultaneously
Equally can be analyzed to triaxial coordinate), it finally can determine whether out the motion track and acceleration of equipment.That is gyroscope is by surveying
The rotation status of itself is measured, equipment current motion state is judged, is forward, back, up, downwards, to the left or to the right, to be
Accelerate (angular speed) or slow down (angular speed), can realize.
The magnetometer can be used for test magnetic field intensity and direction, the orientation of positioning intelligent glasses, can measure intelligence
Glasses and the angle on the four direction of all directions, you can with the direction of travel for the wearer for detecting intelligent glasses.
In the exemplary embodiment, the Brilliant Eyes can be calculated using the magnetometer and the accelerometer simultaneously
The azimuth information of mirror, the azimuth information calculated needs just obtain in combination with magnetic direction and direction motion conditions.
In one embodiment, by above-mentioned many sub- sensors measurements of the intelligent glasses obtain the intelligent glasses or its
Multiple state parameters of wearer, and the plurality of state parameter is sent to the smart mobile phone electrically connected with the intelligent glasses, intelligence
Can mobile phone processing module by being implanted into corresponding software for calculating the Brilliant Eyes according to the multiple state parameter
Angle of inclination, the translational speed of the intelligent glasses, the azimuth information of the intelligent glasses of mirror with respect to the horizontal plane etc..
In another embodiment, the inertia sensing device assembly can also include distance measuring sensor, can be surveyed according to described
Away from the obstacle distance measured by sensor, early warning is sent to the wearer of intelligent glasses.
Rearview with reference to shown in Fig. 2 B, the intelligent glasses can also include USB interface 4, and USB interface 4 can pass through USB
The intelligent glasses are electrically connected by line with the electronic equipment (such as smart mobile phone), and the USB line can include supplying simultaneously
Electric line and data circuit, intelligent glasses can obtain power supply from the electronic equipment by the USB line and supply, it is possible to logical
The data circuit for crossing the USB line realizes data transmit-receive function between the intelligent glasses and the smart mobile phone.
In one embodiment, the intelligent glasses itself do not include any power module or only include an electricity very
The power module (such as button cell) of the equal very little of small, volume and weight, it mainly passes through electricity of the USB line from smart mobile phone
Source module (such as battery) obtains power supply supply, can so mitigate the weight of intelligent glasses, improves the comfort level of wearer.Together
When, if installing battery on the intelligent glasses, wherein being accomplished by weighing in battery durable and fuselage weight, both take one
It is difficult to ensure that user uses for a long time, therefore not higher than the intelligent glasses of 1.2w power consumptions coordinate smart mobile phone more than sufficient, therefore
Use daily enough;The service time that battery saving mode extends intelligent glasses can also be added, and at the end of going out action outside,
Intelligent glasses can just be closed.The smart mobile phone can be powered using battery, and the battery is using charging circuit and lithium battery
With reference to being powered coupled to USB interface for intelligent glasses.
And in another embodiment, the intelligent glasses itself can include power module, it need not pass through intelligent hand
The power module of machine is supplied to obtain power supply.
In the exemplary embodiment, USB interface 4 is arranged in the temple 3 of the intelligent glasses (for example, the one of temple 3
End) and USB interface 4 to after-opening (as shown in Figure 2 B) and/or downwardly open.Wherein USB interface 4 is conducive to intelligence to after-opening
Glasses being worn and removing, without catching on ear when removing.
It should be noted that, although one end of temple 3 in Fig. 2 B only on the left of intelligent glasses shows a USB interface 4, but
The disclosure is not limited to this, for example, it is also possible to one end of temple 3 on the right side of intelligent glasses sets another USB interface 4 simultaneously,
Or the USB interface 4 of 3 one end equipment of temple one only on the right side of intelligent glasses.
In the exemplary embodiment, the intelligent glasses can also include:Microphone (not shown), is arranged on mirror holder
On 1, sound electric wave signal is converted to for the electronic equipment to be returned to the analysis result of the intelligent glasses;Osteoacusis ear
Machine 5, is arranged on the sound electric wave signal that can be used for changing the microphone in temple 3 and is converted to osteoacusis vibration signal.
Osteoacusis is a kind of sound conduction mode, i.e., sound is converted into the mechanical oscillation of different frequency, passes through the cranium of people
Bone, osseous labyrinth, inner ear lymph transmission, spiral organ, auditory nerve, auditory center transmit sound wave.Produced with respect to vibrating diaphragm
The classical sound conduction mode of sound wave, osteoacusis eliminates the step of many sound waves are transmitted, and can realize in a noisy environment clear
Clear sound-reducing, and sound wave also will not have influence on other people because of spreading in atmosphere.Utilize these bone conduction technology systems
The earphone made, referred to as bone conduction earphone, also referred to as osophone, bony earphone, bone pass earphone and bone sensing earphone.
It should be noted that, although each respectively in the temple 3 of the left and right of intelligent glasses two in Fig. 2A symmetrically show one
To bone conduction earphone 5, but the disclosure is not limited to this, in other embodiments, can also be set only in the temple 3 in left side
One bone conduction earphone 5, or one bone conduction earphone 5 of setting only in the temple 3 on right side.
In the present embodiment, acoustic information is conducted to by visually impaired people by bone conduction earphone, for visually impaired people,
Normal hearing passage perceives that the world is particularly significant to it, and intelligent glasses should not hinder its normal hearing passage.Passed by bone
Guide lug machine, can pass on extra acoustic information to it while its normal hearing passage is not hindered.
In another embodiment, bone conduction earphone 5 is rotatable, can so be adapted to different head dummys.
In the exemplary embodiment, bone conduction earphone 5 is arranged at the ear of the wearer in temple 3 and close to intelligent glasses
Position, the position sets the voice broadcast for being easy to wearer to be more easy to hear the microphone, and the content of report passes for smart mobile phone
The voice output information that the analysis result brought is converted into.In one embodiment, bone conduction earphone 5 can also be according to actual feelings
The degree of danger of condition, tunes up or turns down volume to remind visually impaired people.
In the exemplary embodiment, the intelligent glasses can also include image sensing component.With continued reference to shown in Fig. 2A
Embodiment, described image sensory package includes binocular camera (left camera 61 and right camera 62), and the binocular takes the photograph
As head is respectively arranged at the upside of two picture frames 11 in the left and right.
In other embodiments, described image sensory package can also be arranged on the eyeglass 2 of intelligent glasses, the disclosure pair
Quantity, the set location of image sensing component are not especially limited, and it is used to gather the image information in front of the intelligent glasses,
And can be by USB line by described image information transmission to the electronic equipment such as smart mobile phone.This receives described image
The smart mobile phone of information can calculate the obstacle information analyzed in described image information.
In the exemplary embodiment, the intelligent glasses use split-type design, and are that electrical connection smart mobile phone is used
's.Be free of in the intelligent glasses or contain computing unit on a small quantity, and major part is migrated to the processing of data to intelligent hand
Generator terminal is carried out, and can so be greatly reduced the volume of intelligent glasses, be mitigated the heating near the wearer's face of the intelligent glasses
Amount, because alleviating heating problem, so as to improve wear comfort.On the other hand, it is required for daily as visually impaired people
Trip aid, glasses form is convenient for carrying continuous wear not easy to lose but long-term has strict to product weight
It is required that, carried out in the embodiment of the present disclosure by the way that the functions such as the processing of data, power supply supply are migrated to mobile phone end, Ke Yiji
The weight of big mitigation intelligent glasses, facilitates user's long periods of wear.Meanwhile, battery, the transfer of computing unit can be very good solution
The certainly heating problem of intelligent glasses.
And migrate the processing of data to smart mobile phone, the processing of data can be entered by the APP installed on smart mobile phone
OK, later release upgrading can be obtained by way of APP updates so that alleviate user obtain update function into
This.Accessible design is all added in the operating system of current smart mobile phone, many visually impaired peoples have been able to skillfully now
Use smart mobile phone, for example once they because be difficult to distinguish the true and false amount of money of banknote and the payment link of worry because mobile phone branch
Pay and be addressed, net about car can also solve they call a taxi difficulty the problems such as ... therefore smart mobile phone and intelligent glasses are combined,
Operating habit need not carry out excessive adjustment.
In the exemplary embodiment, smart mobile phone includes battery and processing module, USB interface, and USB line is inserted respectively
The USB interface of smart mobile phone and the USB interface of intelligent glasses, intelligent glasses obtain power supply from smart mobile phone by USB line and supplied,
Intelligent glasses are gathered after the data of surrounding environment by image sensing component and inertial sensing component, and data are passed through into the USB line
Transmit to the smart mobile phone and carry out calculating analysis, the Calculation results of the smart mobile phone are back to the intelligence by USB line transmission
Can glasses, the ear for the user that the intelligent glasses can be by above-mentioned bone conduction earphone return analysis result to the intelligent glasses
Piece the inside.
In the exemplary embodiment, user can be grasped by the application program (APP) installed on the smart mobile phone
Make to realize control to the intelligent glasses, or the voice of user can be received by the microphone on the smart mobile phone
Instruction, is realized to the Voice commands of the intelligent glasses, or also sets up on the intelligent glasses voice input module, institute's predicate
Sound input module can be arranged at the either end in the two ends of mirror holder 1, for receiving speech input information (for example, institute's predicate
Sound inputs the objective that the wearer that information can be the intelligent glasses wants) and be back to the speech input information
The smart mobile phone, the smart mobile phone is used to recognize the speech input information to determine the objective, or passes through the intelligence
Camera on energy glasses gathers the gesture motion of user, and the gesture motion is identified, so as to realize to the intelligence
Glasses either the control of the smart mobile phone or can by the inertial sensing component on the intelligent glasses realize to wearing the intelligence
Can glasses user head pose detection, and using the head pose as the intelligent glasses or smart mobile phone control
Instruction.The intelligent glasses are controlled according to the control instruction to the intelligent glasses (in application program).For example, logical
Picture page turning can be controlled by crossing gesture, shoot photo, enquiring route information etc..
By above-mentioned design, intelligent glasses are used as data acquisition unit and man-machine interaction unit, it is possible to achieve from approximate
The world is observed in the visual field of people, is realized " see i.e. obtained by ".
With continued reference to the embodiment shown in Fig. 2A, the intelligent glasses can also include one first button 71 (short-press key) and
One second button 72 (long keying).In one embodiment, the short-press key 71 and the long keying 72 can set it to have solely respectively
Vertical function, such as short-press key 71 can be used for the power switch function of realizing intelligent glasses and/or electronic equipment, long keying 72
It can be used for realizing that the volume add-minus function of intelligent glasses and/or electronic equipment (can be arranged on the side direction of long keying 72
Increase volume during upper pressing, volume is reduced when opposite side side is pressed up).In another embodiment, the short-press key 71 and should
Long keying 72 can also set combination to realize different functions, for example press the short-press key 71 simultaneously and the long keying 72 realize it is double
Hit function or click function etc..The function that the specific short-press key 71 and the long keying 72 can be realized can be carried out in systems
Autonomous to set, the disclosure is not construed as limiting to this.
With reference to Fig. 2 C embodiment, the intelligent glasses can also include multiple heat emission holes 8, and the multiple heat emission hole can be with
It is arranged on mirror holder 1, but the specific set location of heat emission hole can flexibly be selected according to specific circuit layout in the disclosure
Select.Although being that 2 heat emission holes 8 are respectively symmetrically shown in the left and right sides of mirror holder 1 in Fig. 2 C, specific radiating hole number and
The layout disclosure of heat emission hole is not construed as limiting to this.In another embodiment, the multiple heat emission hole 8 can be replaced with microphone
Generation.
The smart machine with augmented reality that the utility model embodiment is provided, it for example can be using intelligent glasses
Form, is worn on the head of visually impaired people (such as blind person), and can solving visually impaired people, there is provided to outside when going on a journey alone
Intelligence guide under barrier, such as roadblock, the dangerous situation such as trap, or even intelligent sound can also be carried out by bone conduction earphone carry
The function such as awake.On the other hand, also speech navigation function can be provided for visually impaired people.It can not only be shown the way for the voice of blind person,
Voice broadcast, voice reminder can also alarm etc. under unsafe condition.For example, when blind userses wear the intelligent glasses
Advance, when direct of travel mistake, walking postures are tilted or the speed of travel is too fast, carry out voice broadcast and send prompting sound
Voice messaging, the voice messaging can be:" dangerous, direct of travel mistake " " gait of march is too fast, please slow down traveling speed
Degree " ... etc..
Wherein avoidance is one of major function of intelligent glasses, and the depth image gathered by binocular camera is in intelligent hand
Generator terminal is shown as example red green two states of different colours, and green can be set to represent the ground that can walk, red then represent
Obstacle, can during normal use provide gentle voice messaging such as piano prompt tone in bone conduction earphone, if close
Obstacle can then become gentle prompt tone originally hurriedly to point out avoidance as radar for backing car.
The system of the intelligent glasses and smart mobile phone composition first judges where be ground, can define and be above the ground level 5 centimetres
Be defined as obstacle, be then considered as hole less than ground 5cm, and visually impaired people is general in itself also has blind man's stick auxiliary with exploring road
Shape, both are combined so can smoothly advance.
System mainly detects the crown to the obstacle of this height region of pin, and underfooting has certain blind area, works as binocular camera
Originally the obstacle assert walks close to enter blind area with visually impaired people's, and system prediction obstacle has arrived underfooting meeting voice message " please be low
Head is checked ", can be that scope indoors can be in 5m to the prompting of barrier in outdoor scope in 2m, system can be with
According to the suitable induction range of barrier distributional analysis adjust automatically in camera view.
The danger that visually impaired people most often faces is not derived from mobile article, as the moving disorders such as the vehicle of contact can be sent out
Go out sound, the visually impaired people's hearing for losing some or all of vision is sharper, this kind of obstacle typically can also be hidden, often
It is that noiseless obstacle can allow them injured, e.g. hangs branch, iron wire on the way, horizontal railing in the presence of, mainly by blind
It is that can not detect some hanging or tiny threats that cane, which explores they that move ahead, therefore the intelligent glasses can help them to detect
All big and small far and near obstacles gone out at the moment, and give and point out.For example, real-time photography during visually impaired people's traveling;When running into barrier
When hindering thing, the obstacle information in the image obtained by shooting is calculated;Call voice messaging to carry out voice broadcast, send prompting sound
Sound, such as " there is obstacle in 5 meters of front " " please detour " etc..The utility model embodiment is by recognizing visually impaired people's walking road
Road preceding object, ensures that it is gone on a journey safely.Meanwhile, the speed of travel of visually impaired people and ordinary people are similar, in 1.5m/s or so,
It disclosure satisfy that the demand of avoidance substantially under such translational speed.
On the other hand, system may also help in visually impaired people and identify including traffic lights, zebra stripes, stair, door, passage etc.
Them are helped to move the object of trip, while word, face, banknote contribute to the object of their daily lifes also to carry out very well
Identification, trip that can be according to visually impaired people and daily life demand, define a variety of articles that can be recognized, are carried out after identification
Voice broadcast.
In another embodiment, in the case of no auxiliary, visually impaired people is easy to get lost, and once get lost be difficult to
Retrieve again, therefore positioned, navigated by the intelligent glasses invocation map, help visually impaired people to quickly find purpose
Ground.By by more than function individually or merge in the intelligent glasses, by help visually impaired people safety freely go on a journey with
Life.
In the exemplary embodiment, the intelligent glasses can also include light emitting module, and the light emitting module can be used for
The intelligent glasses are aided in obtain image information in night.Many visually impaired peoples are engaged in massage work and walked outside at night, it is necessary to come off duty,
The problem of intelligent glasses shooting image of this in night environment can be solved by the light emitting module.
Above-described embodiment is the intelligent glasses form used in being gone on a journey with the smart machine applied to auxiliary visually impaired people,
When visually impaired people wears the intelligent glasses, external information is gathered by two cameras on glasses, and calculate barrier automatically
Spatial distribution and identification object, then convert the result to audio signal, user passed to by conducting earphone, help to regard
Hinder the cognitive surrounding enviroment of personage.In other embodiments, vision can also be given to other all smart machines:Nobody
Machine, unmanned vehicle, robot, VR, AR etc., as long as being installed on unmanned plane, unmanned vehicle etc. in the intelligent glasses and the smart mobile phone
Visual identity functional unit, machine is equivalent to obtain a pair of " eyes ", has visually-perceptible, pass through data wire and hand
Machine connect, camera collection external information, environment is accurately perceived, then information handled, most backward nobody
The control system of machine, unmanned vehicle, robot etc. sends instruction, realizes specific function.
Fig. 3 schematically shows the block diagram of a kind of electronic equipment according to disclosure example embodiment.
As shown in figure 3, the electronic equipment 20 can include the second data reception module 210, processing module 220 and second
Data transmission blocks 230.
Wherein the second data reception module 210 can be used for receiving the image letter in the view area that a smart machine is sent
Cease and for the azimuth information for the image sensing component for obtaining described image information.
Wherein, the smart machine is referred to the embodiment shown in above-mentioned Fig. 1 and Fig. 2, will not be repeated here.
Processing module 220 can be used for carrying out scene Recognition according to described image information and the azimuth information and be divided
Analyse result.
Processing module 220 can be MCU (Micro Control Unit, micro-control unit), refer to extensive collection
Into the appearance and its development of circuit, by the CPU of computer, RAM, ROM, timer conter and a variety of I/O Interface integrations a piece of
On chip, the computer of chip-scale is formed, is that various combination control is done in different application scenarios.
Second data transmission blocks 230 can be used for sending the analysis result to the smart machine.
In the exemplary embodiment, processing module 220 can include:The view area according to described image information acquisition
The set of interior point and the colouring information of each point;Coordinate position of each point in the first coordinate system is obtained and each by preset algorithm
The distance of point;Obtain each according to the distance of coordinate position of each point in first coordinate system and each point, the azimuth information
Coordinate position o'clock in the second coordinate system.
In the exemplary embodiment, processing module 220 can also include:According to seat of each point in second coordinate system
The colouring information of cursor position and each point, carries out scene Recognition;Result to the scene Recognition is analyzed, and obtains the analysis
As a result.
Specifically, giving an absolute coordinate system X-Y-Z, it is assumed that the described image sensory package visual field of the smart machine
In scene in collection a little be combined into N, wherein the coordinate positions of any point n in three dimensions are by (x in set Nn, yn,
zn) represent.
Wherein, described image sensory package (such as monocular, binocular or many mesh cameras) can be with light stream (Optical
Flow) method, range of triangle method or two methods integrate and use the coordinate position (x for carrying out measurement point nn, yn, zn) and its arrive
Camera lens apart from dn;Wherein, it may determine that the shooting using the magnetometer and gyroscope in the inertia sensing device assembly
Head camera lens towards (all directions) directional information onAnd the angle information t with the axis of orientation for being vertically to the earth's coren.By xn、
yn、zn、dn、on、tn, X-Y-Z these information, can accurately draw the spatial coordinate locations of point n on earth.Institute in the comprehensive visual field
Have point n spatial coordinate location, can accurately analyze, understand, recording in scene in the visual field sky a little on earth
Between coordinate position.
Light stream is a kind of expression way of simple and practical image motion, is normally defined the image in an image sequence
Table of the movement velocity of point in the apparent motion of luminance patterns, i.e. space object surface on the imaging plane of vision sensor
Reach.This definition thinks that light stream only represents a kind of Geometrical change.Light stream is newly defined as dynamic by Negahdaripour within 1998
Comprehensive expression of Geometrical change and the radiancy change of image.The research of light stream is to utilize the pixel intensity data in image sequence
Time domain change and correlation determine " motion " of respective location of pixels, i.e. the change in time of research gradation of image and scape
As middle object structures and its relation of motion.Generally, light stream in camera motion, scene target motion or both be total to
Caused by the relative motion produced with motion.
Optical flow approach detects that the general principle of moving object is:A speed arrow is assigned to each pixel in image
Amount, which forms an image motion, the point one on point and three-dimensional body on a particular moment of motion, image
One correspondence, this corresponding relation can be obtained by projection relation, and according to the velocity feature of each pixel, image can be entered
Mobile state is analyzed.If not having moving object in image, light stream vector is consecutive variations in whole image region.Work as image
In when having moving object, there is relative motion in target and image background, velocity certainty and neighborhood that moving object is formed
Background velocity vector is different, so as to detect moving object and position.The advantage of optical flow method is that light stream not only carries motion
The movable information of object, but also the abundant information about scenery three-dimensional structure is carried, it can not know appointing for scene
In the case of what information, Moving Objects are detected.
The operation principle of range of triangle method is infrared transmitter according to certain angular emission infrared beam, when running into thing
After body, light beam can be reflected, and after the infrared light reflected is detected by imaging sensor (such as CCD), can be obtained
A deviant L, using triangle relation, be aware of launch angle a, offset distance L, central moment X, and filter focal length f
After, sensor to object can just be calculated apart from D by geometrical relationship.
Using in the visual field spatial coordinate location information a little on earth, can accurately construct high-precision map.
Using in the visual field spatial coordinate location information a little on earth, with reference to the colouring information of every bit, image point can be done
Cut, scene understands and pattern-recognition etc..
In the exemplary embodiment, described image information can also be pre-processed, is implementing specific meter to image
Calculation machine visible sensation method is extracted before certain specific information, in advance image is handled by a kind of or certain methods first,
To meet the requirement of subsequent image processing, including secondary sample, smoothing denoising improves contrast etc..
In exemplary embodiment, the analysis result includes:Obstacle information in the view area.
Typical case's application of the utility model embodiment is as follows:One regards in unmanned, full-automatic unmanned dolly, auxiliary
In the scene for hindering personage's trip, a crucial application is to identify and distinguish between the road surface that can be advanced and can stop the obstacle of traveling.Barrier
The object advanced can be influenceed including protrusion road surface, the object of traveling can be influenceed from hanging low in the air or less than road surface by hindering
Sunk area (including hole, hole).Identify after road surface, the traveling of unmanned vehicle can be instructed, and pass by bone conduction earphone
Lead and aid in it to go on a journey to visually impaired people.Whole system automatic data collection environmental information, automatically analyzes and provides analysis result and action
It is recommended that.
Fig. 4 schematically shows the block diagram of another electronic equipment according to disclosure example embodiment.
As shown in figure 4, electronic equipment 500 includes:Processor 502;Storage for storing the executable instruction of processor 602
Device 504.
The processor 502 can be configured as:Receive the image information and use in the view area of smart machine transmission
In the azimuth information for the image sensing component for obtaining described image information;Carried out according to described image information and the azimuth information
Scene Recognition simultaneously obtains analysis result;The analysis result is sent to the smart machine.
For example, electronic equipment 500 can be smart mobile phone, computer, digital broadcast terminal, messaging devices, game
Console, tablet device, Medical Devices, body-building equipment, personal digital assistant etc..
Reference picture 4, electronic equipment 500 can include following one or more assemblies:Processing assembly 501, memory 504,
Power supply module 505, multimedia groupware 506, audio-frequency assembly 507, the interface 503 of input/output (I/O), sensor cluster 509,
And communication component 508.
The integrated operation of the usual control electronics 500 of processing assembly 501, such as with display, data communication, camera operation
The associated operation with record operation.Processing assembly 501 can carry out execute instruction including one or more processors 502, with complete
Into all or part of step of above-mentioned method.In addition, processing assembly 501 can include one or more modules, it is easy to processing
Interaction between component 501 and other assemblies.For example, processing assembly 501 can include multi-media module, to facilitate multimedia group
Interaction between part 506 and processing assembly 501.
Memory 504 is configured as storing various types of data supporting the operation in equipment 500.These data are shown
Example includes the instruction of any application program or method for being operated on electronic equipment 500, message, picture, video etc..Storage
Device 504 can realize that such as static random is deposited by any kind of volatibility or non-volatile memory device or combinations thereof
Access to memory (SRAM), Electrically Erasable Read Only Memory (EEPROM), Erasable Programmable Read Only Memory EPROM
(EPROM), programmable read only memory (PROM), read-only storage (ROM), magnetic memory, flash memory, disk or light
Disk.
Power supply module 505 provides electric power for the various assemblies of electronic equipment 500.Power supply module 505 can include power supply pipe
Reason system, one or more power supplys, and other components associated with generating, managing and distributing electric power for electronic equipment 500.
Multimedia groupware 506 is included in the screen of one output interface of offer between the electronic equipment 500 and user.
In certain embodiments, screen can include liquid crystal display (LCD) and touch panel (TP).If screen includes touch surface
Plate, screen may be implemented as touch-screen, to receive the input signal from user.Touch panel includes one or more touch
Sensor is with the gesture on sensing touch, slip and touch panel.The touch sensor can not only sensing touch or slip
The border of action, but also the detection duration related to the touch or slide and pressure.In certain embodiments,
Multimedia groupware 506 includes a front camera and/or rear camera.When equipment 500 is in operator scheme, mould is such as shot
When formula or video mode, front camera and/or rear camera can receive the multi-medium data of outside.Each preposition shooting
Head and rear camera can be a fixed optical lens systems or with focusing and optical zoom capabilities.
Audio-frequency assembly 507 is configured as output and/or input audio signal.For example, audio-frequency assembly 507 includes a Mike
Wind (MIC), when electronic equipment 500 is in operator scheme, when such as call model, logging mode and speech recognition mode, microphone
It is configured as receiving external audio signal.The audio signal received can be further stored in memory 504 or via logical
Letter component 508 is sent.In certain embodiments, audio-frequency assembly 507 also includes a loudspeaker, for exports audio signal.
I/O interfaces 503 is provide interface between processing assembly 501 and peripheral interface module, above-mentioned peripheral interface module can
To be keyboard, click wheel, button etc..These buttons may include but be not limited to:Home button, volume button, start button and lock
Determine button.
Sensor cluster 509 includes one or more sensors, the state for providing various aspects for electronic equipment 500
Assess.For example, sensor cluster 509 can detect opening/closed mode of equipment 500, the relative positioning of component, such as institute
Display and keypad that component is electronic equipment 500 are stated, sensor cluster 509 can also detect electronic equipment 500 or electronics
The position of 500 1 components of equipment changes, the existence or non-existence that user contacts with electronic equipment 500, the orientation of electronic equipment 500
Or acceleration/deceleration and the temperature change of electronic equipment 500.Sensor cluster 509 can include proximity transducer, be configured to
The presence of object near being detected in not any physical contact.Sensor cluster 509 can also include optical sensor, such as
CMOS or ccd image sensor, for being used in imaging applications.In certain embodiments, the sensor cluster 509 can be with
Including acceleration transducer, gyro sensor, Magnetic Sensor, pressure sensor or temperature sensor.
Communication component 508 is configured to facilitate the communication of wired or wireless way between electronic equipment 500 and other equipment.
Electronic equipment 500 can access the wireless network based on communication standard, such as WiFi, 2G or 3G, or combinations thereof.Show at one
In example property embodiment, communication component 508 receives broadcast singal or broadcast from external broadcasting management system via broadcast channel
Relevant information.In one exemplary embodiment, the communication component 508 also includes near-field communication (NFC) module, short to promote
Cheng Tongxin.For example, radio frequency identification (RFID) technology, Infrared Data Association (IrDA) technology, ultra wide band can be based in NFC module
(UWB) technology, bluetooth (BT) technology and other technologies are realized.
In exemplary embodiment, electronic equipment 500 can be by one or more application specific integrated circuits (ASIC), numeral
Signal processor (DSP), digital signal processing appts (DSPD), PLD (PLD), field programmable gate array
(FPGA), controller, microcontroller, microprocessor or other electronic components are realized, for performing the above method.
In exemplary embodiment, a kind of non-transitorycomputer readable storage medium including instructing is additionally provided, for example
Memory 504 including instruction, above-mentioned instruction can be performed to complete the above method by the processor 502 of electronic equipment 500.Example
Such as, the non-transitorycomputer readable storage medium can be ROM, it is random access memory (RAM), CD-ROM, tape, soft
Disk and optical data storage devices etc..
Through the above description of the embodiments, those skilled in the art is it can be readily appreciated that example described herein is implemented
Mode can be realized by software, can also be realized by way of software combines necessary hardware.Therefore, according to the disclosure
The technical scheme of embodiment can be embodied in the form of software product, the software product can be stored in one it is non-volatile
Property storage medium (can be CD-ROM, USB flash disk, mobile hard disk etc.) in or network on, including some instructions are to cause a calculating
Equipment (can be personal computer, server, mobile terminal or network equipment etc.) is performed according to disclosure embodiment
Method.
Those skilled in the art will readily occur to this practicality after considering specification and putting into practice utility model disclosed herein
New other embodiments.The application is intended to any modification of the present utility model, purposes or adaptations, these
Modification, purposes or adaptations follow general principle of the present utility model and including the undocumented this technology neck of the disclosure
Common knowledge or conventional techniques in domain.Description and embodiments be considered only as it is exemplary, it is of the present utility model real
Scope and spirit are pointed out by following claim.
The illustrative embodiments of the disclosure are particularly shown and described above.It should be appreciated that the disclosure is not limited
In detailed construction described herein, set-up mode or implementation method;On the contrary, the disclosure is intended to cover included in appended claims
Spirit and scope in various modifications and equivalence setting.