[go: up one dir, main page]

CN106095089A - A kind of method obtaining interesting target information - Google Patents

A kind of method obtaining interesting target information Download PDF

Info

Publication number
CN106095089A
CN106095089A CN201610397641.4A CN201610397641A CN106095089A CN 106095089 A CN106095089 A CN 106095089A CN 201610397641 A CN201610397641 A CN 201610397641A CN 106095089 A CN106095089 A CN 106095089A
Authority
CN
China
Prior art keywords
target
image
interesting
interesting target
information
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201610397641.4A
Other languages
Chinese (zh)
Inventor
李尧
郑黎光
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Individual
Original Assignee
Individual
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Individual filed Critical Individual
Priority to CN201610397641.4A priority Critical patent/CN106095089A/en
Publication of CN106095089A publication Critical patent/CN106095089A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/012Head tracking input arrangements
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/20Image preprocessing
    • G06V10/25Determination of region of interest [ROI] or a volume of interest [VOI]
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/18Eye characteristics, e.g. of the iris
    • G06V40/19Sensors therefor

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Multimedia (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Ophthalmology & Optometry (AREA)
  • Processing Or Creating Images (AREA)

Abstract

A kind of method and apparatus of the information obtaining interesting target, based on augmented reality glasses system, by the detection to human eye focus, find the target of watching, and judge whether this target interested according to the watching object time, if it is determined that it is interested in this target, the photographic head then opening augmented reality glasses obtains target image, by image identification system identification interesting target, augmented reality glasses connect the Internet, target image and recognition result are scanned for, returns target selling price on the internet.

Description

A kind of method obtaining interesting target information
Technical field:
A kind of method that the present invention relates to information obtaining interesting target, the most automatically identifies and obtains mesh interested Mark and the method for information.
Background technology:
Along with Intelligent hardware, the development of wireless communication technique, VR (Virtual Reality, i.e. virtual reality) technology and AR (Augmented Reality, augmented reality) technology is capable of and obtains actual application, and such as, the VIVE of HTC company is empty Intend real world devices, the google glasses of Google, the hololens technology etc. of microsoft.Virtual reality and augmented reality Technology is all by the light of virtual image or object simulation actual object is invested human eye, thus simulation reality in human eye Image objects.The entirely virtual sight of virtual reality technology, the scene seen in virtual reality device display is entirely virtual Scene, AR technology is the most different, and dummy object and scene are combined by AR technology with actual object, on the one hand, user can be led to Crossing augmented reality equipment and observe directly real-world object and scene, on the other hand, augmented reality equipment can be by dummy object with true Real field scape superposition, thus in real scene, simultaneously view dummy object and information, the mode obtaining information occurs revolutionary Change.
On the other hand, the development of image procossing, identification and artificial intelligence so that computer is for the identification of image information Being possibly realized with understanding, current image recognition algorithm quickly can identify face from image, or identifies thing in image The kind of body, and by means of artificial intelligence, machine learning techniques, recognition accuracy is also in fast lifting, such as at search engine In, upload image and directly can be similar to image at Internal retrieval, and in shopping website, it is also possible to carry out commodity by image Retrieval, such as, in Taobao app, can take pictures to article, and app can return the commodity in picture by image recognition.
But the more display realizing information of augmented reality at present, and the function of acquisition of information cannot be realized, especially It is that the position that realizes following people obtains human eye vision information in real time, and processes.
Summary of the invention:
It is an object of the invention to propose a kind of information that can be obtained human eye interesting target by augmented reality system Method, specifically include:
S1: detection tracker's an eye line focus;
S2: judge whether the target at human eye current focus is interesting target;
S3: if interesting target, obtain target image;
S4: identify the target in image;
S5: obtain the information of target in image.
Method as described before, it is characterised in that: whether the described target judged at human eye current focus is mesh interested Target step includes: whether detection human eye focus exceedes predetermined threshold value in the time of described target residence.
Method as described before, it is characterised in that: whether the described target judged at human eye current focus is mesh interested Target step includes: whether detection human eye action meets default action interested.
Method as described before, it is characterised in that: described default action interested includes: blink continuously twice.
Method as described before, it is characterised in that: the step of described acquisition target image includes: the mesh to human eye focal point Mark is taken pictures.
Method as described before, it is characterised in that: in described identification image, the step of target includes: extract at picture centre Interesting target image, and calculate the eigenvalue of interesting target image.
Method as described before, it is characterised in that: in described acquisition image, the step of the information of target includes:
S51: the eigenvalue of interesting target image is entered with the commodity image eigenvalue in merchandise news image data base Row contrast, it may be judged whether there is the commodity image eigenvalue of coupling.
Method as described before, it is characterised in that in described acquisition image, the step of target information also includes:
S52: if there is the commodity image eigenvalue of coupling, obtain the information of these commodity as interesting target information.
Accompanying drawing illustrates:
Fig. 1 is the schematic diagram of the augmented reality device for realizing the inventive method;
Fig. 2 is the flow chart of the inventive method;
Detailed description of the invention:
The present invention is not limited by following embodiment, can determine specifically according to technical scheme and practical situation Embodiment.
Embodiment one:
The typical augmented reality glasses the most as shown in Figure 1 of the hardware foundation that the method for the present invention is implemented, its can be as in Augmented reality system disclosed in the open CN105188516A of state's patent of invention " for strengthening and the System and method for of virtual reality " System, it is also possible to being such as the augmented reality glasses such as google glass, hololens, it includes the first image-generating unit, is used for detecting Ocular movement direction and eye focus position, and detect eye motion, as;Second image-generating unit, is used for obtaining interesting target Image and find range;Projection arrangement, is used for the virtual objects Projection Display of augmented reality at eyeglass;Communication dress Put, be used for being wirelessly connected to the Internet;Processor and memorizer, for control, the calculating of image procossing of augmented reality glasses Deng.
Wherein the first image-generating unit can include one or more image-forming component, and image-forming component can be visible ray or red Outside line photographic head, its hardware configuration and Eye-controlling focus algorithm refer to the open CN103561635A of Chinese invention patent, and " sight line chases after Track system ", CN104126143A " comprise the HUD of eye tracks ", above-mentioned entirety introduces the present invention, by the The eyes real time imaging that one image-generating unit obtains, can obtain accurate direction of visual lines by calculating, thus guide the second imaging Unit follows eye sight line, thus accurately obtains the image of the target that human eye is being observed.Wherein the second image-generating unit can wrap Including one or more image-forming component, typically, the second image-generating unit includes two photographic head, thus simulates human eye structure 3d and regard Feeling, and according to disparity computation target range, and can use the depth sense technology of auxiliary, such as Chinese invention patent is open CN105409212A " there is multi-view image catch and the electronic equipment of depth sense " disclosed in deep technical device and side Method, so that it is determined that the distance of target and relative depth.
Based on above-mentioned hardware and method, being configured to implement the basis of technical solution of the present invention, the acquisition sense of the present invention is emerging The method of interest target information specifically includes following steps:
S1: detection tracker's an eye line focus;
S2: judge whether the target at human eye current focus is interesting target;
S3: if interesting target, obtain target image;
S4: identify the target in image;
S5: obtain the information of target in image.
Wherein step S1 is realized, in addition to method mentioned above, in any prior art by above-mentioned hardware and method Method for human eye focus detection and tracking is used equally to the present invention, includes but not limited to by visible images, infrared figure Obtain human eye sight direction and the method for focal position as carrying out processing, and carry out eye focus detection by near-infrared laser With the method demarcated.Algorithm can carry out calculation process by the flush bonding processor of augmented reality device or GPU and obtain, it is possible to Be by augmented reality device be specifically designed to Eye-controlling focus hardware circuit realize, as FPGA, ASIC, DSP and other Special chip.
The result that step S1 obtains can be that sight line is in three-dimensional direction, it is also possible to is that sight line is three-dimensional side To the combination of the distance with sight line focus, its object is to obtain the target of people's eye fixation relative to human eye or augmented reality device Position, the expression of relative position can only be represented by human eye sight direction, it is also possible to by human eye sight direction and goal The combination of distance human eye distance represents.
The result that step S1 obtains is for guiding the second image-generating unit to follow the movement of human eye sight and move, thus keeps Tracking and the seizure of target image to human eye fixation object.The result of step S1 is simultaneously used in step S2 interesting target Judgement.
Step S2 can be by being monitored realization to the sight line focus detected in step S1, by augmented reality device In motion sensor, motion and the head movement of people itself can be detected, believe in conjunction with head movable information and eye sight line Breath, it can be determined that whether the physical location of human eye sight changes, i.e. judge the human eye whether same object of continuous observation Body, calculates the time of the same target object of human eye continuous observation, if it exceeds time threshold set in advance, then judges current sight The target examined is interesting target.The setting of time threshold can be set according to the custom of different user, for example, it is possible to set It is set to the times such as 5s, 8s, 10s, 12s, 15s, and user can be set according to the use habit of oneself and adjust, thus Carry out the judgement of interesting target more accurately.
Additionally, can also be by the detection to action interested set in advance to the judgement of interesting target in step S2 Realizing, such as, user may it has been determined that interested in the current target observed, and be not desired to wait in advance before Preset Time arrives If the time arrives, the appreciable action of augmented reality device now can be set as action interested, when augmented reality device Detect when user makes action interested, i.e. judge that the target of current fixation is interesting target.Typical action interested Can be: blink continuously twice (action nictation can be detected by the first image-generating unit of augmented reality device), user nods, (headwork can be examined by the motion sensor of augmented reality device and acceleration transducer in the headworks such as user shakes the head Survey), user's gesture motion (user's gesture motion is obtained by the second image-generating unit and detected).
Additionally, the judgement to interesting target can also be realized by brain-computer interface in step S2, brain-computer interface (Brain- ComputerInterface, BCI) as a kind of, human thinking consciousness can be directly changed into the new of peripheral equipment control instruction Type human-computer interaction technology, the realization of typical brain-computer interface gathers EEG signals by brain electric transducer, and enters EEG signals Row processes and identifies, identifies human thinking consciousness, and current researcher both domestic and external has been able to realize carrying out numeral by brain electricity Or character input, control wheelchair, control artificial limb etc., in addition to gathering EEG signals, brain-computer interface can also be by gathering brain magnetic Signal realizes, such as Chinese invention patent CN105455806A " brain magnetic signal based on GMI effect probe, sensor and collection system System " disclosed in brain magnetic signal sensor and acquisition system.
People is when observing object, if a target creates the idea of " interested ", then its brain electricity or brain magnetic letter Number will differ from the target of " loseing interest in ", by pattern recognition, machine learning scheduling algorithm, this two classes EEG signals can be entered Row classification and identification.Typically, use machine learning algorithm, first gather be known as in a large number " interested " EEG signals and The model of machine learning is trained by the EEG signals " lost interest in ", thus obtains judgment models, is carrying out mesh interested When mark judges, augmented reality device needs to increase brain-computer interface device, thus obtains brain electricity or brain magnetic signal, then uses training Good model judges, obtains the result that human brain is interested in the current target observed.
If being judged as that current object observing is interesting target in step s 2, then enter step S3, existing by strengthening The second image-generating unit that actual load is put obtains the image of interesting target.The optical lens of the second image-generating unit typically has and human eye Similar equivalent focal length, so that the image that the image obtained can actually see closer to human eye.Second image-generating unit camera lens Central point is typically used to focus during imaging, owing to the second image-generating unit follows the direction of visual lines adjustment that the first image-generating unit detects Imaging direction, the object observed therefore in the object i.e. human eye of imaging center position.The another kind of the second image-generating unit During focusing mode, the distance of the human eye focusing directly detected according to the first image-generating unit is focused, thus and human eye Focus keeps consistent.
Second image-generating unit can also carry out dynamic zoom, if object and human eye is distant, and Jiao of imaging lens Consistent with human eye focal length away from remaining in that, then target object ratio in imaging picture is by smaller, by the second one-tenth As the camera lens of unit carries out zoom, make target ratio in picture become big, become apparent from.The process of optical zoom can be according to The identification of target is automatically controlled by two image-generating units.
The image obtained in step S3 is generally coloured image, in a further embodiment, and the target obtained in step S3 Image can also include near-infrared image.
Target in image is identified by step S4, and the specific algorithm present invention of image recognition repeats no more, the present invention Any image recognition algorithm existed in prior art can be used, include but not limited to feature extraction, machine learning, mould Stick with paste collection to identify, add up the methods such as identification, neural network recognization, structure recognition, stencil matching and support vector machine.
Preferably, step S4, before carrying out image recognition, further comprises the steps of:
S41: whether there is bar code or the image in 2 D code of target in recognition target image.
For commodity, typically there is Commercial goods labels, be printed on the bar code or Quick Response Code indicated for commodity above, be used for Instruction merchandise news, and by the identification to bar code or Quick Response Code, can directly obtain the merchandise news of target.
In another preferred implementation, step S4 can further include step:
S43: identify the trademark information on interesting target and character information.
Trade mark and Word message on commodity can help to identify commodity more accurately, such as, if user sees To a football and interested in football, by the algorithm of the present invention, augmented reality system determines that football is mesh interested Mark, and obtain the image of football, by the image recognition algorithm of step S4, identify except the interesting target in image is " foot Ball ", further, in order to obtain interesting target more accurate information, by the football image in interesting target image In trade mark and word be identified, identify the brand of this football for " nike ", then can obtain more accurate in step s 5 Interesting target information.
The application another preferred embodiment in, in step S4 interesting target know method for distinguishing use engineering Practise algorithm, for image that machine learning is trained from the commodity image of shopping website in algorithm.Such as, Taobao, The shopping website such as Jingdone district, Amazon, the article for selling are respectively provided with the picture presentation of multiple different angles, and we are Can clearly know type of merchandize that picture is corresponding and buy the much informations such as link, price, model, use these pictures with Pictorial information carries out the training of big data quantity to machine learning model, thus obtains the machine being capable of identify that interesting target image Learning model.Use which that interesting target is identified, be possible not only to identify the kind of interesting target, it is also possible to straight Connect the corresponding corresponding goods identifying interesting target at different shopping websites.
The concrete grammar of the target recognition that the present invention mentions, be referred to Chinese invention patent CN104991954A, The disclosure of CN105096180A, CN105373938A and CN103578098A, above-mentioned entirety introduces the present invention.
After completing target recognition step, entering step S5, augmented reality device connects the Internet by radio communication device, Obtain the information of interesting target from the Internet, these information include but not limited to: interesting target is in the correspondence of shopping website Commodity, sell and price, model, favor information, similar commodity are evaluated the business that in best commodity, similar commodity, sales volume is the highest The information such as cheapest commodity in product, similar commodity.Obtaining by the data to shopping website of the information of interesting target Storehouse carries out retrieval and obtains.
Embodiment two:
In an alternative embodiment of the invention, the method for described interesting target acquisition of information can also include step
S6: the information of the interesting target obtained is shown above actual interesting target by augmented reality device.
Can pass through to increase with the real augmented reality Display Technique near real world object of form of virtual image by information Strong real device realizes, and described augmented reality fills virtual reality device as aforesaid in the present invention, its concrete Projection Display algorithm If Chinese invention patent CN101911050A " real-time annotator ", CN103472909A are " for wear-type, augmented reality display True to nature block ", the device and method disclosed in CN105144236A " real-time volume coupling ", above-mentioned full patent texts introduces this Bright.
Interesting target information shows after augmented reality device, and user can be by the human-computer interaction function of augmented reality Access interesting target corresponding goods and link in the purchase of shopping website, and be done directly and place an order, additionally, user can also make by oneself One lower single operation of justice, after augmented reality device recognizes the lower single operation of user, directly can complete shopping at shopping website Operation.
The man-machine interaction of augmented reality again may be by aforesaid brain-computer interface and realizes, i.e. by gathering user's brain electricity Or brain magnetic signal, augmented reality device can obtain what user sent in the brain by identifying brain electricity or brain magnetic signal " buy " instruction, thus complete to buy operation.
As an alternative or supplement, function of the present invention can be come by one or more hardware logic assemblies at least in part Perform.Such as, but unrestricted, and the illustrative type of the hardware logic assembly that can be used includes field programmable gate array (FPGA) special standardized product (ASSP), the SOC(system on a chip) (SOC) of integrated circuit (ASIC) that, program is special, program, complexity can Programmed logic device (CPLD), Graphics Processing Unit (GPU).
Any computer-readable medium that can be accessed by augmented reality device can be used to provide computer can perform to refer to Order.Computer-readable medium can include computer-readable storage medium and the communication medias such as the most such as memorizer.Such as memorizer Include for storage such as computer-readable instruction, data structure, program module or other data etc. Deng computer-readable storage medium Volatibility that any method of information or technology realize and medium non-volatile, removable and irremovable.Computer Storage is situated between Matter includes but not limited to, RAM, ROM, EPROM, EEPROM, flash memory or other memory technologies, CD-ROM, digital versatile disc (DVD) or other optical storages, cartridge, tape, disk storage or other magnetic storage apparatus, or can be used for storage information for Any other non-transmission medium that calculating equipment accesses.On the contrary, communication media can be with such as carrier wave or other transmission mechanisms etc. Modulated message signal embodies computer-readable instruction, data structure, program module or other data.As defined herein , computer-readable storage medium does not include communication media.Therefore, computer-readable storage medium is not necessarily to be construed as being substantially to propagate letter Number.Transmitting signal may be present in computer-readable storage medium, but transmitting signal itself is not the example of computer-readable storage medium. Although showing computer-readable storage medium (memorizer) in augmented reality device, it being understood, however, that this storage can be point Cloth or be positioned at remotely and access via network or other communication links.
The example of the NUI technology that can provide include but not limited to depend on voice and/or speech recognition, touch and/or Gesture recognition, bearing of body in the air, head and eye tracking on instruction pen identification (touch-sensitive display), screen and near screen, language Those technology of sound and speech, vision, touch, posture and machine intelligence.Meaning can be included by other examples using NUI technology Figure and purpose understand system, use depth camera (as stereoscopic camera system, infrared camera system, rgb camera system and these Combination) exercise attitudes detecting system, use accelerometer/gyroscope exercise attitudes detection, facial recognition, 3D shows, Head, eyes and watch tracking attentively, immersion augmented reality and virtual reality system, and be used for using electric filed sensing electrodes (EEG And correlation technique) sensing cerebral activity technology.
Term used herein ' computer ' or ' equipment based on calculating ' refer to disposal ability so that it is permissible Perform any equipment of instruction.It will be understood by those skilled in the art that such disposal ability is incorporated into many distinct devices, And therefore term each " computer " and " equipment based on calculating " include that personal computer, server, mobile phone (include Smart phone), tablet PC, Set Top Box, media player, game console, personal digital assistant and many miscellaneous equipments.
Method described herein can be performed by the software of the machine-readable form on tangible media, such as computer The form of program, this computer program is included in when this program is run on computers and is adapted for carrying out any side described herein Method computer program code means in steps and wherein this computer program can be included in computer-readable medium On.The example of tangible media includes that computer memory device, computer memory device include computer-readable medium, such as Dish (disk), thumb drive, memorizer etc. and do not include propagated signal.Transmitting signal may be present in tangible storage and is situated between In matter, but transmitting signal itself is not the example of tangible media.Software may be adapted in parallel processor or serial process Perform so that various method steps can perform in any suitable order or simultaneously on device.
This recognizes, software can be valuable, the most tradable commodity.It is intended to comprise and runs on or control Or standard hardware is to realize the software of required function.It also aims to comprise such as designing silicon, or is used for configuring logical With " descriptions " such as HDL (hardware description language) softwares of programmable chip or definition hardware configuration to realize the soft of desired function Part.
It will be appreciated by those skilled in the art that the storage device for storing programmed instruction can be distributed in network.Such as, Remote computer can store the example of the process being described as software.Local or terminal computer can access remote computer And part or all of downloaded software is to run program.Can alternatively, local computer can downloaded software as required Fragment, or on local terminal, perform some software instructions, and above perform other at remote computer (or computer network) Software instruction.Those skilled in the art is it will also be appreciated that by utilizing conventional art known to those skilled in the art, soft It is whole that part instructs, or a part can be realized by the special circuit of such as DSP, programmable logic array etc.
To being proficient in the people of this technology it is readily apparent that any scope provided herein or device value can be expanded or change Become, the effect sought without loss.
Although the language special by architectural feature and/or method action describes this theme, it is to be understood that, appended right Theme defined in claim is not necessarily limited to above-mentioned specific features or action.On the contrary, above-mentioned specific features and action are as reality Disclosed in the exemplary forms of existing claim.
It is appreciated that advantage as described above can relate to an embodiment and maybe can relate to multiple embodiment.Each reality Execute example be not limited only to solve those embodiments of any or all of stated problem or have any or all of stated excellent Those embodiments of point.It is to be further understood that " one " project to be quoted refer in those projects one or more.
The step of method described herein can the most in any suitable order, or realize simultaneously. It addition, in the case of the spirit and scope of theme described without departing from here, can delete each from any one method Individually frame.The each side of any example as described above can be with each side of any example in other described examples Face combines, to constitute further example, and the effect sought without loss.
It is used here frame or element that term " includes " being intended to include identified method, but such frame or element Do not include that exclusive list, method or equipment can comprise extra frame or element.
It is appreciated that above description is intended only as example and provides and those skilled in the art can make various repairing Change.Described above, example and data provide comprehensive description of the structure to each exemplary embodiment and use.Although above with Certain level of detail or describe each embodiment with reference to one or more independent embodiments, but, without departing from this specification In the case of spirit or scope, the disclosed embodiments can be made a lot of change by those skilled in the art.

Claims (10)

1. the method obtaining interesting target information, it is characterised in that comprise the following steps:
S1: detection tracker's an eye line focus;
S2: judge whether the target at human eye current focus is interesting target;
S3: if it is determined that be interesting target, obtains target image;
S4: identify the interesting target in described target image;
S5: obtain the information of described interesting target.
2. the method for claim 1, it is characterised in that: whether the described target judged at human eye current focus is that sense is emerging The step of interest target includes: whether detection human eye focus exceedes predetermined threshold value in the time of described target residence.
3. the method for claim 1, it is characterised in that: whether the described target judged at human eye current focus is that sense is emerging The step of interest target includes: whether detection user action meets default action interested.
4. method as claimed in claim 3, it is characterised in that: described default action interested includes: blink continuously twice Or nod.
5. the method as described in one of claim 2-4, it is characterised in that: the step of described acquisition target image includes: to people The target of eye focal point is taken pictures.
6. the method as described in one of claim 2-4, it is characterised in that: in described identification image, the step of target includes: carry Take the interesting target image at picture centre, by machine learning model, described interesting target is identified.
7. method as claimed in claim 6, it is characterised in that: described machine learning model uses shopping website merchandising database In commodity image be trained.
8. method as claimed in claim 7, it is characterised in that: described step S4 also includes:
S41: the bar code in recognition target image or image in 2 D code.
9. method as claimed in claim 7 or 8, it is characterised in that described step S4 also includes:
S43: the trademark information identified in image on interesting target and character information.
10. method as claimed in claim 9, it is characterised in that described method also includes:
S6: the information of the interesting target obtained is shown above actual interesting target by augmented reality device.
CN201610397641.4A 2016-06-06 2016-06-06 A kind of method obtaining interesting target information Pending CN106095089A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201610397641.4A CN106095089A (en) 2016-06-06 2016-06-06 A kind of method obtaining interesting target information

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201610397641.4A CN106095089A (en) 2016-06-06 2016-06-06 A kind of method obtaining interesting target information

Publications (1)

Publication Number Publication Date
CN106095089A true CN106095089A (en) 2016-11-09

Family

ID=57227253

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201610397641.4A Pending CN106095089A (en) 2016-06-06 2016-06-06 A kind of method obtaining interesting target information

Country Status (1)

Country Link
CN (1) CN106095089A (en)

Cited By (43)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106484122A (en) * 2016-11-16 2017-03-08 捷开通讯(深圳)有限公司 A kind of virtual reality device and its browse trace tracking method
CN106528826A (en) * 2016-11-18 2017-03-22 广东技术师范学院 Deep learning-based multi-view appearance patent image retrieval method
CN106779940A (en) * 2016-12-13 2017-05-31 中国联合网络通信集团有限公司 A kind of confirmation method and device for showing commodity
CN106843468A (en) * 2016-12-27 2017-06-13 努比亚技术有限公司 A kind of man-machine interaction method in terminal and VR scenes
CN106991169A (en) * 2017-03-31 2017-07-28 北京小米移动软件有限公司 Recommendation method and device based on augmented reality AR equipment
CN107122039A (en) * 2017-03-15 2017-09-01 苏州大学 A kind of intelligent vision auxiliary strengthening system and its application method
CN107197153A (en) * 2017-06-19 2017-09-22 上海传英信息技术有限公司 The image pickup method and filming apparatus of a kind of photo
CN107390877A (en) * 2017-08-01 2017-11-24 深圳市益廷科技有限公司 A kind of hotel self-service method of ordering
CN107403353A (en) * 2017-06-22 2017-11-28 非常云智慧科技(常州)有限公司 A kind of rate of exchange information acquisition method and device based on augmented reality
CN107424013A (en) * 2017-08-01 2017-12-01 深圳市益廷科技有限公司 A kind of hotel self-service meal ordering system
CN107424054A (en) * 2017-08-01 2017-12-01 深圳市益廷科技有限公司 A kind of hotel's purchase system
CN107451865A (en) * 2017-08-01 2017-12-08 深圳市益廷科技有限公司 A kind of hotel's purchase method
CN107657235A (en) * 2017-09-28 2018-02-02 北京小米移动软件有限公司 Recognition methods and device based on augmented reality
CN107948533A (en) * 2017-12-29 2018-04-20 北京陌上花科技有限公司 A kind of image processing method and device for taking pictures
CN107992839A (en) * 2017-12-12 2018-05-04 北京小米移动软件有限公司 Person tracking method, device and readable storage medium storing program for executing
CN108196671A (en) * 2017-12-26 2018-06-22 深圳市亿道数码技术有限公司 Method for displaying image and virtual reality device in virtual reality device
CN108427498A (en) * 2017-02-14 2018-08-21 深圳梦境视觉智能科技有限公司 A kind of exchange method and device based on augmented reality
CN108509034A (en) * 2018-03-16 2018-09-07 广东欧珀移动通信有限公司 Electronic device, information processing method and related product
CN108875691A (en) * 2018-07-03 2018-11-23 京东方科技集团股份有限公司 A kind of auxiliary purchasing article and auxiliary purchase method
CN109062205A (en) * 2018-07-26 2018-12-21 武汉水草能源科技研发中心(有限合伙) Artificial intelligence car driverless system
CN109086726A (en) * 2018-08-10 2018-12-25 陈涛 A kind of topography's recognition methods and system based on AR intelligent glasses
CN109191188A (en) * 2018-08-17 2019-01-11 连云港伍江数码科技有限公司 Determination method, apparatus, computer equipment and the storage medium of target information
CN109191180A (en) * 2018-08-06 2019-01-11 百度在线网络技术(北京)有限公司 The acquisition methods and device of evaluation
CN109215132A (en) * 2017-06-30 2019-01-15 华为技术有限公司 A kind of implementation method and equipment of augmented reality business
CN109254659A (en) * 2018-08-30 2019-01-22 Oppo广东移动通信有限公司 Wearable device control method and device, storage medium and wearable device
WO2019023935A1 (en) * 2017-08-01 2019-02-07 深圳市益廷科技有限公司 Method for self-service food ordering in hotel
WO2019023929A1 (en) * 2017-08-01 2019-02-07 深圳市益廷科技有限公司 Hotel shopping method
CN109358744A (en) * 2018-08-30 2019-02-19 Oppo广东移动通信有限公司 Information sharing method and device, storage medium and wearable device
CN109427220A (en) * 2017-08-29 2019-03-05 深圳市掌网科技股份有限公司 A kind of methods of exhibiting and system based on virtual reality
CN109634409A (en) * 2018-11-26 2019-04-16 深圳增强现实技术有限公司 AR control method and separate type AR equipment
WO2019076105A1 (en) * 2017-10-20 2019-04-25 华为技术有限公司 Identification code identification method, apparatus and device
CN109725726A (en) * 2018-12-29 2019-05-07 上海掌门科技有限公司 A kind of querying method and device
CN109814719A (en) * 2018-07-26 2019-05-28 亮风台(上海)信息科技有限公司 A kind of method and apparatus of the display information based on wearing glasses
CN109920172A (en) * 2017-12-12 2019-06-21 富士施乐株式会社 Information processing unit
CN110059550A (en) * 2019-03-11 2019-07-26 江苏理工学院 A kind of intelligent assistant learning system based on EEG signals
CN110908505A (en) * 2019-10-29 2020-03-24 易念科技(深圳)有限公司 Interest identification method and device, terminal equipment and storage medium
CN112089541A (en) * 2020-09-21 2020-12-18 深兰科技(上海)有限公司 Intelligent wheelchair control system and method
CN112181152A (en) * 2020-11-13 2021-01-05 幻蝎科技(武汉)有限公司 Advertisement push management method, equipment and application based on MR glasses
CN112256955A (en) * 2020-09-17 2021-01-22 山东师范大学 Intelligent recommendation type glasses and using method thereof
CN112885435A (en) * 2019-11-29 2021-06-01 天津拓影科技有限公司 Method, device and system for determining image target area
CN114119171A (en) * 2021-12-02 2022-03-01 浙江科顿科技有限公司 A MR/AR/VR shopping and retrieval scene control method, mobile terminal and readable storage medium
WO2022141192A1 (en) * 2020-12-30 2022-07-07 广东视场科技有限公司 Intelligent control glasses
TWI844813B (en) * 2022-01-20 2024-06-11 黃鈞鼎 Wearable device and projecting method

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102830797A (en) * 2012-07-26 2012-12-19 深圳先进技术研究院 Man-machine interaction method and system based on sight judgment
CN103561635A (en) * 2011-05-11 2014-02-05 谷歌公司 Gaze tracking system
CN104991954A (en) * 2015-07-20 2015-10-21 河海大学 Shopping searching system based on image search and realization method thereof

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103561635A (en) * 2011-05-11 2014-02-05 谷歌公司 Gaze tracking system
CN102830797A (en) * 2012-07-26 2012-12-19 深圳先进技术研究院 Man-machine interaction method and system based on sight judgment
CN104991954A (en) * 2015-07-20 2015-10-21 河海大学 Shopping searching system based on image search and realization method thereof

Cited By (52)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106484122A (en) * 2016-11-16 2017-03-08 捷开通讯(深圳)有限公司 A kind of virtual reality device and its browse trace tracking method
CN106528826A (en) * 2016-11-18 2017-03-22 广东技术师范学院 Deep learning-based multi-view appearance patent image retrieval method
CN106779940A (en) * 2016-12-13 2017-05-31 中国联合网络通信集团有限公司 A kind of confirmation method and device for showing commodity
CN106779940B (en) * 2016-12-13 2020-10-27 中国联合网络通信集团有限公司 A kind of confirmation method and device for displaying goods
CN106843468A (en) * 2016-12-27 2017-06-13 努比亚技术有限公司 A kind of man-machine interaction method in terminal and VR scenes
CN108427498A (en) * 2017-02-14 2018-08-21 深圳梦境视觉智能科技有限公司 A kind of exchange method and device based on augmented reality
CN107122039A (en) * 2017-03-15 2017-09-01 苏州大学 A kind of intelligent vision auxiliary strengthening system and its application method
CN106991169A (en) * 2017-03-31 2017-07-28 北京小米移动软件有限公司 Recommendation method and device based on augmented reality AR equipment
CN107197153B (en) * 2017-06-19 2024-03-15 上海传英信息技术有限公司 Shooting method and shooting device for photo
CN107197153A (en) * 2017-06-19 2017-09-22 上海传英信息技术有限公司 The image pickup method and filming apparatus of a kind of photo
CN107403353A (en) * 2017-06-22 2017-11-28 非常云智慧科技(常州)有限公司 A kind of rate of exchange information acquisition method and device based on augmented reality
CN109215132A (en) * 2017-06-30 2019-01-15 华为技术有限公司 A kind of implementation method and equipment of augmented reality business
CN107424054A (en) * 2017-08-01 2017-12-01 深圳市益廷科技有限公司 A kind of hotel's purchase system
CN107451865A (en) * 2017-08-01 2017-12-08 深圳市益廷科技有限公司 A kind of hotel's purchase method
CN107424013A (en) * 2017-08-01 2017-12-01 深圳市益廷科技有限公司 A kind of hotel self-service meal ordering system
CN107390877A (en) * 2017-08-01 2017-11-24 深圳市益廷科技有限公司 A kind of hotel self-service method of ordering
WO2019023929A1 (en) * 2017-08-01 2019-02-07 深圳市益廷科技有限公司 Hotel shopping method
WO2019023935A1 (en) * 2017-08-01 2019-02-07 深圳市益廷科技有限公司 Method for self-service food ordering in hotel
CN109427220B (en) * 2017-08-29 2021-11-30 深圳市掌网科技股份有限公司 Virtual reality-based display method and system
CN109427220A (en) * 2017-08-29 2019-03-05 深圳市掌网科技股份有限公司 A kind of methods of exhibiting and system based on virtual reality
CN107657235A (en) * 2017-09-28 2018-02-02 北京小米移动软件有限公司 Recognition methods and device based on augmented reality
CN109725699A (en) * 2017-10-20 2019-05-07 华为终端(东莞)有限公司 Identification method, device and equipment for identification code
WO2019076105A1 (en) * 2017-10-20 2019-04-25 华为技术有限公司 Identification code identification method, apparatus and device
CN107992839A (en) * 2017-12-12 2018-05-04 北京小米移动软件有限公司 Person tracking method, device and readable storage medium storing program for executing
CN109920172A (en) * 2017-12-12 2019-06-21 富士施乐株式会社 Information processing unit
CN108196671A (en) * 2017-12-26 2018-06-22 深圳市亿道数码技术有限公司 Method for displaying image and virtual reality device in virtual reality device
CN107948533A (en) * 2017-12-29 2018-04-20 北京陌上花科技有限公司 A kind of image processing method and device for taking pictures
CN108509034A (en) * 2018-03-16 2018-09-07 广东欧珀移动通信有限公司 Electronic device, information processing method and related product
CN108509034B (en) * 2018-03-16 2021-05-11 Oppo广东移动通信有限公司 Electronic device, information processing method and related product
CN108875691A (en) * 2018-07-03 2018-11-23 京东方科技集团股份有限公司 A kind of auxiliary purchasing article and auxiliary purchase method
CN109062205A (en) * 2018-07-26 2018-12-21 武汉水草能源科技研发中心(有限合伙) Artificial intelligence car driverless system
CN109814719B (en) * 2018-07-26 2024-04-26 亮风台(上海)信息科技有限公司 Method and equipment for displaying information based on wearing glasses
CN109814719A (en) * 2018-07-26 2019-05-28 亮风台(上海)信息科技有限公司 A kind of method and apparatus of the display information based on wearing glasses
CN109191180A (en) * 2018-08-06 2019-01-11 百度在线网络技术(北京)有限公司 The acquisition methods and device of evaluation
CN109086726A (en) * 2018-08-10 2018-12-25 陈涛 A kind of topography's recognition methods and system based on AR intelligent glasses
CN109086726B (en) * 2018-08-10 2020-01-14 陈涛 Local image identification method and system based on AR intelligent glasses
CN109191188A (en) * 2018-08-17 2019-01-11 连云港伍江数码科技有限公司 Determination method, apparatus, computer equipment and the storage medium of target information
CN109254659A (en) * 2018-08-30 2019-01-22 Oppo广东移动通信有限公司 Wearable device control method and device, storage medium and wearable device
CN109358744A (en) * 2018-08-30 2019-02-19 Oppo广东移动通信有限公司 Information sharing method and device, storage medium and wearable device
CN109634409A (en) * 2018-11-26 2019-04-16 深圳增强现实技术有限公司 AR control method and separate type AR equipment
CN109725726A (en) * 2018-12-29 2019-05-07 上海掌门科技有限公司 A kind of querying method and device
CN110059550A (en) * 2019-03-11 2019-07-26 江苏理工学院 A kind of intelligent assistant learning system based on EEG signals
CN110908505A (en) * 2019-10-29 2020-03-24 易念科技(深圳)有限公司 Interest identification method and device, terminal equipment and storage medium
CN112885435A (en) * 2019-11-29 2021-06-01 天津拓影科技有限公司 Method, device and system for determining image target area
CN112885435B (en) * 2019-11-29 2023-04-21 天津拓影科技有限公司 Method, device and system for determining image target area
CN112256955A (en) * 2020-09-17 2021-01-22 山东师范大学 Intelligent recommendation type glasses and using method thereof
CN112256955B (en) * 2020-09-17 2022-12-16 山东师范大学 Intelligent recommendation type glasses and using method thereof
CN112089541A (en) * 2020-09-21 2020-12-18 深兰科技(上海)有限公司 Intelligent wheelchair control system and method
CN112181152A (en) * 2020-11-13 2021-01-05 幻蝎科技(武汉)有限公司 Advertisement push management method, equipment and application based on MR glasses
WO2022141192A1 (en) * 2020-12-30 2022-07-07 广东视场科技有限公司 Intelligent control glasses
CN114119171A (en) * 2021-12-02 2022-03-01 浙江科顿科技有限公司 A MR/AR/VR shopping and retrieval scene control method, mobile terminal and readable storage medium
TWI844813B (en) * 2022-01-20 2024-06-11 黃鈞鼎 Wearable device and projecting method

Similar Documents

Publication Publication Date Title
CN106095089A (en) A kind of method obtaining interesting target information
CN110647237B (en) Gesture-based content sharing in an artificial reality environment
CN110646938B (en) Near-eye display system
US20220011098A1 (en) Planar waveguide apparatus with diffraction element(s) and system employing same
US9612403B2 (en) Planar waveguide apparatus with diffraction element(s) and system employing same
US11998798B2 (en) Virtual guided fitness routines for augmented reality experiences
CN113467619B (en) Picture display method and device, storage medium and electronic equipment
HK40053497B (en) Screen display method, device, storage medium and electronic equipment
HK40021893A (en) Augmented reality data presentation method, apparatus, electronic device and storage medium

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
WD01 Invention patent application deemed withdrawn after publication

Application publication date: 20161109

WD01 Invention patent application deemed withdrawn after publication