CN109993045A

CN109993045A - Articles seeking method and lookup device search system and machine readable storage medium

Info

Publication number: CN109993045A
Application number: CN201810388308.6A
Authority: CN
Inventors: 胡景翔
Original assignee: Hangzhou Hikvision Digital Technology Co Ltd
Current assignee: Hangzhou Hikvision Digital Technology Co Ltd; Hangzhou Hikvision System Technology Co Ltd
Priority date: 2017-12-29
Filing date: 2018-04-26
Publication date: 2019-07-09
Anticipated expiration: 2038-04-26
Also published as: CN109993045B

Abstract

It includes: to identify one or more articles from the collected video of picture pick-up device that the application, which provides a kind of articles seeking method based on video and searches device, lookup system and machine readable storage medium, the lookup method,；Save the Item Information of the article identified；When receiving the look-up command of target item of client transmission, searching from the Item Information saved can be improved articles seeking efficiency with the matched target item information of look-up command, this method.

Description

Articles seeking method and lookup device search system and machine readable storage medium

Technical field

This application involves image processing techniques, more particularly to the articles seeking method based on video and lookup device, lookup System and machine readable storage medium.

Background technique

Current article identification is based on radio frequency identification (RFID:Radio Frequency Identification) technology It realizes, concrete principle are as follows: radio frequency chip is set on article, the identification code of article and related to article is recorded in radio frequency chip Information, scanning radio frequency chip by scanning means may recognize that the identification code of the article recorded in radio frequency chip, be finally reached Realize the purpose of article identification.

The article for being placed on fixed position can be identified based on Radio Frequency Identification Technology, but when article is lost or is lost When forgetting placement location, it is typically only capable to manually search, that manually searches is inefficient.

Summary of the invention

In view of this, the application provides a kind of articles seeking method based on video.

Specifically, the application is achieved by the following technical solution:

According to a first aspect of the embodiments of the present invention, a kind of articles seeking method based on video, the method packet are provided It includes:

One or more articles are identified from the collected video of picture pick-up device；

Save the Item Information of the article identified；

When receiving the look-up command of target item of client transmission, lookup and institute from the Item Information saved State the matched target item information of look-up command.

Optionally, the Item Information for saving the article identified, comprising:

Using the combination description information of the article identified as search criterion, from the Item Information saved search with it is described The matched Item Information of combination description information of the article identified；

If not searching, the Item Information of the article identified is saved；

If finding, judge whether the article position of the article identified changes, if it is, what preservation identified The Item Information of article newest identifies object if it is not, then the article time of occurrence in the Item Information found is replaced with Time of product and preservation.

Optionally, whether the position for judging the article identified changes, comprising:

Judge the seat of the coordinate of the article identified or the condition code of article and the article in the Item Information found Whether the condition code of mark or article is identical,

If it is not the same, then determining that the position of the article identified changes；

If identical, it is determined that the position of the article identified does not change.

Optionally, described to be searched and the matched target item packet of the look-up command from the Item Information saved It includes:

Image recognition is carried out to the picture for the target item that the look-up command carries, obtains the description letter of target item Breath；

Using the description information of the target item as search criterion, searched and the target from the Item Information saved The matched target item information of the description information of article.

Using the description information of the target item carried in the look-up command as search criterion, from the Item Information saved The matched target item information of description information of middle lookup and the target item.

Optionally, method further comprises:

According to the target item information to the location information of target item described in the client feedback.

Optionally, it is described according to target item information to the location information packet of target item described in the client feedback It includes:

According to the target item acquisition of information Target Photo, the Target Photo is that target item position is presented Picture；

To Target Photo described in the client feedback.

It is optionally, described according to the target item acquisition of information Target Photo, comprising:

Picture store path information is obtained from the target item information, the picture store path information indicates target The corresponding relationship of the picture of the description information and presentation target item position of article；

Corresponding Target Photo, the item pictures are obtained from item pictures library according to the picture store path information Inventory, which contains, is presented the picture of article position according to multiple that the collected video of picture pick-up device generates.

It is optionally, described to Target Photo described in the client feedback, comprising:

When the Target Photo is multiple, the Target Photo is fed back into the client according to time inverted order.

Optionally, described when receiving the look-up command of target item of client transmission, from the article letter saved It is searched and the matched target item information of the look-up command in breath, comprising:

When receiving the look-up command of title of the title of carrying target item of client transmission and its associated article, With the entitled search criterion of the title of the target item and associated article, found out from the Item Information respectively with institute The corresponding Item Information of the title of the title and associated article of stating target item；

The article time of occurrence for including is filtered out from the Item Information found out within a preset time interval and is wrapped The identical Item Information of the mark of the picture pick-up device contained, as with the matched target item information of the look-up command.

Optionally, further includes:

Playback duration is originated according to the article time of occurrence positioning in the matched target item information of look-up command；

The visitor will be fed back to from the video record after the starting playback duration transferred in the video record of storage Family end, the video record of the storage are to be generated according to the collected video of picture pick-up device.

When receiving the multiple continuous look-up command of target item of client transmission, repeatedly continuously from having saved Item Information in search with the matched target item information of the look-up command, wherein the target carried in each look-up command The description information of article is different, and the picture pick-up device mark in the description information of the target item in each secondary look-up command is corresponding Picture pick-up device position is adjacent, and the article time of occurrence in the description information of the target item in each secondary look-up command is according to feeding back to The video record of client determines.

Optionally, the lookup from the Item Information saved and the matched target item information of the look-up command, Include:

Using the description information of the target item carried in the look-up command as search criterion, from the Item Information saved Middle search identifies comprising the picture pick-up device adjacent with the picture pick-up device mark corresponding position of the target item is acquired, and includes to remove The Item Information of description information other than the picture pick-up device mark of target item, as target item information.

Optionally, before described according to the target item acquisition of information Target Photo, further includes:

Obtain the area map of the distributing position for indicating each picture pick-up device and each picture pick-up device mark；

The Target Photo is superimposed upon on the area map, and the Target Photo is located at corresponding acquisition object Near the distributing position of the picture pick-up device of product；

It is described to Target Photo described in the client feedback, comprising:

The area map of the Target Photo is superimposed with to the client feedback.

Optionally, the picture of personage associated with target item is carried in the look-up command, personage's picture is It is intercepted from the video record for feeding back to the client.

According to a second aspect of the embodiments of the present invention, a kind of articles seeking device based on video, described device packet are provided It includes:

Article recognition unit, for identifying one or more articles from the collected video of picture pick-up device；

Item Information storage unit, for saving the Item Information of the article identified；

Look-up command receiving unit, for when receive client transmission target item look-up command when, Cong Yibao It is searched and the matched target item information of the look-up command in the Item Information deposited.

Optionally, the device further include:

Article is presented according to multiple that the collected video of picture pick-up device generates for storing in item pictures inventory's storage unit The picture of position.

According to a third aspect of the embodiments of the present invention, a kind of articles seeking system based on video is provided, comprising: take the photograph As equipment and articles seeking device described above, the picture pick-up device is used to the video of acquisition being sent to the articles seeking Device.

According to a fourth aspect of the embodiments of the present invention, a kind of machine readable storage medium is provided, it is executable to be stored with machine Instruction, when being called and being executed by processor, the machine-executable instruction promotes the processor to execute side described above Method.

Above-mentioned technical proposal of the invention according to collected video identification article therein, and saves the article of article Information, in turn, when searching target item, with the matched target item information of look-up command, the target item information It can be information relevant to target item, useful information can be provided for articles seeking, it, can be with compared with manually carrying out lookup Improve articles seeking efficiency.

Detailed description of the invention

Fig. 1 is a kind of flow chart of articles seeking method based on video shown in one exemplary embodiment of the application；

Fig. 2 is a kind of flow chart of articles seeking method based on video shown in the application another exemplary embodiment；

Fig. 3 is a kind of flow chart of articles seeking method based on video shown in the application another exemplary embodiment；

Fig. 4 is a kind of flow chart of articles seeking method based on video shown in the application another exemplary embodiment；

Fig. 5 is a kind of flow chart of articles seeking method based on video shown in the application another exemplary embodiment；

Fig. 6 is that a kind of distributing position for indicating each picture pick-up device and each camera shooting shown in one exemplary embodiment of the application are set The schematic diagram of the area map of standby mark；

Fig. 7 is a kind of block diagram of articles seeking device based on video shown in the application another exemplary embodiment；

Fig. 8 is a kind of hardware structure diagram of server shown in the application another exemplary embodiment；

Fig. 9 is a kind of block diagram of articles seeking system based on video shown in the application another exemplary embodiment.

Specific embodiment

Example embodiments are described in detail here, and the example is illustrated in the accompanying drawings.Following description is related to When attached drawing, unless otherwise indicated, the same numbers in different drawings indicate the same or similar elements.Following exemplary embodiment Described in embodiment do not represent all embodiments consistent with the application.On the contrary, they be only with it is such as appended The example of the consistent device and method of some aspects be described in detail in claims, the application.

It is only to be not intended to be limiting the application merely for for the purpose of describing particular embodiments in term used in this application. It is also intended in the application and the "an" of singular used in the attached claims, " described " and "the" including majority Form, unless the context clearly indicates other meaning.

With the development of photography technology and image recognition technology, picture pick-up device must fall and be widely applied, for example, can be in work Make the deployment such as room, family, factory, market picture pick-up device, carries out video acquisition using picture pick-up device, utilize the video of picture pick-up device Function is acquired, the articles seeking method based on video that the present embodiment provides a kind of, this method, which is seen, can be applied to server, for clothes The type embodiment of the present invention of business device without limitation, can be the various servers for having computing capability.

As shown in Figure 1, the articles seeking of the embodiment of the present invention method includes the following steps:

Step S10, one or more articles are identified from the collected video of picture pick-up device；

Picture pick-up device refers to the equipment with video acquisition function, for example, video camera, camera or camera etc..

Picture pick-up device can carry out Image Acquisition, and a series of individual images can be described as a frame image, and a frame image can be recognized For a static picture, a series of continuous each frame images form video, and the generally contiguous acquisition image of picture pick-up device is continuously adopted Each frame image of collection can be transferred to server by forming video code flow after coding, and server receives after video code flow can be into Row decodes and then obtains each frame image.

In scene required for picture pick-up device being deployed in, for example, family life space, office space, public place Etc. in various scenes, the specific location and quantity of picture pick-up device can be disposed according to actual needs, live occupied space can when smaller To dispose a picture pick-up device in place, if live occupied space it is big or it is complex can be in multiple position portions More picture pick-up devices are affixed one's name to, for example, in multiple positions such as each meeting room, office and the corridor of office space and multiple directions portion More picture pick-up devices are affixed one's name to, the video of each picture pick-up device acquisition can be transmitted to server.

Picture pick-up device can acquire video in real time, here be not necessarily referring to each moment in real time, refer to that picture pick-up device is adopted according to itself Collect frequency continuous acquisition video, the video of acquisition includes each frame image, and each frame image is in the angular field of view of picture pick-up device acquisition Each moment scenic picture image.

There may be various articles in image, for example, people, mobile phone, cup, mouse, chair, documents pouch, pen etc., can pass through figure As recognizer identifies each frame image in video, one or more articles in image are identified, for that can know The type of other article and the image recognition algorithm of use are related, and the type of goods identified is not limited in the present embodiment It is fixed, image recognition algorithm can be selected according to the demand to the article of being identified.

Step S11, the Item Information of the article identified is saved.

The Item Information of each article can be obtained by identifying to article in video, which is related to article Information, the coordinate of title, article time of occurrence, the customized information of article, article for example including, article (refers to that article exists Coordinate in image), the condition code of article, picture pick-up device mark (such as ID of imaging identification) etc., the customized information of article refers to The brand of article, the packaged information of model or article, ornament information of article etc.；Article time of occurrence refers to article in video In image current location time of occurrence, the time of occurrence can according to picture pick-up device acquire video each frame image when Between stab determine.

Time that article time of occurrence may occur for the first time in the picture for article or article in the picture non-first The time of secondary appearance, for example, when a certain article appears in the institute of picture pick-up device in the scene for the first time, at this point, being set by camera shooting The article is identified in a certain frame image of the video of standby acquisition, then identifies that the time of the article is that article occurs for the first time It is time, subsequent also to recognize the article always if the article continues there is institute in the scene, until the article is moved to institute Except scene, subsequent non-first time identifies that the time of the article is also article time of occurrence, also, occurs saving article When the time, when the article repeatedly identifies, the article time of occurrence is updated every time, with the newest article that identifies The article time of occurrence that time has saved when instead before identifying the article can make the Item Information of the article saved in this way In article time of occurrence be the newest time of article in video, convenient for searching article.

Step S12, when receiving the look-up command of target item of client transmission, from the Item Information saved It searches and the matched target item information of look-up command.

Settable client in terminal, can be in the look-up command of client input target item.

Client can be realized by APP (application program) mode, can also pass through SDK (Software Development Kit, Software Development Kit) mode realizes, with no restrictions to this implementation.Terminal may include various Terminal, such as mobile phone, tablet computer, laptop, desktop computer etc..

Look-up command can carry the relevant information of target item, can be with for example, the title of target item, model, brand etc. This is keyword from having saved the Item Information retrieved in Item Information with the information matches of target item, the article retrieved Information is target item information, and target item information is Item Information relevant to target item.

It can be to include the correlation in above-mentioned look-up command in Item Information with the matched target item information of look-up command The Item Information of information, or fuzzy matching is carried out with relevant information, find Item Information relevant to relevant information, this reality It applies in example for specific matching way without limitation.

The technical solution of the present embodiment according to collected video identification article therein, and saves the article letter of article Breath, in turn, when searching target item, with the matched target item information of look-up command, which can Think information relevant to target item, useful information can be provided for articles seeking, compared with manually search, Ke Yiti High articles seeking efficiency.

In an optional embodiment, as shown in Fig. 2, saving the article identified described in above-mentioned steps S11 Item Information may include:

Step 111, using the combination description information of the article identified as search criterion, looked into from the Item Information saved Look for the matched Item Information of description information with the article identified；

If step 112 is not searched, the Item Information of the article identified is saved；

If step 113 is found, judge whether the article position of the article identified changes, if it is, saving The Item Information of the article identified, if it is not, then the article time of occurrence in the Item Information found is replaced with newest Identify the time of article and preservation.

During picture pick-up device acquires video, the scene in the angular field of view of picture pick-up device is it is possible that new object Product, for the new article identified, since, not about the information of the new article, needing to save should in the Item Information that has saved The Item Information of new article, therefore, the combination description information for the article that basis identifies in the present embodiment are search criterion, description Information may include at least one of Item Information information, which may include picture pick-up device mark (camera shooting Device id), Item Title, article customized information at least two information, if with single description information be search item Part, it is understood that there may be ware identical with a kind of description information causes to search inaccuracy, deposit the Item Information saved also can In error, therefore, in the present embodiment, searched from the Item Information saved and the group using combining description information as search criterion The matched Item Information of description information is closed to illustrate to recognize new article, and then save the article of the article if do not found Information.If found, further judge whether the article position of the article identified changes.

During acquiring video, if a certain article remains static within a certain period of time, it is in the article In the period of stationary state, since the article position does not change, when being identified to the article, if for each The Item Information for the article that moment is identified saves, and can generate a large amount of repeated data, to avoid repeated data, works as identification When the position of the article out changes, then the Item Information of the article identified is saved, if the article identified Position there is no variation, then in the Item Information that only needs to find with time of the newest article identified substitution The article time of occurrence is to save the Item Information of the article after substitution, that is, the object to the article being saved before Article time of occurrence in product information is updated to the newest time for identifying the article, i.e., the article is identified from present image Time, which is saved to the Item Information of the updated article as article time of occurrence, can reduce article letter The data volume of breath, improves the speed of lookup, and reduces data space.

For judging whether the position of the article identified changes described in above-mentioned steps S113, some optional In embodiment, it can be judged by the following manner:

Step S1131, judge in the coordinate of article identified or the condition code of article and the Item Information saved Article coordinate or article condition code it is whether identical,

Step S1132, if it is not the same, then determining that the position of the article identified changes；

If step S1133, identical, it is determined that the position of the article identified does not change.

The condition code of article refers to the value for being used to indicate article characteristics obtained by image recognition algorithm, and this feature value is for example It is feature vector obtained from being abstracted as details of the deep learning neural network recognition method to article to gross feature, This feature value can accurately indicate the article identified, have opposite uniqueness.

When acquiring video, within the period that the article remains static, the object that is identified for each moment The condition code of product be it is identical, when the position of article changes, the condition code of calculated article can also change, for not It is also different with condition code for article, therefore, when in the condition code and the Item Information saved for judging the article identified When the condition code of article is all different, it can determine that the position of the article identified changes；Otherwise, it determines the object identified The position of product does not change.

The coordinate of article refers to the coordinate of article in the picture, and piece image is usually by multiple pixel groups arranged in arrays At, it can be using the pixel in the image upper left corner as origin, other pixels and origin have relative position, the relative position of pixel The as coordinate of the pixel.The pixel for the certain point or articles central position in each pixel that can also include by article Each coordinate for each pixel for including as article coordinate in the picture or article is as one group of data, by this group of data As the coordinate of article in the picture.

It, can when the coordinate of article in the coordinate for judging the article identified and the Item Information saved is all different To determine that the position of the article identified changes；Otherwise, it determines the position of the article identified does not change.

It needs, above-mentioned is identical, not identical, the range that allows that there is a certain error.

In an optional embodiment, target item can be searched by following two mode:

First way carries the picture of target item in look-up command, i.e., is searched by way of picture, above-mentioned Lookup and the matched target item information of look-up command from the Item Information saved may include:

Step S121, the picture of the target item carried to look-up command carries out image recognition, obtains retouching for target item State information；

Step S122, it using the description information of target item as search criterion, is found out from Item Information and target item The matched target item information of description information.

The picture comprising target object can be inputted in client, figure that this includes target item is carried in such look-up command When piece, at this point, image recognition can be carried out to the picture that this includes target item by image recognition algorithm, target item is obtained Description information, the description information of target item may include: the title of target item, the model of target item, target item Brand etc. can also obtain the condition code of target item by image recognition.

After the description information for obtaining target item, as search criterion, found out from Item Information and target item The matched target item information of description information.

The second way carries at least one description information of target item in look-up command, that is, passes through target object The mode of text information is searched, and above-mentioned search from the Item Information saved is believed with the matched target item of look-up command It ceases, may include:

Step S123, using the description information of the target item carried in look-up command as search criterion, from the object saved The matched target item information of description information with target item is searched in product information.

It can be in the text of the description information of client input target item, for example, the title of input target item, object Model, brand of target item of product etc., carry the description information in such look-up command, as search criterion, from article It is found out in information and the matched target item information of the description information of target item.

It is in such a way that text information is searched with the difference by picture searching mode, it, can when passing through picture searching The content that article can not be described with text information is obtained using image recognition, for example, target item is the cup with special shape Son can be identified after look-up command, which carries, includes the picture of the target item by deep learning neural network recognition method The condition code of the condition code of the target item, the target item can reflect the thin of the shape of the target item, color and article Information is saved, and then is searched from the Item Information saved with the condition code of target item, with the condition code of target item It carries out similarity calculation and the accuracy of articles seeking can be improved to find corresponding target item information.And pass through text When lookup, the condition code of target item cannot be obtained, is usually searched with the title of target item, model and brand etc., Since look-up command directly carries the description information of target item, do not need to carry out image recognition, therefore, search speed is relatively Fastly, if target item is uncommon article, the location information for finding target item can also be more accurate to.

In a kind of optional embodiment, as shown in figure 3, can also include: after above-mentioned steps S12

Step S13, according to target item information to the location information of client feedback target item.

The location information of target item be based on target item acquisition of information, the location information specifically can there are many, For example, article time of occurrence and the picture pick-up device mark etc. in target item information can be can determine the related of article position Information feeds back to client, for example, the picture pick-up device of acquisition target item can be known by the mark of picture pick-up device, and Picture pick-up device has installation site and acquires the visual angle of video, and accordingly, after feeding back to client, user can know object Grade judges the position of target item in the angular field of view of picture pick-up device；Or by target item time of occurrence and Picture pick-up device mark, can know time of occurrence of the target item in the angular field of view of picture pick-up device, and then judge object The time of the position of product and article in the position, after the location information of target item is fed back to client, user can be known Target item position, and then find target item.

In a kind of optional embodiment, as shown in figure 4, according to target item information described in above-mentioned steps S13 To the location information of client feedback target item, may include:

Step S131, according to target item acquisition of information Target Photo, Target Photo is that target item position is presented Picture；

Step S132, to client feedback Target Photo.

Item Information is that the article identified in the video acquired according to picture pick-up device generates, and be can wrap in Item Information The description information of article is included, and establishes article description information and the picture corresponding relationship of article position is presented, that is, is established The picture mapping relations of article description information and corresponding presentation article position, and then can be according to target item acquisition of information mesh It marks on a map piece.

Here the picture of presentation article position is that each frame image in the video acquired according to picture pick-up device generates Picture, picture pick-up device can the image of collection site picture in real time at this time can be with if having article in picture and being identified The description information of article is obtained, and the image comprising the article picture is saved as into picture, the picture comprising the article picture It can indicate the scene where article, article position can be presented, for example, position of the article in locating scene, article Ambient enviroment etc. in scene locating for the case where locating scene, article.

The corresponding relationship that the description information of the article of generation can be established with the corresponding picture that article position is presented It is stored in Item Information, and target item information is finding out from Item Information to match with target item description information Record, therefore, can by target item acquisition of information it is corresponding present target item position picture, then feed back To client.

In the present embodiment, the location information to the target item of client feedback is the figure that target item position is presented Piece, user can intuitively know the location of target item by observing the picture, convenient for searching target item, improve and use The efficiency of family lookup article.

In some alternative embodiments, according to target item acquisition of information target figure described in above-mentioned steps S131 Piece may include:

Step S1311, picture store path information is obtained from target item information, picture store path information indicates mesh It marks the description information of article and the corresponding relationship of the picture of target item position is presented；

Step S1312, corresponding Target Photo, article figure are obtained from item pictures library according to picture store path information Valut, which is stored with, is presented the picture of article position according to multiple that the collected video of picture pick-up device generates.

In the present embodiment, the memory space that the image data occupancy of article position is presented is larger, and Item Information is The memory space of lteral data, occupancy is smaller, therefore, can save respectively the picture of Item Information and presentation article position In different positions, classification saves image data and lteral data, is conducive to the reasonable distribution and utilization of memory space, and in object It may include picture store path information in product information, corresponding target can be obtained from item pictures library by store path information Picture, which is, for example, chained address, can be linked to item pictures library by chained address, get correspondence Target Photo.

In some instances, when the Target Photo of acquisition is multiple, Target Photo can be fed back to according to time inverted order Client.

When seen from the above description, according to target item acquisition of information Target Photo, the target item information inquired can Can have a plurality of, therefore, each target item information, which can correspond to, gets a Target Photo or target item letter Cease multiple corresponding Target Photos.Target Photo is generated according to each frame image of acquisition, and each frame image is sequentially in time Successively acquisition generates, therefore also has time sequencing according to the Target Photo that each frame image generates, and sequentially in time It sequentially generates, when returning to each Target Photo, client is fed back in the way of time inverted order, i.e., according to Target Photo Time (acquisition time of Target Photo) is generated from evening to early sequence, the Target Photo generated the latest returns at first, raw earliest At picture finally return to, when showing each Target Photo on the client in this way, it is most newborn for coming the Target Photo of foremost At, it comes rearmost Target Photo and generates earliest, the newest position for obtaining target item not only can be facilitated It sets, the convenient lookup to target item, and it is possible to help to understand the change in location feelings that target item occurs according to the time Condition facilitates the lookup that user carries out article.

In an optional embodiment, client transmission is received as shown in figure 5, working as described in above-mentioned steps S12 Target item look-up command when, search from the Item Information saved and believe with the matched target item of the look-up command It ceases, may include:

Step S124, looking into when the title of the title and its associated article for the carrying target item for receiving client transmission When looking for instruction, with the entitled search criterion of the title of target item and associated article, found out from Item Information respectively with The title of target item and the corresponding Item Information of the title of associated article；

Step S125, the article time of occurrence for including is filtered out from the Item Information found out within a preset time interval And the picture pick-up device for including identifies identical Item Information, records as with the matched target information of look-up command.

When identifying from video to article, one or more articles can be recognized, and obtain the article of article Information, Item Information for example may include the title of article, the model of article, brand of article etc., if the article identified It is relatively conventional article, for example, picture pick-up device is arranged in office space, and in the office of office space, have a large amount of Article is repeated, such as: mobile phone, notebook and charger etc., if the Item Information of the article identified saved only includes object The title of product when then being searched according to look-up command target item (for example, mobile phone), can find picture pick-up device and identify All information for appearing in the mobile phone in picture pick-up device, finally obtain the location information of a large amount of mobile phone, and these positions are believed The noise of breath is larger, after feeding back to client, the location information of target item required for needing user's artificial screening to obtain, Therefore the search efficiency of article is low.

For uniqueness article or the lower article of repetitive rate, it can be searched, can be looked into faster by Item Title Target item information is found, determines the location information of target item.

And when searching of ware higher for repetitive rate, can according to the customized information of article, for example, The modes such as brand, the model of article, the ornament information of the packaged information of article, article of article are searched, and are referred in lookup The customized information of belongings, can be improved search efficiency in order.

When searching of ware higher for repetitive rate, another kind be through this embodiment in combination search Mode, the title of target item and its title of associated article are carried in look-up command, is referred to the associated article of target item The article in identical image is appeared within same time or some period with target item, for example, it is desired to search Article is mobile phone, and simultaneously there are also other articles around mobile phone, for example, cup, at this point, the information carried in look-up command is Mobile phone and cup.

Item Information is searched using the title of the title of target item and associated article as keyword, is searched Item Information corresponding with the title of the title of target item and associated article respectively out, then according in these Item Information Article time of occurrence and picture pick-up device mark are screened again, filter out article time of occurrence wherein included in preset time Picture pick-up device that is in interval and including identifies identical Item Information.

Each frame image is comprising target item and association in the video that same picture pick-up device acquires within a preset time interval The image of article, and the Item Information that these images obtain according to the Item Information after screening, therefore, by combining lookup side Formula can reduce the range of the Item Information of lookup, reduce the quantity of matched target item information, and then accurately obtain The location information of target item is taken, search efficiency is improved.

In addition to it is above-mentioned lookup is combined according to the title of target item and its title of associated article other than, can also be with it His mode is combined lookup, for example, referring to shown in Fig. 6, if user can determine that the target item to be searched is A, and And can determine the position that the target item A to be searched once occurred, for example, meeting room b, and once according to target item A Position (picture pick-up device of the determining corresponding position meeting room b), such as the picture pick-up device 2 in meeting room b, and article through occurring It may include picture pick-up device mark in information, when searching target item, object can be carried in look-up command The title (any at least one description information such as model or brand of target item) and picture pick-up device mark of product, with object Being identified as search criterion for the title of product A and picture pick-up device 2, finds out corresponding target item information from Item Information, The mark of title and picture pick-up device 2 in the target item information simultaneously comprising the target item A in look-up command, and then basis The location information of the target item acquisition of information target item found also can achieve the range for reducing the Item Information searched Purpose, naturally it is also possible to other two or more the description information of target item is that search criterion is combined and looks into It looks for, the present embodiment does not limit this.

In an optional embodiment, as shown in figure 5, the above method can with the following steps are included:

Step S126, it is played back according to the article time of occurrence positioning starting in the matched target item information of look-up command Time；

Step S127, visitor will be fed back to from the video record after the starting playback duration transferred in the video record of storage Family end, the video record of storage are to be generated according to the collected video of picture pick-up device.

In the present embodiment, the article time of occurrence positioning in target item information filtered out according to above-described embodiment is originated Playback duration, the article time of occurrence are also time of occurrence and the picture pick-up device acquisition of the image of target item in video The time comprising target item video arrived, due to target item information may have it is a plurality of, accordingly, it is possible to include multiple articles go out Between current, starting playback can be transferred from the video record of storage using any time in multiple times as starting playback duration Video record after time, scene where dynamically continuously can reflecting target item due to the video record, feeds back to visitor Behind the end of family, user can know the position of target item accordingly, and can be tracked to target item by video record, Facilitate the whereabouts of understanding target item.

It should be noted that method of the above-mentioned feedback video record to client, can after various lookup modes, and It is not limited to shown in Fig. 5 after step 125.

In an optional embodiment, according to target item acquisition of information target figure described in above-mentioned steps S131 Before piece, further includes:

Step S1301, the area map of the distributing position for indicating each picture pick-up device and each picture pick-up device mark is obtained；

Step S1302, Target Photo is superimposed upon on area map, and Target Photo is located at corresponding acquisition target item Picture pick-up device distributing position near；

To Target Photo described in client feedback described in above-mentioned steps S132, comprising: be superimposed with target to client feedback The area map of picture.

In the present embodiment, as shown in fig. 6, area map is further obtained, for example, area map shown in fig. 6, the area An office space is shown to domain, which includes Office Area and meeting room a, meeting room b and meeting room c, also, is somebody's turn to do The distributing position that the picture pick-up device 1-15 of office space is set is shown in area map, and has marked each picture pick-up device Mark, such as number 1-15, the Target Photo that can be will acquire (such as picture t1- picture t3) be superimposed upon the area map On, also, each Target Photo be located at it is corresponding acquisition target item picture pick-up device distributing position near, for example, picture t1 Near picture pick-up device 2, picture t2 is located near picture pick-up device 7, and picture t3 is located near picture pick-up device 11, in this way can be more Add the distributing position for intuitively knowing picture corresponding picture pick-up device and picture pick-up device that target item position is presented, helps In the whereabouts for understanding target item.

In an optional embodiment, the target item of client transmission is received described in above-mentioned steps S12 When look-up command, searched and the matched target item information of look-up command from the Item Information saved, comprising:

When receiving the multiple continuous look-up command of target item of client transmission, repeatedly continuously from having saved Item Information in search with the matched target item information of look-up command, wherein the target item carried in each look-up command Description information it is different, and the picture pick-up device in the description information of the target item in each secondary look-up command identifies corresponding camera shooting Device location is adjacent, and the article time of occurrence in the description information of the target item in each secondary look-up command is according to feeding back to client The video record at end determines.

In a kind of optional embodiment, described in above-mentioned steps S12 from the Item Information saved search with The matched target item information of look-up command, comprising:

Using the description information of the target item carried in look-up command as search criterion, looked into from the Item Information saved It looks for and being identified comprising the picture pick-up device adjacent with the picture pick-up device mark corresponding position of the acquisition target item, and include except target The Item Information of description information other than the picture pick-up device mark of article, it is above-mentioned to remove target item as target item information Picture pick-up device mark other than description information can for target item description information in other relevant informations, for example, mesh Mark Item Title, customized information of target item etc..

In the present embodiment, look-up command can be inputted in client continuous several times, mesh is repeatedly searched by multiple look-up command Item Information is marked, after searching article, user can determine that target by the video record that observation feeds back to client The article time that corresponding picture pick-up device and target item disappear in video record when disappearing in video record, in order into One step tracks the whereabouts of article, and lookup can be tracked to target item, the further location information for obtaining target item, with Target item is recorded according to target item in video when disappearing in video record centered on corresponding picture pick-up device position The time to disappear as in searches target item.

For example, referring to shown in Fig. 6, when determining that target item disappears, corresponding picture pick-up device is picture pick-up device in figure 4, when time of disappearance is 8:00, the time of above-mentioned disappearance, the title of target item and above-mentioned are carried in look-up command The mark of picture pick-up device 4, accordingly searches Item Information, search Item Information in include target item title, with take the photograph As the adjacent picture pick-up device mark of the mark corresponding position of equipment 4 is (for example, picture pick-up device 1 and picture pick-up device 5 are and take the photograph in Fig. 6 Picture 4 corresponding position of equipment is adjacent, then the adjacent picture pick-up device for identifying corresponding position with picture pick-up device 4 is identified as picture pick-up device 1 Mark and picture pick-up device 5 mark), and Item Information of the article time of occurrence after the time of above-mentioned disappearance will be looked into The Item Information found includes according to picture pick-up device in the target item information found as matched target item information The Item Information for the target item that the video of 1 acquisition generates and the target item generated according to the video that picture pick-up device 5 acquires Item Information, that is, centered on 4 corresponding position of picture pick-up device, search each camera shooting adjacent with 4 corresponding position of picture pick-up device The corresponding target item information of equipment, and then according to the location information of the target item acquisition of information to target item, Yong Huke The location information of the target item required to look up is judged whether it is according to the location information for the target item for feeding back to client, and And, it can be determined that the location information for the target item searched required for going out is the video life acquired according to that above-mentioned picture pick-up device At, for example, being picture pick-up device 5, then further search again, the picture pick-up device mark that look-up command carries when searching again Know different from the picture pick-up device mark that last time look-up command carries, is to be identified with the picture pick-up device that is carried in last time look-up command pair The picture pick-up device that the picture pick-up device answered is positioned proximate to identifies (for example, mark of picture pick-up device 5 shown in Fig. 6), searches again When it is identical as last lookup method, search include in Item Information target item title, corresponding with the mark of picture pick-up device 5 Position it is adjacent picture pick-up device mark (for example, in Fig. 6 picture pick-up device 6 be it is adjacent with 5 corresponding position of picture pick-up device, then with camera shooting The adjacent picture pick-up device that equipment 5 identifies corresponding position is identified as the mark of picture pick-up device 6), the target item information found In include according to picture pick-up device 6 acquire video generate target item Item Information, that is, again search when be to take the photograph As centered on 5 corresponding position of equipment, searching target item letter corresponding with the adjacent picture pick-up device 6 of 5 corresponding position of picture pick-up device Breath, and then according to the location information of the target item acquisition of information to target item, user can be according to the mesh for feeding back to client The location information of mark article judges whether it is the location information of the target item required to look up again, can repeatedly continuously repeat later Above-mentioned search procedure, it is adjacent that the picture pick-up device in each secondary look-up command, which identifies corresponding picture pick-up device position, and every It is to be searched centered on identifying corresponding position with the picture pick-up device carried in current lookup instruction when secondary lookup, is set according to camera shooting The correlation of standby position target item is searched step by step, until the location information of the target item according to feedback is true The position that target item finally occurs is made, therefore, in the present embodiment, target item can be determined by repeatedly continuous search Change in location track understands the whereabouts of target item, improves search efficiency.

In above-described embodiment, for obtaining each camera shooting adjacent with the picture pick-up device mark corresponding position of acquisition target item The mode of device identification can there are many, for example, may include the geographical location of each picture pick-up device in Item Information, according to each The distance in the corresponding geographical location of picture pick-up device judges whether adjacent, or is stored in advance in Item Information and sets with camera shooting The adjacent each picture pick-up device mark of standby mark corresponding position, the present embodiment do not limit this.

In an optional embodiment, the picture of personage associated with target item, people are carried in look-up command Object picture is to intercept from the video record for feed back to client.

In the present embodiment, to after client feedback video record, user's observable video record finds target object by people When concealing, such as find that someone puts into target item in pocket or packet, at this point, user can intercept the people from video record The picture of object, the picture of personage can be face picture or the picture including entire body, and the picture of the personage is inputted visitor The picture of the personage is carried in the end of family, in look-up command, and then can include in the picture of personage from this by image recognition algorithm The condition code of the personage is obtained, then using the condition code of personage as search criterion, obtains the matched target of condition code with personage Item Information, and then obtain the information of the personage, or be tracked in such a way that multiple in above-described embodiment is continuously searched It searches, the whereabouts of target item can be tracked by tracking the personage.

Corresponding with the aforementioned embodiment of articles seeking method based on video, present invention also provides the objects based on video The embodiment of product lookup device.

Referring to shown in Fig. 7, it is somebody's turn to do the articles seeking device 1 based on video, comprising:

Article recognition unit 10, for identifying one or more articles from the collected video of picture pick-up device；

Item Information storage unit 11, for saving the Item Information of the article identified；

Look-up command receiving unit 12, for when receive client transmission target item look-up command when, from It is searched and the matched target item information of the look-up command in the Item Information of preservation.

Above-mentioned articles seeking device further include:

Object is presented according to multiple that the collected video of picture pick-up device generates for storing in item pictures inventory storage unit 13 The picture of product position.

The embodiment of the application articles seeking device can be using on the server.

In an optional embodiment, above-mentioned Item Information storage unit is particularly used in:

If not searching, the Item Information of the article identified is saved；

Further, in above-mentioned Item Information storage unit, whether the position for judging the article identified becomes Change, comprising:

Above-mentioned look-up command receiving unit is particularly used in:

Or look-up command receiving unit is particularly used in: with the description letter of the target item carried in the look-up command Breath is search criterion, searches from the Item Information saved and believes with the matched target item of the description information of the target item Breath.

Above-mentioned apparatus can also include:

Location information feedback unit, for according to the target item information to target item described in the client feedback Location information.

Above-mentioned location information feedback unit is particularly used in:

To Target Photo described in the client feedback.

It is described according to the target item acquisition of information Target Photo in above-mentioned location information feedback unit, comprising:

It is described to Target Photo described in the client feedback in above-mentioned location information feedback unit, comprising:

Above-mentioned look-up command receiving unit can be also used for:

Further, above-mentioned look-up command receiving unit can be also used for:

Above-mentioned look-up command receiving unit can be also used for:

The lookup from the Item Information saved and the look-up command in above-mentioned look-up command receiving unit The target item information matched, comprising:

Above-mentioned location information feedback unit can be also used for:

It is described according to the target item acquisition of information Target Photo before:

It is described to Target Photo described in the client feedback, comprising:

The area map of the Target Photo is superimposed with to the client feedback.

The figure of personage associated with target item is carried in the look-up command in above-mentioned look-up command receiving unit Piece, personage's picture are to intercept from the video record for feeding back to the client.

For device embodiment, since it corresponds essentially to embodiment of the method, so related place is referring to method reality Apply the part explanation of example.The apparatus embodiments described above are merely exemplary, wherein described be used as separation unit The unit of explanation may or may not be physically separated, and component shown as a unit can be or can also be with It is not physical unit, it can it is in one place, or may be distributed over multiple network units.It can be according to actual The purpose for needing to select some or all of the modules therein to realize application scheme.Those of ordinary skill in the art are not paying Out in the case where creative work, it can understand and implement.

Installation practice can also be realized by software realization by way of hardware or software and hardware combining.With It is the place by server applied by the articles seeking device as the device on a logical meaning for software realization Computer program instructions corresponding in nonvolatile memory are read into memory what operation was formed by reason device.From hardware view Speech, as shown in figure 8, for a kind of hardware structure diagram of the application articles seeking device place server, in addition to processing shown in Fig. 8 Except device, memory, external interface and nonvolatile memory, the server in embodiment where device is generally according to reality Function can also include other hardware, repeat no more to this.

The embodiment of the present invention also provides a kind of articles seeking system based on video, as shown in figure 9, the system includes: to take the photograph The articles seeking device 1 as described in equipment 2 and above-described embodiment, the picture pick-up device 2 are used to the video of acquisition being sent to institute State articles seeking device 1.

The embodiment of the present invention also provides a kind of machine readable storage medium, is stored with machine-executable instruction, processed When device is called and executed, the machine-executable instruction promotes the processor to execute described in above-described embodiment any one Method.

In one embodiment, machine readable storage medium can be any electronics, magnetism, optics or other physical stores Device may include or store information, such as executable instruction, data, etc..For example, machine readable storage medium may is that RAM (Radom Access Memory, random access memory), volatile memory, nonvolatile memory, flash memory, storage are driven Dynamic device (such as hard disk drive), solid state hard disk, any kind of storage dish (such as CD, dvd) or similar storage are situated between Matter or their combination.

The foregoing is merely the preferred embodiments of the application, not to limit the application, all essences in the application Within mind and principle, any modification, equivalent substitution, improvement and etc. done be should be included within the scope of the application protection.

Claims

1. a kind of articles seeking method based on video characterized by comprising

Save the Item Information of the article identified；

When receiving the look-up command of target item of client transmission, searches from the Item Information saved and looked into described Look for the target item information of instructions match.

2. the method according to claim 1, wherein the Item Information for saving the article identified, comprising:

Using the combination description information of the article identified as search criterion, searched and the identification from the Item Information saved The matched Item Information of combination description information of article out；

If not searching, the Item Information of the article identified is saved；

If finding, judge whether the article position of the article identified changes, if it is, saving the article identified Item Information, if it is not, then article time of occurrence in the Item Information found is replaced with the newest article that identifies Time simultaneously saves.

3. according to the method described in claim 2, it is characterized in that, whether the position for judging the article identified becomes Change, comprising:

Judge the condition code of the coordinate of article identified or article and the coordinate of the article in the Item Information found or Whether the condition code of person's article is identical,

4. the method according to claim 1, wherein described search from the Item Information saved is looked into described The target item information for looking for instructions match includes:

Image recognition is carried out to the picture for the target item that the look-up command carries, obtains the description information of target item；

Using the description information of the target item as search criterion, searched and the target item from the Item Information saved The matched target item information of description information.

5. the method according to claim 1, wherein described search from the Item Information saved is looked into described The target item information for looking for instructions match includes:

Using the description information of the target item carried in the look-up command as search criterion, looked into from the Item Information saved It looks for and the matched target item information of the description information of the target item.

6. the method according to claim 1, wherein this method further comprises:

7. according to the method described in claim 6, it is characterized in that, it is described according to target item information to the client feedback The location information of the target item includes:

According to the target item acquisition of information Target Photo, the Target Photo is the figure that target item position is presented Piece；

To Target Photo described in the client feedback.

8. the method according to the description of claim 7 is characterized in that described according to the target item acquisition of information target figure Piece, comprising:

Picture store path information is obtained from the target item information, the picture store path information indicates target item Description information and present target item position picture corresponding relationship；

Corresponding Target Photo, the item pictures inventory are obtained from item pictures library according to the picture store path information It contains and the picture of article position is presented according to multiple that the collected video of picture pick-up device generates.

9. method according to claim 7 or 8, which is characterized in that it is described to Target Photo described in the client feedback, Include:

10. the method according to claim 1, wherein

It is described when receive client transmission target item look-up command when, from the Item Information saved search and institute State the matched target item information of look-up command, comprising:

When receiving the look-up command of title of the title of carrying target item of client transmission and its associated article, with institute State the title of target item and the entitled search criterion of associated article, found out from the Item Information respectively with the mesh Mark the corresponding Item Information of title of the title and associated article of article；

The article time of occurrence for including is filtered out from the Item Information found out within a preset time interval and comprising The identical Item Information of the mark of picture pick-up device, as with the matched target item information of the look-up command.

11. the method according to claim 1, wherein further include:

The client will be fed back to from the video record after the starting playback duration transferred in the video record of storage, The video record of the storage is to be generated according to the collected video of picture pick-up device.

12. according to the method for claim 11, which is characterized in that the target item that client transmission ought be received When look-up command, searched and the matched target item information of the look-up command from the Item Information saved, comprising:

When receiving the multiple continuous look-up command of target item of client transmission, repeatedly continuously from the object saved Lookup and the matched target item information of the look-up command in product information, wherein the target item carried in each look-up command Description information it is different, and the picture pick-up device in the description information of the target item in each secondary look-up command identifies corresponding camera shooting Device location is adjacent, and the article time of occurrence in the description information of the target item in each secondary look-up command is according to feeding back to client The video record at end determines.

13. according to the method for claim 12, which is characterized in that it is described from the Item Information saved search with it is described The matched target item information of look-up command, comprising:

Using the description information of the target item carried in the look-up command as search criterion, looked into from the Item Information saved It looks for and being identified comprising the picture pick-up device adjacent with the picture pick-up device mark corresponding position of the target item is acquired, and include except target The Item Information of description information other than the picture pick-up device mark of article, as target item information.

14. method according to claim 7 or 8, which is characterized in that

It is described according to the target item acquisition of information Target Photo before, further includes:

The Target Photo is superimposed upon on the area map, and the Target Photo is located at corresponding acquisition target item Near the distributing position of picture pick-up device；

It is described to Target Photo described in the client feedback, comprising:

The area map of the Target Photo is superimposed with to the client feedback.

15. according to the method for claim 11, which is characterized in that carried in the look-up command associated with target item Personage picture, personage's picture is to intercept from the video record for feeding back to the client.

16. a kind of articles seeking device based on video characterized by comprising

Look-up command receiving unit, for when receive client transmission target item look-up command when, from what is saved It is searched and the matched target item information of the look-up command in Item Information.

17. lookup device according to claim 16, which is characterized in that further include:

Article place is presented according to multiple that the collected video of picture pick-up device generates for storing in item pictures inventory's storage unit The picture of position.

18. a kind of articles seeking system based on video characterized by comprising picture pick-up device and claim 16 or 17 The articles seeking device, the picture pick-up device are used to the video of acquisition being sent to the articles seeking device.

19. a kind of machine readable storage medium, which is characterized in that be stored with machine-executable instruction, by processor call and When execution, the machine-executable instruction promotes the processor perform claim to require the described in any item methods of 1-15.