JP4752628B2 - Drawing search system, drawing search method, and drawing search terminal - Google Patents

Description

  The present invention relates to a drawing search system, a drawing search method, and a drawing search terminal for searching for drawing via a network such as the Internet.

  As a conventional image search apparatus, Patent Document 1 discloses an image search apparatus that searches for an image recorded in advance in a memory based on a drawn and input image image. Further, as a conventional information retrieval device, a plurality of types and a plurality of image data corresponding to characters, symbols, photographic images, illustrations, and other image images are stored in advance in a database as retrieval information, and each of these image data is stored. An information search device that outputs image data corresponding to an image specified by a search key when a search key such as a specific keyword or code data previously added in a one-to-one relationship is input to It is described in Document 2.

  In addition, in an image search engine that searches for similar images using feature quantities including colors and shapes of images as search keys, an image searcher searches for a desired image in an environment where a variety of images are managed together with categories. Further, Patent Document 3 discloses an image search method and apparatus for searching for similar images using text indicating image feature quantities and categories as search keys and a recording medium on which an image search program is recorded.

  FIG. 10 is a diagram illustrating a configuration example of a conventional image search apparatus.

In the image search apparatus shown in FIG. 10, the classification tree management unit 140 manages keywords, the categories to which the keywords belong, images corresponding to the keywords, and image feature quantities as classification trees. From the displayed classification tree, the image corresponding to the keyword selected by the image searcher is displayed to the image searcher and displayed by the image searcher. The feature amount of the selected image is acquired, and the image DB 300 is searched from the DB search unit 130 using the acquired feature amount and category of the image as search keys.
JP 2005-63465 A JP-A-7-85097 JP 2002-63172 A

  However, in the one described in Patent Document 1, since a desired image is searched from images recorded in a memory in advance, a necessary image can be obtained only from limited images. There is a problem that information related to an image to be searched cannot be acquired.

  Moreover, in what was described in Patent Document 2, since an image is searched based on a search key, an image floating in the head is not searched as an illustration by hand, but close to different images for each person. In addition to searching for a desired image, a desired image is searched from pre-registered images, so that a necessary image can be obtained only from a limited number of images.

  Moreover, in what was described in patent document 3, in order for a searcher to extract a desired image, it selects for every category to which a keyword belongs, and there exists a problem similar to the above.

  The present invention has been made in view of the problems of the conventional techniques as described above, and the searcher can automatically obtain a large amount of drawings close to the image floating in his head. An object is to provide a drawing search system, a drawing search method, and a drawing search terminal.

In order to achieve the above object, the present invention provides:
A user terminal for inputting a drawing image and a drawing search in which drawing data is registered, the drawing data is searched based on the drawing image input to the user terminal, and the drawing data is provided to the user terminal In a drawing search system in which a terminal is connected via a network,
The drawing search terminal
A drawing information database in which drawing data and information related to the drawing data are registered;
A drawing search unit for searching for drawing data and information related to the drawing data based on drawing input to the user terminal from the drawing information database;
A combined display unit that transmits drawing data searched by the drawing search unit and information related to the drawing data to the user terminal;
A drawing data registration unit that registers drawing drawn by image input to the user terminal with drawing information database as drawing data in association with identification information capable of identifying the user terminal;
The composite display unit transmits the drawing data to a first user terminal identified by identification information associated with the drawing data searched by the drawing search unit, and the first user Information related to the drawing provided from the terminal is transmitted to the second user terminal to which the drawing is input as an image.

  In the present invention configured as described above, when drawing is input to the user terminal, the drawing search unit of the drawing search terminal stores the drawing data in the drawing information database in which the drawing data is registered. Drawing data is retrieved based on the image-input drawing. At this time, the drawing input to the user terminal is registered in the drawing information database as drawing data in the drawing data registration unit of the drawing search terminal. Then, in the composite display unit of the drawing search terminal, the drawing data searched by the drawing search unit is transmitted to the user terminal. In addition, in the composite display unit of the drawing search terminal, the drawing data is transmitted to the first user terminal identified by the identification information associated with the drawing data searched by the drawing search unit. Information relating to drawing provided from the user terminal is transmitted to the second user terminal to which the drawing is input as an image.

  In this way, drawing data is retrieved based on the drawing input to the user terminal and provided to the user terminal, so the searcher automatically obtains a drawing close to the image floating in the head. be able to. In addition, the drawing input as an image to the user terminal is registered in the drawing information database as drawing data each time, and the drawing data for the first user terminal that has registered the drawing data retrieved from the drawing information database. Is transmitted, and the information regarding the drawing provided from the first user terminal is transmitted to the second user terminal to which the drawing is input, so that a large amount of drawing data is registered in the drawing information database, The user can acquire a large amount of drawing.

Also, a user terminal for inputting an image of drawing and drawing data are registered, the drawing data is searched based on the drawing input as an image to the user terminal, and the drawing data is provided to the user terminal. In a drawing search system in which a drawing search terminal is connected via a network,
The drawing search terminal
A drawing information database in which drawing data and information related to the drawing data are registered;
A drawing search unit for searching for drawing data and information related to the drawing data based on drawing input to the user terminal from the drawing information database;
A combined display unit that transmits drawing data searched by the drawing search unit and information related to the drawing data to the user terminal;
A drawing data registration unit that registers drawing drawn by image input to the user terminal with drawing information database as drawing data in association with identification information capable of identifying the user terminal;
When the drawing for which the drawing data registered in the drawing information database is to be searched is input as an image at the first user terminal and information related to the drawing is input, the composite display unit The drawing search system, wherein the drawing and information related to the drawing are transmitted to a second user terminal identified by the identification information associated with the drawing data.

  In the present invention configured as described above, when drawing is input to the user terminal, the drawing search unit of the drawing search terminal stores the drawing data in the drawing information database in which the drawing data is registered. Drawing data is retrieved based on the image-input drawing. At this time, the drawing input to the user terminal is registered in the drawing information database as drawing data in the drawing data registration unit of the drawing search terminal. Then, in the composite display unit of the drawing search terminal, the drawing data searched by the drawing search unit is transmitted to the user terminal. In addition, in the composite display unit of the drawing search terminal, when a drawing for which drawing data registered in the drawing information database is to be searched is input as an image at the first user terminal and information related to the drawing is input, Information relating to drawing and drawing is transmitted to the second user terminal identified by the identification information associated with the drawing data in the drawing information database.

  In this way, drawing data is retrieved based on the drawing input to the user terminal and provided to the user terminal, so the searcher automatically obtains a drawing close to the image floating in the head. be able to. In addition, each time the image input to the user terminal is registered in the drawing information database as the drawing data, and the drawing for which the drawing data registered in the drawing information database is to be searched is the first user terminal. When the image input and information related to the drawing are input, the drawing information is transmitted to the second user terminal that has registered the drawing data registered in the drawing information database. A large amount of drawing data is registered in the database, and the user can acquire a large amount of drawing.

  As described above, in the present invention, drawing data is retrieved based on the drawing input to the user terminal and provided to the user terminal, so that the drawing close to the image that the searcher has floated in his head. The drawing input to the user terminal is registered in the drawing information database as the drawing data each time, and the information about the drawing provided from the user terminal is used for other purposes. Since a large amount of drawing data is registered in the drawing information database, the user can acquire a large amount of drawing.

  Embodiments of the present invention will be described below with reference to the drawings.

  FIG. 1 is a diagram showing an embodiment of a drawing search system of the present invention.

  As shown in FIG. 1, the present embodiment is a user terminal (searcher) 1 that is a user terminal, a drawing search terminal 2, an other user terminal (registrant) 3 that is a user terminal, and a user terminal. Another user terminal (searcher) 4 and a proxy search site 5 are connected via a network 6 such as the Internet.

  A user terminal (searcher) 1 is an information processing apparatus such as a personal computer, a mobile phone, or a portable information terminal, and accesses a drawing information database provided by the drawing search terminal 2, and the drawing data and information related thereto. Is displayed on the screen. Examples of drawing data include places (parks, stations, tourist attractions, etc.), objects (products, buildings, animals, plants, etc.), people (historical figures, characters, etc.), time (season, night, climate, etc.) The drawing data is similar to the drawing input by hand and the image is information related to the drawing. In the drawing information database provided by the drawing search terminal 2, drawing data similar to drawing input by hand and an image related to the drawing are registered. In addition, the user terminal (searcher) 1 has a function that allows a user to input a handwritten image of a place, an object, a person, or the like that has come to mind in the mind of the searcher. For example, a touch panel is provided, and drawing is input as an image by touching the touch panel with a pen or the like. In addition to image input by illustration, drawing input on the screen can also be input by text, and the input text is converted into an illustration. This is realized by associating previously registered drawing information with a word in the user terminal (searcher) 1. For example, when a sentence “A boy rides a bicycle on the Sumida River bridge” is input, a drawing of “Sumida River”, “Bridge”, “Boy” and “Bicycle” is displayed. Also, voice input is possible, and the input voice is once converted into characters and then converted into illustrations. The drawing image input in this way is provided with a function of transmitting to the drawing search terminal 2 via the network 6. Further, it has a function of transmitting a plurality of drawing screens to the drawing search terminal 2 at a time.

  The drawing search terminal 2 is an information processing device such as a workstation server that searches for drawing information, receives a drawing image transmitted from the user terminal (searcher) 1, searches a database of drawing information, and receives the drawing image. A function of transmitting a drawing image having high similarity to the drawing image to the user terminal 1 is provided. Further, the drawing search terminal 2 searches for a drawing image, and searches the user terminal (searcher) 1, other user terminal (registrant) 3, other user terminal (searcher) 4, and proxy search site 5 via the network 6. Send. Further, it has a function of receiving information related to drawing from the other user terminal (registrant) 3, the other user terminal (searcher) 4, and the proxy search site 5. Each time this drawing image is searched, the drawing image transmitted from the user terminal (searcher) 1 is registered in the drawing information database, so that the latest and large amount of information can be provided to the user terminal. it can. It is also possible to provide the latest and large amount of information to the other user terminal (registrant) 3, the other user terminal (searcher) 4 and the proxy search site 5 by charging or a point system.

  The other user terminal (registrant) 3 is an information processing apparatus such as a personal computer, a mobile phone, or a portable information terminal, and receives a drawing image searched from the database from the drawing search terminal 2. Here, as a result of a drawing search performed by the drawing search terminal 2 on a drawing image such as a place, an object, or a person that the user terminal (searcher) 1 thinks in his / her head, the other user terminal (registrant) 3 It is determined that the drawing image is similar to the already registered drawing image. Based on this, information related to this drawing image is transmitted to the user terminal (searcher) 1 via the drawing search terminal 2.

  The other user terminal (searcher) 4 is an information processing apparatus such as a personal computer, a mobile phone, or a portable information terminal, and receives the drawing image searched from the database from the drawing search terminal 2. Here, as a result of a drawing search performed by the drawing search terminal 2 on a drawing image such as a place or an object or a person that the user terminal (searcher) 1 has thought in his / her mind, the other user terminal (searcher) 4 It is determined to be similar to the drawing image retrieved later. Based on this, information related to this drawing image is transmitted to the user terminal (searcher) 1 via the drawing search terminal 2.

  The agency search site 5 is a search search company that performs drawing search by professional personnel. For example, an information processing apparatus such as a workstation server, a personal computer, a mobile phone, or a portable information terminal installed in a search search company receives a drawing image input to the user terminal (searcher) 1. Here, a drawing image similar to this drawing is extracted as a result of a drawing search performed on the drawing search terminal 2 with respect to a drawing image of a place, object, person or the like that the user terminal (searcher) 1 has thought of in his head. If not, a drawing search is performed on behalf. In the agency search site 5, a specialist performs a drawing search using materials such as books and the Internet, and the specialist determines the similarity. Based on this, information related to the drawing image is transmitted to the user terminal (searcher) 1 via the drawing search terminal 2. When transmitting the drawing search to the drawing search terminal 2, the user terminal (searcher) 1 can set the selection as to whether the drawing search is desired on behalf of the proxy search site 5 and transmit it.

  FIG. 2 is a block diagram showing a configuration of the drawing search terminal 2 shown in FIG.

  As shown in FIG. 2, the drawing search terminal 2 in this embodiment includes a drawing recognition extraction unit 7, a drawing information registration unit 8, a drawing information database 8 a, a drawing search unit 9, and a composite display unit 10. Yes.

  The drawing recognition extraction unit 7 receives a drawing image input by the user terminal (searcher) 1, refers to the drawing information database 8 a for the received drawing image, and displays an illustration of a place, an illustration of an object, a human Identify if it is an illustration. In addition, a characteristic part, color, shape, size, position, etc. of the drawn image are recognized and extracted.

  The drawing information registration unit 8 classifies the target portion of the drawing image extracted by the drawing recognition extraction unit 7 by classification. For example, if a person's drawing image shows a tie in a suit, a business man, and if wearing a hat and uniform, identify them as baseball players. Then, the drawing image target part is registered in the drawing information database 8a as drawing data in descending order of priority for each classification. This priority is set based on the degree of extraction of the portion extracted by the drawing recognition extraction unit 7. Thereby, a drawing image with a high degree of extraction can be searched quickly. In addition, for this drawing image, information related to drawing is also registered in the drawing information database 8a. Furthermore, when registering a drawing image and information related to the drawing in the drawing information database 8a, a user ID serving as identification information for identifying the user terminal to which the drawing is input corresponds to the information related to the drawing image and the drawing. Then, it is registered in the drawing information database 8a.

  For the drawing image transmitted from the user terminal (searcher) 1, the drawing search unit 9 performs a drawing image target portion (color, shape, size, etc.) with respect to the drawing data registered in the drawing information database 8 a. Position), etc. are combined by moving, enlarging, reducing, etc., and compared, and narrowed down by drawing search. Then, the drawing information database 8a is searched for drawing data having a high similarity to the drawing image transmitted from the user terminal (searcher) 1. Also, information related to the drawing is searched from the drawing information database 8a.

  As a result of the drawing search performed by the drawing search unit 9, the composite display unit 10 searches the drawing information database 8a for drawing data having a high similarity to the drawing image transmitted from the user terminal (searcher) 1. If it is, the drawing data and information about drawing are transmitted to the user terminal (searcher) 1. When transmitting drawing data and information related to drawing to the user terminal (searcher) 1, they are combined and transmitted. Further, the other user terminal (registrant) 3 who has already registered the drawing data searched by the drawing search unit 9 is requested to provide information related to the drawing. Information on the provided drawing is transmitted to the user terminal (searcher) 1. In addition, after the user terminal (searcher) 1 performs a drawing search, the other user terminal (searcher) 4 also performs a drawing search search. As a result, similar to the drawing data registered by the user terminal (searcher) 1 If so, the drawing data transmitted from the other user terminal (searcher) 4 and information related thereto are automatically transmitted to the user terminal (searcher) 1. Further, if drawing data having a high similarity to drawing is not found as a result of the drawing search, the drawing search is sent to the substitute search site 5 that performs drawing search instead. In addition, the drawing information registration unit 8 is notified of information from the other user terminal (registrant) 3 and the proxy search site 5.

  The operation of the drawing search system configured as described above will be described below.

  FIG. 3 is a diagram in which drawing data searched based on drawing input by the user terminal (searcher) 1 in the drawing search system shown in FIG. 1 is registered by another user terminal (registrant) 3. It is a figure for demonstrating the process in a certain case.

  In the user terminal (searcher) 1, the drawing image (b) is input by handwriting on the drawing search screen and transmitted to the drawing search terminal 2 (A1).

  In the drawing search terminal 2, the drawing search is performed with reference to the drawing information database 8 a for the drawing image (b) transmitted from the user terminal (searcher) 1. As a result, drawing data (b1, b2, b3) having a high similarity to the drawing image (b) transmitted from the user terminal (searcher) 1 is searched, and this drawing data (b1, b2, b3). Is transmitted to the user terminal (searcher) 1. The similarity is set in advance in the drawing search terminal 2, and it is determined whether the drawn images are similar using the set similarity. Here, the drawing data (b1, b2, b3) searched by the drawing search terminal 2 is obtained by registering the drawing data (b1) by the other user terminal (registrant) 31, and the drawing data (b2). Is registered by the other user terminal (registrant) 32, and the drawing data (b 3) is registered by the other user terminal (registrant) 33. Therefore, the drawing data (b1) is transmitted to the other user terminal (registrant) 31, the drawing data (b2) is transmitted to the other user terminal (registrant) 32, and the drawing data (b3) is transmitted to the other user. It is transmitted to the terminal (registrant) 33 (A2).

  Then, the information (c1) related to the drawing data (b1) is extracted and transmitted to the drawing search terminal 2 at the other user terminal (registrant) 31, and the drawing data (b2) is sent to the other user terminal (registrant) 32. ) Information (c2) is extracted and transmitted to the drawing search terminal 2, and information (c3) related to the drawing data (b3) is extracted and transmitted to the drawing search terminal 2 at the other user terminal (registrant) 33. (A3).

  In the drawing search terminal 2, information (c1) related to the drawing data is combined with the drawing data (b1) and displayed on the drawing search screen, and information (c2) related to the drawing data is displayed in the drawing data (b2). The combined data is displayed on the drawing search screen, and the drawing data (b3) is combined with the information (c3) on the drawing data and displayed on the drawing search screen, and transmitted to the user terminal (searcher) 1. (A4).

  Thereby, while being able to acquire the drawing image similar to the drawing image input by handwriting in the user terminal (searcher) 1, the information regarding the drawing image can be acquired.

  FIG. 4 shows a drawing search system shown in FIG. 1 in which drawing data searched based on drawing input by a user terminal (searcher) 1 is registered by another user terminal (registrant) 3. It is a flowchart for demonstrating the process in being. In this example, the user terminal (searcher) 1 is the second user terminal, and the other user terminal (registrant) 3 is the first user terminal.

  In this example, after the drawing search terminal 2 performs a drawing search on a drawing image input by handwriting to the user terminal (searcher) 1, the searched drawing data is sent to the user terminal (searcher) 1. A request is made to provide information related to the drawing data to another user terminal (registrant) 3 who has registered the drawing data, and information related to the drawing data is provided to the user terminal (searcher) 1.

  First, the user terminal (searcher) 1 accesses the homepage of the drawing search engine established by the drawing search terminal 2 (step S1).

  In response to this, information on the drawing search screen is transmitted from the drawing search terminal 2 to the user terminal (searcher) 1 (step S2) and displayed on the user terminal (searcher) 1 (step S3).

  Thereafter, a desired drawing image is input by handwriting on the user terminal (searcher) 1 (step S4). Information about the drawing image can also be input.

  FIG. 5 is a diagram illustrating a state in which a drawing image is input by handwriting to the user terminal (searcher) 1 illustrated in FIG. 1.

  As shown in FIG. 5, a drawing image is handwritten on the monitor screen 11 of the user terminal (searcher) 1 with a pen 12 or the like.

  The handwritten input drawing image is transmitted from the user terminal (searcher) 1 (step S5), and the drawing search terminal 2 receives the drawing image and information related to drawing (step S6). At this time, a user ID that can identify the user terminal (searcher) 1 is also transmitted from the user terminal (searcher) 1 and received by the drawing search terminal 2.

  In the drawing search terminal 2, first, the drawing recognition extraction unit 7 identifies whether the drawing image transmitted from the user terminal (searcher) 1 is a place illustration, an object illustration, or a person illustration, In addition, the characteristic part, color, shape, size, position, etc. of the drawn image are recognized and extracted.

  In addition, the drawing image target parts are classified, and the drawing image target parts are set in the order of high priority.

  In the drawing information registration unit 8, the drawing image transmitted from the user terminal (searcher) 1 is registered in the drawing information database 8a (step S7). At this time, the drawing image is registered in association with a user ID that can identify the user terminal (searcher) 1.

  Further, the drawing search unit 9 combines the drawing data registered in the drawing information database 8a by moving, enlarging or reducing the position of the drawing image transmitted from the user terminal (searcher) 1 by moving the position, enlarging or reducing the position. As a result, comparison is made and narrowing down is performed (step S8).

  Then, drawing data similar to the drawing image transmitted from the user terminal (searcher) 1 is extracted from the drawing data registered in the drawing information database 8a (step S9). (Searcher) 1 is transmitted.

  In the user terminal (searcher) 1, the drawing data that is the search result transmitted from the drawing search terminal 2 is displayed, and thereby drawing data similar to the drawing image input by handwriting can be acquired (step). S10).

  6 is a diagram showing an example of a search result displayed on the user terminal (searcher) 1 in the drawing search system shown in FIG.

  As shown in FIG. 6, when a drawing image as shown in FIG. 5 is input to the user terminal (searcher) 1, drawing data similar to this is searched by the drawing search terminal 2, and the user terminal (search) 1) is displayed.

  At this time, if the drawing data retrieved from the drawing information database 8a is input by handwriting at the other user terminal (registrant) 3 and registered in the drawing information database 8a as described above, the drawing retrieval terminal 2 In the composite display unit 10, the retrieved drawing data is transmitted to the other user terminal (registrant) 3. This is because the drawing data is registered in the drawing information database 8a in association with a user ID that can identify the other user terminal (registrant) 3 who registered the drawing data. The other user terminal (registrant) 3 who registered the drawn data can be identified. As a result, the composite display unit 10 requests the other user terminal (registrant) 3 to provide information related to the retrieved drawing data.

  On the other hand, when the information regarding the drawing data transmitted from the drawing search terminal 2 is provided in the other user terminal (registrant) 3 (step S11), the combined display unit 10 of the drawing search terminal 2 draws the drawing data. The data and the information transmitted from the other user terminal (registrant) 3 are combined and transmitted to the user terminal (searcher) 1.

  The transmitted drawing data synthesized in the drawing search terminal 2 and information related thereto are displayed in the user terminal (searcher) 1, thereby acquiring drawing data similar to the drawing image input by handwriting and information related thereto. (Step S12).

  7 is a diagram showing an example of a search result displayed on the user terminal (searcher) 1 in the drawing search system shown in FIG.

  As shown in FIG. 7, the user terminal (searcher) 1 combines the drawing data searched by the drawing search terminal 2 with the information related to the drawing data provided from the other user terminal (registrant) 3. Will be displayed.

  Next, after the user terminal (searcher) 1 performs a drawing search, the other user terminal (searcher) 4 also performs a drawing search search. As a result of the drawing search, handwriting is performed on the other user terminal (searcher) 4. A process when the input drawing image is similar to the drawing data registered by the user terminal (searcher) 1 will be described.

  FIG. 8 shows that after the user terminal (searcher) 1 performs a drawing search in the drawing search system shown in FIG. 1, the other user terminal (searcher) 4 also performs a drawing search search. It is a flowchart for demonstrating a process in case the drawing image input by handwriting into the other user terminal (searcher) 4 is similar to the drawing data which the user terminal (searcher) 1 registered. In this example, the user terminal (searcher) 1 is the second user terminal, and the other user terminal (searcher) 4 is the first user terminal.

  After the processing of steps S1 to S10 shown in FIG. 4 is performed at the user terminal (searcher) 1, the processing of steps S1 to S10 shown in FIG. If the drawing image input by handwriting on the other user terminal (searcher) 4 is similar to the drawing data registered by the user terminal (searcher) 1, the other user terminal (registrant) 4 When information about the input drawing image is provided (step S13), the combined display unit 10 of the drawing search terminal 2 combines the drawing data with the information transmitted from the other user terminal (registrant) 4. To the user terminal (searcher) 1.

  The transmitted drawing data synthesized by the drawing search terminal 2 and information related thereto are displayed on the user terminal (searcher) 1 as shown in FIG. Information about the drawing data can be acquired (step S14).

  Next, a description will be given of processing when there is no similarity as a result of performing a drawing search on a drawing image input by handwriting to the user terminal (searcher) 1 in the drawing search terminal 2.

  FIG. 9 shows a case where the drawing retrieval system shown in FIG. 1 does not have a similarity as a result of a drawing retrieval performed on the drawing image handwritten to the user terminal (searcher) 1 in the drawing retrieval terminal 2. It is a flowchart for demonstrating the process of.

  When the processing of steps S1 to S8 shown in FIG. 4 is performed and the drawing search results in that drawing data having a high similarity to the drawing is not searched, the user terminal (searcher) 1 inputs the handwriting. The drawing image is transmitted from the composite display unit 10 of the drawing search terminal 2 to the proxy search site 5 that performs the drawing search as a proxy.

  Then, drawing data similar to the drawing image transmitted from the drawing search terminal 2 is searched at the proxy search site 5 and transmitted to the user terminal (searcher) 1 via the drawing search terminal 2 (step S15). .

  The drawing data transmitted from the proxy search site 5 and the information related thereto are displayed on the user terminal (searcher) 1 as shown in FIG. A drawing image and information related thereto can be acquired (step S16).

It is a figure which shows one Embodiment of the drawing search system of this invention. FIG. 2 is a block diagram showing a configuration of a drawing search terminal shown in FIG. The processing when the drawing data searched based on the drawing input by the user terminal (searcher) in the drawing search system shown in FIG. 1 is registered by another user terminal (registrant) will be described. It is a figure for doing. In the drawing search system shown in FIG. 1, processing when drawing data searched based on drawing input by an image at a user terminal (searcher) is registered by another user terminal (registrant). It is a flowchart for demonstrating. It is a figure which shows the state by which a drawing image is input by handwriting into the user terminal (searcher) shown in FIG. It is a figure which shows an example of the search result displayed on a user terminal (searcher) in the drawing search system shown in FIG. It is a figure which shows an example of the search result displayed on a user terminal (searcher) in the drawing search system shown in FIG. In the drawing search system shown in FIG. 1, after a user terminal (searcher) performs a drawing search, another user terminal (searcher) similarly performs a drawing search search. As a result of the drawing search, the other user terminal (searcher) ) Is a flowchart for explaining processing in a case where the drawing image input by handwriting is similar to the drawing data registered by the user terminal (searcher). In the drawing search system shown in FIG. 1, for explaining a process when there is no similarity as a result of performing a drawing search on a drawing image input by handwriting to a user terminal (searcher) in a drawing search terminal. It is a flowchart of. It is a figure which shows the example of 1 structure of the conventional image search apparatus.

Explanation of symbols

1 User terminal (searcher)
2 Drawing search terminal 3 Other user terminal (registrant)
4 Other user terminal (searcher)
5 Proxy Search Site 6 Network 7 Drawing Recognition Extraction Unit 8 Drawing Information Registration Unit 8a Drawing Information Database 9 Drawing Search Unit 10 Composite Display Unit 11 Monitor Screen 12 Pen

Claims (14)

A user terminal for inputting a drawing image and a drawing search in which drawing data is registered, the drawing data is searched based on the drawing image input to the user terminal, and the drawing data is provided to the user terminal In a drawing search system in which a terminal is connected via a network,
The drawing search terminal
A drawing information database in which drawing data and information related to the drawing data are registered;
A drawing search unit for searching for drawing data and information related to the drawing data based on drawing input to the user terminal from the drawing information database;
A combined display unit that transmits drawing data searched by the drawing search unit and information related to the drawing data to the user terminal;
A drawing data registration unit that registers drawing drawn by image input to the user terminal with drawing information database as drawing data in association with identification information capable of identifying the user terminal;
The composite display unit transmits the drawing data to a first user terminal identified by identification information associated with the drawing data searched by the drawing search unit, and the first user A drawing search system, wherein information relating to drawing provided from a terminal is transmitted to a second user terminal to which an image of the drawing is input. A user terminal for inputting a drawing image and a drawing search in which drawing data is registered, the drawing data is searched based on the drawing image input to the user terminal, and the drawing data is provided to the user terminal In a drawing search system in which a terminal is connected via a network,
The drawing search terminal
A drawing information database in which drawing data and information related to the drawing data are registered;
A drawing search unit for searching for drawing data and information related to the drawing data based on drawing input to the user terminal from the drawing information database;
A combined display unit that transmits drawing data searched by the drawing search unit and information related to the drawing data to the user terminal;
A drawing data registration unit that registers drawing drawn by image input to the user terminal with drawing information database as drawing data in association with identification information capable of identifying the user terminal;
When the drawing for which the drawing data registered in the drawing information database is to be searched is input as an image at the first user terminal and information related to the drawing is input, the composite display unit The drawing search system, wherein the drawing and information related to the drawing are transmitted to a second user terminal identified by the identification information associated with the drawing data. In the drawing search system according to claim 1 or 2,
The drawing search system, wherein the drawing search unit searches the drawing information database for drawing data having a high similarity to the drawing input as an image to the user terminal and information related to the drawing data. In the drawing search system according to claim 1 or 2,
The drawing search system, wherein the user terminal transmits the identification information together with the drawing with the image input to the drawing search terminal. The drawing search system according to any one of claims 1 to 4,
The drawing display system, wherein the combining display unit combines the drawing data and the information related to drawing and transmits the combined data to the user terminal. A user terminal for inputting a drawing image and a drawing search in which drawing data is registered, the drawing data is searched based on the drawing image input to the user terminal, and the drawing data is provided to the user terminal A drawing search method using a drawing search system in which a terminal is connected via a network,
A process in which the user terminal transmits the image-input drawing to the drawing search terminal;
The drawing search terminal searches the drawing information database for drawing data and information related to the drawing data based on drawing input to the user terminal as an image;
Processing for the drawing search terminal to register the drawing inputted as an image in the user terminal in the drawing information database as drawing data;
A process in which the drawing search terminal transmits drawing data searched from the drawing information database and information related to the drawing data to the user terminal;
A process in which the drawing search terminal transmits the drawing data to a first user terminal identified by identification information associated with the drawing data searched from the drawing information database;
A drawing search method comprising: a process in which the drawing search terminal transmits information related to drawing provided from the first user terminal to a second user terminal to which the drawing is input as an image. . A user terminal for inputting a drawing image and a drawing search in which drawing data is registered, the drawing data is searched based on the drawing image input to the user terminal, and the drawing data is provided to the user terminal A drawing search method using a drawing search system in which a terminal is connected via a network,
A process in which the user terminal transmits the image-input drawing to the drawing search terminal;
The drawing search terminal searches the drawing information database for drawing data and information related to the drawing data based on drawing input to the user terminal as an image;
Processing for the drawing search terminal to register the drawing inputted as an image in the user terminal in the drawing information database as drawing data;
A process in which the drawing search terminal transmits drawing data searched from the drawing information database and information related to the drawing data to the user terminal;
When the drawing retrieval terminal receives a drawing for which the drawing data registered in the drawing information database is to be retrieved as an image input at the first user terminal and information relating to the drawing is inputted, the drawing information database And a process of transmitting the drawing and information relating to the drawing to a second user terminal identified by the identification information associated with the drawing data. In the drawing search method according to claim 6 or 7,
The drawing search terminal has processing for searching the drawing information database for drawing data having a high degree of similarity to the drawing input as an image to the user terminal and information related to the drawing data from the drawing information database retrieval method. In the drawing search method according to claim 6 or 7,
A drawing search method comprising: a process in which the user terminal transmits the identification information to the drawing search terminal together with the image input drawing. In the drawing search method according to any one of claims 6 to 9,
A drawing search method comprising: a process in which the drawing search terminal synthesizes the drawing data and information related to the drawing and transmits the combined data to the user terminal. Connected via a network to a user terminal for inputting a drawing image, the drawing data is registered, the drawing data is searched based on the drawing image input to the user terminal, and the drawing data is retrieved from the user A drawing search terminal provided to the terminal,
A drawing information database in which drawing data and information related to the drawing data are registered;
A drawing search unit for searching for drawing data and information related to the drawing data based on drawing input to the user terminal from the drawing information database;
A combined display unit that transmits drawing data searched by the drawing search unit and information related to the drawing data to the user terminal;
A drawing data registration unit that registers drawing drawn by image input to the user terminal with drawing information database as drawing data in association with identification information capable of identifying the user terminal;
The composite display unit transmits the drawing data to a first user terminal identified by identification information associated with the drawing data searched by the drawing search unit, and the first user A drawing search terminal, wherein information relating to drawing provided from a terminal is transmitted to a second user terminal to which the drawing is input as an image. Connected via a network to a user terminal for inputting a drawing image, the drawing data is registered, the drawing data is searched based on the drawing image input to the user terminal, and the drawing data is retrieved from the user A drawing search terminal provided to the terminal,
A drawing information database in which drawing data and information related to the drawing data are registered;
A drawing search unit for searching for drawing data and information related to the drawing data based on drawing input to the user terminal from the drawing information database;
A combined display unit that transmits drawing data searched by the drawing search unit and information related to the drawing data to the user terminal;
A drawing data registration unit that registers drawing drawn by image input to the user terminal with drawing information database as drawing data in association with identification information capable of identifying the user terminal;
When the drawing for which the drawing data registered in the drawing information database is to be searched is input as an image at the first user terminal and information related to the drawing is input, the composite display unit A drawing search terminal that transmits the drawing and information related to the drawing to a second user terminal identified by identification information associated with the drawing data. The drawing search terminal according to claim 11 or 12,
The drawing search terminal, wherein the drawing search unit searches the drawing information database for drawing data having a high similarity to the drawing input to the user terminal and information related to the drawing data. The drawing search terminal according to any one of claims 11 to 13,
The drawing search terminal characterized in that the combined display unit combines the drawing data and the information related to drawing and transmits the combined data to the user terminal.

Images