KR20150100332A - Sketch retrieval system, user equipment, service equipment, service method and computer readable medium having computer program recorded therefor - Google Patents

Abstract

The present invention provides a search result according to a user's sketch input as a candidate sketch in a sketch area, thereby guiding the sketch to draw the search result, and can also sketch a desired sketch using a separate search result image separately provided in a search result output area The present invention relates to a sketch search system, a user apparatus, a service providing apparatus, a service method thereof, and a recording medium on which a computer program is recorded. In addition to a sketch area configured to perform a sketch on an overlapped candidate sketch, By directly sketching the individual candidate sketch images selected in the search result output areas individually listed, it is possible to clearly sketch a part of a specific candidate sketch image which is difficult to distinguish from the overlapping candidate sketches, Even from the rim image is superimposed state is not clearly identify the desired destination has to select the correct target effects can proceed with the sketch.

Description

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a sketch retrieval system, a user apparatus, a service providing apparatus, a service method thereof, and a recording medium on which a computer program is recorded.

The present invention relates to a sketch search system, a user apparatus, a service providing apparatus, a service method thereof, and a recording medium on which a computer program is recorded. More particularly, the present invention relates to a sketch search system, A user apparatus, a service providing apparatus, a service method thereof, and a recording medium in which a computer program is recorded, wherein the sketch search system, the user apparatus, and the service providing apparatus are provided. Media.

In recent years, demand for multimedia information services has increased along with the development of computers and communication technologies. VOD (Video On Demand) service, digital library, medical field (for example, Telemedicine, medical image retrieval), and so on.

At the beginning of the research, a text-based search has been used in which a person manually adds an index to all multimedia data to be searched, and a user searches for desired information using a keyword.

However, this method takes a lot of time and content, and there is a problem that efficiency of retrieval is greatly deteriorated when a viewpoint of a person who adds an index is different from a viewpoint of a searching user. In addition, there is a disadvantage that complex attributes of multimedia data can not be expressed accurately by text alone. In order to overcome this problem, a content - based retrieval method is needed to extract features that can represent the contents of multimedia data and to perform indexing and detection based on the features.

One of these contents-based search methods is to recognize a picture drawn while the user touches the touch pad and to perform a search using the recognized result. However, when the sketch quality is poor, the accuracy of the search result is lowered. In order to solve this problem, a sketch corresponding to a sketch situation is sometimes provided to guide the sketch operation. However, since a plurality of candidate sketches are provided in a superimposed manner, the sketch can not be clearly distinguished, A situation occurs.

Korean Patent No. 1005407480000 [Title: Improved Query Method for Content-Based Retrieval and Recording Medium Saving Program for Implementing the Method]

In order to minimize the inconvenience of the user, the present invention is characterized in that not only a sketch area configured to perform a sketch on a superimposed candidate sketch, but also individual candidate sketch images selected in a search result output area in which candidate sketch images are individually listed according to search results So that it is possible to clearly sketch a part of a specific candidate sketch image that is difficult to distinguish from the overlapping candidate sketch.

It is another object of the present invention to select a desired candidate sketch image of a candidate sketch image exposed in a search result output area during a sketch and to apply the selected candidate sketch image as a sketch image on the sketch area to perform a sketch operation.

A sketch search user device according to an embodiment of the present invention includes a sketch search interface unit having a sketch area displaying a nested sketch to provide a guide for sketch input and a search result output area listing sketch search results, A stroke recognition unit for detecting user input through a sketch area and a search result output area as a stroke information and outputting stroke information to the service providing apparatus as stroke recognition information based on the similarity according to the stroke recognition information, And a control unit receiving the sketch search information including the selected candidate sketch and the corresponding original image from the service providing apparatus and displaying the sketch search information in the sketch area and the search result output area of the sketch search interface unit.

As an example related to the present invention, when a sketch operation is performed from the search result output area, the controller may apply the sketch line generated on the candidate sketch image to the sketch line on the sketch area.

According to an embodiment of the present invention, when a desired candidate sketch image is selected for a plurality of candidate sketch images exposed in a search result output area, the control unit can provide a selected candidate sketch by superimposing the sketch regions.

An apparatus for providing a sketch search service according to an exemplary embodiment of the present invention includes a sketch image database unit storing a sketch image and an original image corresponding thereto, a sketch area configured to draw along a sketch, Receives stroke recognition information on a stroke input from a user device having an output area through a sketch area and a search result output area and selects candidate sketch images from the sketch database part according to the similarity based on the received stroke recognition information A sketch search information providing unit for providing the sketch search information providing unit to the user device so that the candidate sketch selected in the sketch image providing unit and the sketch image providing unit and the corresponding original image can be displayed in the sketch area and the search result output area of the user device, respectively have.

As an example related to the present invention, the sketch search information providing unit may provide an interval setting menu item for setting the interval between the sketch line and the drag line to the user device, and may set the interval setting method according to the interval setting method selected by the user According to the drawn drag line and the drag line, the interval of the sketch line drawn in the sketch can be set, and when the stroke information is inputted within the set interval, the sketch line can be exposed on the sketch along the drag line.

As an example related to the present invention, the interval setting menu item may include a first interval setting menu item for simultaneously setting a gap between a sketch line and a drag line by clicking a drag area and a draw area with a double touch, a drag area and a draw area sequentially A second interval setting menu item for setting the interval between the sketch line and the drag line by clicking on the edge of the sketch line and the drag line, and setting the edge length by selecting both end points where the drag area and the draw area meet, And a fourth interval setting menu item for setting the interval between the sketch line and the drag line by setting the drag area and the draw area according to the edge setting.

As an example related to the present invention, when the third interval setting menu item or the fourth interval setting menu item is selected, the edge can be selected to change the positions of the drag area and the draw area.

As an example related to the present invention, the sketch image database unit further stores web page link information corresponding to an original image, and the sketch search information providing unit may provide web page link information corresponding to an original image to a user apparatus.

A sketch search service method according to an exemplary embodiment of the present invention includes a step in which a service providing apparatus receives a sketch search execution request signal from a user apparatus and a sketch search execution request signal in response to a sketch search execution request signal, The method comprising the steps of: providing a search interface to a user device, the service providing device including: receiving stroke recognition information for both a sketch area and a search result output area from a user device; And transmitting the selected data to the user device.

A sketch search service method according to an exemplary embodiment of the present invention includes receiving a signal that a service providing apparatus touched a search result output area of a sketch search interface, when a service touched a search result output area Recognizing a sketch line formed on the candidate sketch image, and allowing the service providing apparatus to apply the recognized sketch line to the sketch line on the sketch region so that the sketch operation proceeds.

A computer program for performing the sketch search service method according to the above-described embodiment may be stored in the recording medium on which the computer program according to the embodiment of the present invention is recorded.

The sketch search system according to an embodiment of the present invention provides a sketch search interface, transmits stroke information of a user input through a sketch search interface, receives sketch images corresponding to the transmitted stroke information, A candidate sketch image of the search result output region selected by the user is superimposed on the sketch region and provided, and when a sketch operation is performed from the search result output region, the sketch line generated on the candidate sketch image is provided as a sketch region image And a service providing apparatus for selecting candidate sketch images based on the similarity degree of the stroke recognition information and providing the candidate sketch images to the user apparatus when the stroke recognition information is received from the user apparatus and the user apparatus.

The present invention can perform sketching directly on individual candidate sketch images selected in a search result output area in which candidate sketch images are individually listed according to search results as well as sketch areas configured to sketch on overlapping candidate sketches, It is possible to clearly perform a sketch on a part of a specific candidate sketch image which is difficult to distinguish from the candidate sketch, and thus, even if a desired object is not clearly identified in a state in which a plurality of sketch images are superimposed, There is an effect that can be.

Also, according to the present invention, a desired candidate sketch image of a candidate sketch image exposed in a search result output area during sketching can be selected and applied as a sketch image on a sketch area to perform a sketch operation, A sketch image can be applied to a sketch area so that a sketch can be obtained more accurately and quickly.

1 is a block diagram showing a configuration of a sketch search system according to an embodiment of the present invention.
2 is a block diagram illustrating a configuration of a user apparatus according to an embodiment of the present invention.
3 is a block diagram illustrating a configuration of a service providing apparatus according to an embodiment of the present invention.
4 is a flowchart illustrating a sketch search service method according to an embodiment of the present invention.
5 is a flowchart illustrating a sketch process in a candidate sketch output area in a sketch search service method according to an embodiment of the present invention.
FIG. 6 is an exemplary diagram for explaining a sketch search interface of a user apparatus according to an embodiment of the present invention. Referring to FIG.
FIG. 7 is an exemplary diagram illustrating that a sketch line of a candidate sketch image output from a user apparatus according to an exemplary embodiment of the present invention is reflected on a sketch line on a sketch region.

It is noted that the technical terms used in the present invention are used only to describe specific embodiments and are not intended to limit the present invention. In addition, the technical terms used in the present invention should be construed in a sense generally understood by a person having ordinary skill in the art to which the present invention belongs, unless otherwise defined in the present invention, Should not be construed to mean, or be interpreted in an excessively reduced sense. In addition, when a technical term used in the present invention is an erroneous technical term that does not accurately express the concept of the present invention, it should be understood that technical terms can be understood by those skilled in the art. In addition, the general terms used in the present invention should be interpreted according to a predefined or prior context, and should not be construed as being excessively reduced.

Furthermore, the singular expressions used in the present invention include plural expressions unless the context clearly dictates otherwise. In the present invention, terms such as "comprising" or "comprising" and the like should not be construed as encompassing various elements or various steps of the invention, Or may further include additional components or steps.

Furthermore, terms including ordinals such as first, second, etc. used in the present invention can be used to describe elements, but the elements should not be limited by terms. Terms are used only for the purpose of distinguishing one component from another. For example, without departing from the scope of the present invention, the first component may be referred to as a second component, and similarly, the second component may also be referred to as a first component.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings, wherein like reference numerals refer to like or similar elements throughout the several views, and redundant description thereof will be omitted.

In the following description, well-known functions or constructions are not described in detail since they would obscure the invention in unnecessary detail. It is to be noted that the accompanying drawings are only for the purpose of facilitating understanding of the present invention, and should not be construed as limiting the scope of the present invention with reference to the accompanying drawings.

1 is a block diagram showing a configuration of a sketch search system according to an embodiment of the present invention.

1, a sketch search system according to an embodiment of the present invention includes a user apparatus 100, a service providing apparatus 200, and a communication network 300. As shown in FIG.

The user apparatus 100 provides the sketch search interface composed of the sketch area and the search result output area to the user so that the user transmits the stroke recognition information about the stroke applied by the user while performing the sketch through the sketch area to the service providing apparatus 200 The candidate sketch image is received and displayed in the sketch area and the search result output area. In the sketch area, the candidate sketch image is superimposed and displayed as a blurred sketch, and the user can use it as a guide to help the sketch process. If the original image corresponding to the sketch image is further received, the candidate sketch image is displayed as a sketch in the sketch area, and the original image corresponding to the candidate sketch image is displayed in the search result output area in various ways (list, scroll, etc.) .

Meanwhile, in the embodiment of the present invention, not only the sketch area of the user device 100 but also a candidate sketch image provided in the search result output area or an original image corresponding thereto is selected and a part of the sketch is superimposed on the image as a sketch can do. In this case, the stroke applied to the image is reflected in the corresponding sketch area. Since the candidate candidate sketch image or the corresponding original image provided in the search result output region is one of the sketch images superimposed on the sketch region, if referring to the ratio expressed in the sketch region, the image provided in the search result output region A stroke point to be applied can be represented corresponding to the sketch area. Through this method, a sketch for a specific part that is difficult to distinguish in a superimposed sketch can be processed using an individual image of a search result output area in which the corresponding part is clearly expressed.

Of course, an error may occur when the stroke applied to the image of the search result output area is reflected in the sketch area, but this can easily be corrected if the scale or alignment can be adjusted.

The service providing apparatus 200 extracts candidate sketch images based on the stroke information provided from the user device 100 and provides them as sketch search information. The sketch search information includes an original image corresponding to the candidate sketch image, Lt; RTI ID = 0.0 > web page. ≪ / RTI >

As another example, when the service providing apparatus 200 has a kind of web program and substantially manages a sketch search interface provided to the user apparatus 100, the user performs a sketch operation on the sketch area or searches When the sketch operation is performed on the sketch area after confirming whether or not the sketch operation is performed, the candidate sketch image is extracted based on the stroke recognition information according to the sketch operation and provided to the user device 100, When the operation is performed, the sketch line generated on the candidate sketch image may be applied to the sketch line on the sketch area to configure the search contents, and the candidate sketch image may be extracted based on the sketch line and provided to the user device 100.

The user device 200 allows a user to select one of a plurality of candidate sketch images by a drag-and-drop method, superimpose the sketch image on the sketch area, and use the sketch image as a guide sketch image. In this case, it is possible to increase the expression weight of the selected candidate sketch so that the candidate sketch image can be grasped more clearly, and only the selected candidate sketch images can be superimposed on the sketch of the sketch area.

2 is a block diagram showing a configuration of a user apparatus of the sketch search system of the present invention.

The user apparatus 100 shown in FIG. 2 includes a sketch search interface unit 110, a stroke recognition unit 120, and a control unit 130.

Not all of the components of FIG. 2 are essential components of user device 100, and user device 100 may be implemented that is capable of implementing a sketch search system by more components than the components shown in FIG. 2 , The user device 100 may be implemented by fewer components.

The user device 100 is a terminal capable of transmitting and receiving various data via a communication network according to a key operation of a user. The user device 100 includes a tablet PC, a laptop, a smart phone, A personal digital assistant (PDA), a mobile communication terminal, or the like.

The user device 100 also includes a browser for communicating with the service providing apparatus 200 via the communication network 300, a memory for storing programs and protocols, a microprocessor for executing and controlling various programs, and the like A terminal device that is connected to the Internet. That is, if the user device 100 can perform server-client communication with the service providing device 200 and can execute the sketch search service, any terminal can be used, and the communication computing device such as a mobile communication terminal, a PDA Is a broad concept. Meanwhile, the user device 100 is preferably formed with a touch screen, but is not limited thereto.

In particular, when the sketch operation is performed so that an arbitrary shape is formed on the sketch area of the sketch search interface including the sketch area and the search result output area, the user device 100 according to the embodiment of the present invention may acquire the stroke recognition information The sketch line is generated on the sketch area or the search result output area and the sketch line generated on the search result output area is sketched on the sketch area or the search result output area, To the sketch line on the area.

The sketch search interface unit 110 includes a sketch area in which a superimposed sketch for providing a guide for sketch input is displayed and a sketch search result output area in which sketch search results are listed.

The stroke recognition unit 120 detects user input through the sketch area of the sketch search interface unit 110 as stroke information and outputs the detected stroke information to the control unit 130. When the stroke recognition unit 120 recognizes the stroke information and outputs the stroke information to the control unit 130, the control unit 130 may extract the feature of the sketch and then transmit only the feature information of the extracted sketch to the service providing apparatus 200. Accordingly, the load between the user device 100 and the service providing device 200 is reduced, thereby preventing the service speed from being lowered. The stroke recognition unit 120 may include general input devices such as a small keyboard, a pen mouse, a joystick, a touch screen, a touch pad, and the like.

The control unit 130 transmits the stroke information of the stroke recognition unit 120 to the service providing apparatus 200 as the stroke recognition information and stores the selected candidate sketch based on the similarity according to the stroke recognition information and the corresponding original image From the service providing apparatus 200 and displays the sketch search information in the sketch area and the search result output area of the sketch search interface unit 110. [

When a sketch operation is performed from the search result output area, the control unit 130 applies the sketch line generated on the candidate sketch image to the sketch line on the sketch area to display the sketch line, while the sketch search execution request signal And transmits the sketch search information (superimposed candidate sketch information, individual candidate sketch information, or a video corresponding thereto) provided by the service providing apparatus 200 to a sketch search And provides the communication environment between the user device 100 and the service providing device 200 so that the searched product is searched through the sketch search interface.

When the controller 130 selects a desired candidate sketch image for a plurality of candidate sketch images exposed in the search result output area, the controller 130 overlaps the selected candidate sketch with a high weight of the sketch area.

The sketch search interface unit 110 searches the sketch search interface for a sketch image (or a corresponding original image) provided corresponding to the stroke information generated by the sketch operation through the sketch area provided from the service providing apparatus 200 The sketch line is exposed to the sketch line on the sketch area when the sketch operation is performed on an arbitrary image among the images exposed on the search result output area.

3 is a block diagram showing a configuration of a service providing apparatus of the sketch search system of the present invention.

3, the service providing apparatus 200 includes a sketch image database unit 210, a sketch image providing unit 220, and a sketch search information providing unit 230.

The service providing apparatus 200 receives the stroke recognition information from the user device 100, extracts the sketch images with the stroke recognition information as a search condition, provides the extracted sketch images to the user device 100, When the sketch operation is performed, the guide sketch image is selected from the search result output area using the stroke recognition information, superimposed on the sketch area, and outputted. When the sketch operation is performed from the search result output area, To the sketch lines on the sketch region.

The sketch image database unit 210 stores a plurality of sketch images, a corresponding original image, and web page information linked to the original image.

The sketch image providing unit 220 selects a candidate sketch image from the sketch database unit 210 according to the similarity degree range based on the stroke recognition information received from the user device 100. [

The sketch image providing unit 220 can expose the candidate sketch image selected by the user in the search result output area by superimposing the candidate sketch image on the guide sketch image on the sketch region.

When the sketch search information request signal is received from the user apparatus 100, the sketch search information providing unit 230 searches for sketch search information corresponding to the sketch search interface unit 110 of the user apparatus 100 (the candidate sketch and the corresponding source Video) to the user device 100. The sketch search information provided to the user device 100 may include a candidate sketch image to be displayed in the sketch area and the search result output area, an original image corresponding to the candidate sketch image, and link information linked to the original image. The candidate sketch image included in the sketch search information or the original image corresponding thereto is provided to the user device 100 as a search result and the user device 100 displays the search result in the search result output area of the sketch search interface 110 Can be displayed on a screen or can be provided by a scroll method.

The sketch search information providing unit 230 provides an interval setting menu item for setting the interval between the sketch line and the drag line to the user device 100 and displays the sketch information to the user device 100 by the interval setting method selected according to the interval setting menu item Can set the interval of the sketch line drawn in the sketch according to the drag line and the drag line and expose the sketch line on the sketch along the drag line when the stroke information is inputted within the set interval.

That is, when the user sketches along the sketch image of the sketch region, the sketched tool is covered with the edge line of the sketch image, which makes it inconvenient to sketch. For example, this phenomenon may be small for thin pens, but if the sketch tool is thick, such as the user's hand, the sketch tool will hide the sketch image, making it difficult to sketch based on the sketch image. If the sketch is sketched along the edge line of the sketch image at a position spaced apart from the edge line of the sketch image, a drag line may be displayed along the sketch line along the edge line of the sketch image. The sketch search information providing unit 230 of the service providing apparatus 200 provides an interval setting menu item and can set the relation between the drag line and the sketch line by selecting the interval setting menu item at the initial stage of the sketch operation or at a desired time point have.

The interval setting menu item includes a first interval setting menu item for simultaneously setting the interval between the sketch line and the drag line by clicking the drag area and the draw area with a double-touch, and a first interval setting menu item for sequentially clicking the drag area and the draw area, A second interval setting menu item for setting an interval between the sketch line and the drag line by setting the edge length by selecting both end points where the drag area and the draw area meet, 3 interval setting menu item, and a fourth interval setting menu item for setting the interval between the sketch line and the drag line by setting the drag area and the draw area according to the edge setting.

The sketch search information providing unit 230 may select the edge when the third interval setting menu item or the fourth interval setting menu item is selected to change the positions of the drag area and the draw area.

In the previous embodiment, the sketch search information providing unit 230 of the service providing apparatus 200 has an additional user interface support function for solving a situation where it is difficult to perform a sketch while checking a sketch when a user inputs a stroke through a sketch interface However, such a function may be performed independently or in conjunction with the service providing apparatus 200 in the sketch search interface unit 110 of the user apparatus 100. [ This will be apparent to those skilled in the art from the foregoing description and thus will not be described further.

Hereinafter, a sketch search service method based on the above-described configuration will be described in detail with reference to the accompanying drawings.

4 is a flowchart illustrating a sketch search service method according to an embodiment of the present invention.

As shown in FIG. 4, the service providing apparatus 200 determines whether a sketch search execution request signal is received from the user device 100 (S110). If it is determined that the sketch search execution request signal is received, the user device 100 provides the sketch search interface including the sketch area and the search result output area to the user through the sketch search interface unit 110, (Step S120), the tag identification information corresponding to the stroke of the sketch area and the tag information corresponding to the sketch area of the sketch area, to the service providing apparatus 200 as a filtering condition.

The service providing apparatus 200 determines whether or not stroke recognition information is received from the user device 100 (S130). If the determination result indicates that the stroke recognition information has been received, the service providing apparatus 200 transmits the stroke recognition information to the filtering condition (S140), and transmits the extracted images to the user device 100 to expose the images through the search result output area (S150).

In this case, as shown in FIG. 6, the candidate sketch exposure scheme exposes one candidate sketch image in each of the divided spaces constituting the search result output region divided into a plurality of regions, and the user simultaneously displays the candidate sketch image exposed at one time You can directly select the desired sketch image. Also, the user can confirm whether or not any sketch image is selected according to the sketch line of the sketch line and applied to another sketch even if the sketch image is not selected.

Meanwhile, another method of exposing the candidate sketch image is the scroll method. In the scroll method, the candidate sketch area is exposed at the bottom of the sketch area and the left and right scroll arrow buttons are provided. When the user clicks the scroll arrow button, So that the candidate sketch image previously provided or the candidate sketch image provided can be confirmed.

FIG. 5 is a flowchart illustrating a sketch process in a candidate sketch output area of a sketch search service method according to an embodiment of the present invention based on the above-described configuration.

As shown in FIG. 5, the service providing apparatus 200 determines whether a signal obtained by touching the search result output area in the sketch search interface is received (S210), and if a signal touching the search result output area is received The service providing apparatus 200 determines whether or not the sketch operation is performed on the candidate sketch image of the search result output area (S220), and determines whether the sketch operation is being performed (S230).

As a result of the sketch operation state, if the sketch operation is being performed, the service providing apparatus 200 recognizes the sketch line formed on the candidate sketch image as shown in FIG. 7 (S240) The sketch line is applied to the sketch line (S250).

At this time, in order to reflect the sketch line on the candidate sketch image on the sketch area on the sketch area, the candidate sketch image is first scaled and aligned with the overlapping sketch image on the sketch area, and the additional stroke portion applied to the corresponding image is scaled And the alignment is applied and added to the sketch line that is currently being worked on. Such scaling and alignment is preferably performed automatically, but can also be done manually.

Finally, the service providing apparatus 200 allows the user to select one of the plurality of candidate sketch images in the search result output area and superimpose the selected sketch image on the guide sketch image on the sketch area. At this time, The exposure may be performed in a different manner from that of the exposure. For example, a thick edge line, or to differentiate exposure colors from other overlapped sketch images.

6 is an exemplary diagram illustrating a sketch search screen of a user device according to an embodiment of the present invention. 6A shows an example of a sketch search interface provided through a user device. FIG. 6A illustrates a case where a terminal having a relatively large screen is used. When a user draws a picture directly on a sketch area configured on a touch screen, , The candidate sketch image having high similarity is extracted according to the stroke of the user to update the overlapping sketch in the sketch area, and the extracted candidate sketch image or the original image linked to the candidate sketch image is displayed in the search result output area . For reference, a web page providing various additional information such as a product sale page, an advertisement page, an affiliate company homepage, etc. may be provided when the image of the search result output area is selected for confirming the search result.

6B is an example of a sketch search interface in the case of using a relatively small screen terminal. As shown in FIG. 6B, the size of the search result output area is reduced in order to increase the weight of the sketch area as much as possible. In this case, the search result output area can be scrolled using the left and right arrows and scrolled by the user's gesture.

On the other hand, in the sketch search, a sketch tool such as a user's finger or a pen may cause the sketch to be obscured. This problem may be caused by various methods of separating an actual stroke area from an actual touch area Some can be solved. For example, if you select a location to provide the actual stroke and then draw a line by touching the distanced area, you can take a way that the line is drawn first. Of course, the spacing distance, the method of selecting a stroke providing position, and the like may vary depending on various methods.

7 is an exemplary view for explaining that a sketch line formed in a candidate sketch image output to a user apparatus according to an exemplary embodiment of the present invention is reflected on a sketch line on a sketch region. When the user selects one of the candidate sketch images in the search result output area during sketching in the sketch area and directly sketches the image, the sketch line drawn directly on the candidate sketch image is reflected in the sketch area. FIG. 7A is an example of a case in which a terminal having a relatively small screen is used. When a user selects a candidate sketch image provided in a scroll mode, the corresponding image is popped up on the screen, And the sketch line directly sketched on the popped candidate sketch image is directly reflected in the sketch area.

A computer program for performing the sketch search service method according to the above-described embodiment may be stored in the recording medium on which the computer program according to the embodiment of the present invention is recorded.

The sketch search service method according to an embodiment of the present invention can be written in a computer program, and the codes and code segments constituting the computer program can be easily deduced by computer programmers in the field. In addition, the computer program may be stored in a computer readable medium and read and executed by a computer or a service providing apparatus according to an embodiment of the present invention to implement a sketch search service method.

The information storage medium includes a magnetic recording medium, an optical recording medium, and a carrier wave medium. A computer program for implementing the sketch search service method according to an embodiment of the present invention may be stored and installed in a built-in memory such as a user device and a service providing device. Alternatively, an external memory such as a smart card storing and installing a computer program for implementing the sketch search service method according to an embodiment of the present invention may be installed in a user apparatus, a service providing apparatus, or the like through an interface.

It will be apparent to those skilled in the art that various modifications and variations can be made in the present invention without departing from the spirit or essential characteristics thereof. Therefore, the embodiments disclosed in the present invention are intended to illustrate rather than limit the scope of the present invention, and the scope of the technical idea of the present invention is not limited by these embodiments. The scope of protection of the present invention should be construed according to the following claims, and all technical ideas within the scope of equivalents should be construed as falling within the scope of the present invention.

The present invention is based on stroke recognition information generated when a sketch operation is performed by a user, and when a sketch is directly performed on a desired candidate sketch image of candidate sketch images exposed in a search result output area, So that the user can accurately sketch the product to be searched. Accordingly, not only the desired product can be provided as the search result, but also the user is required to advertise the product with much exposure by using the sketch Can be widely used in the service field.

100: user equipment 110: sketch search interface unit
120: stroke recognition unit 130:
200: Service providing apparatus 210: Sketch image database unit
220: Sketch image providing unit 230: Sketch search information providing service
300: Network

Claims (12)

A sketch search interface unit having a sketch area displaying a superimposed sketch for providing a guide for inputting a sketch and a search result output area listing sketch search results;
A stroke recognition unit for detecting user input through a sketch area and a search result output area of the sketch search interface unit as stroke information and outputting the detected stroke information; And
The stroke information of the stroke recognition unit is transmitted to the service providing apparatus as the stroke recognition information, and sketch search information including the candidate sketch selected based on the similarity based on the stroke recognition information and the corresponding original image, And displaying the search result in the sketch area and the search result output area of the sketch search interface unit. The method according to claim 1,
Wherein the control unit applies the sketch line generated on the candidate sketch image to the sketch line on the sketch area when a sketch operation is performed from the search result output area. The method according to claim 1,
Wherein the controller overlaps the selected candidate sketches in a sketch area when a desired candidate sketch image is selected for a plurality of candidate sketch images exposed in the search result output area. A sketch image database unit storing a sketch image and a corresponding original image;
Receiving a stroke recognition information about a stroke input through a sketch area and a search result output area from a user device having a sketch area configured to draw along a sketch and a search result output area providing search results according to a sketched content A sketch image providing unit for selecting a candidate sketch image from the sketch database unit according to the similarity based on the received stroke recognition information; And
And a sketch search information providing unit for providing candidate sketches selected in the sketch image providing unit and a corresponding original image to a user device so as to be displayed in a sketch area and a search result output area of the user device, . 5. The method of claim 4,
Wherein the sketch search information providing unit provides the interval setting menu item for setting the interval between the sketch line and the drag line to the user device and displays the drag line drawn by the user according to the interval setting method selected according to the interval setting menu item, Wherein the sketch line is set in a sketch line according to a drag line and the sketch line is exposed on a sketch along a drag line when stroke information is input within a set interval. 6. The method of claim 5,
A first interval setting menu item for setting the interval between the sketch line and the drag line by simultaneously clicking the drag area and the draw area with a double touch;
A second interval setting menu item for sequentially setting the interval between the sketch line and the drag line by clicking the drag area and the draw area sequentially;
A third interval setting menu item for setting an interval between the sketch line and the drag line by selecting both end points where the drag area and the draw area meet, and exposing an edge between the set intervals; And
And a fourth interval setting menu item for setting the interval between the sketch line and the drag line by setting the drag area and the draw area according to the edge setting. The method according to claim 6,
Wherein when the third interval setting menu item or the fourth interval setting menu item is selected, an edge is selected to change the positions of the drag area and the draw area. 5. The method of claim 4,
The sketch image database unit further stores web page link information corresponding to an original image,
Wherein the sketch search information providing unit also provides web page link information corresponding to the original image to the user device. The service providing apparatus receiving a sketch search execution request signal from the user apparatus;
Providing the sketch search interface to the user device, the sketch search interface including a sketch area and a search result output area in response to a sketch search execution request signal;
Receiving the stroke recognition information for both the sketch area and the search result output area from the user device; And
Wherein the service providing device extracts the sketch images with the stroke recognition information as a filtering condition, and transmits the sketch images to the user device. Receiving a signal that the service providing apparatus has touched the search result output area of the sketch search interface;
Recognizing a sketch line formed on a candidate sketch image when a signal obtained by touching a search result output area of the service providing apparatus is received; And
Wherein the service providing apparatus applies the recognized sketch line to the sketch line on the sketch area so that the sketch operation proceeds. A recording medium on which a computer program for performing the sketch search service method according to claim 9 or 10 is recorded. A sketch search interface, transmitting stroke information of a user input through the sketch search interface, receiving sketch images corresponding to the transmitted stroke information, superimposing the sketch images on a sketch of a sketch search interface, A user device for providing a candidate sketch image of a search result output area in a sketch area in a superimposed manner and reflecting the sketch line generated on the candidate sketch image when a sketch operation is performed from a search result output area; And
And a service providing device for selecting a candidate sketch image based on the similarity of the stroke recognition information and receiving the stroke sketch information from the user device when the stroke recognition information is received from the user device.

Images