JP7609513B2 - Interaction-based information providing method and system - Google Patents

Description

Application of Article 30, Paragraph 2 of the Patent Act Published on March 18, 2022, on the website http://www. navercorp. com/promotion/pressReleasesView/30830

Application of Article 30, Paragraph 2 of the Patent Act Posted on March 18, 2022, on the website http://blog.naver.com/naver_search/222675572949

Application of Article 30, Paragraph 2 of the Patent Act Posted on June 13, 2022 on the website http://channelsearch.naver.com/tech/issue01_3/

Applicable under Article 30, Paragraph 2 of the Patent Act Posted on June 20, 2022 on the website http://www.youtube.com/watch?v=zsB2XQyC2J0

The following description relates to an interaction-based information provision method and system.

A search service is an interactive or dialogue service provided over a communication network that provides the ability to access information stored in a database center. As an example, a search service may provide search results for search terms entered by a user. As a more specific example, a search service may provide a user with a search result page that includes search results from multiple databases in response to the entered search terms.

Korean Patent Publication No. 10-2022-0108611

We provide an information provision method and system that provides an interaction function for a specific subject in response to a preset interaction search term corresponding to the subject, and provides information on the subject in accordance with the interaction with the user.

A method for providing information for a computer device including at least one processor, the method including: providing, by the at least one processor, a search interface for providing search results based on an input search term; and, by the at least one processor, providing, when the search term input to the search interface includes a preset interaction search term corresponding to a given subject, an interaction function for providing information related to the subject through interaction with a user in response to the interaction search term.

According to one aspect, the step of providing the interaction function may include a step of displaying an object related to the subject using a viewer included in the interaction function.

In another aspect, the step of providing the interaction function may further include controlling a view of the object displayed in the viewer or a motion of the object through an interaction with the user.

In another aspect, the controlling step may include providing a function for adjusting a playback speed for the motion of the object.

In another aspect, the controlling step may include providing an AR (Augmented Reality) function for reproducing the motion of the object against a background of an image input in real time to a camera included in the computer device.

In another aspect, the step of providing the interaction function may further include a step of providing sub-motion information for each of a plurality of sub-motions obtained by separating the motion of the object.

In another aspect, the step of providing the submotion information may include a step of providing a submotion selection interface for selecting one submotion from the plurality of submotions, and a step of playing the submotion selected from the submotion selection interface using the viewer.

According to another aspect, the submotion information may include video information, audio information, and text information related to the corresponding submotion, and the step of playing the selected submotion may include outputting at least one of the audio information and the text information while playing the selected submotion in the video information.

According to another aspect, the submotion selection interface may include a plurality of submotion buttons for the plurality of submotions, and the step of playing the selected submotion may include playing a submotion corresponding to a submotion button selected from the plurality of submotion buttons.

According to another aspect, the plurality of sub-motion buttons are arranged in order, and a display position is changed by a drag gesture input on the plurality of sub-motion buttons, and the step of playing the selected sub-motion may be characterized in that a sub-motion corresponding to a sub-motion button at a preset display position among the plurality of sub-motion buttons is played, and a playback direction and a playback speed of the sub-motion being played are determined based on a direction and a speed of the drag gesture.

In another aspect, the step of playing the selected submotion may include a step of displaying an annotation button at a position of a specific point of the object to provide detailed information related to the specific point, a step of moving a display position of the annotation button as the position of the specific point of the object moves by playing the selected submotion, and a step of changing the selected submotion to provide the detailed information when the annotation button is selected.

In another aspect, the step of playing the selected submotion may include a step of displaying an annotation guide including at least two points on the object and a link connecting the two points.

According to another aspect, the object may include a three-dimensional human body model, and the at least two points may correspond to joint positions of the three-dimensional human body model.

In another aspect, the step of providing the interaction functionality may include providing the viewer through a search result page generated using the interaction search term.

In another aspect, the step of providing the interaction function may include providing, via the search result page or the viewer, a link for accessing a page that provides submotion information for each of a plurality of submotions obtained by separating the motion of the object.

In another aspect, providing the interaction functionality may include providing a question and answer interface for receiving a voice or text-based query from the user and providing a subject-specific response to the query.

In yet another aspect, the response may include one of a plurality of submotions obtained by separating the motion of the object, or may include a result generated by analyzing the contents of the documents searched based on the query using artificial intelligence.

A computer program is provided for causing a computer device to execute the method.

A computer-readable recording medium is provided that stores a program for causing a computer device to execute the method.

A computer device is provided, the computer device including at least one processor that is implemented to execute instructions readable by the computer device, and that receives search terms from a user's terminal by the at least one processor, and if the received search terms include interaction search terms that are preset corresponding to any subject, generates a search result page that includes search results corresponding to the interaction search terms and an interaction function that provides information related to the subject through interaction with the user, and provides the generated search result page to the user's terminal.

A subject interaction function is provided in response to a preset interaction search term corresponding to a particular subject, and information about the subject can be provided through interaction with the user.

FIG. 1 illustrates an example of a network environment in accordance with an embodiment of the present invention. FIG. 2 is a block diagram illustrating an example of a computing device in accordance with an embodiment of the present invention. 1 is a diagram illustrating an overview of an information providing system according to an embodiment of the present invention. FIG. 13 is a diagram showing an example of a page providing sub-motion information in accordance with an embodiment of the present invention. 11A to 11C are diagrams illustrating an example of a process of playing a motion according to an embodiment of the present invention. 11A to 11C are diagrams illustrating an example of a process of playing a motion according to an embodiment of the present invention. FIG. 13 is a diagram showing an example of a case where the playback of a motion is stopped in one embodiment of the present invention. FIG. 13 is a diagram showing an example of a case where the playback of a motion is stopped in one embodiment of the present invention. FIG. 13 is a diagram showing an example of a case where the playback of a motion is stopped in one embodiment of the present invention. 11A and 11B are diagrams showing examples of user interfaces for controlling the display state of lesson point graphics in one embodiment of the present invention. FIG. 13 illustrates an example of displaying a lesson point graphic for a particular submotion in accordance with an embodiment of the present invention. 11A and 11B are diagrams showing examples of annotation buttons in one embodiment of the present invention. FIG. 13 illustrates an example of providing a list of all submotions in accordance with an embodiment of the present invention. FIG. 13 illustrates an example of a viewer extension in accordance with an embodiment of the present invention. 1 is a flowchart showing an example of an information providing method of a user terminal in an embodiment of the present invention. 10 is a flowchart showing an example of an information providing method of a server in an embodiment of the present invention. FIG. 13 illustrates an example of using the interaction feature to provide topic-related information corresponding to an interaction search term in one embodiment of the present invention. FIG. 13 illustrates an example of using the interaction feature to provide topic-related information corresponding to an interaction search term in one embodiment of the present invention. FIG. 13 illustrates an example of using the interaction feature to provide topic-related information corresponding to an interaction search term in one embodiment of the present invention. FIG. 2 illustrates an example of providing a response to a query in accordance with an embodiment of the present invention.

The following describes the embodiments in detail with reference to the attached drawings.

The information provision system according to an embodiment of the present invention may be realized by at least one computer device. In this case, a computer program according to an embodiment of the present invention may be installed and executed in the computer device, and the computer device may execute the information provision method according to an embodiment of the present invention according to the control of the executed computer program. The above-mentioned computer program may be recorded on a computer-readable recording medium in combination with the computer device to cause the computer to execute the information provision method.

Figure 1 is a diagram showing an example of a network environment in one embodiment of the present invention. The network environment in Figure 1 shows an example including multiple electronic devices 110, 120, 130, 140, multiple servers 150, 160, and a network 170. Figure 1 is merely an example for explaining the invention, and the number of electronic devices and the number of servers are not limited to those shown in Figure 1.

The electronic devices 110, 120, 130, and 140 may be fixed terminals or mobile terminals realized by a computer system. Examples of the electronic devices 110, 120, 130, and 140 include smartphones, mobile phones, navigation systems, personal computers (PCs), notebook PCs, digital broadcasting terminals, personal digital assistants (PDAs), portable multimedia players (PMPs), tablets, game consoles, wearable devices, internet of things (IoT) devices, virtual reality (VR) devices, and augmented reality (AR) devices. As an example, FIG. 1 shows a smartphone as an example of the electronic device 110, but in an embodiment of the present invention, the electronic device 110 may refer to one of a variety of physical computer systems that can communicate with other electronic devices 120, 130, 140 and/or servers 150, 160 via a network 170 using a substantially wireless or wired communication method.

The communication method is not limited, and may include not only a communication method using a communication network that the network 170 can include (for example, a mobile communication network, a wired Internet, a wireless Internet, or a broadcasting network), but also short-range wireless communication between devices. For example, the network 170 may include any one or more of a personal area network (PAN), a local area network (LAN), a campus area network (CAN), a metropolitan area network (MAN), a wide area network (WAN), a broadband network (BBN), the Internet, and the like. Furthermore, the network 170 may include any one or more of a network topology including, but not limited to, a bus network, a star network, a ring network, a mesh network, a star-bus network, a tree or a hierarchical network, and the like.

Each of the servers 150 and 160 may be realized by one or more computer devices that communicate with the multiple electronic devices 110, 120, 130, and 140 via the network 170 to provide instructions, code, files, content, services, and the like. For example, the server 150 may be a system that provides a first service to the multiple electronic devices 110, 120, 130, and 140 connected via the network 170, and the server 160 may also be a system that provides a second service to the multiple electronic devices 110, 120, 130, and 140 connected via the network 170. As a more specific example, the server 150 may provide the multiple electronic devices 110, 120, 130, and 140 with a service targeted by the application as a first service through an application, which is a computer program installed and executed in the multiple electronic devices 110, 120, 130, and 140. As another example, the server 160 may provide, as the second service, a service of distributing files for installing and executing the above-mentioned application to multiple electronic devices 110, 120, 130, and 140.

Figure 2 is a block diagram showing an example of a computer device in one embodiment of the present invention. Each of the multiple electronic devices 110, 120, 130, and 140 and each of the servers 150 and 160 described above may be realized by the computer device 200 shown in Figure 2.

Such a computer device 200 may include a memory 210, a processor 220, a communication interface 230, and an input/output interface 240, as shown in FIG. 2. The memory 210 is a computer-readable recording medium and may include a RAM (random access memory), a ROM (read only memory), and a permanent mass storage device such as a disk drive. Here, a permanent mass storage device such as a ROM or a disk drive may be included in the computer device 200 as a separate permanent storage device separate from the memory 210. In addition, the memory 210 may store an operating system and at least one program code. Such software components may be loaded into the memory 210 from a computer-readable recording medium separate from the memory 210. Such a separate computer-readable recording medium may include a computer-readable recording medium such as a floppy drive, a disk, a tape, a DVD/CD-ROM drive, or a memory card. In other embodiments, the software components may be loaded into the memory 210 through a communication interface 230 that is not a computer-readable recording medium. For example, the software components may be loaded into the memory 210 of the computer device 200 based on a computer program that is installed by a file received via the network 170.

The processor 220 may be configured to process computer program instructions by performing basic arithmetic, logic, and input/output operations. The instructions may be provided to the processor 220 by the memory 210 or the communication interface 230. For example, the processor 220 may be configured to execute instructions received according to program code recorded in a recording device such as the memory 210.

The communication interface 230 may provide a function for the computer device 200 to communicate with other devices (for example, the above-mentioned recording device) via the network 170. As an example, requests, commands, data, files, etc. generated by the processor 220 of the computer device 200 according to program code recorded in a recording device such as the memory 210 may be transmitted to other devices via the network 170 under the control of the communication interface 230. Conversely, signals, commands, data, files, etc. from other devices may be received by the computer device 200 through the communication interface 230 of the computer device 200 via the network 170. The signals, commands, data, etc. received through the communication interface 230 may be transmitted to the processor 220 or the memory 210, and the files, etc. may be recorded on a recording medium (the above-mentioned permanent recording device) that the computer device 200 may further include.

The input/output interface 240 may be a means for interfacing with the input/output device 250. For example, the input device may include devices such as a microphone, keyboard, or mouse, and the output device may include devices such as a display and a speaker. As another example, the input/output interface 240 may be a means for interfacing with a device that integrates functions for input and output into one, such as a touch screen. The input/output device 250 may be configured as a single device together with the computer device 200.

Also, in other embodiments, the computing device 200 may include fewer or more components than those of FIG. 2. However, most of the prior art components need not be explicitly shown in the figures. For example, the computing device 200 may be implemented to include at least some of the input/output devices 250 described above, and may further include other components such as a transceiver, a database, etc.

Figure 3 is a diagram showing an overview of an information provision system according to one embodiment of the present invention. The information provision system according to this embodiment may include a server 310 and a user terminal 320. There may be multiple user terminals, but Figure 3 shows one user terminal 320.

The user terminal 320 may access the server 310 via a network (for example, the network 170 in FIG. 1 and FIG. 2) according to the control of an application installed on the user terminal 320, and may receive services from the server 310. In this embodiment, it is assumed that the server 310 provides a search service to the user terminal 320. When a user of the user terminal 320 inputs a search term into a search interface provided by an application installed and executed on the user terminal 320, the user terminal 320 may transmit the input search term to the server 310, and the server may generate a search result page for the input search term and provide it to the user terminal 320. In practice, the server 310 provides the user terminal 320 with information for rendering and displaying the search result page on the user terminal 320, but the following description will be given assuming that the server 310 provides the search result page to the user terminal 320.

In this case, if the search term includes a preset interaction search term corresponding to a given subject, the server 310 may provide an interaction function that provides information related to the subject through interaction with the user. FIG. 3 shows an interaction function area 330 of a page including such an interaction function. Depending on the embodiment, the interaction function area 330 may be included in a search result page and provided to the user terminal 320, or may be included in a separate response page for the interaction search term (for example, a page providing submotion information described below) and provided to the user terminal 320. When a search result page is provided, the server 310 may generate a search result page including search results corresponding to the interaction search term and the above-mentioned interaction function, and provide it to the user terminal 320.

At this time, the interaction function area 330 may include a viewer for displaying an object related to a subject, as shown in a first dotted frame 340. In this case, the user terminal 320 may control the view of the object or the motion of the object displayed in the viewer according to the interaction with the user. In this embodiment, an example is shown in which "golf" is used as an interaction search term to provide an object motion of "iron full swing". In this embodiment, the object may include a three-dimensional human body model, and the "iron full swing" motion of such a three-dimensional human body model may be reproduced by the viewer. As described above, the interaction search term may be preset corresponding to any subject, and the object may also be preset in association with such a subject. In other words, when the user inputs an interaction search term, the view and/or motion of the object according to the subject of the interaction search term is reproduced by the viewer. In this case, the display of the view and/or motion of the object may be controlled according to the interaction with the user.

In addition to the viewer, the interaction function area 330 may further include basic information related to interaction search terms and/or object motion, as shown in the second dotted frame 350.

The search result page, the interaction function area 330, and/or the viewer may include links to pages that provide submotion information for each of a plurality of submotions that separate the motion of the object. In the embodiment of FIG. 3, as shown in the third dotted frame 360, an example is shown in which the viewer includes links to pages that provide submotion information.

Figure 4 is a diagram showing an example of a page providing sub-motion information in one embodiment of the present invention. The user terminal 320 may display a page 410 providing sub-motion information on a screen, and may display a view and/or motion of an object using a viewer appearing in a first dotted frame 420 of the page 410.

Also, as described above, the motion of the object may be separated into a plurality of sub-motions. In this case, the user terminal 320 may provide sub-motion information for each individual sub-motion through the page 410. In the embodiment of FIG. 4, an example is shown in which the motion "iron full swing" is separated into eight sub-motions, namely, an "address" sub-motion (P1), a "take back" sub-motion (P2), a "half back swing" sub-motion (P3), a "top of swing" sub-motion (P4), a "down swing" sub-motion (P5), an "impact" sub-motion (P6), a "follow through" sub-motion (P7), and a "finish" sub-motion (P8). In this case, the user terminal 320 may provide eight sub-motion buttons for the eight sub-motions through the page 410. Although FIG. 4 shows an example in which one motion is separated into eight sub-motions, it is also possible for the same motion to be separated into more or fewer sub-motions. For example, the "iron full swing" motion may be separated into ten sub-motions depending on how the motions are divided.

In the embodiment of FIG. 4, the second dotted frame 430 shows an example in which the sub-motion button for the "address" sub-motion (P1) and the sub-motion button for the "take back" sub-motion (P2) are displayed among the eight sub-motion buttons. Although not shown in FIG. 4, the eight sub-motion buttons may be listed in order, and the display position can be changed by the user's drag gesture. As an example, when the user drags the area of the second dotted frame 430 to the left, the user terminal 320 may control the sub-motion button for the "address" sub-motion (P1) to disappear to the left, and at the same time, control the display of the sub-motion button for the "half back swing" sub-motion (P3) to appear from the right side. If the user continues to drag the area of the second dotted frame 430 to the left, the user terminal 320 may control the display so that submotion buttons for each of the "top of swing" submotion (P4), "downswing" submotion (P5), "impact" submotion (P6), "follow-through" submotion (P7), and "finish" submotion (P8) appear in sequence in the area of the second dotted frame 430.

When the user selects a particular sub-motion button (for example, by touching an area where the sub-motion button is displayed using a finger or a touch tool in a touch screen environment), the user terminal 320 may play the sub-motion corresponding to the selected sub-motion button using the viewer in the first dotted frame 420. Thus, the user can control the playback of the motion for each sub-motion of the motion.

The user terminal 320 may also play a submotion corresponding to a submotion button located at a preset display position among the multiple submotion buttons. At this time, when a user's drag gesture is input in the area of the second dotted frame 430, the user terminal 320 may determine the playback direction and playback speed of the submotion being played based on the direction and speed of the input drag gesture. For example, in FIG. 4, when the user drags the submotion button for the "address" submotion (P1) to the left, the user terminal 320 may play the "address" submotion (P1) in the forward direction. Conversely, when the user drags the submotion button for the "address" submotion (P1) to the right, the user terminal 320 may play the "address" submotion (P1) in the reverse direction. At this time, the playback speed may be determined by the user's dragging speed.

The page 410 may also include a user interface 440 for controlling the display state of the lesson point graphic and a user interface 450 for navigating to an AR service. Such user interfaces 440, 450 are described in more detail below.

The play button 460 may be a user interface for playing the entire motion of the object (the "iron full swing" motion in the embodiment of FIG. 4) by sub-motion stage. When the user selects the play button 460, the user terminal 320 may play the "iron full swing" motion by playing the eight sub-motions, namely, the "address" sub-motion (P1), the "take back" sub-motion (P2), the "half back swing" sub-motion (P3), the "top of swing" sub-motion (P4), the "down swing" sub-motion (P5), the "impact" sub-motion (P6), the "follow through" sub-motion (P7), and the "finish" sub-motion (P8), in order through the viewer of the first dotted frame 420.

FIGS. 5 and 6 are diagrams illustrating an example of a process of playing a motion in an embodiment of the present invention. Page 510 of FIG. 5 may be provided when a user selects play button 460 on page 410 of FIG. 4. In the embodiment of FIG. 5, an example is shown in which, when play button 460 is selected, user terminal 320 provides a first dotted frame 520 as well as a playback speed adjustment function for adjusting the playback speed when playback of the motion is stopped and a playback refresh function. As an example, a user may use the playback speed adjustment function to control the playback speed of the motion, and may use the refresh function to control the motion to be played from the beginning.

The submotion button for the currently playing submotion may be highlighted differently from the other buttons. In the embodiment of FIG. 5, an example is shown in which the frame of the submotion button 530 for the "address" submotion (P1) is highlighted. It will be readily apparent that the buttons may be highlighted in a more diverse manner. For example, a particular button may be highlighted by filling the inside of the button with a color different from the other buttons.

Meanwhile, the information on each submotion (submotion information) may further include text information and/or audio information in addition to the video information on the submotion played by the viewer. In the embodiment of FIG. 5, an example is shown in which text information corresponding to the "Address" submotion (P1) is displayed in the area of the second dotted frame 540 during playback of the "Address" submotion (P1). The text information may be a certain unit (word, line, phrase, etc.) to reduce the constraint due to the length of the text, and may be displayed or removed in the area of the second dotted frame 540. The page 510 may also provide a function 550 for controlling the provision of audio information. The audio information may include audio information obtained by converting the contents of the text information using a TTS (Text-To-Speech) function, and the user terminal 320 may output the audio information from the speaker by activating the function 550.

Furthermore, the user terminal 320 may display an annotation button 560 for providing detailed information related to a specific point of the object while playing the submotion using the viewer of the page 510. The user terminal 320 may display the annotation button 560 at the position of the specific point of the object, and as the position of the specific point of the object moves as the submotion is played, the display position of the annotation button 560 may also move to the position of the moved specific point. In this case, when the user selects the annotation button 560, the user terminal 320 may change the submotion and provide detailed information. At least one annotation button may be preset for each submotion.

In the embodiment of FIG. 6, the user terminal 320 shows an example of playing back the "Iron Full Swing" motion on page 610 for each submotion at a default playback speed or a playback speed selected by the playback speed adjustment function. At this time, the embodiment of FIG. 6 shows an example of displaying an annotation button 620 set for the "Follow Through" submotion (P7) while playing the "Follow Through" submotion (P7). Also, the play button 630 on page 610 has a different form from the play button 460 on page 410, and indicates that the motion is currently being played. At this time, the position of the submotion button may be changed so that the submotion button of the currently played submotion is located at a specific position. FIG. 6 shows an example where the specific position is the position next to the right of the play button 630 in FIG. 6.

FIGS. 7 to 9 are diagrams showing examples of flicks in one embodiment of the present invention. FIG. 7 shows an example in which a user flicks (for example, touches and drags a finger) a specific sub-motion button while a motion is being played. In this case, the user terminal 320 may pause the playback of the existing motion. FIG. 7 shows a stop button 710 for pausing. As described above, the playback direction and playback speed of the corresponding sub-motion can be adjusted depending on the direction and speed of the flick (drag).

Figure 8 shows an example where the user selects a specific sub-motion button. In this case, the user terminal 320 may highlight the selected sub-motion button and output sub-motion information of the selected sub-motion button. As described above, playing the sub-motion information of the sub-motion button may include at least playing the corresponding sub-motion by a viewer, and may further include outputting text information and/or audio information. When the user flicks the specific sub-motion button again, the sub-motion may be played with the playback direction and playback speed of the corresponding sub-motion adjusted according to the direction and speed of the flick, as in Figure 7.

Figure 9 shows an example in which a playback speed adjustment function and a refresh function are provided when a user presses the stop button 910. In this case, the motion paused in Figure 7 may be played back in sequence from the section where it was stopped.

FIG. 10 is a diagram showing an example of a user interface for controlling the display of a lesson point graphic in one embodiment of the present invention. FIG. 10 shows an example in which a skeleton is displayed on an object in a second dotted frame 1020 by a user selecting the user interface in a first dotted frame 1010 during playback of a motion. The skeleton may be a type of annotation guide that includes at least two points on an object and a link connecting the two points. In this case, playback of the motion can be paused, and when the user interface in the first dotted frame 1010 is selected again, the motion may be played.

Figure 11 is a diagram showing an example of displaying a lesson point graphic for a specific submotion in one embodiment of the present invention. When a specific submotion is being played, the user terminal 320 may display an annotation guide, which is a lesson point graphic that has been preset for that submotion.

FIG. 12 is a diagram showing an example of an annotation button in an embodiment of the present invention. As described above, an annotation button may be set for each of a plurality of submotions. Such an annotation button may be used to provide detailed information about the corresponding submotion. In the embodiment of FIG. 12, when a user selects the annotation button in the first dotted frame 1210, the user terminal 320 provides detailed information about the submotion together with the second dotted frame 1220. The annotation button may be displayed in association with a specific point of the object, and the detailed information may be detailed information related to the specific point. The button in the third dotted frame 1230 may be a user interface for returning to a process before the annotation button was selected. For example, when the back button is selected, the user terminal 320 may play the rest of the submotion that was being played before the annotation button was selected.

Figure 13 is a diagram showing an example of providing a list of all submotions in one embodiment of the present invention. In the embodiment of Figure 13, an example is shown in which a submotion list is provided as shown in the second dotted line frame 1320 when the user touches the area of the first dotted line frame 1310 and drags it upward. At this time, if the user selects a specific submotion from the submotion list as shown in the third dotted line frame 1330, the user terminal 320 may play the selected submotion.

Figure 14 is a diagram showing an example of viewer expansion in one embodiment of the present invention. Figure 14 shows an example in which the viewer is expanded to the area of the second dotted frame 1420 by the user selecting the area of the first dotted frame 1410. If the user selects the area of the second dotted frame 1420, the viewer shrinks to the area of the first dotted frame 1410. Motion being played and/or audio guidance being output may be played and/or output as is.

Figure 15 is a flowchart showing an example of a server information provision method according to an embodiment of the present invention. The information provision method according to this embodiment may be executed by a computer device 200 that realizes the server 310. In this case, the processor 220 of the computer device 200 may be realized to execute control instructions according to the operating system code and at least one computer program code contained in the memory 210. Here, the processor 220 may control the computer device 200 so that the computer device 200 executes steps 1510 to 1540 included in the method of Figure 15 according to the control instructions provided by the code recorded in the computer device 200.

At step 1510, the computer device 200 may receive a search term from a user's terminal. Here, the user's terminal may correspond to the user terminal 320 described above. As described above, the server 310 may provide a search service to the user terminal 320, and the user terminal 320 may use such a search service to send the search term to the server 310.

In step 1520, if the received search term includes a preset interaction search term corresponding to a given subject, the computer device 200 may generate a search result page including search results corresponding to the interaction search term and an interaction function for providing information related to the subject through interaction with the user. As an example, the computer device 200 may generate a search result page as a search service that includes not only an area for displaying search results for the search term from the user, but also an area for providing an interaction function.

In step 1530, the computer device 200 may provide the generated search result page to the user's terminal. The user's terminal may utilize an interaction function included in such a search result page to provide the user with information on the subject corresponding to the interaction search term by interacting with the user.

In step 1540, the computer device 200 may provide a separate page for the interaction function to the user's terminal according to a search result page or a request using the interaction function from the user's terminal. As an example, an example of providing a link to a page for providing sub-motion information has been described with reference to the third dotted frame 360 of FIG. 3. The user's terminal may play detailed object motions for each sub-motion through the page for providing sub-motion information and output information for each sub-motion. According to an embodiment, the separate page for the interaction function may be a page that provides various information through interaction with the user. As an example, the separate page providing the interaction function may include a question and answer interface for receiving a query based on a user's voice and/or text and providing a response related to the subject of the query. In this case, the response may include one of a plurality of sub-motions obtained by separating the motion of the object, or may include a result generated by analyzing the contents of the document searched based on the query using artificial intelligence. An example of providing a result of analyzing search results using artificial intelligence will be described in more detail with reference to FIGS. 17 to 20.

Figure 16 is a flowchart showing an example of an information provision method for a user terminal in one embodiment of the present invention. The information provision method according to this embodiment may be executed by a computer device 200 that realizes a user terminal 320. In this case, the processor 220 of the computer device 200 may be implemented to execute control instructions from the operating system code and at least one computer program code contained in the memory 210. Here, the processor 220 may control the computer device 200 to execute steps 1610 and 1620 included in the method of Figure 16 according to the control instructions provided by the code recorded in the computer device 200.

In step 1610, the computer device 200 may provide a search interface for providing search results based on the input search term. As an example, the computer device 200 may provide the search interface through an application installed and executed on the computer device 200. As an example, such an application may be a computer program that cooperates with a service provided by the server 310.

In step 1620, the computer device 200 may provide an interaction function that provides information related to the subject through interaction with the user in response to the interaction search term when the search term entered in the search interface includes a preset interaction search term corresponding to a given subject. Depending on the embodiment, the interaction function may be provided by being included in a search result page corresponding to the interaction search term, or may be provided by being included in a separate page for the interaction function.

Depending on the embodiment, such step 1620 may include steps 1621 and 1622 as shown in FIG. 16.

In step 1621, the computer device 200 may display an object related to the subject using a viewer included in the interaction function. For example, the motion of the object may be generated by capturing the motion in the case of a motion for an object that exists, such as a human, and may be generated by 3D modeling for a non-existent object or an object for which motion capture is difficult. In this case, sub-motions and detailed information of each sub-motion may be generated in advance for each motion. Information regarding each generated motion may be provided to the computer device 200 via a server.

In step 1622, the computer device 200 may control the view of the object or the motion of the object displayed in the viewer according to an interaction with the user. As an embodiment, the computer device 200 may control the view by rotating the object according to a user's input for the object displayed in the viewer, or may control the motion of the object using the sub-motion selection interface described above. As a more specific example for controlling the motion of the object, the computer device 200 may provide sub-motion information for each of a plurality of sub-motions obtained by separating the motion of the object. In this case, an interface for selecting a sub-motion such as a sub-motion button may be provided to the user, and the computer device 200 may play a sub-motion corresponding to a sub-motion button selected from the plurality of sub-motion buttons using the viewer. As another example, the computer device 200 may control the motion of the object by receiving a query based on the user's voice or text and playing a specific motion of the object (for example, one of a plurality of sub-motions) for the query.

The submotion information may include video information, audio information, and text information related to the corresponding submotion. In this case, the computer device 200 may output the audio information and/or the text information while playing the submotion selected by the video information.

Also, depending on the embodiment, the multiple sub-motion buttons may be arranged in order, and the display positions may be changed according to a drag gesture input to the multiple sub-motion buttons. In this case, the computer device 200 plays a sub-motion corresponding to a sub-motion button at a preset display position among the multiple sub-motion buttons, and may determine the playback direction and playback speed of the sub-motion being played based on the direction and speed of the drag gesture.

In addition, according to an embodiment, the computer device 200 may display an annotation button at the position of a specific point of an object to provide detailed information related to the specific point. In this case, the computer device 200 may move the display position of the annotation button as the position of the specific point of the object moves with the playback of the submotion. When the annotation button is selected, the computer device 200 may change the submotion to provide detailed information.

In addition, according to an embodiment, the computer device 200 may display an annotation guide including at least two points on the object and a link connecting the two points. According to an embodiment, the object may include a 3D human body model, and the at least two points may correspond to joint positions of the 3D human body model.

In addition, according to an embodiment, the computer device 200 may provide a function for adjusting a playback speed for the motion of an object. In addition, the computer device 200 may provide an AR (Augmented Reality) function for playing back the motion of an object against a background of an image input in real time to a camera included in the computer device 200.

In addition, according to an embodiment, the computer device 200 may provide a question and answer interface for receiving a user's voice and/or text-based query input through an interaction function and providing a response related to the subject of the query. In this case, the response may include one of a plurality of sub-motions obtained by separating the motion of an object, or may include a result generated by analyzing the contents of a document searched based on the query using artificial intelligence. Such an embodiment for providing a result generated by analyzing using artificial intelligence will be described in more detail with reference to FIGS. 17 to 20.

In the above embodiment, the motion of a human playing golf is used as an example, but the motions may be diverse and the objects may also be diverse. For example, to provide information on the theme "dinosaurs," it is possible to provide information related to dinosaurs through user interaction with a dinosaur object.

Figures 17 to 19 show an example of using the interaction feature to provide information related to a subject that corresponds to an interaction search term in one embodiment of the present invention.

FIG. 17 shows a search result page 1710. For example, based on the motion search term "Tyrannosaurus" transmitted from the user terminal 320, the server 310 may generate a search result page 1710 including search results for the motion search term "Tyrannosaurus" and a viewer for playing the motion of the dinosaur object, and transmit the search result page 1710 to the user terminal 320. The viewer is shown in a first dotted frame 1720. In addition, the search result page 1710 and/or the viewer may include links 1730, 1740, 1750 to pages for providing interaction functions.

FIG. 18 illustrates an example of a page 1810 for providing an interaction function provided by selecting a link 1730 on the search result page 1710. In this case, the page 1810 may include a viewer for displaying an object, as shown in a first dotted frame 1820. Using the viewer, the view and motion of the object may be controlled by user interaction. The page 1810 may also include a user interface 1820 for inputting a user's voice and/or text-based query, as shown in a second dotted frame 1830. As an example, when a user selects the area of the second dotted frame 1830, the user terminal 320 may provide a keypad to the user, and the user may input a text-based query using the provided keypad. The user terminal 320 may also include a text display area, as shown in a third dotted frame 1840. Sample queries may be displayed in the text display area, and the user may select a query from the displayed sample queries. In addition, the text display area may further display text information related to the voice information, reference materials, search, and response history. Meanwhile, the size of the text displayed in the text display area may be automatically adjusted depending on the amount of information displayed in the text display area. In other words, the user terminal 320 may automatically adjust the size of the text depending on the amount of information displayed in the text display area.

19 shows an example of a response presented by selecting link 1740 in FIG. 17, inputting the query "run" in the area of the second dotted line box 1830 in FIG. 18, or selecting the query "run" from the area of the third dotted line box 1840 in FIG. 18. Page 1910 in FIG. 19 may include a viewer for playing a motion or submotion of an object as shown in the first dotted line box 1920. In this case, the viewer may play a submotion corresponding to the query "run". Also, text information and/or audio information corresponding to such a submotion may be output. The second dotted line box 1930 shows an example of the text information being output. Also, the third dotted line box 1940 shows an example of the query "run" that has already been used being highlighted.

In this manner, the user terminal 320 may provide a submotion selection interface as an interface for selecting a submotion corresponding to a user's voice and/or text-based query input from among a plurality of submotions as a response.

At this time, since queries are extremely diverse, if there is no submotion corresponding to the input query, the user terminal 320 may output information regarding the absence of a corresponding submotion. For example, if there is no submotion of a dinosaur object corresponding to the query "jump", information regarding the impossibility of this submotion or response may be output, such as "You can't jump", "That's a difficult question for me", or "I can't show you the jump".

Meanwhile, the size, position, movement, view angle, etc. of the object may be changed according to a query from the user, and the submotion of the object may be played. For example, in the golf motion example described above, a user interface is provided for the user to input a query. In this case, the size, position, movement, view angle, etc. of the three-dimensional human object may be changed according to such a query from the user, and the motion may be played.

Responses to user queries can also be provided through searches related to the relevant objects.

20 is a diagram showing an example of providing a response to a query in an embodiment of the present invention. The first screen 2010 of FIG. 20 shows an example of providing a response to the query "when did the dinosaurs go extinct". In this case, if a response to the query is obtained by a search, the response may provide information about the reference material as shown in the first dotted box 2011. FIG. 20 shows an example of providing information about the reference material as shown in the second dotted box 2021 of the second screen 2020 by the user selecting the area of the first dotted box 2011. In this case, the information about the reference material may include a link to a source document of the information as shown in the third dotted box 2022. If the user selects the area of the third dotted box 2022, the source document of the link address may be provided as shown in the third screen 2030.

Thus, according to an embodiment of the present invention, a subject-related interaction function is provided in response to a preset interaction search term corresponding to a particular subject, and information about the subject can be provided through interaction with a user.

The above-mentioned devices may be realized by hardware components or a combination of hardware and software components. For example, the devices and components described in the embodiments may be realized using one or more general-purpose or special-purpose computers, such as, for example, a processor, a controller, an arithmetic logic unit (ALU), a digital signal processor, a microcomputer, a field programmable gate array (FPGA), a programmable logic unit (PLU), a microprocessor, or various devices capable of executing and responding to instructions. The processing device may execute an operating system (OS) and one or more software applications that run on the OS. The processing device may also respond to the execution of the software and access, record, manipulate, process, and generate data. For ease of understanding, the description may be given as if one processing device is used, but one skilled in the art will understand that the processing device may include multiple processing elements and/or multiple types of processing elements. For example, a processing unit may include multiple processors or one processor and one controller. Other processing configurations, such as parallel processors, are also possible.

The software may include computer programs, codes, instructions, or a combination of one or more of these, and may configure or instruct the processing device to operate as desired, either independently or collectively. The software and/or data may be embodied in any type of machine, component, physical device, virtual device, computer storage medium, or device to be interpreted based on the processing device or to provide instructions or data to the processing device. The software may be distributed and stored or executed in a distributed manner on computer systems connected by a network. The software and data may be stored on one or more computer-readable storage media.

The method according to the embodiment may be realized in the form of program instructions executable by various computer means and recorded on a computer-readable medium. The computer-readable medium may include program instructions, data files, data structures, etc., alone or in combination. The medium may be one that continuously records a computer-executable program, or one that temporarily records it for execution or download. The medium may be one that is a recording or storage means in the form of a single or multiple hardware devices, and may be distributed over a network without being limited to a medium directly connected to a certain computer system. Examples of the medium include magnetic media such as hard disks, floppy disks, and magnetic tapes, optical media such as CD-ROMs and DVDs, magneto-optical media such as floptical disks, and ROMs, RAMs, flash memories, etc., configured to record program instructions. Other examples of the medium include recording media or storage media managed by application stores that distribute applications, or sites, servers, etc. that supply or distribute various other software. Examples of program instructions include not only machine code, such as that produced by a compiler, but also high-level language code that is executed by a computer using an interpreter or the like.

Although the embodiments have been described above based on limited embodiments and drawings, those skilled in the art will appreciate that various modifications and variations may be made from the above description. For example, suitable results may be achieved even if the described techniques are performed in a different order than described, and/or the components of the described systems, structures, devices, circuits, etc. are combined or combined in a different manner than described, or are contrasted or substituted with other components or equivalents.

Therefore, different embodiments that are equivalent to the scope of the claims are within the scope of the attached claims.

110, 120, 130, 140: Electronic devices 150, 160: Server 170: Network

Claims (17)

A computer program for causing a computer device to execute an information providing method,
The information providing method includes:
providing a search interface for providing search results based on an input search term; and, when the search term input to the search interface includes a preset interaction search term corresponding to a given subject, providing an interaction function for providing information related to the subject through an interaction with a user in response to the interaction search term , the step of providing the interaction function includes:
The computer program further comprises displaying an object related to the subject using a viewer included in the interaction function, and providing submotion information for each of a plurality of submotions obtained by dividing a motion of the object . The step of providing an interaction function includes:
The computer program product of claim 1 , further comprising: controlling a view of the object displayed on the viewer or a motion of the object according to an interaction with the user. The controlling step includes:
The computer program product of claim 2 , further comprising: providing a function for adjusting a playback speed of the motion of the object. The controlling step includes:
The computer program product of claim 2 , further comprising: providing an augmented reality (AR) function for reproducing the motion of the object against a background of an image input in real time to a camera included in the computer device. The step of providing the sub-motion information includes:
The computer program product of claim 1 , further comprising: providing a submotion selection interface for selecting one submotion from the plurality of submotions; and playing the submotion selected in the submotion selection interface using the viewer. The submotion information includes video information, audio information, and text information related to the corresponding submotion;
The step of playing the selected sub-motion includes:
6. The computer program according to claim 5 , further comprising: outputting at least one of the audio information and the text information while reproducing the selected sub-motion based on the video information. the sub-motion selection interface includes a plurality of sub-motion buttons for the plurality of sub-motions;
The step of playing the selected sub-motion includes:
6. The computer program according to claim 5 , further comprising: playing a submotion corresponding to a submotion button selected from the plurality of submotion buttons. the plurality of sub-motion buttons are arranged in order, and display positions of the plurality of sub-motion buttons are changed according to a drag gesture input to the plurality of sub-motion buttons;
The step of playing the selected sub-motion includes:
The computer program product according to claim 7, characterized in that a submotion corresponding to a submotion button at a preset display position among the plurality of submotion buttons is played, and a playback direction and a playback speed of the submotion being played are determined based on a direction and a speed of the drag gesture. The step of playing the selected sub-motion includes:
displaying an annotation button at a position of a specific point of the object to provide detailed information related to the specific point;
8. The computer program product of claim 7, further comprising: moving a display position of the annotation button by moving a position of a specific point of the object by playing the selected sub-motion; and, when the annotation button is selected , changing the selected sub-motion to provide the detailed information. The step of playing the selected sub-motion includes:
The computer program product of claim 7 , further comprising: displaying an annotation guide including at least two points on the object and a link connecting the at least two points. The object includes a three-dimensional human body model,
The computer program product of claim 10 , wherein the at least two points correspond to joint positions of the three-dimensional human model. The step of providing an interaction function includes:
The computer program product of claim 1 , further comprising: providing the viewer with a search result page generated using the interaction search term. The step of providing an interaction function includes:
The computer program product of claim 12, further comprising: providing, through the search result page or the viewer, a link for accessing a page providing sub-motion information for each of a plurality of sub-motions obtained by dividing the motion of the object . The step of providing an interaction function includes:
2. The computer program product of claim 1, further comprising: providing a question and answer interface for receiving a voice or text-based query from the user and providing responses to the query that are related to the subject matter. 15. The computer program product of claim 14, wherein the response includes one of a plurality of submotions obtained by dividing a motion of an object related to the subject, or includes a result generated by analyzing the contents of a document searched based on the query using artificial intelligence . 1. A method for providing information in a computer device including at least one processor, comprising:
providing a search interface for providing search results based on an input search term by the at least one processor; and providing an interaction function for providing information related to a subject by interaction with a user in response to an interaction search term when the search term input to the search interface includes an interaction search term preset corresponding to the subject, the at least one processor comprising:
The information providing method further includes displaying an object related to the subject using a viewer included in the interaction function, and providing submotion information for each of a plurality of submotions obtained by dividing a motion of the object . at least one processor implemented to execute computer readable instructions;
by said at least one processor,
receiving a search term from a user's device;
If the received search term includes a preset interaction search term corresponding to a given subject, generate a search result page including a search result corresponding to the interaction search term and an interaction function for providing information related to the subject through an interaction with the user;
providing the generated search result page to the user's terminal ;
The generated search result page includes:
The computer device further comprising: a viewer including an interaction function that displays an object related to the subject; and provides submotion information for each of a plurality of submotions obtained by dividing a motion of the object .

Images