JP2013003685A - Information processing device, information processing method and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To accurately transfer information assigned to some content by a user.SOLUTION: Segment information where a segment having a duration of time for some content is specified and assigned by a user is displayed on a content reproduction screen so as to match a position within the content of the segment. In addition, information indicating the segment specified by the user with respect to reproduced content and segment assignment information assigned to the specified segment are acquired. The present invention can be applied to a content delivery service system, for example.

Description

  The present technology relates to an information processing device, an information processing method, and a program, and particularly relates to an information processing device, an information processing method, and a program that allow a user to add information to content.

  2. Description of the Related Art Conventionally, in a content distribution service, it is generally performed that a user can give an evaluation to content (for example, see Patent Document 1).

  Conventionally, a moving image distribution service has been provided in which a server collects comments input during reproduction of a moving image on a client and displays the collected comments superimposed on the moving image. With this service, the user can enjoy watching a comment given to each scene of the moving image by another user along with the moving image.

JP 2010-244380 A

  However, in the above-described moving image distribution service, there may be a difference between the reproduction position of the moving image to which the user wants to add a comment and the reproduction position of the moving image when the comment is actually input and transmitted to the server. As a result, the comments are not always accurately transmitted to other users who use the service.

  The present technology enables a user to accurately convey information given to a part of content.

  An information processing apparatus according to an aspect of the present technology includes a reproduction unit that reproduces content, and grant information that is given by designating a segment having a partial time width of the content during content playback, A display control unit that controls to display the segment according to the position in the content, information indicating the segment designated by the user for the reproduced content, and the grant information given to the designated segment And an acquisition unit for acquiring.

  The display control unit can control the grant information to display only a section including at least a segment to which the grant information is given.

  The display control unit can fade in the grant information at the start of display and fade out at the end.

  The display control unit may be configured to control the display of information indicating a segment in the content to which the grant information is added while scrolling the grant information in a predetermined direction as the reproduction of the content progresses. it can.

  A receiving unit that receives content and the grant information assigned to each segment of the content is further provided from the server, and the display control unit receives the content received from the server during playback of the content received from the server. The grant information can be controlled to be displayed in accordance with the position in the content of the segment to which the grant information is given.

  The receiving unit further receives information indicating the user who has given the grant information from the server, and the display control unit displays information indicating the user who has given the grant information together with the grant information. Can be controlled.

  It is possible to further provide a transmission unit that transmits the segment designated by the user to the reproduced content, information indicating the designated user, and the grant information assigned to the designated segment to the server.

  The receiving unit sequentially receives from the server the grant information assigned to each content segment in another information processing apparatus, and the display control unit sequentially displays the received grant information in time series. Can be controlled.

  The grant information can include at least one of text data, a file, an evaluation for a segment, and link information to another segment.

  An operation unit for designating a segment for the content being reproduced can be further provided.

  By operating the operation unit, a segment can be designated based on a predetermined unit based on the content structure.

  According to an information processing method of one aspect of the present technology, an information processing apparatus that reproduces content includes grant information that is given by a user by designating a segment having a partial time width during content playback. , Control to display in accordance with the position of the segment in the content, and obtain information indicating the segment designated by the user for the reproduced content, and the grant information assigned to the designated segment Includes steps.

  The program according to one aspect of the present technology displays, during reproduction of content, grant information assigned by a user by specifying a segment having a partial time width of the content according to the position of the segment in the content. And a step of acquiring information indicating a segment designated by the user for the reproduced content and the grant information given to the designated segment.

  In one aspect of the present technology, during reproduction of content, grant information assigned by a user specifying a segment having a partial time width of the content is displayed in accordance with the position of the segment in the content. Information indicating the segment designated by the user for the reproduced content and the grant information assigned to the designated segment are acquired.

  According to one aspect of the present technology, information given to a part of content by a user can be accurately transmitted.

1 is a block diagram illustrating an embodiment of an information processing system to which the present technology is applied. It is a block diagram which shows the structural example of the function of a server. It is a block diagram which shows the structural example of the function of a client. It is a flowchart for demonstrating the content reproduction process performed by a client. It is a figure which shows the 1st example of a content reproduction screen. It is a figure which shows the 2nd example of a content reproduction screen. It is a figure which shows the 1st example of the operation screen for performing the setting of a check-in area. It is a figure which shows the 2nd example of the operation screen for performing the setting of a check-in area. It is a figure which shows the 3rd example of the operation screen for performing the setting of a check-in area. It is a figure which shows the 1st example of the input screen of segment provision information. It is a figure which shows the 2nd example of the input screen of segment provision information. It is a figure which shows the example which updated the content reproduction screen of FIG. 5 with the input of segment provision information. It is a flowchart for demonstrating the content delivery process performed by the server. It is a figure which shows the 1st modification of a content reproduction screen. It is a figure which shows the example of a display of a check-in area. It is a figure which shows the example of a display of the link information to another segment. It is a figure which shows the 2nd modification of a content reproduction screen. It is a flowchart for demonstrating the segment recommendation process using CF performed by the server. It is a flowchart for demonstrating the play list production | generation process using CF performed by the server. It is a figure for demonstrating the extraction method of the segment used for a play list. It is a flowchart for demonstrating the segment recommendation process using CBF performed by the server. It is a flowchart for demonstrating 1st Embodiment of the play list production | generation process using CBF performed by the server. It is a figure for demonstrating the specific example of a playlist. It is a flowchart for demonstrating 2nd Embodiment of the play list production | generation process using CBF performed by the server. It is a figure which shows the example of a display of the list of play lists. It is a flowchart for demonstrating the segment recommendation process using the comment provided to the segment performed by the server. It is a flowchart for demonstrating 1st Embodiment of the play list production | generation process using the comment provided to the segment performed by the server. It is a flowchart for demonstrating 2nd Embodiment of the play list production | generation process using the comment provided to the segment performed by the server. It is a figure which shows the example of a comment table. It is a figure which shows the example after replacing the comment of the comment table of FIG. 29 with the comment label. It is a figure which shows the example of a feature-value table. It is a figure which shows the example after replacing the feature-value of the feature-value table of FIG. 31 with the feature-value label. It is a flowchart for demonstrating the segment recommendation process based on the ranking performed by the server. It is a flowchart for demonstrating the learning process of the correlation of the segment and image performed by the server. It is a flowchart for demonstrating 1st Embodiment of the slide show production | generation process performed by the server. It is a flowchart for demonstrating 2nd Embodiment of the slide show production | generation process performed by the server. It is a block diagram which shows the structural example of a computer.

Hereinafter, modes for carrying out the present technology (hereinafter referred to as embodiments) will be described. The description will be given in the following order.
1. Embodiment 2. FIG. Modified example

<1. Embodiment>
[Configuration Example of Information Processing System 1]
FIG. 1 is a block diagram illustrating an embodiment of an information processing system 1 to which the present technology is applied.

  The information processing system 1 is configured to include a server 11 and clients 12-1 to 12-n. The server 11 and the clients 12-1 to 12-n are connected to each other via the network 13.

  The server 11 recommends or distributes content to the clients 12-1 to 12-n via the network 13. The server 11 recommends and distributes content not only for the entire content but also for each segment that is a section of the content.

  The clients 12-1 to 12-n are configured by devices capable of using content such as personal computers, portable information terminals, mobile phones, and audio players, for example. Then, the user uses the content distributed from the server 11 using the clients 12-1 to 12-n.

  Further, in the clients 12-1 to 12-n, the user can specify an arbitrary section (segment) of the content, and can add information such as a comment to the specified segment. Hereinafter, it is referred to as check-in that the user designates an arbitrary segment of content.

  Then, the clients 12-1 to 12-n send the check-in information including the information indicating the checked-in user and the segment and the information given to the segment (hereinafter referred to as segment grant information) to the network 13. To the server 11.

  On the other hand, as will be described later, the server 11 recommends and distributes content in units of segments based on the check-in information collected from the clients 12-1 to 12-n.

  Hereinafter, the clients 12-1 to 12-n are simply referred to as clients 12 when it is not necessary to individually distinguish the clients 12-1 to 12-n.

  Hereinafter, an example in which the information processing system 1 performs distribution and recommendation of music will be described. Therefore, hereinafter, unless otherwise specified, the term “content” refers to music or its data (music data).

[Configuration Example of Server 11]
FIG. 2 is a block diagram illustrating a configuration example of the server 11.

  The server 11 includes a storage unit 31, an analysis unit 32, a comment label determination unit 33, a feature amount label determination unit 34, a recommendation unit 35, a slide show generation unit 36, a distribution unit 37, a transmission unit 38, a reception unit 39, and a check-in. An information acquisition unit 40 is included.

  The storage unit 31 includes a content database (DB) 51, a check-in information database (DB) 52, a user database (DB) 53, a synonym dictionary 54, a label database (DB) 55, and a storage device 56. The

  The content DB 51 is a database that stores the content distributed by the server 11 and the feature amount of each content.

  Note that the type and number of feature quantities of content to be stored can be arbitrarily set. For example, feature quantities such as waveform, volume, melody, rhythm, chord progression, instrument configuration, and lyrics can be used.

  The check-in information DB 52 is a database that stores a history of check-in by the user in each client 12. More specifically, the check-in information DB 52 stores check-in information including information indicating the checked-in user and segment, and segment grant information assigned to the segment. That is, the check-in information DB 52 collects check-in information transmitted from each client 12.

  The user DB 53 is a database that stores personal information of users who use the information processing system 1.

  The synonym dictionary 54 stores data of various synonyms.

  The label DB 55 is a database that stores labels that briefly represent the features of the content and segments.

  The storage device 56 stores, for example, various data that is not stored in the content DB 51 to the label DB 55, such as software for reproducing content.

  The analysis unit 32 performs various analysis processes using data stored in each unit of the storage unit 31. Then, the analysis unit 32 notifies the recommendation unit 35 and the slide show generation unit 36 of the analysis result, or causes the storage device 56 to store the analysis result.

  The analysis unit 32 is configured to include a segment analysis unit 61, a user analysis unit 62, a given information analysis unit 63, a correlation analysis unit 64, and a statistical analysis unit 65.

  The segment analysis unit 61 uses the data stored in each unit of the storage unit 31 to perform various types of analysis regarding the segment. For example, the segment analysis unit 61 analyzes the feature amount of each segment, the similarity between segments, and the like.

  The user analysis unit 62 performs various types of analysis regarding the user who uses the information processing system 1 by using data stored in each unit of the storage unit 31. For example, the user analysis unit 62 analyzes each user's preference, similarity between users, and the like.

  The assignment information analysis unit 63 performs various analyzes on the segment assignment information by using data stored in each unit of the storage unit 31. For example, the assignment information analysis unit 63 analyzes a feature amount such as a comment or an image included in the segment assignment information, a similarity between comments or images, and the like.

  The correlation analysis unit 64 analyzes the correlation between various analysis results obtained by the segment analysis unit 61, the user analysis unit 62, and the assigned information analysis unit 63.

  The statistical analysis unit 65 aggregates or analyzes statistics of checked-in segments, users, and the like, and generates various rankings of segments, for example.

  The comment label discriminating unit 33 has a function of discriminating a label (hereinafter referred to as a comment label) suitable for a comment given to each segment by performing learning processing in advance. Note that any method can be adopted as a learning method of the comment label determination unit 33.

  Then, the comment label determination unit 33 extracts a segment to which a comment is attached from the check-in information DB 52, and a comment label that matches the comment attached to the extracted segment is stored in the label DB 55. Choose from. The comment label determination unit 33 supplies the recommendation unit 35 with information indicating a combination of the extracted segment, the user to which the comment is added, and the comment label.

  The feature amount label discriminating unit 34 has a function of discriminating a label (hereinafter referred to as a feature amount label) suitable for each segment based on the feature amount of each segment by performing learning processing in advance. An arbitrary method can be adopted as the learning method of the feature amount label discriminating unit 34.

  Then, the feature amount label discriminating unit 34 uses the content DB 51 and the check-in information DB 52 to obtain the feature amount of each segment checked in by the user, and based on the feature amount of each segment, the feature conforming to each segment The quantity label is selected from the labels stored in the label DB 55. The feature amount label determination unit 34 supplies information indicating the feature amount label of each segment to the recommendation unit 35.

  The recommendation unit 35 extracts a segment recommended for the user and performs a recommendation process. The recommendation unit 35 is configured to include a segment extraction unit 71, a segment recommendation unit 72, and a playlist generation unit 73.

  The segment extraction unit 71 recommends to the user based on the analysis result of the analysis unit 32, the comment label given to the segment by the comment label discrimination unit 33, the feature amount label given to the segment by the feature amount label discrimination unit 34, and the like. To extract the segment.

  The segment recommendation unit 72 generates segment recommendation information for recommending a segment to the user based on the segment extracted by the segment extraction unit 71. More specifically, the segment recommendation unit 72 uses the content DB 51, the check-in information DB 52, and the like to generate segment recommendation information including information on the extracted segment, the recommendation reason, and the like. Then, the segment recommendation unit 72 transmits the generated segment recommendation information to the client 12 via the transmission unit 38 and the network 13.

  Further, the segment recommendation unit 72 generates information (hereinafter referred to as ranking information) including information related to the segments higher in the ranking of the segments generated by the statistical analysis unit 65 using the content DB 51, the check-in information DB 52, and the like. To do. Then, the segment recommendation unit 72 transmits the generated ranking information to the client 12 via the transmission unit 38 and the network 13.

  The playlist generation unit 73 generates a playlist for recommending a segment to the user based on the segment extracted by the segment extraction unit 71. Here, the play list is a list in which extracted segments are arranged in the order of reproduction. Using this playlist, the client 12 can automatically reproduce the segments in the playlist in the designated reproduction order.

  The playlist generation unit 73 uses the content DB 51, the check-in information DB 52, and the like to arrange the extracted segments in the order of playback according to a predetermined rule, and information that lists information about each segment (hereinafter referred to as playlist information and To generate). Then, the playlist generation unit 73 transmits the generated playlist information to the client 12 via the transmission unit 38 and the network 13.

  The slide show generation unit 36 generates a slide show to be displayed while switching images together with BGM (Back Ground Music). Specifically, the slide show generation unit 36 instructs the segment analysis unit 61 to analyze the feature amount of each segment of the content used for the slide show, and acquires the analysis result. Further, the slide show generation unit 36 instructs the assigned information analysis unit 63 to analyze the feature amount of the image used for the slide show, and acquires the analysis result. Then, the slide show generation unit 36 selects an appropriate combination of each segment and image based on the acquired analysis result, and generates a slide show.

  The slide show generation unit 36 generates data for reproducing the generated slide show (hereinafter referred to as slide show data) using data stored in each unit of the storage unit 31 and supplies the data to the distribution unit 37.

  The distribution unit 37 receives a request for transmission of data (hereinafter referred to as content reproduction data) for reproducing the content (or its segment) from the client 12 via the network 13 and the reception unit 39. The distribution unit 37 reads content data of the content designated from the client 12 from the content DB 51 and reads check-in information associated with the designated content from the check-in information DB 52. Then, the distribution unit 37 transmits the read content data and the content reproduction data including the check-in information to the requesting client 12 via the transmission unit 38 and the network 13.

  The distribution unit 37 receives a slide show distribution request from the client 12 via the network 13 and the reception unit 39. The distribution unit 37 supplies the information received from the client 12 at that time to the slide show generation unit 36 and instructs the generation of the slide show. The distribution unit 37 acquires slide show data from the slide show generation unit 36 and transmits the slide show data to the requesting client 12 via the transmission unit 38 and the network 13.

  The transmission unit 38 transmits various information, data, instructions, and the like to the client 12 via the network 13 according to a predetermined communication method.

  The receiving unit 39 receives various information, data, instructions, and the like from the client 12 via the network 13 according to a predetermined communication method. The receiving unit 39 supplies the received information, data, instructions, and the like to the recommendation unit 35, the distribution unit 37, and the check-in information acquisition unit 40 as necessary.

  The check-in information acquisition unit 40 receives check-in information from the client 12 via the network 13 and the reception unit 39 and stores the check-in information in the check-in information DB 52.

[Configuration example of client 12]
FIG. 3 is a block diagram illustrating a configuration example of the client 12.

  The client 12 includes a reception unit 101, a storage unit 102, a UI control unit 103, a playback unit 104, a display unit 105, an audio output unit 106, an operation unit 107, a check-in information generation unit 108, and a transmission unit 109. Composed.

  The receiving unit 101 receives various information, data, instructions, and the like from the server 11 via the network 13 according to a predetermined communication method. The receiving unit 101 stores the received information, data, commands, and the like in the storage unit 102 as necessary, or supplies the UI control unit 103 and the playback unit 104 to the information.

  The storage unit 102 appropriately stores information, data, etc. received from the server 11.

  The UI control unit 103 controls the user interface by controlling the display unit 105 and the audio output unit 106 according to a command input by the user via the operation unit 107. For example, the UI control unit 103 is based on information and data received from the server 11 via the reception unit 101, information and data stored in the storage unit 102, information on content supplied from the reproduction unit 104, and the like. A content reproduction screen, an operation screen, and the like are displayed on the display unit 105, and sound associated therewith is output from the audio output unit 106.

  Also, the UI control unit 103 transmits a command to the server 11 input by the user via the operation unit 107 to the server 11 via the transmission unit 109 and the network 13. Furthermore, the UI control unit 103 instructs the playback unit 104 to play back content and stop playback. In addition, the UI control unit 103 supplies information indicating the segment checked in by the user and the segment assignment information assigned to the segment to the check-in information generation unit 108.

  The reproduction unit 104 reproduces the content data received via the reception unit 101 or the content data stored in the storage unit 102, and supplies the resulting audio to the audio output unit 106. In addition, the playback unit 104 supplies information related to content obtained as a result of playback of content data to the UI control unit 103.

  The display unit 105 displays various screens such as a content playback screen and an operation screen under the control of the UI control unit 103.

  The audio output unit 106 includes, for example, a speaker or an audio output terminal, and outputs audio supplied from the UI control unit 103 and the playback unit 104.

  The operation unit 107 includes various input devices such as a keyboard, buttons, switches, and pointing devices, for example. The user operates the operation unit 107 to give various commands to the client 12 and input information, data, and the like. Then, the operation unit 107 supplies the input information, data, command, and the like to the UI control unit 103.

  When a user checks in a content segment, the check-in information generation unit 108 displays check-in information including information indicating the checked-in user and the segment, segment grant information assigned to the segment, and the like. Generate. Then, the check-in information generation unit 108 transmits the generated check-in information to the server 11 via the transmission unit 109.

  The transmission unit 109 transmits various information, data, commands, and the like to the server 11 via the network 13 according to a predetermined communication method.

[Processing of information processing system 1]
Next, processing of the information processing system 1 will be described with reference to FIGS.

[Content playback processing]
First, content reproduction processing executed by the client 12 will be described with reference to the flowchart of FIG.

  This process is started when, for example, the user operates the operation unit 107 of the client 12 to input a content reproduction command and the UI control unit 103 is notified of the command.

  In step S <b> 1, the UI control unit 103 requests the server 11 to transmit content reproduction data for reproducing the specified content via the transmission unit 109 and the network 13.

  In response to this, the server 11 starts transmitting content reproduction data to the requesting client 12 via the network 13 in step S52 of FIG.

  In step S <b> 2, the reception unit 101 of the client 12 starts receiving content reproduction data transmitted from the server 11 via the network 13.

  Note that the method for distributing content from the server 11 to the client 12 is not limited to a predetermined method, but an example in which content is distributed by a streaming method will be described below.

  In step S3, the client 12 starts reproduction of the content. Specifically, the reception unit 101 starts supplying content data included in the received content reproduction data to the reproduction unit 104. The reproduction unit 104 starts reproduction of the content data, and causes the audio output unit 106 to output sound (that is, music) obtained as a result. In addition, the playback unit 104 supplies information related to content obtained as a result of playback of content data to the UI control unit 103. Here, the information regarding the content includes, for example, the title of the content, the name of the album in which the content is recorded, the image of the album jacket, and the like.

  In addition, the reception unit 101 starts supplying check-in information included in the received content reproduction data to the UI control unit 103. The UI control unit 103 displays the content reproduction screen on the display unit 105 in synchronization with the reproduction of the content based on the check-in information supplied from the reception unit 101 and the information about the content supplied from the reproduction unit 104. Let

[Example of content playback screen]
FIG. 5 shows an example of a content playback screen.

  This content reproduction screen is largely divided into a region R1, a region R2, and a region R3.

  In the area R1, information related to the content being reproduced is displayed. For example, the artist name, song name, recorded album name, album jacket, etc. of the content being reproduced are displayed.

  Buttons and the like for operating content reproduction are displayed at the bottom of the region R2. Specifically, a playback button 151 for playing content, a rewind button 152 for rewinding, a fast-forward button 153 for fast-forwarding, and a progress bar 154 for specifying the playback position of the content Is displayed.

  Further, in the region R2, as the playback of the content progresses, the user who has checked in each segment of the content and the provided segment assignment information are located at the position (position on the time axis of the content) of the segment. Displayed together.

  Specifically, a scale indicating the content playback position is displayed at the left end of the region R2.

  In the area R2, icons 171a to 171d indicating the user who has checked in the content being reproduced are displayed. The icons 171a to 171d are displayed around the time when each user checked in on the time axis of the content being played back. In addition, when segment grant information is given to a checked-in segment, the segment grant information is displayed in a balloon to the right of each icon.

  For example, a balloon 172b including a comment is displayed to the right of the icon 171b. That is, it is indicated that the user indicated by the icon 171b gives a comment “cool” to the checked-in segment.

  A balloon 172c including a comment is displayed on the right side of the icon 171c. In other words, it is indicated that the user indicated by the icon 171c gives a comment “When you listen to the lyrics here, you always remember your boyfriend ...” to the checked-in segment.

  Further, a balloon 172d including an image is displayed to the right of the icon 171d. That is, it is indicated that the user indicated by the icon 171d has given the image in the balloon 172d to the checked-in segment.

  In addition, a scale 173 indicating a checked-in section is displayed on the left of the icon 171c. As will be described later, the user can check in at an arbitrary position of the content by pinpointing, or can also check in by specifying a section of an arbitrary length. That is, the user can specify a segment by pinpointing, or can specify a segment having an arbitrary time width.

  The scale 173 indicates the segment (section) in the content checked in by the user indicated by the icon 171c and the segment (section) in the content to which the segment assignment information in the balloon 172c is assigned.

  Further, the user can vote for the segment assignment information given to each segment. For example, when segment giving information that is sympathetic or worrisome is displayed, the user designates a speech bubble in which the segment grant information is displayed or an icon next to the speech bubble by clicking, touching, or the like. Can vote.

  The number of votes for each segment assignment information is displayed in a balloon together with a predetermined mark. For example, in this example, votes of 0, 6, and 22 are respectively given to the segment assignment information in the balloons 172b to 172d.

  The display in the region R2 is scrolled downward as a whole as content playback progresses, except for the playback button 151 to the progress bar 154. In addition, a boundary B1 in which the background color in the region R2 changes indicates the current content reproduction position.

  Accordingly, the icons 171a to 171d and the balloons 172b to 172d are displayed in the region R2 for a predetermined period regardless of the time width of the corresponding segment. That is, the icons 171a to 171d and the balloons 172b to 172d appear in the region R2 a predetermined time before the head of the corresponding segment is played back, and a predetermined time after the head of the corresponding segment is played back. It will disappear from the area R2 later.

  In the region R3, buttons 155 to 158 for performing various operations other than the content reproduction are displayed. These buttons are used, for example, for operations for performing check-in and switching display modes.

  For example, the user can switch the display mode by operating any one of the buttons 155 to 158, and can display the content reproduction screen shown in FIG. 6 on the display unit 105.

  The content playback screen in FIG. 6 is different in display in the region R2 from the content playback screen in FIG. Specifically, in the area R2, an icon indicating a user who has checked in in the past (time) of the currently reproduced content, a balloon indicating segment assignment information, and the like are displayed.

  In this example, a screen is shown when a portion of content that is 40 seconds past is being played. Therefore, among the icons and the like displayed in the region R2 in FIG. 5, only the icon 171c and the balloon 172c related to the check-in of the content after 40 seconds, and the icon 171d and the balloon 172d are displayed.

  Note that the icon 171c and the balloon 172c, and the icon 171d and the balloon 172d are displayed in the region R2 in FIG. 6 only in a section including at least the corresponding segment.

  For example, the icon 171c and the balloon 172c appear in the region R2 a predetermined time (for example, one second) before the head of the corresponding segment is reproduced. The icon 171c and the balloon 172c disappear from the area R2 after a predetermined time (for example, 1 second) after the end of the corresponding segment is reproduced.

  Similarly, the icon 171d and the balloon 172d are displayed in the region R2 a predetermined time before the corresponding pinpoint segment is reproduced, and disappear from the region R2 a predetermined time after the corresponding segment is reproduced. .

  As described above, the segment assignment information in each balloon is displayed in the region R2 of FIG. 6 only in a section including at least the segment to which the information is assigned. Therefore, in the content reproduction screen of FIG. 6, compared to the content reproduction screen of FIG. 5, it is possible to recognize more intuitively, easily and accurately which part of the content is provided with the segment assignment information. .

  In the content playback screen of FIG. 6, for example, each icon and balloon may be faded in at the start of display and faded out at the end.

  Further, for example, when the client 12 is configured by a tablet terminal that can perform a pinch operation using two fingers on the screen of the display unit 105, the pinch operation is performed on the content reproduction screen of FIG. 5 or FIG. Thus, the display range may be enlarged or reduced.

  Thereby, for example, when there are too many icons and speech bubbles, and it is difficult to see the screen with the default display size, it is possible to easily enlarge the portion where the icons and speech bubbles are concentrated and confirm the details. On the other hand, when icons and balloons are not displayed so much, for example, by reducing the display size of the content playback screen in FIG. 5 from the default, the time width of the content displayed on the screen can be expanded.

  Returning to FIG. 4, in step S <b> 4, the UI control unit 103 determines whether a check-in operation has been performed on the operation unit 107. If it is determined that a check-in operation has been performed, the process proceeds to step S5.

  At this time, it is possible to set a section to check in before checking in.

[Check-in section setting method]
Here, an example of a check-in section setting method will be described with reference to FIGS.

  For example, as shown in FIG. 7, the check-in section may be set by setting a start point and an end point at an arbitrary position of the content being played using the progress bar 201 and the cursor 202.

  Further, for example, as shown in FIG. 8, the content being played is divided into a minimum unit of a predetermined unit (for example, measure unit) and presented, and one or more minimum segments are selected by the cursor 211 or the like. Thus, a check-in section may be set.

  Furthermore, for example, as shown in FIG. 9, the content being played is divided into segments based on the music structure such as A melody, B melody, and chorus, and one or more segments are selected using the cursor 221 or the like. By doing so, a check-in section may be set.

  Thereby, the user can easily set the check-in section (segment time width and position) to a desired section.

  Note that in a small device such as a mobile phone or a portable information terminal, the screen of the display unit 105 is small, and thus it may be difficult to operate with the method illustrated in FIGS.

  Therefore, for example, the screen of the display unit 105 may be tapped to specify the start point of the check-in section, and the screen may be tapped again to specify the end point.

  Alternatively, for example, the start point of the check-in section may be specified by tapping the screen of the display unit 105, and the section from the start point to a predetermined time (for example, after 10 seconds) may be set as the check-in section. .

  Further, for example, the check-in section may be set by using a two-finger on the screen of the display unit 105 and a so-called pinch operation according to a position or interval at which the finger touches the screen.

  In this way, by setting the check-in section, the user can specify an arbitrary position of content and a segment of time width.

  When the check-in section is not set, for example, the content playback position when the check-in operation is performed is set as the start point and the end point. That is, the check-in section is set as a pinpoint at the content playback position.

  Further, for example, the entire content can be specified by setting the entire content in the check-in section. That is, it is possible to check in the entire content.

  Then, the UI control unit 103 acquires information indicating the check-in section set via the operation unit 107.

  If the user can arbitrarily set the check-in section by the operation shown in FIG. 7, the segment serving as a processing unit varies between users in the segment recommendation process and the playlist generation process described later. The processing may become complicated.

  Therefore, for example, a check-in section set by the user is approximated to a section based on a preset minimum segment, and the approximated section is a segment designated by the user (hereinafter referred to as an approximate segment). You may make it set.

  Alternatively, for example, when check-in sections set by a plurality of users overlap, an approximate segment may be set by statistical processing. Specifically, for example, a portion where check-in sections of a plurality of users overlap most may be set as an approximate segment.

  In addition, when performing segment approximation, for example, processing is performed using the approximate segment internally, and when displaying outside, the original check-in section before approximation may be used.

  Returning to FIG. 4, in step S <b> 5, the client 12 receives an input of segment assignment information. Specifically, for example, the UI control unit 103 causes the display unit 105 to display the input screen illustrated in FIG.

  The input screen of FIG. 10 differs from the content playback screen of FIG. 5 in that an input screen for segment assignment information is displayed in the region R2. Specifically, a comment input field 231, a pull-down menu 232, a pull-down menu 233, a segment assignment button 234, a file assignment button 235, an evaluation input field 236, and a send button 237 are displayed in the region R2.

  The comment input field 231 is a field for inputting text data such as a comment for the checked-in content segment.

  The pull-down menu 232 and the pull-down menu 233 allow a comment to be easily given to a specified content segment. For example, the items shown on the left side of FIG. 10 are displayed by designating the pull-down menu 232 or the pull-down menu 233 by touching or clicking, respectively. Then, by selecting a desired item from the items displayed in each menu, it is possible to quickly and easily input a comment expressing “A is B” (for example, lyrics are radical).

  Note that A in the above “A is B” indicates an item selected from the pull-down menu 232, and B indicates an item selected from the pull-down menu 233.

  For example, words frequently used in comments given by the user may be extracted and set as selection items of the pull-down menu 232 and the pull-down menu 233. At this time, it is possible to extract frequently used phrases including comments of other users and set selection items, or extract frequently used phrases for each user and customize the selected items for each user. .

  The segment assignment button 234 is operated when another segment is linked to the checked-in content segment.

  Here, a specific example of the operation of linking another segment to the checked-in content segment will be described.

  For example, when the segment assignment button 234 is pressed, a screen for selecting linked content is displayed. When the content is selected, reproduction of the selected content is started, and the content reproduction screen described above with reference to FIG. 5 is displayed. Then, for example, the segment of the link destination is specified by specifying the section of the content being reproduced by the same operation as described above with reference to FIGS. 7 to 9.

  At this time, it is possible not only to link to a segment of content different from the content being played back, but also to link a segment of content being played back.

  The file assignment button 235 is operated when a file is assigned to the checked-in content segment. For example, by operating the file grant button 235, a screen for selecting a file to be given is displayed, and the user can select the file to be given.

  Note that the type of file to be added is not particularly limited, and for example, a file such as an image, a sound, or a document can be added.

  The evaluation input field 236 is used to give a five-stage evaluation to the checked-in content segment. Ratings are represented by the number of stars, and the user can assign a rating to a segment of the checked-in content by specifying the number of stars.

  Note that, for example, evaluations of less than five levels or more may be given, and likes and dislikes may be selected.

  The transmission button 237 is a button for transmitting the segment assignment information input from the comment input field 231 to the evaluation input field 236 to the server 11.

  The user uses the operation unit 107 to input or set a desired item from the comment, the link destination segment, the file, and the evaluation from the input screen of FIG. Then, the UI control unit 103 acquires the segment assignment information that is input or set.

  For example, as shown in FIG. 11, a pull-down menu 241 may be displayed on the content playback screen, a desired comment may be selected from the pull-down menu 241, and a comment may be easily added to the checked-in segment.

  Although detailed description is omitted, it is also possible to give the same information as the above-described segment assignment information to the entire content without particularly specifying a segment.

  At this time, similarly to the pull-down menus 232 and 233 in FIG. 10, the selection items of the pull-down menu 241 may be set based on the frequently used phrases in the comments given by each user.

  Returning to FIG. 4, in step S6, the client 12 transmits check-in information. Specifically, when the transmission button 237 is pressed on the input screen of FIG. 10, the operation unit 107 notifies the UI control unit 103 that the transmission of check-in information has been commanded. The UI control unit 103 supplies the check-in information generation unit 108 with information indicating the segment checked in by the user (for example, the segment time in the content) and the segment assignment information assigned to the segment.

  The check-in information generation unit 108 generates check-in information including information indicating the checked-in segment and the checked-in user, and the given segment assignment information. Then, the check-in information generation unit 108 transmits the generated check-in information to the server 11 via the transmission unit 109 and the network 13.

  Thereafter, the process proceeds to step S7.

  In response to this, the server 11 receives the check-in information transmitted from the client 12 in step S53 of FIG. 13 described later, and updates the check-in information DB 52 in step S54.

  At this time, in each client 12 that is playing back the checked-in content, the checked-in user and the given segment assignment information may be displayed in real time.

  For example, FIG. 12 shows an example in which the content reproduction screen of FIG. 5 is updated by performing check-in. In the content reproduction screen of FIG. 12, an icon 171e and a balloon 172e are added as compared to the content reproduction screen of FIG. That is, it is shown that the user indicated by the icon 171e has checked in, and the segment assignment information shown in the balloon 172e is given to the checked-in segment.

  In the balloon 172e, an image (for example, a jacket or the like) indicating other content (segment) linked to the checked-in segment and a comment are displayed. In this example, a comment indicating that the vicinity of 40 seconds of the content being reproduced is similar to a part of the content included in the album of the jacket in the balloon 172e is shown.

  Returning to FIG. 4, if it is determined in step S4 that the check-in operation has not been performed, the processes in steps S5 and S6 are skipped, and the process proceeds to step S7.

  In step S <b> 7, the UI control unit 103 determines whether or not a stop of content reproduction is instructed. If it is determined that the stop of content reproduction has not been instructed, the process proceeds to step S8.

  In step S <b> 8, the UI control unit 103 determines whether or not the content reproduction has ended. If it is determined that the content reproduction has not ended, the process returns to step S4.

  Thereafter, the processes in steps S4 to S8 are repeatedly executed until it is determined in step S7 that a stop of content reproduction has been instructed, or in step S8, it is determined that the reproduction of content has ended.

  On the other hand, if it is determined in step S8 that the content reproduction has ended, the process proceeds to step S9.

  In step S9, the UI control unit 103 determines whether there is content to be reproduced next. For example, when it is determined that there is content to be reproduced next to content that has been reproduced, for example, during reproduction of a playlist, the process returns to step S1, and the processes after step S1 are executed. That is, reception of content reproduction data of the content to be reproduced next is started, and reproduction of the content is started.

  On the other hand, if it is determined in step S9 that there is no content to be reproduced next, the process proceeds to step S11.

  In step S <b> 7, when the user inputs a content playback stop command via the operation unit 107 and the command is notified to the UI control unit 103, the UI control unit 103 stops the content playback. It determines with having been instruct | indicated and a process progresses to step S10.

  In step S10, the client 12 stops the reproduction of the content. Specifically, the UI control unit 103 instructs the playback unit 104 to stop the content playback, and the playback unit 104 stops the content playback. Also, the UI control unit 103 stops updating the content playback screen synchronized with the content playback.

  Thereafter, the process proceeds to step S11.

  In step S <b> 11, the UI control unit 103 requests to stop transmission of content reproduction data via the transmission unit 109 and the network 13.

  On the other hand, the server 11 stops the transmission of the content reproduction data in step S56 of FIG.

  Then, the content reproduction process ends.

[Content delivery processing]
Next, content distribution processing executed by the server 11 in response to content reproduction processing by the client 12 of FIG. 4 will be described with reference to the flowchart of FIG.

  In step S51, the distribution unit 37 determines whether transmission of content reproduction data is requested. When the distribution unit 37 receives a request for transmitting content reproduction data from the client 12 via the network 13 and the reception unit 39, the process proceeds to step S52.

  In step S52, the server 11 starts transmitting content reproduction data. Specifically, the distribution unit 37 reads content data of content designated from the client 12 from the content DB 51. Further, the distribution unit 37 reads check-in information associated with the content designated by the client 12 from the check-in information DB 52. Then, the distribution unit 37 starts transmission of the read content data and the content reproduction data including the check-in information to the requesting client 12 via the transmission unit 38 and the network 13.

  Thereafter, the process proceeds to step S53.

  On the other hand, if it is determined in step S51 that transmission of content reproduction data is not requested, the process of step S52 is skipped, and the process proceeds to step S53.

  In step S53, the check-in information acquisition unit 40 determines whether check-in information has been received. When the check-in information acquisition unit 40 receives the check-in information from the client 12 via the network 13 and the reception unit 39, the process proceeds to step S54.

  In step S54, the check-in information acquisition unit 40 updates the check-in information DB 52. That is, the check-in information acquisition unit 40 updates the check-in information DB 52 by storing the received check-in information in the check-in information DB 52.

  Thereafter, the process proceeds to step S55.

  On the other hand, if it is determined in step S53 that check-in information has not been received, the process of step S54 is skipped, and the process proceeds to step S55.

  In step S55, the distribution unit 37 determines whether or not a stop of transmission of the content reproduction data is requested. When the distribution unit 37 receives a request to stop transmission of content reproduction data from the client 12 via the network 13 and the reception unit 39, the process proceeds to step S56.

  In step S <b> 56, the distribution unit 37 stops transmitting the content reproduction data to the requesting client 12.

  Thereafter, the process returns to step S51, and the processes after step S51 are executed.

  On the other hand, when it is determined in step S55 that the stop of transmission of the content reproduction data is not requested, the process returns to step S51, and the processes after step S51 are executed.

  As described above, the client 12 can specify an arbitrary section of the content being played back and check it in, and give various information (segment assignment information) to the checked-in section (segment). it can. Thereby, the user can give the expression etc. which represent a user's subjectivity to not only the whole content but arbitrary segments in the content.

  In addition, the client 12 can display the segment assignment information assigned to each segment in synchronization with the reproduction of the content in accordance with the position of the segment in the content. This makes it possible to intuitively and accurately recognize the portion to which segment assignment information is assigned. Therefore, information given to an arbitrary section of content by each user can be transmitted to each user more accurately.

[Modification of content playback screen]
Here, a modified example of the content reproduction screen in the client 12 will be described with reference to FIGS.

[Modification 1 of content playback screen]
For example, the content screen shown in FIG. 14 may be displayed by a user operation or the like while the content playback screen of FIG. 5 or 6 is displayed.

  The content playback screen in FIG. 14 is different in display in the region R2 from the content playback screen in FIG. 5 or FIG. Specifically, in the area R2, comments and the like given to the segments of each content in each client 12 are displayed in time series in order from the latest, regardless of the content being reproduced. Then, the client 12 sequentially receives a comment or the like given to each content segment in each client 12 from the server 11, and sequentially updates the display in the region R2. That is, the latest comment or the like is added to the uppermost column of the region R2, and accordingly, the comment or the like being displayed is scrolled downward and the old one is deleted.

  Each column displays the name of the user who checked in, the icon indicating the user, the artist name and song name of the checked-in content, the added comment, the date and time when the comment was added, and the like.

  When a comment is given to a segment for which a start point and an end point (check-in section) are set, as shown in a circled area R11 in FIG. 15, the start point and end point contents are on the time axis. The position of is displayed.

  When a comment is given to a segment linked to another segment, as shown in a circled region R12 in FIG. 16, the song title and artist name of the linked content, and The start point and end point contents of the linked segment on the time axis are displayed.

[Modification 2 of content playback screen]
Further, the content screen shown in FIG. 17 may be displayed by a user operation or the like while the content reproduction screen of FIG. 5, FIG. 6, or FIG. 14 is displayed. That is, in the region R2, the screen in the region R2 in FIG. 5 and the screen in the region R2 in FIG. 14 may be displayed side by side.

  Accordingly, it is possible to confirm in real time the comment or the like given to each content segment in each client 12 while confirming the comment or the like given to the content segment being reproduced.

  In addition, in the area | region R2 of FIG. 17, you may make it display the screen in area | region R2 of FIG. 6 instead of the screen in area | region R2 of FIG.

  When the display unit 105 has a plurality of screens, the content playback screen of FIG. 5 or 6 and the content playback screen of FIG. 14 may be displayed on different screens.

[Recommendation processing by information processing system 1]
Next, content recommendation processing executed by the information processing system 1 will be described.

  In the information processing system 1, content recommendation or the like can be performed for each segment based on each segment of the content checked in by the user, segment assignment information assigned to each segment, and the like. Hereinafter, a specific example of recommendation processing by the information processing system 1 will be described.

[Segment recommendation processing using CF]
First, the segment recommendation process using CF (collaborative filtering) executed by the server 11 will be described with reference to the flowchart of FIG.

  Hereinafter, a user who recommends a segment is referred to as a target user.

  In step S101, the user analysis unit 62 searches for a user similar to the target user. For example, the user analysis unit 62 uses the check-in information DB 52 to search for users whose target user has a similar tendency to the checked-in segment. The user analysis unit 62 notifies the segment extraction unit 71 of the search result.

  Note that the method of searching for a user whose segment checked in with the target user is not limited to a specific one, and any method can be employed.

  In step S102, the segment extraction unit 71 extracts recommended segments based on the check-in history of similar users. Specifically, the segment extraction unit 71 extracts, from the check-in information DB 52, a history of segments that have been checked in by similar users in the past. Then, for example, the segment extraction unit 71 extracts, as recommended segments, segments that the target user has not checked in among the segments that have been checked in by the similar user in the past.

  In step S103, the segment recommendation unit 72 recommends the extracted segment. Specifically, the segment recommendation unit 72 uses the content DB 51, the check-in information DB 52, and the like to generate segment recommendation information including information about the segment extracted by the segment extraction unit 71, a recommendation reason, and the like. The segment recommendation unit 72 transmits the generated segment recommendation information to the client 12 of the target user via the transmission unit 38 and the network 13.

  The UI control unit 103 of the target user's client 12 receives the segment recommendation information via the receiving unit 101. Then, the UI control unit 103 causes the display unit 105 to display a screen for recommending a segment to the target user based on the segment recommendation information. For example, the content name, artist name, album name, album jacket, etc. of the content to which the segment to be recommended belongs, as well as the position of the segment in the content, the reason for recommendation, etc. are shown.

  The method for indicating the position of the segment in the content is not limited to a specific method as long as the position is accurately transmitted to the user. For example, using the time on the time axis of the content of the segment, the music structure corresponding to the segment (for example, A melody, B melody, etc.), the lyrics included in the segment, etc., to indicate the position of the segment in the content Can do.

  In addition, as a reason for recommendation, for example, “A user who has checked in this part also checks this part.”, “A user similar to you has also checked in this part of such a song. It may be possible to display a sentence such as “

  Then, the target user can reproduce the designated segment by designating the recommended segment, for example.

  In this way, content can be recommended to the user in units of segments. In other words, using the CF, it is possible to recommend a personalized segment group according to individual user preferences. Therefore, it is possible to recommend content (segments) according to the user's preference more precisely and appropriately. For example, although the content as a whole does not match the user's preference, only the portion of the content that matches the user's preference can be extracted and recommended. In addition, the user can easily enjoy only the portion in the content that matches his / her preference.

[Playlist generation processing using CF]
Next, playlist generation processing using CF (collaborative filtering) executed by the server 11 will be described with reference to the flowchart of FIG.

  In step S121, the segment analysis unit 61 uses the check-in information DB 52 to calculate the similarity between segments based on the checked-in user.

  Specifically, as shown in FIG. 20, for example, the segment analysis unit 61 collects statistics of users who have checked in each segment of each content. In this example, for example, user 2 and user 3 are checking in segment 1 of content 1, and segment 2 indicates that user 1 is checking in.

  Then, the segment analysis unit 61 calculates the similarity between segments based on the user who checked in each segment.

  For example, in the example of FIG. 20, a case where the user 2 is the target user and the segment is extracted based on the segment 1 of the content 1 checked in by the user 2 will be described.

  In this case, the similarity between the segments is calculated by comparing the user who has checked in the segment 1 of the content 1 with the user who has checked in the other segment. In this example, the user who checked in segment 1 of content 1 and the user who checked in segment 1 of content 2 match, so the similarity between the segments increases.

  Then, the segment analysis unit 61 notifies the recommendation unit 35 of the similarity between the segments.

  In step S122, the segment extraction unit 71 extracts segments similar to the user who checked in. That is, the segment extraction unit 71 extracts a segment whose similarity with a reference segment (for example, the segment 1 of the content 1 in FIG. 20) is equal to or greater than a predetermined threshold.

  In step S123, the playlist generation unit 73 generates a playlist based on the extracted segments. For example, the playlist generation unit 73 uses the content DB 51, the check-in information DB 52, and the like to arrange the extracted segments in a predetermined order and generate playlist information that lists information on each segment. The information regarding each segment includes, for example, the content name, artist name, album name of the content to which each segment belongs, and information indicating the position of each segment within the content.

  In step S124, the playlist generation unit 73 distributes the playlist. Specifically, the playlist generation unit 73 transmits the generated playlist information to the client 12 of the target user via the transmission unit 38 and the network 13.

  The UI control unit 103 of the client 12 of the target user receives playlist information via the reception unit 101. Then, the UI control unit 103 causes the display unit 105 to display a list of segments included in the playlist based on the playlist information, for example.

  Then, the target user can reproduce the segments registered in the playlist in order by instructing the reproduction of the presented playlist.

  In this way, it is possible to generate and distribute a playlist composed of personalized segment groups according to individual user preferences using CF.

  In addition, for example, without limiting the target user, segments that are simply checked-in by users who are similar may be collected and a playlist may be generated and distributed.

  Further, for example, a playlist including only segments checked in by the target user may be generated and distributed. Thereby, it is possible to easily perform the digest reproduction of only the content portion (for example, the rust portion) checked in by the target user.

[Segment recommendation processing using CBF]
Next, a segment recommendation process using CBF (Content Based Filtering) executed by the server 11 will be described with reference to the flowchart of FIG.

  In step S141, the segment analysis unit 61 analyzes the feature amount of the segment checked in by the target user. Specifically, the segment analysis unit 61 extracts the past check-in history of the target user from the check-in information DB 52. Further, the segment analysis unit 61 extracts the feature amount of each segment checked in by the target user from the content DB 51 based on the extracted check-in history of the target user.

  Further, the segment analysis unit 61 extracts particularly remarkable feature amounts, for example, chord progressions and lyrics having high appearance frequency from the feature amounts of the segments checked in by the target user. Then, the segment analysis unit 61 notifies the recommendation unit 35 of the extracted feature amount.

  In step S142, the segment extraction unit 71 extracts a segment whose characteristics are similar to the segment checked in by the target user. For example, the segment extraction unit 71 extracts, from the content DB 51, a segment having a feature amount whose similarity to the feature amount extracted by the segment analysis unit 61 is equal to or greater than a predetermined threshold.

  In step S143, the extracted segment is recommended in the same manner as in step S101 of FIG.

  In this way, it is possible to recommend a group of personalized segments according to individual user preferences using CBF.

[Playlist generation process 1 using CBF]
Next, a first embodiment of a playlist generation process using CBF executed by the server 11 will be described with reference to a flowchart of FIG.

  In step S161, the feature amount of the segment checked in by the target user is analyzed in the same manner as in step S141 of FIG.

  In step S162, as in the process of step S142 in FIG. 21, a segment whose characteristics are similar to the segment checked in by the target user is extracted.

  In step S163, a playlist is generated based on the extracted segments, as in the process of step S123 of FIG.

  In step S164, the playlist is distributed in the same manner as in step S124 of FIG.

  Here, with reference to FIG. 23, a specific example of the playlist generated by the processing of FIG. 22 will be described.

  For example, the feature amount analysis of the segments Sa to Sc of the contents A to C checked in by the target user in the past is performed. As a result, it is assumed that it is detected that the segments Sa to Sc are all high-pitched portions and the chord progression is changed from G7 to C, but there is no common feature regarding the speed of music.

  In this case, for other contents, a segment in which the chord progression changes from G7 to C in the treble part is extracted, and a playlist including the extracted segments is generated.

  Then, for example, on the client 12 of the target user, a button 301 indicating a playlist (channel) composed of segments in which the chord progression changes from G7 to C in the treble portion is displayed. The target user can sequentially play back the segments included in the playlist by pressing this button 301.

  In this way, it is possible to generate and distribute a playlist composed of personalized segment groups according to individual user preferences using CBF.

  Usually, even the same user prefers different types of content such as rhythmic and cheerful music or loose ballad-like music, so the feature amount of the segment to be checked in varies widely.

  Therefore, the feature quantities extracted by the segment analysis unit 61 in step S161 are clustered based on the similarity between the feature quantities, and a playlist is generated and distributed for each group of obtained feature quantities. May be. Thereby, a plurality of playlists having different characteristics can be generated and distributed.

[Playlist generation process 2 using CBF]
Next, a second embodiment of playlist generation processing using CBF executed by the server 11 will be described with reference to the flowchart of FIG.

  In step S181, the segment analysis unit 61 extracts characteristic features from the feature amounts of the segments checked in by each user. Specifically, the segment analysis unit 61 extracts the past check-in history of each user from the check-in information DB 52. Further, the segment analysis unit 61 extracts the feature amount of each segment checked in by each user from the content DB 51 based on the extracted check-in history of each user.

  Furthermore, the segment analysis unit 61 extracts a predetermined number of features that are characteristic in the set of feature amounts of all the extracted segments, for example, feature amounts having a high appearance frequency. The segment analysis unit 61 notifies the recommendation unit 35 of the extracted feature amount.

  In step S182, the segment extraction unit 71 extracts a segment having the feature amount extracted by the segment analysis unit 61 from the content DB 51.

  At this time, only segments that have been checked in by one or more users in the past may be included in the extraction target, or segments that have not yet been checked in by one user may also be included in the extraction target. Also good. In the latter case, for example, a segment of content immediately after release can be included in the extraction target.

  In step S183, the playlist generation unit 73 generates a playlist based on the extracted segments. Specifically, the playlist generation unit 73 classifies the segments extracted by the segment extraction unit 71 for each feature amount that is an extraction condition. Then, the playlist generation unit 73 uses the content DB 51, the check-in information DB 52, and the like to arrange the segments in a predetermined order for each classified group and generate playlist information that lists information on each segment. To do. Further, the playlist generation unit 73 assigns a name to the playlist based on the feature amount corresponding to each playlist.

  In step S184, the playlist is distributed in the same manner as in step S124 in FIG.

  The UI control unit 103 of the distribution destination client 12 receives the playlist information via the reception unit 101. Then, the UI control unit 103 causes the display unit 105 to display a list of playlists based on the received playlist information.

  FIG. 25 shows an example of a list of playlists displayed at this time. In this example, the buttons 321 to 325 are associated with different playlists, and the names of the playlists corresponding to the buttons are displayed.

  For example, the playlist corresponding to the button 321 has a modulation channel name, and includes a segment group including a modulation portion of the content.

  The playlist corresponding to the button 322 is named Crescendo Ch. And includes a segment group including a portion where the sound of the content becomes stronger.

  The playlist corresponding to the button 323 has a name of percussion instrument large release Ch., And includes a segment group including a portion where the content percussion instrument is largely released.

  The playlist corresponding to the button 324 is named “Melody rise Ch.” And includes a segment group including a portion where the melody of the content rises.

  The playlist corresponding to the button 325 is named (Lyrics) “I can't see you again” Ch., And consists of a segment group that includes the lyrics of the content “I can't see you again”.

  For example, the user can reproduce a playlist corresponding to the selected button by selecting any of the buttons 321 to 325.

  At this time, ranking of each playlist may be performed based on the appearance frequency of the feature amount. For example, the playlist generated based on the feature quantity having the highest appearance frequency may be ranked first, and the playlist may be arranged in the order of appearance frequency of the corresponding feature quantity and presented to the user.

  In this way, it is possible to generate and distribute a playlist including a group of segments having feature quantities that many users like using CBF.

[Segment recommendation processing using comments assigned to segments]
Next, with reference to the flowchart of FIG. 26, the segment recommendation process using the comment (that is, text data) given to the segment executed by the server 11 will be described.

  In step S201, the assignment information analysis unit 63 analyzes the comment assigned by the target user. Then, the assigned information analysis unit 63 notifies the recommendation unit 35 of the analysis result.

  For example, when the target user checks in a segment of the content being played and adds a comment, the target information analysis unit 63 analyzes the comment, and analyzes a characteristic word (for example, a word or phrase that directly represents the feature of the segment). Etc.). The assignment information analysis unit 63 notifies the recommendation unit 35 of the extracted word / phrase.

  Alternatively, for example, the assignment information analysis unit 63 extracts, from the check-in information DB 52, comments previously assigned to the segment by the target user. Then, the assigned information analysis unit 63 analyzes the extracted comments and extracts characteristic words (for example, words having the highest appearance frequency). The assignment information analysis unit 63 notifies the recommendation unit 35 of the extracted word / phrase.

  In step S202, the segment extraction unit 71 extracts a segment to which a comment similar to the comment provided by the target user is assigned based on the analysis result by the assignment information analysis unit 63.

  For example, the segment extraction unit 71 extracts a segment to which a comment including the phrase extracted by the analysis unit 32 is given from the check-in information DB 52. At this time, for example, the synonym dictionary 54 may be used to extend the extraction range to a segment to which a comment including a phrase similar to the extracted phrase is given.

  In step S203, the extracted segment is recommended as in the process of step S103 of FIG.

  In this manner, a segment to which a comment similar to the comment given by the target user is given by another user can be recommended to the target user. Thereby, for example, the other segment to which evaluation and impression similar to the evaluation and impression given to a certain segment are given can be recommended to the target user.

[Playlist generation process 1 using comments assigned to segments]
Next, with reference to the flowchart of FIG. 27, a description will be given of a first embodiment of a playlist generation process that is executed by the server 11 and uses a comment given to a segment.

  In step S221, the comment given by the target user is analyzed in the same manner as in step S201 of FIG.

  In step S222, as in the process of step S202 of FIG. 26, a segment to which a comment similar to the comment given by the target user is given is extracted.

  In step S223, a playlist is generated based on the extracted segments, similar to the process in step S123 of FIG.

  In step S224, the playlist is distributed in the same manner as in step S124 of FIG.

  At this time, the name of the playlist may be given using a word extracted from the comment of the target user. For example, when the phrase “Sawayaka” is extracted, a playlist name such as “Sawayaka Channel” may be given.

  Further, for example, the segments extracted in the process of step S222 may be further classified based on the segment feature amount, and a plurality of playlists may be generated for each segment having a similar feature amount. Furthermore, in this case, for example, the name of the playlist may be given by combining the phrase extracted from the comment of the target user and the feature amount. For example, if a playlist is generated by segmenting segments extracted using the phrase “Sawayaka” based on the speed of the song, a playlist name such as “Sweating & Slow Channel” or “Sweating & Fast Channel” is given. You may make it do.

  In this way, it is possible to generate and present a playlist including a segment group to which comments similar to the comments given by the target user are given by other users.

[Playlist generation process 2 using comments assigned to segments]
Next, with reference to the flowchart of FIG. 28, the second embodiment of the playlist generation process using the comments given to the segments executed by the server 11 will be described.

  In step S241, the comment label determination unit 33 assigns a comment label to each segment based on the assigned comment. Specifically, the comment label determination unit 33 extracts a segment to which a comment is given from the check-in information DB 52. And the comment label discrimination | determination part 33 produces | generates the table (henceforth a comment table) which shows the relationship between the extracted segment, the user who provided the comment, and the provided comment.

  FIG. 29 shows an example of a comment table. In this example, it is shown that comments are given from the users U1 to U3 to the segments S1 to S3. For example, it is shown that the comment “This song is cool!” Is given to the segment S1 by the user U1.

  Next, the comment label discriminating unit 33 selects a label that best matches the comment assigned to each segment from the labels stored in the label DB 55. Then, the comment label determination unit 33 replaces each comment in the comment table with the selected label (comment label).

  FIG. 30 shows an example after the comments in the comment table of FIG. 29 are replaced with comment labels. For example, the comment “This song is cool!” Given to the segment S1 by the user U1 is replaced with a comment label “cool”. For example, the comment “cool is ...” given to the segment S3 by the user U3 is also replaced with a comment label “cool”.

  When comments can be freely input, even if each user has the same subjectivity in the segment, the expression of the comment to be given is different. Therefore, by replacing the comment with the comment label by the comment label discriminator 33, although the expression of the comment is different, the subjectivity of users who are similar to each other can be aggregated.

  In addition, since each user can give a different comment freely with respect to the same segment, a different comment label may be provided with respect to the same segment like segment S1 of FIG.

  Then, the comment label determination unit 33 supplies the comment table after the comment is replaced with the comment label to the recommendation unit 35.

  In step S242, the feature amount label determination unit 34 assigns a feature amount label to each segment based on the feature amount. Specifically, the feature quantity label discriminating unit 34 uses the content DB 51 and the check-in information DB 52 to generate a table indicating the relationship between each segment and the feature quantity (hereinafter referred to as a feature quantity table).

  FIG. 31 shows an example of the feature amount table. FIG. 31 shows an example in which feature amounts 1 to 3 are extracted from the segments S1 to S5.

  Next, the feature amount label discriminating unit 34 selects a label that best matches the feature amount of each segment from the labels stored in the label DB 55. Then, the feature quantity label determination unit 34 replaces the feature quantity in the feature quantity table with the selected label (feature quantity label).

  FIG. 32 shows an example after the feature quantity in the feature quantity table of FIG. 31 is replaced with a feature quantity label. For example, the feature amount of the segment S1 is replaced with a feature amount label “cool”.

  In this way, the feature amount label is selected from the same type of label candidates using the label DB 55 as in the case of the comment label, and is given to each segment. However, the comment label and the feature amount label given to the same segment do not always match.

  Then, the feature amount label determination unit 34 supplies the feature amount table after the feature amount is replaced with the feature amount label to the recommendation unit 35.

  In step S243, the segment extraction unit 71 extracts a segment based on the comment label corresponding to the comment given by the target user.

  Here, a case where a segment is extracted based on the comment label “cool” corresponding to the comment “this song is cool!” Given to the segment S1 by the user U1 using the example of FIGS. explain.

  First, the segment extraction unit 71 extracts a segment to which a comment label or feature amount label “cool” is attached from the comment table and the feature amount table. As a result, the segment S3 is extracted from the comment table, and the segments S4 and S5 are extracted from the feature amount table.

  Further, the segment extraction unit 71 extracts a segment similar to the segment S1 from the extracted segments (for example, a segment whose feature amount similarity with the segment S1 is a predetermined value or more).

  In step S244, a playlist is generated based on the extracted segments, similar to the process in step S123 of FIG.

  In step S245, the playlist is distributed in the same manner as in step S124 in FIG.

  In this way, based on the comment given by the target user, a playlist is created that includes a segment to which a comment similar to the given comment is given, and a segment group having the characteristics represented by the given comment. Can be delivered.

  When the playlist is presented by the client 12, the segment extracted based on the comment label may be presented together with, for example, the original comment and the information of the user who added the comment.

  For example, when extracting a segment based on a comment label, only a comment label corresponding to a comment given by a user similar to the target user may be used. Here, a similar user is a user whose segment evaluation tendency, comment application tendency, segment reproduction history, and the like are similar to the target user, for example.

[Segment recommendation by ranking]
Next, segment recommendation processing based on ranking executed by the server 11 will be described with reference to the flowchart of FIG.

  In step S261, the statistical analysis unit 65 uses the check-in information DB 52 to take statistics of the checked-in segment.

  In step S262, the statistical analysis unit 65 generates a segment ranking based on the statistical result. In other words, the statistical analysis unit 65 ranks the segments by arranging the segments in the descending order of the number of checked-in users.

  At this time, for example, ranking may be performed according to the genre of the content to which the segment belongs.

  Alternatively, for example, ranking may be performed for each context. For example, the ranking may be performed according to the place or area where the check-in is performed, or may be performed according to the time zone when the check-in is performed.

  Further, for example, ranking may be performed by region, age, or nationality of the user who checked in.

  Then, the statistical analysis unit 65 supplies information indicating the generated ranking to the recommendation unit 35.

  In step S263, the segment recommendation unit 72 distributes the ranking. Specifically, the segment recommendation unit 72 uses the content DB 51, the check-in information DB 52, and the like to generate ranking information that includes information related to higher-ranked segments generated by the statistical analysis unit 65. The segment recommendation unit 72 transmits the generated ranking information to the client 12 via the transmission unit 38 and the network 13.

  The UI control unit 103 of the distribution destination client 12 receives the ranking information via the reception unit 101. Then, the UI control unit 103 causes the display unit 105 to display ranking information.

  In this way, popular segments with many users who have checked in can be recommended to users.

[Slide show processing]
Next, with reference to FIG. 34 to FIG. 36, processing related to a slide show executed by the server 11 will be described.

[Learn the correlation between segments and images]
First, the learning process of the correlation between the segment and the image will be described with reference to the flowchart of FIG.

  In step S281, the segment analysis unit 61 analyzes the feature amount of the segment to which the image is added. Specifically, the segment analysis unit 61 extracts a segment to which an image is assigned from the check-in information DB 52. Then, the segment analysis unit 61 analyzes the extracted feature quantity of each segment using the content DB 51.

  Here, the type and number of feature quantities to be analyzed can be arbitrarily set.

  In step S282, the assignment information analysis unit 63 analyzes the feature amount of the image assigned to the segment. Specifically, the assignment information analysis unit 63 extracts the image attached to the segment extracted in step S281 from the check-in information DB 52, and analyzes the feature amount of each extracted image.

  Here, the type and number of feature quantities to be analyzed can be arbitrarily set. For example, it is possible to analyze low-level feature quantities such as image colors and textures, and to analyze high-level feature quantities such as objects in the image and their feature quantities using object recognition. is there.

  In step S283, the correlation analysis unit 64 analyzes the correlation between the segment and the feature amount of the attached image. That is, the correlation analysis unit 64 analyzes the correlation between the feature amount of the segment to which the image is assigned and the feature amount of the assigned image, based on the analysis results of the segment analysis unit 61 and the assigned information analysis unit 63. To do. Then, the correlation analysis unit 64 stores the obtained analysis result in the storage device 56.

[First embodiment of slide show generation processing]
Next, a first embodiment of the slide show generation process executed by the server 11 will be described with reference to the flowchart of FIG. In this process, a slide show is generated by assigning images to designated content (music). That is, a slide show is generated in which images are sequentially switched in accordance with reproduction of designated content.

  In step S301, the server 11 analyzes the feature amount of the content used for the slide show in units of segments.

  For example, the client 12 transmits information indicating content to be generated for the slide show and information indicating image candidates used for the slide show to the server 11 via the network 13 and requests distribution of the slide show.

  The distribution unit 37 receives information transmitted from the client 12 via the reception unit 39, supplies the received information to the slide show generation unit 36, and instructs the generation of the slide show. The slide show generation unit 36 instructs the segment analysis unit 61 to analyze the feature amount of the content used for the slide show.

  The segment analysis unit 61 acquires content data used for the slide show from the content DB 51 and breaks it down into segments of a predetermined unit (for example, a measure unit, a music structure unit, etc.). Then, the segment analysis unit 61 analyzes the feature amount of each segment, and notifies the slide show generation unit 36 of the analysis result.

  In step S <b> 302, the server 11 analyzes feature amounts of image candidates used for the slide show. Specifically, the slide show generation unit 36 instructs the attached information analysis unit 63 to analyze the feature amount of the image candidates used for the slide show. The assigned information analysis unit 63 reads out image candidates used for the slide show from the check-in information DB 52 and the storage device 56, and analyzes the feature amount of each image. Then, the assignment information analysis unit 63 notifies the slide show generation unit 36 of the analysis result.

  In step S303, the slide show generating unit 36 selects an image to be combined with each segment. Specifically, the slide show generation unit 36 reads the analysis result of the correlation between the segment and the image feature amount from the storage device 56.

  Based on the acquired analysis result, the slide show generation unit 36 selects an image to be displayed during playback of each segment of content used for the slide show, from slide show image candidates. For example, the slide show generation unit 36 selects an image having the highest correlation from slide show image candidates for each segment of content used for the slide show.

  In step S304, the slide show generator 36 generates a slide show. Specifically, the slide show generating unit 36 sets the playback order and playback time of images combined with each segment based on the order and playback time of each segment. Then, the slide show generating unit 36 generates slide show data including content data and images used for the slide show and information indicating the playback order and playback time of each image. The slide show generation unit 36 supplies the generated slide show data to the distribution unit 37.

  In step S305, the distribution unit 37 distributes the slide show. That is, the distribution unit 37 transmits the slide show data to the requesting client 12 via the transmission unit 38 and the network 13.

  The receiving unit 101 of the requesting client 12 receives the slide show data, supplies the content data included in the received slide show data to the reproducing unit 104, and supplies the rest to the UI control unit 103.

  The playback unit 104 starts playback of the content data and causes the audio output unit 106 to output the resulting audio. Also, the UI control unit 103 causes the display unit 105 to display each image included in the slide show data in synchronization with the reproduction of each segment in the content.

  The received slide show data may be stored in the storage unit 102 without immediately reproducing the slide show.

  In this way, it is possible to sequentially display images suitable for each segment in the content in accordance with the reproduction of the content. Thereby, for example, the user can enjoy watching a landscape photograph suitable for each segment of the content while listening to the content (music).

  In addition, when the time of each segment is short, it is assumed that an image switches frequently and gives a user discomfort and discomfort. In order to prevent this, for example, the similarity of feature amounts between adjacent segments may be calculated, and the segments whose similarity exceeds a predetermined threshold may be combined into one.

  Further, for example, when content and image candidates to be used in the slide show are determined in advance, it is possible to analyze those feature amounts in advance and to omit the processing in steps S301 and S302. Alternatively, it is possible to use the analysis results of steps S281 and S282 in FIG. As a result, the slide show can be distributed more quickly, and the convenience for the user is improved.

[Second embodiment of slide show generation processing]
Next, a second embodiment of the slide show generation process executed by the server 11 will be described with reference to the flowchart of FIG. In this process, a slide show is generated by assigning a content segment to each image of a group of a plurality of images. That is, a slide show that sequentially reproduces a plurality of images together with BGM is generated.

  In step S321, the server 11 analyzes the feature amount of each image used for the slide show.

  For example, the client 12 transmits information indicating a plurality of images to be generated for the slide show, a display order, and content candidates used for the slide show to the server 11 via the network 13 and requests distribution of the slide show. At this time, the client 12 can also specify the display time of each image.

  The distribution unit 37 receives information transmitted from the client 12 via the reception unit 39 and supplies the received information to the slide show generation unit 36. Then, the slide show generation unit 36 instructs the assigned information analysis unit 63 to analyze the feature amount of each image used in the slide show.

  The assigned information analysis unit 63 analyzes the feature amount of each image used for the slide show, and notifies the slide show generation unit 36 of the analysis result.

  In step S322, similar to the processing in step S301 in FIG. 35, the feature quantities of content candidates used in the slide show are analyzed in units of segments. Then, the analysis result is notified from the segment analysis unit 61 to the slide show generation unit 36.

  In step S323, the slide show generating unit 36 selects a segment to be combined with each image. Specifically, the slide show generation unit 36 reads the analysis result of the correlation between the segment and the image feature amount from the storage device 56.

  The slide show generation unit 36 selects a segment to be reproduced during display of each image used for the slide show, from each segment of the slide show content candidates based on the acquired analysis result. For example, the slide show generation unit 36 selects a segment having the highest correlation from the respective segments of content candidates for the slide show for each image used for the slide show.

  In order to prevent the atmosphere of the content from changing greatly when the images are switched and causing the user to feel uncomfortable or uncomfortable, for example, select a segment having a high correlation with not only the target image but also the adjacent image. It may be.

  Further, when it is desired to make the BGM atmosphere consistent, for example, one content having a high correlation with all images may be selected instead of the segment unit.

  Further, for example, when the display time of each image is specified and the display time is long, when a plurality of segments are assigned to one image, the feature amounts are similar so that the BGM atmosphere does not change in the middle. A plurality of segments may be selected and assigned.

  In step S324, the slide show generator 36 generates a slide show. Specifically, when the display time of each image is not designated, the slide show generating unit 36 sets the playback time of the segment assigned to each image as the display time of each image.

  Then, the slide show generating unit 36 generates slide show data including information indicating the images and segments used in the slide show, the playback order and display time of each image, and the playback order of each segment. The slide show generation unit 36 supplies the generated slide show data to the distribution unit 37.

  In step S325, a slide show is distributed in the same manner as in step S305 in FIG. Then, the requesting client 12 reproduces a slide show or stores slide show data, for example.

  It should be noted that fade-in, fade-out, cross-fade, etc. may be performed at the time of segment switching so that each segment can be heard naturally when a slide show is played.

  In this way, segments suitable for each image can be sequentially reproduced in accordance with the display of the image. Thus, for example, when a slide show is created using photos taken during a trip, or when the taken photos are sequentially played back with a digital photo frame or the like, a BGM that matches the atmosphere of each photo can be easily obtained. You can turn it on.

  Note that BGM can be added to the moving image by the same processing. For example, the correlation between the feature amount of each scene of several moving images and the feature amount of the content segment is analyzed. Then, it is possible to set the switching of the scene of the moving image to which the BGM is added manually or automatically, and assign a segment for each scene in the same manner as the above-described processing.

  As described above, the user can check in an arbitrary segment of the content and give information such as a comment and a file to the checked-in segment.

  Further, based on the user's preference for each segment, it is possible to recommend content in units of segments, and to distribute playlists and slide shows. Accordingly, the user can find a favorite segment from, for example, an unknown type of content or a disliked type of content. In addition, the user can enjoy, for example, a difference in impression between different segments in the same content, a difference in characteristics between segments of content of the same genre, and the like.

<2. Modification>
Hereinafter, modifications of the embodiment of the present technology will be described.

[Modification 1]
In addition to the music described above, the present technology can also be applied to, for example, recommending content that can be decomposed into a plurality of segments, such as moving images (movies, TV programs, etc.) and electronic books. For example, in the case of a moving image, it is possible to recommend a user's favorite scene, and in the case of an electronic book, it is possible to recommend a user's favorite sentence or section.

[Modification 2]
Also, segment unit recommendation and content unit recommendation may be switched or performed simultaneously. Further, a playlist in which segment units and content units are mixed may be generated.

  Furthermore, a playlist including contents including segments extracted based on user's preference may be generated and distributed. In this case, for example, the position of the extracted segment in the content may be presented to the user by marking or the like to indicate the reason for selecting the content in the playlist.

[Modification 3]
In addition, FIG. 1 shows an example in which one server 11 is provided, but two or more servers may be provided. For example, a server that recommends content may be separated from a server that actually transmits content data.

[Modification 4]
Furthermore, the present technology can be applied not only to the above-described distribution-type service but also to the case where content held by the user is used in a device owned by the user, a home network, or the like.

  For example, the function of the server 11 can be provided to the client 12 so that the user can check in the content segment held by the client 12 or add segment assignment information. Further, based on the checked-in segments and the provided segment assignment information, it is possible to recommend segments and generate playlists and slide shows using content held by the client 12.

  Thereby, the user can enjoy the content he owns not only in content units but also in segment units.

[Modification 5]
Moreover, the content reproduction screen described above is an example, and other forms are possible. For example, as long as the position in the content of the segment to which the segment assignment information is assigned can be easily recognized, the method for displaying the segment assignment information is not limited to the method described above.

[Modification 6]
Furthermore, the kind of segment provision information mentioned above is the example, and the kind and number of information provided to a segment can be set arbitrarily. Moreover, the input method of the segment provision information mentioned above is the example, and you may make it input using another method and another input screen.

[Computer configuration example]
The series of processes described above can be executed by hardware or can be executed by software. When a series of processing is executed by software, a program constituting the software is installed in the computer. Here, the computer includes, for example, a general-purpose personal computer capable of executing various functions by installing various programs by installing a computer incorporated in dedicated hardware.

  FIG. 37 is a block diagram illustrating an example of a hardware configuration of a computer that executes the above-described series of processes using a program.

  In a computer, a CPU (Central Processing Unit) 501, a ROM (Read Only Memory) 502, and a RAM (Random Access Memory) 503 are connected to each other by a bus 504.

  An input / output interface 505 is further connected to the bus 504. An input unit 506, an output unit 507, a storage unit 508, a communication unit 509, and a drive 510 are connected to the input / output interface 505.

  The input unit 506 includes a keyboard, a mouse, a microphone, and the like. The output unit 507 includes a display, a speaker, and the like. The storage unit 508 includes a hard disk, a nonvolatile memory, and the like. The communication unit 509 includes a network interface or the like. The drive 510 drives a removable medium 511 such as a magnetic disk, an optical disk, a magneto-optical disk, or a semiconductor memory.

  In the computer configured as described above, the CPU 501 loads the program stored in the storage unit 508 to the RAM 503 via the input / output interface 505 and the bus 504 and executes the program, for example. Is performed.

  The program executed by the computer (CPU 501) can be provided by being recorded on a removable medium 511 as a package medium or the like, for example. The program can be provided via a wired or wireless transmission medium such as a local area network, the Internet, or digital satellite broadcasting.

  In the computer, the program can be installed in the storage unit 508 via the input / output interface 505 by attaching the removable medium 511 to the drive 510. Further, the program can be received by the communication unit 509 via a wired or wireless transmission medium and installed in the storage unit 508. In addition, the program can be installed in the ROM 502 or the storage unit 508 in advance.

  The program executed by the computer may be a program that is processed in time series in the order described in this specification, or in parallel or at a necessary timing such as when a call is made. It may be a program for processing.

  Further, in the present specification, the term “system” means an overall apparatus composed of a plurality of apparatuses and means.

  Furthermore, the embodiments of the present technology are not limited to the above-described embodiments, and various modifications can be made without departing from the gist of the present technology.

  For example, this technique can also take the following structures.

(1)
A playback unit for playing back content,
A display control unit that controls the display so that the attached information given by designating a segment having a partial time width of the content is displayed according to the position in the content of the segment during the reproduction of the content; ,
An information processing apparatus comprising: information indicating a segment designated by a user for the reproduced content; and an acquisition unit that obtains the attached information assigned to the designated segment.
(2)
The information processing apparatus according to (1), wherein the display control unit controls the grant information to display only a section including at least a segment to which the grant information is given.
(3)
The information processing apparatus according to (2), wherein the display control unit fades in the grant information at the start of display and fades out at the end.
(4)
The display control unit controls the display to display information indicating a segment in the content to which the grant information is added while scrolling the grant information in a predetermined direction as the reproduction of the content progresses. ).
(5)
A receiving unit that receives content and the grant information assigned to each segment of the content from a server;
The display control unit controls the display of the grant information received from the server in accordance with the position in the content of the segment to which the grant information is given during playback of the content received from the server. The information processing apparatus according to any one of (1) to (4).
(6)
The receiving unit further receives from the server information indicating a user who has given the grant information,
The information processing apparatus according to (5), wherein the display control unit controls to display information indicating the user who has given the grant information together with the grant information.
(7)
(5) or (5) further including a transmission unit that transmits the segment specified by the user to the reproduced content and the information indicating the specified user, and the information added to the specified segment to the server. The information processing apparatus according to 6).
(8)
The receiving unit sequentially receives, from the server, grant information given to each content segment in another information processing apparatus,
The information processing apparatus according to any one of (5) to (7), wherein the display control unit controls the received grant information to be sequentially displayed in a time series.
(9)
The information processing apparatus according to any one of (1) to (8), wherein the assignment information includes at least one of text data, a file, an evaluation for a segment, and link information to another segment.
(10)
The information processing apparatus according to any one of (1) to (9), further including an operation unit for designating a segment for the content being reproduced.
(11)
The information processing apparatus according to (10), wherein a segment is designated based on a predetermined unit based on a content structure by operating the operation unit.
(12)
An information processing device that plays back content
During playback of content, control is performed so that the grant information given by the user specifying a segment with a partial time width of the content is displayed according to the position in the content of the segment,
An information processing method including the step of acquiring information indicating a segment designated by a user with respect to reproduced content and the grant information given to the designated segment.
(13)
During playback of content, control is performed so that the grant information given by the user specifying a segment with a partial time width of the content is displayed according to the position in the content of the segment,
A program for causing a computer to execute a process including a step of obtaining information indicating a segment designated by a user with respect to reproduced content and the grant information assigned to the designated segment.

  DESCRIPTION OF SYMBOLS 1 Information processing system, 11 Server, 12 Client, 31 Memory | storage part, 32 Analysis part, 33 Comment label discrimination | determination part, 34 Feature-value label discrimination | determination part, 35 Recommendation part, 36 Slide show production | generation part, 37 Distribution part, 38 Transmission part, 39 Receiving unit, 40 check-in information acquisition unit, 51 content DB, 52 check-in information DB, 53 user DB, 54 synonym dictionary, 55 label DB, 61 segment analysis unit, 62 user analysis unit, 63 added information analysis unit, 64 correlation Analysis unit, 65 statistical analysis unit, 71 segment extraction unit, 72 segment recommendation unit, 73 playlist generation unit, 101 reception unit, 103 UI control unit, 104 playback unit, 105 display unit, 106 audio output unit, 107 operation unit, 108 Check-in information generator, 109 transmitter

Claims (13)

A playback unit for playing back content,
A display control unit that controls the display so that the attached information given by designating a segment having a partial time width of the content is displayed according to the position in the content of the segment during the reproduction of the content; ,
An information processing apparatus comprising: information indicating a segment designated by a user for the reproduced content; and an acquisition unit that obtains the attached information assigned to the designated segment. The information processing apparatus according to claim 1, wherein the display control unit controls the grant information to display only a section including at least a segment to which the grant information is given. The information processing apparatus according to claim 2, wherein the display control unit fades in the grant information at the start of display and fades out at the end. The display control unit controls the display of information indicating a segment in the content to which the grant information is added while scrolling the grant information in a predetermined direction as the reproduction of the content progresses. The information processing apparatus described in 1. A receiving unit that receives content and the grant information assigned to each segment of the content from a server;
The display control unit controls the display of the grant information received from the server in accordance with the position in the content of the segment to which the grant information is given during playback of the content received from the server. The information processing apparatus according to claim 1. The receiving unit further receives from the server information indicating a user who has given the grant information,
The information processing apparatus according to claim 5, wherein the display control unit performs control so as to display information indicating a user who has given the grant information together with the grant information. The transmission unit according to claim 5, further comprising: a transmission unit that transmits, to the server, information indicating the segment designated by the user and the designated user for the reproduced content, and the grant information given to the designated segment. Information processing device. The receiving unit sequentially receives, from the server, grant information given to each content segment in another information processing apparatus,
The information processing apparatus according to claim 5, wherein the display control unit controls the received grant information to be sequentially displayed in a time series. The information processing apparatus according to claim 1, wherein the assignment information includes at least one of text data, a file, an evaluation for a segment, and link information to another segment. The information processing apparatus according to claim 1, further comprising an operation unit for designating a segment for the content being reproduced. The information processing apparatus according to claim 10, wherein a segment is designated based on a predetermined unit based on a content structure by operating the operation unit. An information processing device that plays back content
During playback of content, control is performed so that the grant information given by the user specifying a segment with a partial time width of the content is displayed according to the position in the content of the segment,
An information processing method including the step of acquiring information indicating a segment designated by a user with respect to reproduced content and the grant information given to the designated segment. During playback of content, control is performed so that the grant information given by the user specifying a segment with a partial time width of the content is displayed according to the position in the content of the segment,
A program for causing a computer to execute a process including a step of obtaining information indicating a segment designated by a user with respect to reproduced content and the grant information assigned to the designated segment.

Images