WO2014162757A1

WO2014162757A1 - Information processing apparatus, tagging method and program

Info

Publication number: WO2014162757A1
Application number: PCT/JP2014/050829
Authority: WO
Inventors: 淳己大村; 淳也小野; 誠司鈴木; 健太郎木村
Original assignee: ソニー株式会社
Priority date: 2013-04-04
Filing date: 2014-01-17
Publication date: 2014-10-09

Abstract

[Problem] To allow tagging having a higher degree of flexibility to be performed for contents. [Solution] Provided is an information processing apparatus comprising: a position information acquiring unit that acquires the position information of an operating element associated with the elapsed-time of a content being reproduced; and a tagging unit that adds, as tag information, the position information to the content, thereby performing a tagging for the content.

Description

Information processing apparatus, tagging method, and program

The present disclosure relates to an information processing apparatus, a tagging method, and a program.

2. Description of the Related Art In recent years, it has become popular to enjoy content in which content data (content data) such as music and video is imported to a terminal such as a PC (Personal Computer) or a smartphone and the viewer (user) views the content at a desired timing. . On the other hand, the way users view content is diversifying. For example, there is a demand for extracting only a desired part of content and viewing it, instead of viewing all the content. In order to meet such a demand, a technique for tagging each scene in the content has been developed.

For example, in Patent Document 1, metadata including information on event occurrence time, event type, content, and the like of each scene included in a moving image that is content is acquired, and the metadata is transferred to the corresponding scene in the moving image as an event. A technique for assigning as a time tag is disclosed. Further, for example, Patent Document 2 collects a plurality of comments posted to a moving image via a network such as the Internet, extracts a scene of interest from the moving image based on the number of comments posted, and includes the comment. A technique for tagging a comment keyword to the attention scene is disclosed.

JP 2008-5010 A JP 2012-155695 A

However, in the technique described in Patent Document 1, since the metadata used as a tag is generated by a distribution company of the content to be tagged, tagging is uniquely determined according to the content. . Further, in the technique described in Patent Document 2, the comment keyword used as a tag is generated based on comments posted from a plurality of users with respect to a published video. It includes social elements that reflect the preferences of other users who have posted comments. Therefore, with these conventional techniques, it is difficult to perform tagging based on the user's subjective preference. Further, for example, when the content is a private video shot by the user, particularly when the content is a private video that is not desired to be disclosed to others, these techniques cannot be applied.

Therefore, the present disclosure proposes a new and improved information processing apparatus, tagging method, and program capable of tagging content with a higher degree of freedom.

According to the present disclosure, a position information acquisition unit that acquires position information of an operating tool associated with an elapsed time during content reproduction, and a tag for the content by adding the position information to the content as tag information. There is provided an information processing apparatus including a tagging unit that performs tagging.

Further, according to the present disclosure, tagging of the content is obtained by acquiring position information of the operating tool associated with the elapsed time during content playback, and adding the position information to the content as tag information. And a tagging method is provided.

In addition, according to the present disclosure, a function of acquiring position information of an operating tool associated with an elapsed time during content playback and a function of acquiring the position information as tag information to the content to the computer. And a program for realizing the tagging function are provided.

According to the present disclosure, the position information acquisition unit acquires position information of the operating tool associated with the elapsed time during content reproduction, and the tagging unit assigns the position information as tag information to the content. Is tagged. As described above, since the user can tag the content by the operation of moving the operating tool, the tagging reflecting the user's preference is realized by a simpler operation.

As described above, according to the present disclosure, it is possible to tag content with a higher degree of freedom.

1 is a functional block diagram illustrating a schematic configuration of an information processing apparatus according to an embodiment of the present disclosure. It is explanatory drawing for demonstrating an example of the tagging process which concerns on this embodiment. It is explanatory drawing for demonstrating the tagging process by which the reproduction speed of a content is controlled which is a modification of the tagging process in this embodiment. FIG. 10 is an explanatory diagram for explaining the association between the position information of the operating tool in the X-axis direction and the content playback speed in the modification of the tagging process shown in FIG. 3. FIG. 10 is an explanatory diagram for explaining the association between the position information of the operating tool in the X-axis direction and the content playback speed in the modification of the tagging process shown in FIG. 3. FIG. 10 is an explanatory diagram for explaining the association between the position information of the operating tool in the X-axis direction and the content playback speed in the modification of the tagging process shown in FIG. 3. It is explanatory drawing for demonstrating the tagging process which is a modification of the tagging process in this embodiment, and the fast-forward or rewind of content is controlled. It is explanatory drawing for demonstrating the production | generation process of the content of predetermined reproduction | regeneration time. It is explanatory drawing for demonstrating the smoothing process at the time of extracting a part of content. It is explanatory drawing for demonstrating several mutually different tag information. It is explanatory drawing for demonstrating the production | generation process of the content of predetermined reproduction | regeneration time based on the tag information with respect to several mutually different moving images. It is a flowchart which shows the process sequence of the tagging method which concerns on this embodiment. It is a block diagram for demonstrating the hardware constitutions of the information processing apparatus which concerns on this embodiment.

Hereinafter, preferred embodiments of the present disclosure will be described in detail with reference to the accompanying drawings. In addition, in this specification and drawing, about the component which has the substantially same function structure, duplication description is abbreviate | omitted by attaching | subjecting the same code | symbol.

The description will be made in the following order.
1. 1. Configuration of information processing apparatus 2. Modification of tagging process 2-1. Control of playback speed 2-2. 2. Control of fast forward and rewind Specific example of content editing process using tag information 3-1. Creation of content with a predetermined playback time 3-2. Sharing tag information 4. Processing procedure of tagging method Hardware configuration Summary

<1. Configuration of information processing apparatus>
In the present embodiment, the position information of the operating tool associated with the elapsed time during content playback is acquired by detecting the position of the operating tool while controlling the playback state of the content. Then, tagging of the content is performed by giving the position information as tag information to the content. In the following description, the above-described series of processes in which tag information is acquired and the tag information is assigned to content is referred to as tagging process.

First, a configuration example of an information processing apparatus for executing the tagging process according to the present embodiment will be described with reference to FIG. FIG. 1 is a functional block diagram illustrating a schematic configuration of an information processing apparatus according to an embodiment of the present disclosure.

Referring to FIG. 1, the information processing apparatus 10 according to an embodiment of the present disclosure includes an input unit 110, a display unit 120, a storage unit 130, and a control unit 140.

The input unit 110 is an input interface for allowing a user to input information and commands related to various processing operations to the information processing apparatus 10. In the present embodiment, the input unit 110 has a function of detecting the position of the operating tool and inputting the position information to the information processing apparatus 10. For example, the input unit 110 includes a sensor device for detecting the position of the operating body. The user can input the position information of the operating tool to the information processing apparatus 10 by moving the operating tool within the detection range of the sensor device of the input unit 110. For example, the sensor device included in the input unit 110 may be a device that detects the position of the operation body on a plane such as a touch pad, and position information on a two-dimensional plane is input as position information of the operation body. Also good. Further, for example, the sensor device included in the input unit 110 may be a device that detects the position of the operating tool in a space such as a stereo camera or an infrared camera, and position information in a three-dimensional space as the position information of the operating tool. May be input.

The display unit 120 is an output interface that visually displays various types of information processed in the information processing apparatus 10 and processed results on a display screen. In the present embodiment, the display unit 120 displays the contents of various contents (for example, moving images and still images) on the display screen under the control of the control unit 140. Further, the display unit 120 may display the locus of the position information of the operating tool input from the input unit 110 on the display screen.

The storage unit 130 is an example of a storage medium for storing various types of information processed by the information processing apparatus 10 and processed results. In the present embodiment, the storage unit 130 stores content data processed by the information processing apparatus 10. In addition, the storage unit 130 stores content data to which tag information is added, which is generated as a result of the tagging process performed by the control unit 140.

Here, prior to describing the function and configuration of the control unit 140, an overview of the tagging process according to the present embodiment will be described with reference to FIG. FIG. 2 is an explanatory diagram for explaining an example of a tagging process according to the present embodiment.

In the example shown in FIG. 2, the input unit 110 includes a sensor device that detects the position of the operating body on a plane such as a touch pad, and is integrated with the display screen 210 of the display unit 120. That is, the input unit 110 and the display unit 120 constitute a so-called touch panel. FIG. 2 illustrates a case where the operation body is a user's finger as an example of the operation body.

Referring to FIG. 2, on the display screen 210, one scene of the moving image (image data included in the moving image data) is displayed on the display screen 210 as an example of the content. In addition, an indicator 220 indicating the elapsed time (reproduction position) during reproduction of the moving image is displayed on the display screen 210 at the same time. In the following description, the horizontal direction is referred to as the X-axis direction and the vertical direction is referred to as the Y-axis direction based on the image displayed on the display screen 210.

For example, when the finger 230 is brought into contact with an arbitrary point on the display screen 210, a point 240 representing the contact point is displayed on the display screen 210. In this way, the two-dimensional position information of the point 240 on the display screen 210 is input to the information processing apparatus 10. Further, by moving the finger 230 in a state where the finger 230 is in contact with the display screen 210, a locus 250 of position information may be displayed on the display screen 210 as shown in FIG. As described above, in the example illustrated in FIG. 2, the position information of the operation tool is acquired as the coordinate value (X, Y) on the display screen 210.

Here, in the present embodiment, among the position information of the operating tool, the position information of the operating tool in the first direction is used as tag information, and the operating tool in a second direction different from the first direction is used. The position information may be used for content playback state control. Specifically, in the example shown in FIG. 2, the first direction may be the Y-axis direction, that is, the vertical direction with respect to the display screen, and the X-axis direction, ie, the display screen display. On the other hand, the left-right direction may be the second direction. For example, the playback position of the content or the playback speed of the content may be controlled according to the position information in the X-axis direction among the position information of the operating tool.

As described above, in the present embodiment, when the two-dimensional position information is acquired as the position information of the operating tool, the reproduction state is controlled by the position information in one of them, for example, the X-axis direction, while the other, for example, Position information in the Y-axis direction is acquired. Therefore, the position information in the Y-axis direction is acquired as the position information of the operating tool associated with the elapsed time during content reproduction, and is used as tag information.

Referring back to FIG. 1, the function and configuration of the control unit 140 for realizing the tagging process according to the present embodiment described above will be described. However, in the following, as an example of the present embodiment, as illustrated in FIG. 2, as an example, the input unit 110 and the display unit 120 configure a touch panel, the operation body is a finger, and the content data is moving image data. In this regard, the present embodiment will be described. However, this embodiment is not limited to this example. In the present embodiment, the input unit 110 may have any configuration as long as the position of the operating body can be detected. For example, the operating body may be a mouse pointer operated by a mouse. The position of the mouse pointer on the display screen of the display unit 120 may be detected. Further, as described above, the input unit 110 may include a sensor device that detects the position of the operating tool in space, and the position of the user's hand may be detected as the operating tool. Furthermore, in the present embodiment, the content data may not be moving image data, and for example, any content data such as music data and slide show data in which still images are continuously displayed at a predetermined time may be applied.

The control unit 140 controls the information processing apparatus 10 in an integrated manner, and performs various types of information processing in the tagging process according to the present embodiment. Hereinafter, the function and configuration of the control unit 140 will be described in more detail.

The control unit 140 includes a position information acquisition unit 141, a playback state control unit 142, a display control unit 143, and a tagging unit 144.

The position information acquisition unit 141 acquires the position information of the operating tool that is detected by the input unit 110 and is associated with the elapsed time during content playback. In the present embodiment, the position information acquired by the position information acquisition unit 141 is the position information of the operating tool on the display screen of the display unit 120, and the position information is acquired as, for example, two-dimensional coordinates on the display screen. May be. In the example illustrated in FIG. 2, the position information acquisition unit 141 may acquire the coordinate value (X, Y) corresponding to the point 240 that is a contact point of the operating tool with respect to the display screen 210 as the position information. The position information acquisition unit 141 transmits the acquired position information of the operating tool to the reproduction state control unit 142, the display control unit 143, and the tagging unit 144.

The playback state control unit 142 controls the playback state of content in the information processing apparatus 10. Here, content playback state control means control of various operations related to content playback. For example, (normal) playback, stop, pause, fast forward, rewind, high speed playback, slow playback, and repeat of content. This includes control of various operations such as reproduction. The content playback state control includes control for playing back content from an arbitrary playback position, control for extracting and playing back a part of the content, and the like.

As described above, in the present embodiment, the position information of the operating tool in the first direction is used as tag information for the position information of the operating tool acquired by the position information acquiring unit 141, and the first direction and The position information of the operating body in a different second direction is used for content playback state control. In the example illustrated in FIG. 2, the playback state control unit 142 may control the playback state of the content according to the position information of the operating tool in the X-axis direction of the display screen 210.

Specifically, the playback state control unit 142 associates the position information of the operating tool in the X-axis direction with the elapsed time during content playback, and the content at the playback position corresponding to the position information of the operating tool in the X-axis direction. Can be played. That is, the X-axis coordinate value on the display screen 210 corresponds to the elapsed time during content reproduction, and the position of the operation body in the X-axis direction on the display screen 210 changes to seek the content reproduction position. The When the X-axis coordinate value corresponds to the elapsed time during content playback, the time in the content elapses from the left to the right of the display screen 210, that is, as the X-axis coordinate value increases. Both can be associated with each other. By performing such association, it is possible to seek the reproduction position that is more suitable for the user's intuition for moving the operating tool. When the X-axis coordinate value corresponds to the elapsed time during content playback, the indicator 220 indicating the content playback position may also change according to the position information of the operating tool in the X-axis direction. .

In the above description, the case where the playback state control unit 142 controls the playback position of the content according to the position information of the operating tool in the X-axis direction has been described, but the present embodiment is not limited to such an example. The playback state control unit 142 may perform other playback control on the content in accordance with the position information of the operating tool in the X-axis direction. Regarding other reproduction control by the reproduction state control unit 142, the following <2. This will be described later in detail in a modification of the tagging process.

In addition, the playback state control unit 142 edits the content after the tagging process based on the tag information given to the content, and controls the playback of the edited content. May be. Regarding content editing processing using such tag information, the following <3. Specific example of content editing using tag information> will be described in detail.

The playback state control unit 142 transmits information related to the playback control of content performed by the playback state control unit 142 to the display control unit 143.

The display control unit 143 controls the driving of the display unit 120 and visually displays various types of information processed in the information processing apparatus 10 on the display screen of the display unit 120 in all formats such as text, tables, graphs, and images. To display. In the present embodiment, the display control unit 143 displays the content content on the display screen of the display unit 120. Specifically, the display control unit 143 displays an image included in the moving image that is the content on the display screen in accordance with the content reproduction state control by the reproduction state control unit 142. In addition, the display control unit 143 displays a point corresponding to the position information of the operating tool acquired by the position information acquisition unit 141 on the display screen of the display unit 120. For example, in the example illustrated in FIG. 2, the display control unit 143 displays the point 240 on the display screen 210 at a position corresponding to the position information of the operating tool. Further, as shown in FIG. 2, the display control unit 143 may display the locus 250 of the position information of the operating tool on the display screen 210.

The tagging unit 144 tags the content by adding the location information acquired by the location information acquisition unit 141 to the content as tag information. In the present embodiment, as described above, the tagging unit 144 uses the position information of the operating tool in the first direction among the position information of the operating tool acquired by the position information acquiring unit 141 as tag information. . Specifically, in the example illustrated in FIG. 2, the tagging unit 144 uses position information of the operating tool in the Y-axis direction as tag information. More specifically, the tagging unit 144 may digitize the position information of the operating tool in the Y-axis direction and use the numerical value (for example, the coordinate value of the Y-axis) as tag information.

As described above, the position information of the operating tool is, for example, coordinate values (X, Y) on the display screen 210. As described above when describing the playback state control unit 142, the coordinate value of the X axis in the position information of the operating tool corresponds to, for example, the playback position of the content, that is, the elapsed time during playback of the content. Yes. Accordingly, it can be said that the position information of the operating tool acquired by the position information acquisition unit 141 has a value (Y-axis coordinate value) associated with the elapsed time during the reproduction of the content. Therefore, the tagging unit 144 can tag content by using the position information of the operating tool as tag information.

Here, referring to FIG. 2 again, the tagging process according to the present embodiment will be described more specifically, and the position information acquisition unit 141, the playback state control unit 142, the display control unit 143, and the control unit according to the present embodiment will be described. The function of the tagging unit 144 will be described in more detail. FIG. 2 is an explanatory diagram for explaining an example of a tagging process according to the present embodiment. The tagging process described with reference to FIG. 2 is an example of the tagging process according to the present embodiment, and other tagging processes may be performed in the present embodiment. Details of such other tagging processes in the present embodiment are described in <2. This will be described in detail again in “Modification of Tagging Process>.

As shown in FIG. 2, when performing the tagging process, the user inputs position information by bringing a finger 230 into contact with the display screen 210. Here, the X axis corresponds to the elapsed time (reproduction position) during content reproduction. Further, the value of the Y axis may be an index indicating, for example, the “preference level” of the user for the content. For example, while the finger 230 is in contact with the display screen 210, the user moves the finger 230 from the left end to the right end of the display screen 210 to seek the playback position of the content, and in the desired scene, moves the finger 230 upward. The finger 230 is moved downward (in the direction in which the Y-axis coordinate value decreases) in a scene that does not feel so attractive. When the position information is input in this manner, the position information acquired by the position information acquisition unit 141 corresponds to the elapsed time during the reproduction of the content, that is, represents the user's preference for each scene of the content. Become. Therefore, the tagging unit 144 can add a tag representing the user's preference level for each scene of the content to the content by adding the position information to the content as the tag information. In the following description, inputting position information serving as tag information is also referred to as inputting tag information.

Here, in the tagging process shown in FIG. 2, while the position information is being input, the display control unit 143 displays an image of the scene corresponding to the position information of the finger 230 in the X-axis direction on the display screen 210. The Accordingly, the user can input his / her preference degree while referring to the image displayed on the display screen 210, that is, referring to the thumbnail of the moving image. In addition, when the user stops the finger in the middle of the position information input or releases the finger from the display screen 210, the playback state control unit 142 displays the content in the scene corresponding to the X-axis coordinate value of the position. The reproduction state may be controlled such that the reproduction of the content is paused and the reproduction of the content is continued when the position information is input again by the user. As described above, in the tagging process according to the present embodiment, the position information may not necessarily be input continuously, and may be interrupted in the middle. In this way, it is possible to input position information while pausing playback of a video as necessary and referring to a thumbnail of the video, so that the user's intention is reflected more in each scene of the video. The degree can be input.

In the above description, the case where the finger 230 is moved from the left end to the right end of the display screen 210, that is, the case where the position information is input to all scenes of the content has been described. However, the present embodiment is not limited to such an example. . In the present embodiment, the position information acquisition unit 141 acquires the position information of the operating tool for a portion corresponding to an arbitrary time range in the content, and the tagging unit 144 corresponds to the time range in which the position information is acquired. Tag information may be added to the content for the portion. In order to input position information only for an arbitrary time, input of position information may be started from an arbitrary point on the X axis, and input of position information may be ended at an arbitrary point. For example, the display screen 210 is divided into a tag information input area and a reproduction position seek area, and the reproduction state control unit 142 and tagging unit 144 tag only the position information acquired in the tag information input area. The position information used in the information and acquired in the playback position seek area may not be used as tag information but may be used to seek the playback position of the content. In the example shown in FIG. 2, in the display screen 210, the playback position seek area may be an area where the indicator 220 is displayed, and the tag information input area is from the area where the indicator 220 is displayed. May be the upper region. First, the user seeks the playback position of the content to a desired position by moving the operating tool on the indicator 220, and then inputs the tag information by moving the operating tool in the tag information input area. .

Here, in the tagging process in the above description, when the X axis is associated with the total reproduction time of the content when the X axis is associated with the elapsed time during content reproduction, the X axis is set according to the length of the content reproduction time. The resolution will be different. For example, for a movie with a playback time of 10 minutes and a movie with a playback time of 100 minutes, the playback time of content associated with the same distance on the X-axis is 10 times different. Therefore, when the content playback time is relatively long, the progress (seek amount) of the elapsed time during content playback with respect to the movement distance of the operating tool in the X-axis direction increases, and fine position information is input for each scene. Can be difficult. Therefore, in the present embodiment, the playback state control unit 142 associates one end to the other end in the X-axis direction on the display screen 210 with a portion corresponding to an arbitrary time range in the content, and The content may be reproduced at a reproduction position corresponding to the position information of the operating body in the X-axis direction. That is, the time range of the content to be sought while the operating body moves from the left end to the right end of the display screen 210 may be arbitrarily set. For example, if the content is a video with a playback time of 100 minutes, and if the left end to the right end of the display screen 210 is assigned to 10 minutes, the playback state control unit 142 plays the content by dividing it into 10 parts. Then, the position information may be input while moving the operating body from the left end to the right end of the display screen 210. Thus, by extracting a portion corresponding to an arbitrary time range in the content and performing the tagging process, it is possible to perform a tagging process that reflects the user's intention in more detail.

Furthermore, in this embodiment, tag information may be overwritten. That is, the tagging unit 144 may tag content based on the latest position information of the operating tool. Further, when the tag information is overwritten, the position information does not need to be reacquired for the entire time range of the content, and only the portion corresponding to the arbitrary time range in the content is positioned by the position information acquisition unit 141. Information may be reacquired, and only the tag information of the portion corresponding to the time range may be overwritten by the tagging unit 144. Accordingly, for example, the position information is input with a small resolution in association with the entire time range (total playback time) of the content from the left end to the right end of the display screen 210 for the first time. And about the part which a user is worried about, the time range corresponding to the part is matched with the left end from the left end of the display screen 210, and position information is input again in a state with a large resolution. By performing such a tagging process, after inputting the position information roughly for the entire time range of the content, the position information corresponding to the time range of interest is input again again. This enables efficient tagging processing.

In the present embodiment, the content reproduction state may not be controlled by the position information of the finger 230 in the X-axis direction. For example, regardless of the position information of the finger 230 in the X-axis direction, the content is played back at a predetermined speed and the content is displayed on the display screen 210, and the playback position of the content played back and displayed on the display screen 210; The tagging process may be performed by associating the input position information of the finger 230 in the Y-axis direction. By performing such a tagging process, the user does not need to pay attention to the positional information of the finger 230 in the X-axis direction, and the finger 230 can be viewed in the Y-axis direction while watching content that is played back at a normal speed. The position information can be input by moving to. Therefore, the user can input position information as if he / she attaches a tag to a scene he / she likes while enjoying the contents, and tagging processing more convenient for the user can be performed.

The schematic configuration of the information processing apparatus according to an embodiment of the present disclosure has been described above with reference to FIG. In addition, an example of the tagging process according to the present embodiment has been described with reference to FIG. As described above, in the present embodiment, the position information acquisition unit 141 acquires the position information of the operating tool associated with the elapsed time during content reproduction, and the tagging unit 144 uses the position information as the tag information. By being given to the content, a content tagging process is performed. Therefore, tag information can be added to the content by inputting the position information of the operating tool by the user, for example, by moving a finger on the display screen of the touch panel, so that tagging processing with a higher degree of freedom is possible.

In the present embodiment, the position information of the operating body in the first direction is used as tag information by the tagging unit 144 among the acquired position information of the operating body, and is different from the first direction. The playback state of the content is controlled by the playback state control unit 142 in accordance with the position information of the operating body in the direction of the direction. Therefore, the user can input the tag information while controlling the playback state of the content, for example, while seeking the playback position of the content. Moreover, tag information may be input only with respect to a part of content, and may be overwritten. Furthermore, the resolution of the position information of the operating body in the second direction assigned to seek the playback position of the content may be changed. Therefore, the user seeks the playback position of the content up to an arbitrary position and then inputs tag information only for an arbitrary part, or changes the resolution and inputs tag information multiple times. It becomes possible to input tag information.

<2. Modification of tagging process>
Next, a modification of the tagging process in the present embodiment will be described with reference to FIG. 3, FIG. 4A to FIG. 4C, and FIG. <1. In the tagging process described with reference to FIG. 2 in the configuration of the information processing apparatus, the reproduction state control unit 142 associates the position information of the operating tool in the X-axis direction of the display screen 210 with the elapsed time during content reproduction. In addition, reproduction control for reproducing content at a reproduction position corresponding to the position information of the operating tool in the X-axis direction has been performed. On the other hand, in the tagging process according to this modification, the playback state control unit 142 may perform other playback controls on the content in accordance with the position information of the operating tool in the X-axis direction. For example, the playback state control unit 142 may change the playback speed of the content based on the position information of the operating tool in the X-axis direction. For example, the playback state control unit 142 may perform fast forward or rewind of the content based on the position information of the operating tool in the X axis direction. Here, among the modifications of the tagging process according to the present embodiment, these two types of tagging processes will be described in detail.

[2-1. Controlling playback speed]
First, among the modifications of the tagging process according to this embodiment, a tagging process in which the playback speed of content is controlled will be described in detail with reference to FIG. FIG. 3 is an explanatory diagram for describing a tagging process in which the playback speed of content is controlled, which is a modification of the tagging process in the present embodiment. The display screen 210, the indicator 220, the finger 230, the point 240, and the locus 250 in FIG. 3 and FIG. 5 described later are the same as those shown in FIG.

In the tagging process shown in FIG. 3, the position information of the operating body in the X-axis direction of the display screen 210 and the content playback speed are associated with each other, and the playback state control unit 142 displays the operating body in the X-axis direction. Based on the position information, the playback speed of the content is changed. For example, in the tagging process according to this modification, the position information of the operating tool and the content playback speed in the X-axis direction are the normal playback speed at the left end of the display screen 210 in the X-axis direction, and as it goes toward the right end. That is, the reproduction speed is increased as the X-axis value increases. The reproduction state control unit 142 can reproduce the content at a corresponding reproduction speed based on the position information of the point 240 in the X-axis direction.

Also in this modification, the position information in the Y-axis direction may be an index indicating the “preference level” of the user for the content. For example, while the finger 230 is in contact with the display screen 210, the user adjusts the playback speed of the content according to the position of the finger 230 in the X-axis direction, and moves the finger 230 upward (Y-axis coordinates in a favorite scene). The finger 230 is moved downward (in the direction in which the Y-axis coordinate value decreases) in a scene that is not very attractive. The user's preference operation for each scene corresponding to the elapsed time during the reproduction of the content by performing the input operation of the position information on the entire time range of the content or the portion corresponding to the arbitrary time range. Is acquired by the position information acquisition unit 141, and the tagging unit 144 adds tag information to the content using the position information as tag information.

In addition, while the user inputs position information with the finger 230, the display control unit 143 controls the playback state control unit 142 to control the playback speed of the content at a speed corresponding to the playback speed. Are displayed on the display screen 210. Therefore, the user can input his / her preference degree while referring to the image (moving image thumbnail) displayed on the display screen 210.

Here, in this modification, the position information of the operating body in the X-axis direction and the content playback speed are associated with each other. However, the coordinate value of the X-axis and the playback speed are proportional to each other. It does not need to be associated. Such association between the position information of the operating tool in the X-axis direction and the content reproduction speed in this modification will be described with reference to FIGS. 4A to 4C. 4A to 4C are explanatory diagrams for explaining the association between the position information of the operating tool in the X-axis direction and the content reproduction speed in the modification of the tagging process shown in FIG.

4A to 4C, the horizontal axis represents the X-axis coordinate value on the display screen 210, and the vertical axis represents the content playback speed. Therefore, the curves shown in FIGS. 4A to 4C show the relationship between the position information of the operating tool in the X-axis direction and the content playback speed.

In this modification, as indicated by a straight line A in FIG. 4A, the X-axis coordinate value and the content playback speed are proportional to each other as the X-axis coordinate value increases and the content playback speed also increases at the same rate. Relationship may be. Further, as shown by a curve B in FIG. 4B, the X-axis coordinate value and the content playback speed gradually increase until a certain value on the X-axis, and then increase rapidly. The relationship shown by the downwardly convex curve may be sufficient. Further, as indicated by a curve C in FIG. 4C, the X-axis coordinate value and the content playback speed rapidly increase until a certain value on the X-axis, and then gradually increase. The relationship shown by a convex curve may be sufficient.

As described above, various correspondence relationships as shown in FIGS. 4A to 4C may be used for associating the position information of the operating tool in the X-axis direction and the content playback speed in this modification. Note that the association between the position information of the operating tool in the X-axis direction and the content playback speed in the present modification is not limited to the relationship shown in FIGS. 4A to 4C, and any other correspondence relationship may be used. For example, the user may be able to input an arbitrary relationship regarding the relationship between the X-axis coordinate value and the content playback speed by moving the operating tool on the display screen 210.

As described above with reference to FIGS. 3 and 4A to 4C, in the tagging process according to this modification, the position information of the operating tool in the X-axis direction and the content playback speed are associated with each other. The user can input the position information of the operating tool while controlling the playback speed of the content. Therefore, for example, while referring to the thumbnail of the moving image displayed on the display screen 210, the user increases the playback speed and moves the finger 230 downward in a scene that does not feel much attractive (that is, as a preference level). It is possible to input a fine degree of preference by slowing down the playback speed and moving the finger 230 up and down in a favorite scene. Thus, in this modification, tagging processing that is more convenient for the user is realized.

[2-2. Control of fast forward and rewind]
Next, among the modifications of the tagging process according to the present embodiment, the tagging process in which fast-forwarding and rewinding of content is controlled will be described in detail with reference to FIG. FIG. 5 is an explanatory diagram for explaining a tagging process in which fast-forwarding or rewinding of content is controlled, which is a modification of the tagging process in the present embodiment.

In the tagging process shown in FIG. 5, the position information of the operating tool in the X-axis direction of the display screen 210 is associated with the fast-forward and rewind control of the content. The content may be fast-forwarded or rewound based on the position information of the operating body. In the example shown in FIG. 5, the playback state control unit 142 uses the approximate midpoint in the X-axis direction of the display screen 210 as a reference point, and the content when the position information of the operating tool is acquired on the right side of the reference point. And when the position information of the operating tool is acquired on the left side of the reference point, control is performed to rewind the content. Further, when the playback state control unit 142 performs fast-forward or rewind of the content, the fast-forward or rewind speed may be controlled according to the position information of the operating body in the X-axis direction. For example, in the example shown in FIG. 5, the fast-forward speed increases as the value of the X-axis in the position information of the operating body moves rightward on the display screen 210, and the rewinding speed increases faster toward the left side. May be.

Also in this modification, the position information in the Y-axis direction may be an index indicating the “preference level” of the user for the content. For example, while the finger 230 is in contact with the display screen 210, the user rewinds or fast-forwards the content according to the position of the finger 230 in the X-axis direction, and moves the finger 230 upward (in the Y-axis direction in a favorite scene). The finger 230 is moved downward (in the direction in which the Y-axis coordinate value decreases) in a scene that is not very attractive. The user's preference operation for each scene corresponding to the elapsed time during the reproduction of the content by performing the input operation of the position information on the entire time range of the content or the portion corresponding to the arbitrary time range. Is acquired by the position information acquisition unit 141, and the tagging unit 144 adds tag information to the content using the position information as tag information.

In addition, while the user inputs position information with the finger 230, the display control unit 143 controls the moving image corresponding to the fast-forward or rewind according to the fast-forward or rewind control of the content by the playback state control unit 142. The image inside is displayed on the display screen 210. Therefore, the user can input his / her preference degree while referring to the image (moving image thumbnail) displayed on the display screen 210.

As described above with reference to FIG. 5, in the tagging process according to this modification, the position information of the operating tool in the X-axis direction is associated with the fast-forward and rewind control of the content, The user can input position information while fast-forwarding or rewinding the content. In addition, the speed of fast forward or rewind can be controlled. Therefore, for example, while referring to the image data displayed on the display screen 210, the user moves the finger 230 downward while fast-forwarding the content in a scene that does not feel much attractive (that is, the preference is small). In a favorite scene, it is possible to return the playback speed to the normal speed and move the finger 230 up and down to input a fine degree of preference. When it is desired to overwrite the tag information, the content can be rewound to a desired reproduction position, and the position information can be re-input. Thus, in this modification, tagging processing that is more convenient for the user is realized.

As described above, the modification example of the tagging process in the present embodiment has been described with reference to FIGS. 3, 4A to 4C, and FIG. In addition, in the tagging process according to each of the modifications described above, as in the tagging process described with reference to FIG. 2, position information is input only to a portion corresponding to an arbitrary time range of the content. Partial tagging processing may be performed, or tag information may be overwritten by re-inputting position information of the operating tool.

As described above, in this modification, based on the position information of the operating body in the X-axis direction of the display screen 210, the control of the content playback speed and the fast-forward or rewind operation of the content are performed. Accordingly, the user can input the tag information while changing the playback speed of the content to a desired speed and moving to a desired playback position by performing fast forward or rewind, which is more convenient for the user. A highly tagging process is realized. Note that the tagging process according to the present embodiment is not limited to the one described above, and other tagging processes in which the position information of the operating tool in the X-axis direction is associated with other reproduction controls may be performed. .

<3. Specific example of content editing processing using tag information>
Next, the content editing process using tag information by the playback state control unit 142 will be specifically described. As described above, the playback state control unit 142 can edit the content based on the tag information given to the content, and can control the playback of the edited content. Here, a specific example of content editing using tag information according to the present embodiment will be described in detail with reference to FIGS. 6, 7, 8, and 9.

[3-1. Creation of content with a specified playback time]
The playback state control unit 142 according to the present embodiment can extract a part of the content based on the tag information. First, a process of extracting a part of content based on tag information and creating content with a predetermined reproduction time will be described with reference to FIGS. FIG. 6 is an explanatory diagram for explaining a process of creating content with a predetermined playback time. FIG. 7 is an explanatory diagram for explaining a smoothing process when a part of content is extracted.

In FIG. 6, the horizontal axis (x-axis) indicates the elapsed time during playback of the content, and the vertical axis (y-axis) is on the Y axis of the position information display screen 210 input in the tagging process. The coordinate value in is shown. Therefore, it can be said that the curve 310 shown in FIG. 6 is tag information in which the elapsed time during the reproduction of the content and the position information of the operating tool (position information in the Y-axis direction) are associated with each other. Therefore, in the following description, the curve 310 is also referred to as tag information 310. 8 and 9 to be described later also have the same meaning as the horizontal and vertical axes in FIG. 6, and in the following description, the curve 410 shown in FIGS. 8 and 9 is used. , 420 are also referred to as

tag information

410, 420. In the following description of FIGS. 6, 7, 8, and 9, as an example of the position information of the operating tool, the value on the vertical axis is an index representing the user's preference.

Referring to FIG. 6, a state in which content having a predetermined playback time is created by extracting a range in which the value of the vertical axis is greater than or equal to a predetermined threshold with respect to the tag information 310 is shown. . Since the value on the vertical axis represents the user's preference level in each scene of the content, by performing such processing, only the portion where the user's preference level is high, that is, the portion in which the user is interested is displayed. The extracted digest version of the moving image data can be created. As described above, the reproduction state control unit 142 associates the position information of the operating tool in the Y-axis direction with the preference degree (score) assigned to the coordinate value of the Y-axis for the tag information, and the preference degree of the content A portion where is equal to or greater than a predetermined threshold can be extracted.

In the example shown in FIG. 6, for example, as a threshold value for creating digest version moving image data, a threshold value for 5 minute digest, a threshold value for 10 minute digest, and a threshold value for 20 minute digest Is schematically shown on the tag information 310. For example, in the case of creating a 5 minute digest version of moving image data, a portion corresponding to a time range in which the value on the vertical axis is equal to or greater than the 5 minute digest threshold is extracted from the content. Specifically, in the example shown in FIG. 6, portions corresponding to the time ranges from the time T ₁₁ to T ₁₂ and T ₁₇ to the end of the moving image are extracted from the content, and these moving images are extracted from the content. By combining the data, a 5-minute digest version of moving image data is created.

Similarly, for example, in the case of creating a 10 minute digest version of moving image data, a time range in which the value on the vertical axis is equal to or greater than the 10 minute digest threshold, that is, the elapsed time during playback is T ₂ . The portions corresponding to the time ranges from T ₃ , T ₆ to T ₇ , T ₁₀ to T _13, and T ₁₆ to the end of the moving image are extracted from the content, and these moving image data are joined together to produce a 10 minute digest version. Video data is created. Also, for example, in the case of creating a 20-minute digest version of moving image data, a time range in which the value on the vertical axis is equal to or greater than the 20-minute digest threshold, that is, the elapsed time during playback is T ₁ to T ₄ , T ₅ -T ₈ , T ₉ -T ₁₄ and T ₁₅ -Parts corresponding to the time range from the end of the video are extracted from the content, and these video data are joined together to create a 20-minute digest version. Movie data is created.

As described above, the playback state control unit 142 adjusts the threshold value for the preference level, and extracts a part of the content in order from the highest preference level so that the total playback time becomes a predetermined playback time. be able to.

Here, in the method shown in FIG. 6, portions corresponding to a plurality of non-consecutive time ranges are extracted from the content, and the moving image data are connected to each other, so that the digest version of the moving image data of a predetermined reproduction time is obtained. Is created. Therefore, when the extracted portions are joined together, the moving image may become discontinuous at the joint. In the present embodiment, for example, smoothing processing based on the content of a moving image can be performed for this phenomenon.

With reference to FIG. 7, a description will be given of the smoothing process at the time of creating content with such a predetermined playback time. A curve 320 shown in FIG. 7 is obtained by extracting a part of the tag information 310 shown in FIG. Referring to FIG. 7, for example, when trying to create a digest version of a moving image, as described with reference to FIG. 6, an extraction range that is originally a portion corresponding to a time range equal to or greater than a threshold value. _A portion of TA is extracted. However, when performing smoothing processing, playback state control unit 142 extracts a portion of the broad extraction range T _B than the range shown in the extraction range T _A, by joining with other extracted portions of the front and rear A digest version of the video may be created.

Here, the extraction range T _B may be determined based on image data and audio data included in the content data. For example, when the pixel information changes greatly in the image data included in the moving image data, the brightness, color, etc. in the screen change greatly, and the shooting direction of the camera changes or the scene changes within the moving image. There is a high possibility of being broken. In addition, in audio data, when the audio input level (volume) changes significantly or the audio direction changes, there is a high possibility that a scene change is performed in the moving image. Accordingly, the playback state control unit 142 uses the extraction range T2 as a boundary by using a point where the amount of change in the pixel information in the image data, the audio input level and the audio direction in the audio data, and the like included in the content data is relatively large. _B may be set. Further, the content data, when the tag information according to the present embodiment is different from the tags applied may be set extraction range T _B based on such other tags. Here, the other tag is, for example, metadata including information about the event occurrence time, the event type, and the content of each scene included in the moving image that is the content set by the content provider. For example, when the content is a program that is distributed for television, the timing at which a so-called commercial (CM) starts or ends, the timing at which a specific performer appears or leaves, or the timing at which a scene changes It may be information about etc. Therefore, the reproduction state control unit 142, based on the metadata, as the boundary a timing indicating a scene change, may set the extracted range T _B of the content data. By setting the extraction range T _B, the immediately preceding and immediately following the extraction range T _B, possibly scene change or the like is performed in the moving image is increased. Therefore, by connecting portions corresponding to these extraction ranges, discontinuity at the joints is reduced in the created digest version of the moving image, and a more natural moving image for the user is generated. Note that whether to use what information to set an extraction range T _B may be configurable as appropriate by the user.

[3-2. Tag information sharing]
Next, content editing processing based on a plurality of different tag information will be described with reference to FIGS. 8 and 9. FIG. 8 is an explanatory diagram for describing a plurality of different tag information. FIG. 9 is an explanatory diagram for explaining content creation processing for a predetermined playback time based on tag information for a plurality of different moving images.

Referring to FIG. 8, two

different tag information

310 and 410 are illustrated. The tag information 310 is the same as the tag information 310 shown in FIG. 6, and is created based on the position information of the operating tool input by the user. On the other hand, the tag information 410 is, for example, tag information created based on the position information of the operating tool input by another user for the same moving image. Thus, in this embodiment, a plurality of tag information created by a plurality of different users may be shared between users.

For example, a user can upload the tag information created by himself / herself for a certain video to a server existing on the cloud and make it available to other users. Moreover, the user can browse the tag information created by other users for the moving image uploaded to the server. Here, the range of users who can share tag information may be set arbitrarily. For example, the range of users who can share tag information may be a range of users belonging to the same SNS (Social Networking Service), or an arbitrary range of users set in the SNS (for example, so-called “ Range of users belonging to “My Friend”. In this way, by sharing tag information created by different users between users, it is possible to easily compare the degree of preference for the same moving image with the degree of preference of others.

In addition, tag information by other users may be uploaded to a server on the cloud when the tagging process is completed, or the tag information during the tagging process is updated in real time while the server is updated. May be up. Tag information while tagging is being performed can be viewed by multiple users, so that tagging can be performed while referring to tag information of other users, that is, referring to social tag information. Processing can be performed.

Also, tag information by other users uploaded to the server on the cloud may be stored for a predetermined period, and a plurality of different tag information for the same video may be accumulated in the server as needed. Then, when browsing the tag information by other users uploaded to the server, the user displays the tag information for each registered period (daily, weekly, etc.), displays it in order of preference, etc. It may be possible to sort and display the items in order.

In this embodiment, the content editing process by the playback state control unit 142 may be performed using a plurality of pieces of tag information that are different from each other. For example, the playback state control unit 142 performs the above [3-1. A process of extracting a part of the content as described in “Creating content with a predetermined playback time” can be performed. At that time, the playback state control unit 142 uses the tag information created by other users as a plurality of different tag information, thereby creating a digest version of the movie that reflects the social preference. be able to. Furthermore, the creation of a digest version of a movie is given specific conditions such as tag information created during a desired period, tag information created by a desired user, among tag information created by other users. Social tag information may be used. Here, when the content is edited using a plurality of pieces of tag information that are different from each other, the playback state control unit 142 may use a simple sum of the degrees of preference in the tag information, an average value, or a median value. Etc. may be used.

Also, based on tag information for a plurality of different videos, it is possible to view the videos as if they were zapping when watching a TV program. For example, FIG. 9 shows processing for creating content of a predetermined playback time based on tag information for a plurality of different moving images.

Referring to FIG. 9, tag information 410 assigned to “Movie A” and tag information 420 assigned to “Movie B” are illustrated. The tag information 410 and the tag information 420 are social tag information in which tag information created by a plurality of other users is integrated, for example. For example, if the user wants to view “Movie A” and “Movie B” in a predetermined time, for example, 5 minutes in a digest manner, the total extraction range for “Movie A” and “Movie B” is Threshold values are set in the tag information 410 and the tag information 420 so as to be 5 minutes, and a portion corresponding to a time range having a preference degree equal to or higher than the threshold value is extracted from each video, A 5-minute digest version of the video may be created. In the example shown in FIG. 9, from “Movie A”, the portion corresponding to the time range of T ₁₈ to T ₁₉ and T ₂₀ to T ₂₁ is extracted from “Movie A”, and from “Movie B” A portion corresponding to the time range of T ₂₂ to T ₂₃ during extraction is extracted, and a digest version of a moving image of 5 minutes is created as a whole. Note that the threshold values set in the tag information 410 and the tag information 420 are set so that the degree of preference of both is handled equally, and a total of five minutes of moving images are extracted from the one with the highest degree of preference. Alternatively, the extraction range from “Movie A” and the extraction range from “Movie B” may be set by specifying a certain ratio. For example, if you want to extract a total of 5 minutes from “Movie A” and “Movie B”, a 3 minute movie is extracted from “Movie A”, and a 2 minute movie from “Movie B”. The user may specify that the data is to be extracted, and the threshold value may be set so as to meet the conditions. In the example shown in FIG. 9,

social tag information

410 and 420 are used as tag information. However, the present embodiment is not limited to this example, and the same processing is performed based on tag information created by the user. Of course it is also possible to do.

As described above, in this embodiment, it is possible to create a digest version of a moving image within an arbitrary playback time for a plurality of different moving images in descending order of preference. Therefore, it is possible to provide a way of enjoying content that is more convenient for the user.

The specific example of the content editing process using the tag information according to the present embodiment has been described in detail above with reference to FIGS. 6, 7, 8, and 9. As described above, in the present embodiment, for example, the playback state control unit 142 extracts a part of the content based on the tag information, and creates a digest version of the movie for a predetermined time. In the process of extracting a part of the content, a threshold is provided for the score associated with the position information of the operating tool in the Y-axis direction, and the time range in which the score is equal to or greater than the threshold A portion corresponding to may be extracted. Therefore, when the user's preference level is reflected in the position information of the operating tool in the Y-axis direction, it is possible to create a digest version of a moving image in which a part of the content is extracted in descending order of preference level. The digest version of the moving image creation process may be performed based on a plurality of pieces of tag information created by a plurality of other users. Therefore, it is possible to edit and view content based on a social preference level that reflects the preferences of other users. As described above, in the present embodiment, the content editing process using the tag information is performed, so that a variety of content viewing methods are provided to the user, and a user-friendly way of enjoying the content is realized. The

In the above description, the content editing process based on a plurality of tag information according to the present embodiment has been described. However, the content editing process according to the present embodiment is not limited to such an example. For example, content editing processing may be performed using tag information according to the present embodiment and another tag different from the tag information according to the present embodiment. Here, the other tag may be, for example, metadata including information about an event occurrence time, an event type, content, and the like of each scene included in the moving image that is the content set by the content provider. . For example, when the content is a program that is distributed for television, the timing at which a so-called commercial (CM) starts or ends, the timing at which a specific performer appears or leaves, or the timing at which a scene changes It may be information about etc. In the present embodiment, for example, in addition to the tag information according to the present embodiment, it is possible to set a preference level using such other tags for content. As described above, when the preference level set by the method different from the tag information according to the present embodiment is assigned to the content, the tag information according to the present embodiment and the different method are set. The content editing process may be performed using both the degree of preference. For example, by using the metadata as described above, it is possible to realize a content editing process more in line with the user's preference, such as cutting the CM portion or extracting only the appearance scene of the favorite performer.

<4. Processing procedure for tagging method>
Next, a processing procedure of the tagging method according to the present embodiment will be described with reference to FIG. FIG. 10 is a flowchart showing a processing procedure of the tagging method according to the present embodiment. In the following description of the processing procedure of the tagging method according to the present embodiment, the case of performing the tagging process shown in FIG. 2 will be described as an example. The functions of the storage unit 130, the position information acquisition unit 141, the playback state control unit 142, and the tagging unit 144 are described in <1. Since it is described in “Configuration of Information Processing Device>, detailed description thereof is omitted.

Referring to FIG. 10, in the tagging method according to the present embodiment, first, the length (playback time) of a moving image to be displayed at a time on the display screen 210 in the tagging process is set (step S501). This is because <1. The reproduction state control unit 142 described in the configuration of the information processing apparatus corresponds to the process of associating one end to the other end in the X-axis direction on the display screen 210 with a portion corresponding to an arbitrary time range in the content. ing. In this way, a part of the content is associated from one end to the other end in the X-axis direction on the display screen 210, thereby enabling tagging processing with a high resolution.

Next, the tagging start position is set (step S503). This is because <1. The position information acquisition unit 141 described in the section of the configuration of the information processing apparatus corresponds to the process of acquiring the position information of the operating tool for a portion corresponding to an arbitrary time range in the content. In this way, the user seeks the playback position of the content to a desired position by moving the operating body on the indicator 220 displayed in the playback position seek area of the display screen 210, and from the playback position. Tag information can be input only in an arbitrary part.

Next, a tagging process is performed (step S505). That is, when the operating tool is moved in the tag information input area on the display screen 210, the tag information is input and the tag information is given to the content. Specifically, the position information acquisition unit 141 acquires the position information of the operating tool associated with the elapsed time during content reproduction, and the tagging unit 144 assigns the position information to the content as tag information. The content is tagged.

When the tagging process in step S505 ends, the content data after the tagging process is stored in the storage unit 130 (step S507). The end of the tagging process is, for example, that a predetermined time has elapsed since the operating tool is no longer detected (in the example shown in FIG. 2, the predetermined time elapses when the finger 230 moves away from the display screen 210. Or a dedicated operation for ending the tagging process such as a button press.

Next, content editing processing based on the tag information is performed on the content that has been tagged (step S509). The content editing process in step S509 is, for example, <3. Various editing processes described in the specific example of content editing process using tag information may be used.

The processing procedure of the tagging method according to the present embodiment has been described above with reference to FIG. In the above description, the content after the tagging process is stored in the storage unit 130, but the present embodiment is not limited to such an example. For example, <3. As described in Specific Example of Content Editing Process Using Tag Information>, the content after the tagging process may be stored in a server or the like on the cloud and shared among specific users.

<5. Hardware configuration>
Next, the hardware configuration of the information processing apparatus 10 according to the embodiment of the present disclosure will be described in detail with reference to FIG. FIG. 11 is a block diagram for describing a hardware configuration of the information processing apparatus 10 according to the embodiment of the present disclosure.

The information processing apparatus 10 mainly includes a CPU 901, a ROM 903, and a RAM 905. The information processing apparatus 10 further includes a host bus 907, a bridge 909, an external bus 911, an interface 913, an input device 915, an output device 917, a storage device 919, a communication device 921, and a drive 923. And a connection port 925.

The CPU 901 functions as an arithmetic processing unit and a control unit, and controls all or a part of the operation in the information processing apparatus 10 according to various programs recorded in the ROM 903, the RAM 905, the storage device 919, or the removable recording medium 929. The ROM 903 stores programs used by the CPU 901, calculation parameters, and the like. The RAM 905 temporarily stores programs used by the CPU 901, parameters that change as appropriate during execution of the programs, and the like. These are connected to each other by a host bus 907 constituted by an internal bus such as a CPU bus. In the present embodiment, the CPU 901, the ROM 903, and the RAM 905 correspond to, for example, the control unit 140 illustrated in FIG.

The host bus 907 is connected to an external bus 911 such as a PCI (Peripheral Component Interconnect / Interface) bus via a bridge 909.

The input device 915 is an operation means operated by the user, such as a mouse, a keyboard, a touch panel, a button, a switch, and a lever. Further, the input device 915 may be, for example, remote control means (so-called remote controller) using infrared rays or other radio waves, or an external connection device such as a mobile phone or a PDA corresponding to the operation of the information processing device 10. It may be 931. Furthermore, the input device 915 includes an input control circuit that generates an input signal based on information input by a user using the above-described operation means and outputs the input signal to the CPU 901, for example. The user of the information processing apparatus 10 can input various data and instruct a processing operation to the information processing apparatus 10 by operating the input device 915. In the present embodiment, the input device 915 corresponds to, for example, the input unit 110 illustrated in FIG.

The output device 917 is a device that can notify the user of the acquired information visually or audibly. Examples of such devices include CRT display devices, liquid crystal display devices, plasma display devices, EL display devices, display devices such as lamps, audio output devices such as speakers and headphones, printer devices, and the like. For example, the output device 917 outputs results obtained by various processes performed by the information processing apparatus 10. Specifically, the display device visually displays results obtained by various processes performed by the information processing device 10 in various formats such as text, images, tables, and graphs. In the present embodiment, the display device corresponds to, for example, the display unit 120 illustrated in FIG. On the other hand, the audio output device converts an audio signal composed of reproduced audio data, acoustic data, and the like into an analog signal and outputs it aurally.

The storage device 919 is a data storage device configured as an example of a storage unit of the information processing device 10. In this embodiment, the storage device 919 corresponds to, for example, the storage unit 130 illustrated in FIG. The storage device 919 includes, for example, a magnetic storage device such as an HDD (Hard Disk Drive), a semiconductor storage device, an optical storage device, or a magneto-optical storage device. The storage device 919 stores various information processed in the tagging process according to the present embodiment, such as a program executed by the CPU 901 and various data. For example, the storage device 919 has various contents to be played back by the information processing apparatus 10, tag information obtained in the process of tagging processing according to the present embodiment, and content to which the tag information is attached (that is, tagging). Data such as later content) is stored.

Although not explicitly shown in FIG. 1, the information processing apparatus 10 according to the present embodiment may further include the following components.

The communication device 921 is a communication interface configured by a communication device for connecting to a communication network (network) 927, for example. The communication device 921 is, for example, a communication card for wired or wireless LAN (Local Area Network), Bluetooth (registered trademark), or WUSB (Wireless USB). The communication device 921 may be a router for optical communication, a router for ADSL (Asymmetric Digital Subscriber Line), a modem for various communication, or the like. The communication device 921 can transmit and receive signals and the like according to a predetermined protocol such as TCP / IP, for example, with the Internet or other communication devices. The network 927 connected to the communication device 921 is configured by a wired or wireless network, and may be, for example, the Internet, a home LAN, infrared communication, radio wave communication, satellite communication, or the like. In the present embodiment, various types of content played back by the information processing apparatus 10, tag information obtained in the tagging process according to the present embodiment, data such as content after tagging, and the like are transmitted by the communication device 921. It may be received via the network 927 or transmitted from the information processing apparatus 10 to another external device (for example, a server on the cloud).

The drive 923 is a recording medium reader / writer, and is built in or externally attached to the information processing apparatus 10. The drive 923 reads information recorded on a removable recording medium 929 such as a mounted magnetic disk, optical disk, magneto-optical disk, or semiconductor memory, and outputs the information to the RAM 905. The drive 923 can also write information to a removable recording medium 929 such as a mounted magnetic disk, optical disk, magneto-optical disk, or semiconductor memory. The removable recording medium 929 is, for example, a DVD medium, an HD-DVD medium, a Blu-ray (registered trademark) medium, or the like. Further, the removable recording medium 929 may be a compact flash (registered trademark) (CompactFlash: CF), a flash memory, an SD memory card (Secure Digital memory card), or the like. Further, the removable recording medium 929 may be, for example, an IC card (Integrated Circuit card) on which a non-contact IC chip is mounted, an electronic device, or the like. In the present embodiment, various contents reproduced by the information processing apparatus 10, tag information obtained in the process of tagging processing according to the present embodiment, and data such as content after tagging are removed by the drive 923. It may be read from the recording medium 929 or written to the removable recording medium 929.

The connection port 925 is a port for directly connecting a device to the information processing apparatus 10. Examples of the connection port 925 include a USB (Universal Serial Bus) port, an IEEE 1394 port, and a SCSI (Small Computer System Interface) port. As another example of the connection port 925, there are an RS-232C port, an optical audio terminal, an HDMI (registered trademark) (High-Definition Multimedia Interface) port, and the like. By connecting the external connection device 931 to the connection port 925, the information processing apparatus 10 acquires various data directly from the external connection device 931 or provides various data to the external connection device 931. In the present embodiment, various contents reproduced by the information processing apparatus 10, tag information obtained in the course of the tagging process according to the present embodiment, and data such as content after tagging are connected to the connection port 925. Via the external connection device 931, or may be output to the external connection device 931.

Heretofore, an example of a hardware configuration capable of realizing the function of the information processing apparatus 10 according to the embodiment of the present disclosure has been shown. Each component described above may be configured using a general-purpose member, or may be configured by hardware specialized for the function of each component. Therefore, it is possible to change the hardware configuration to be used as appropriate according to the technical level at the time of carrying out this embodiment.

Note that a computer program for realizing each function of the information processing apparatus 10 according to the present embodiment as described above can be produced and installed in a personal computer or the like. In addition, a computer-readable recording medium storing such a computer program can be provided. The recording medium is, for example, a magnetic disk, an optical disk, a magneto-optical disk, a flash memory, or the like. Further, the above computer program may be distributed via a network, for example, without using a recording medium.

<6. Summary>
As described above, in the present embodiment, the following effects can be obtained.

In the present embodiment, the position information acquisition unit 141 acquires the position information of the operating tool associated with the elapsed time during content playback, and the tagging unit 144 assigns the position information to the content as tag information. Thus, the content tagging process is performed. Therefore, tag information can be added to the content by inputting the position information of the operating tool by the user, for example, by moving a finger on the display screen of the touch panel, so that tagging processing with a higher degree of freedom is possible.

Further, in the present embodiment, the position information of the operating tool in the second direction of the display screen 210 may correspond to other reproduction control. For example, the playback state control unit 142 may control the playback speed of the content and the fast-forward or rewind operation of the content based on the position information of the operating tool in the second direction. Accordingly, the user can input the tag information while changing the playback speed of the content to a desired speed and moving to a desired playback position by performing fast forward or rewind, which is more convenient for the user. A highly tagging process is realized.

Further, in the present embodiment, the playback state control unit 142 can edit the content based on the tag information given to the content and control the playback of the edited content. For example, the playback state control unit 142 extracts a part of the content based on the tag information, and creates a digest version of the movie for a predetermined time. In the process of extracting a part of the content, a threshold is provided for the score associated with the position information of the operating tool in the first direction, and the time when the score is equal to or greater than the threshold. A portion corresponding to the range may be extracted. Therefore, for example, when the user's preference level is reflected in the position information of the operating tool in the first direction, it is possible to create a digest version of a moving image in which a part of the content is extracted in descending order of preference level. The digest version of the moving image creation process may be performed based on a plurality of pieces of tag information created by a plurality of other users. Therefore, it is possible to edit and view content based on a social preference level that reflects the preferences of other users. As described above, in the present embodiment, the content editing process using the tag information is performed, so that a variety of content viewing methods are provided to the user, and a user-friendly way of enjoying the content is realized. The

The preferred embodiments of the present disclosure have been described in detail above with reference to the accompanying drawings, but the technical scope of the present disclosure is not limited to such examples. It is obvious that a person having ordinary knowledge in the technical field of the present disclosure can come up with various changes or modifications within the scope of the technical idea described in the claims. Of course, it is understood that it belongs to the technical scope of the present disclosure.

For example, in the above description, the embodiment has been described in which the position information is two-dimensional position information on the display screen 210 of the touch panel, but the present embodiment is not limited to such an example. In the present embodiment, the tag information may be any position information of the operating tool associated with the elapsed time during content reproduction, and the type thereof is not limited. For example, the input unit 110 may include a sensor device that detects the position of the operating tool in a space such as a stereo camera or an infrared camera, and position information in a three-dimensional space may be input as the position information of the operating tool. When the position information of the operation body is position information in a three-dimensional space, the operation body may be, for example, a user's hand, and the user reproduces content according to the position of the hand in the left-right direction with respect to the sensor device of the input unit 110 The state may be controlled and tag information may be input according to the vertical position of the hand. For example, the user can perform the tagging process by moving his / her hand up / down / left / right with respect to the sensor device of the input unit 110 while referring to the content displayed on the display screen of the display unit 120. .

Further, for example, the position information acquisition unit 141 may detect the locus of the position information of the operating tool as characters, numbers, symbols, and the like, so that the tag information may be acquired. For example, the position information acquisition unit 141 may detect the locus of the position information of the operating tool as a symbol having a binary meaning such as “◯” or “×”. For example, while referring to the content of the content displayed on the display screen of the display unit 120, the user moves the operation body so that the locus of the position information of the operation body draws a shape of “◯” in a favorite scene. In the scene that did not feel much attractive, by moving the operation body so that the locus of the position information of the operation body draws a shape of “×”, the tag information on which the presence or absence of binary preference is superimposed is input can do. The tagging unit 144 may add tag information on which the presence / absence of such a binary preference is superimposed.

In the above description, the embodiment in which the content data to which the tag information is attached is the moving image data has been described, but the present embodiment is not limited to such an example. In the present embodiment, the content data to be subjected to the tagging process may be music data or slide show data in which still images are continuously displayed for a predetermined time. For example, when the content data is music data, the information processing apparatus 10 includes an audio output device including a speaker, headphones, and the like, and the user listens to audio included in the music data output from the audio output device. However, tag information may be input. For example, when the content data is slide show data, tagging processing similar to that for moving image data may be performed.

The following configurations also belong to the technical scope of the present disclosure.
(1) A position information acquisition unit that acquires position information of an operating tool associated with an elapsed time during content reproduction, and tagging the content by adding the position information to the content as tag information. An information processing apparatus comprising a tagging unit.
(2) a playback state control unit that controls the playback state of the content, wherein the tagging unit uses position information of the operating body in a first direction as the tag information, and the playback state control unit includes: The information processing apparatus according to (1), wherein the reproduction state of the content is controlled in accordance with position information of the operating body in a second direction different from the first direction.
(3) a display control unit configured to display the content of the content on a display screen, wherein the position information acquisition unit acquires position information of the operating body on the display screen, and the first direction is The information processing apparatus according to (2), wherein the display screen has a vertical direction with respect to the display screen, and the second direction has a horizontal direction with respect to the display screen.
(4) The reproduction state control unit associates the position information of the operation body in the second direction with the elapsed time during the content reproduction, and corresponds to the position information of the operation body in the second direction. The information processing apparatus according to (2) or (3), wherein the content is reproduced at a reproduction position.
(5) The playback state control unit associates a range from one end to the other end in the second direction on the display screen with an arbitrary time range in the content, and the second on the display screen. The content is played back at a playback position corresponding to the position information of the operating tool in the direction of, and the position information acquisition unit acquires the position information of the operating tool on the display screen. Information processing device.
(6) The information processing apparatus according to (2) or (3), wherein the reproduction state control unit changes a reproduction speed of the content based on the position information of the operation body in the second direction. .
(7) The playback state control unit associates the content from one end to the other end in the second direction on the display screen with the playback speed of the content, and in the second direction on the display screen. The information processing apparatus according to (3), wherein the content is reproduced at a reproduction speed corresponding to the position information of the operation tool.
(8) The information processing apparatus according to (2) or (3), wherein the reproduction state control unit performs fast-forward or rewind of the content based on position information of the operation body in the second direction. .
(9) When the position information of the operating tool is acquired on one side of the reference point with respect to the reference point in the second direction, the reproduction state control unit fast-forwards the content, The information processing apparatus according to (8), wherein control for rewinding the content is performed when the position information of the operating tool is acquired on the other side of the reference point.
(10) The position information acquisition unit acquires position information of the operation tool for a part corresponding to an arbitrary time range in the content, and the tagging unit corresponds to the time range from which the position information is acquired. The information processing apparatus according to any one of (1) to (9), wherein the tag information is assigned to the content for a portion to be processed.
(11) The information processing apparatus according to any one of (1) to (10), wherein the tagging unit tags the content based on the latest position information of the operation body.
(12)
(1) to (11), further comprising: a display control unit that displays the content of the content on a display screen, wherein the display control unit displays a locus of position information of the operating body on the display screen. The information processing apparatus according to any one of the above.
(13) a playback state control unit for controlling the playback state of the content, wherein the playback state control unit extracts a part of the content based on the tag information; The information processing apparatus according to any one of claims.
(14) The tagging unit uses position information of the operating body in a first direction as the tag information, and the reproduction state control unit is configured to output the operating body in the first direction with respect to the tag information. The information processing apparatus according to (13), wherein position information and a score are associated with each other, and a portion of the content in which the score is equal to or greater than a predetermined threshold is extracted.
(15) The information processing apparatus according to (14), wherein the reproduction state control unit determines the threshold based on a reproduction time of the extracted content.
(16) The playback state control unit according to (14) or (15), wherein the playback state control unit further extracts a part of the content based on at least one of image data and audio data included in the content data. Information processing device.
(17) The information processing apparatus according to any one of (13) to (16), wherein the reproduction state control unit extracts a part of the content based on a plurality of different pieces of tag information.
(18) The information processing apparatus according to any one of (1) to (17), wherein the position information acquisition unit acquires three-dimensional position information of the operating body in space.
(19) Acquiring position information of an operating tool associated with an elapsed time during content reproduction, and tagging the content by adding the position information to the content as tag information; A tagging method including:
(20) Tagging the content by giving the computer the function of acquiring the position information of the operating tool associated with the elapsed time during the content reproduction, and adding the position information to the content as tag information Function and program to realize.

DESCRIPTION OF SYMBOLS 10 Information processing apparatus 110 Input part 120 Output part 130 Storage part 140 Control part 141 Position information acquisition part 142 Playback state control part 143 Display control part 144 Tagging part 210 Display screen 310,320,410,420 Tag information

Claims

A position information acquisition unit that acquires position information of an operating tool associated with an elapsed time during content playback;
A tagging unit for tagging the content by giving the position information as tag information to the content;
An information processing apparatus comprising:
A playback state control unit for controlling the playback state of the content,
Further comprising
The tagging unit uses position information of the operating body in a first direction as the tag information,
The reproduction state control unit controls the reproduction state of the content according to position information of the operating body in a second direction different from the first direction;
The information processing apparatus according to claim 1.
A display control unit for displaying the content of the content on a display screen;
Further comprising
The position information acquisition unit acquires position information of the operating tool on the display screen,
The first direction is a vertical direction with respect to the display of the display screen;
The second direction is a left-right direction with respect to the display of the display screen;
The information processing apparatus according to claim 2.
The reproduction state control unit associates the position information of the operating body in the second direction with the elapsed time during the content reproduction, and the reproduction position corresponding to the position information of the operating body in the second direction To play the content,
The information processing apparatus according to claim 2.
The reproduction state control unit associates a range from one end to the other end in the second direction on the display screen with an arbitrary time range in the content, and in the second direction on the display screen. Playing the content at a playback position corresponding to the position information of the operating body,
The position information acquisition unit acquires position information of the operating body on the display screen.
The information processing apparatus according to claim 3.
The playback state control unit changes the playback speed of the content based on the position information of the operating tool in the second direction.
The information processing apparatus according to claim 2.
The reproduction state control unit associates the content from one end to the other end in the second direction on the display screen with the reproduction speed of the content, and the operation body in the second direction on the display screen. Playing the content at a playback speed corresponding to the position information of
The information processing apparatus according to claim 3.
The reproduction state control unit performs fast-forwarding or rewinding of the content based on position information of the operating body in the second direction.
The information processing apparatus according to claim 2.
The reproduction state control unit fast-forwards the content when the position information of the operating tool is acquired on one side of the reference point with respect to the reference point in the second direction, When position information is acquired on the other side of the reference point, control to rewind the content is performed.
The information processing apparatus according to claim 8.
The position information acquisition unit acquires position information of the operating tool for a portion corresponding to an arbitrary time range in the content,
The tagging unit assigns the tag information to the content for a portion corresponding to a time range in which the position information is acquired;
The information processing apparatus according to claim 1.
The tagging unit tags the content based on the latest position information of the operation body.
The information processing apparatus according to claim 1.
A display control unit for displaying the content of the content on a display screen;
Further comprising
The display control unit displays a locus of position information of the operating body on the display screen;
The information processing apparatus according to claim 1.
A playback state control unit for controlling the playback state of the content,
Further comprising
The reproduction state control unit extracts a part of the content based on the tag information;
The information processing apparatus according to claim 1.
The tagging unit uses position information of the operating body in a first direction as the tag information,
The reproduction state control unit associates the position information of the operating body in the first direction and the score with respect to the tag information, and extracts a portion of the content in which the score is a predetermined threshold value or more. ,
The information processing apparatus according to claim 13.
The reproduction state control unit determines the threshold based on a reproduction time of the extracted content;
The information processing apparatus according to claim 14.
The information processing apparatus according to claim 14, wherein the reproduction state control unit extracts a part of the content based further on at least one of image data and audio data included in the content data.
The reproduction state control unit extracts a part of the content based on a plurality of different tag information.
The information processing apparatus according to claim 13.
The position information acquisition unit acquires three-dimensional position information of the operating body in space.
The information processing apparatus according to claim 1.
Obtaining the position information of the operating tool associated with the elapsed time during content playback;
Tagging the content by giving the location information as tag information to the content;
A tagging method including:
On the computer,
A function of acquiring position information of an operating tool associated with an elapsed time during content playback;
A function of tagging the content by giving the position information to the content as tag information;
A program to realize