WO2020071545A1

WO2020071545A1 - Information processing device

Info

Publication number: WO2020071545A1
Application number: PCT/JP2019/039345
Authority: WO
Inventors: 道生小林
Original assignee: パロニム株式会社
Priority date: 2018-10-04
Filing date: 2019-10-04
Publication date: 2020-04-09
Also published as: JPWO2020071545A1

Abstract

The present invention addresses the problem of improving convenience for a user viewing a video or still image when accessing information about a specific object shown in the video or still image. An associated information management unit 101 associates associated information for providing object information to a viewer W with an object J which may be designated by the viewer W in a video L and manages said information, said association being performed prior to designation. A video presentation control unit 102 presents the video L to the viewer W. A designation acceptance unit 103 accepts the designation via a tap operation on a TIG area A by the viewer W of the video L. An acquisition unit 104 acquires the associated information associated with the object J for which the designation was accepted. A provision unit 105 provides the object information to the viewer W on the basis of the acquired associated information. The problem is solved thereby.

Description

Information processing device

<< The present invention relates to an information processing device.

Until now, in order to support the user's introduction of a product using a video, a video by a distribution user is presented to a plurality of viewing users, an introduction product from a plurality of products is presented, and a selection of a viewing user's product is performed. An accepting system has been proposed (for example, see Patent Document 1).

JP 2018-26152 A

However, for example, when a user who watches a video is interested in a product in the video and has a request to know details or a request to purchase, the user separately searches using a name or the like of the product using a search engine or the like. There is a need. In such a case, there is a problem in that the viewing user has an increased operation and time and labor until final purchase, and thus the possibility of purchase is reduced.

The object of the present invention is to improve the convenience of a user who browses a moving image and a still image when accessing information of an object shown in the moving image and the still image.

In order to achieve the above object, an information processing device of one embodiment of the present invention
Presenting means for presenting to the user an image including at least one or more objects capable of providing information to the user;
An acquisition unit configured to acquire information for identifying a target to which the user wants to provide information, based on an operation performed by the user whose image is presented;
Based on the information acquired by the acquiring means, the identifying means for identifying the object the user wants to provide information,
Providing means for providing the user with information on the target specified by the specifying means,
Is provided.

According to the present invention, it is possible to improve the convenience of a user who browses a moving image or the like when accessing information of an object shown in a moving image or a still image.

It is a figure showing an outline of an example of this service which can be realized by information processing system concerning one embodiment of the present invention. It is a figure showing the outline of the heat map service which is an example of this service. It is a figure which shows the outline | summary of the story branching service which is an example of this service, and a specific example. It is a figure showing other examples of the story branch service which is an example of this service. It is a figure showing the outline of the multilink service which is an example of this service. It is a figure showing the outline of voice TIG service which is an example of this service. It is a figure showing the outline of the gesture TIG service which is an example of this service. It is a figure showing the outline of the real-time suggestion service which is an example of this service. 1 is a diagram illustrating an example of a configuration of an information processing system according to an embodiment of the present invention. FIG. 10 is a block diagram illustrating an example of a hardware configuration of a management server in the information processing system of FIG. 9. FIG. 11 is a functional block diagram illustrating an example of a functional configuration for executing a heat map process, a branching process, a link process, a voice process, a gesture process, and a suggestion process among the functional configurations of the management server in FIG. 10. FIG. 10 is a diagram illustrating a specific example of a GUI (Graphical User Interface) function of a viewer terminal in the information processing system of FIG. 9. FIG. 9 is a diagram illustrating a specific example of a GUI function of the viewer terminal. FIG. 9 is a diagram illustrating a specific example of a GUI function of the viewer terminal.

Hereinafter, embodiments of the present invention will be described with reference to the drawings.

In the following, when simply called "image", it includes both "moving image" and "still image".
The “moving image” includes images displayed by the following first to third processes.
The first process is a process of successively switching and displaying a series of still images composed of a plurality of images with respect to each motion of an object (for example, an animation character) in a planar image (2D image). . Specifically, for example, a process based on the principle of a two-dimensional animation, a so-called flip comic, corresponds to the first process.
The second process is a process of setting a motion corresponding to each motion of an object (for example, an animated character) in a stereoscopic image (a 3D model image) and changing and displaying the motion over time. . Specifically, for example, a three-dimensional animation corresponds to the second processing.
The third process is a process of preparing a video (that is, a moving image) corresponding to each motion of an object (for example, an animated character) and flowing the video over time.
Here, the “video (ie, moving image)” is composed of images such as a plurality of frames and fields (hereinafter, referred to as “unit images”). In the following example, the unit image is described as a frame.

First, with reference to FIG. 1, an outline of a service (hereinafter, referred to as “this service”) that can be realized by the information processing system of FIG. 2 described below will be described.

FIG. 1 is a diagram showing an outline of an example of the present service which can be realized by the information processing system according to one embodiment of the present invention.

This service is provided by a service provider (not shown) who views a moving image (hereinafter, referred to as “viewer”) and a person who creates the moving image and performs various settings (hereinafter, “setter”). ) Are provided.
Hereinafter, among the present services, a service mainly intended for viewers will be referred to as a "service for viewers", and a service mainly intended for setters will be referred to as a "service for setters".
In this service, an object displayed on a moving image can be managed by linking information about the object (hereinafter, referred to as “object information”). This service is provided as a “service for setters”.

Here, the “object” includes, in addition to an area such as an image or a character indicating a person or an object appearing as a subject in the moving image, an image such as a telop displayed over the moving image (still image or moving image) Etc. are also included. Objects that cannot be viewed in a moving image are also included in the “object”. More specifically, for example, BGM (Back Ground Music), music, position information, and the like are all examples of “objects”.

The “object information” may include all kinds of information about the object, but in the present service, information about the object that cannot be directly obtained from a moving image viewed by a viewer is mainly used as object information. You.
The viewer designates a desired object among one or more objects displayed on the moving image while watching the moving image displayed on a terminal such as a smartphone (a viewer terminal 3 in FIG. 2 and the like described later). Perform the operation you want.
Thus, the viewer can easily acquire the object information associated with the object designated by the viewer. This service is provided as a “viewer service”.

In this service, it is assumed that a moving image is distributed to a viewer. In the present embodiment, the moving image is viewed using dedicated application software (hereinafter, referred to as “viewing application”) for viewing the moving image, which is installed in the viewer's terminal in advance. .
However, the method of viewing a moving image is not particularly limited, and for example, a method of viewing a moving image using a browser function of a viewer terminal may be adopted.

Specifically, for example, FIG. 1 shows a specific example of a moving image L distributed to a viewer terminal. The viewer can view the moving image L delivered to the terminal using a viewing application or a browser function.

動 The moving image L shown in FIG. 1 depicts a female talent walking on a Hawaiian beach. The female talent drawn in the moving image L is an example of the object J. Note that, in addition to the female talent, any object such as clothes (products), hotels (facilities), palm trees (animals and plants), and the sea (natural objects) of the female talent can correspond to the object J.

(4) While watching the moving image L, for example, when the viewer is interested in a female talent appearing in the moving image L, the viewer performs an operation of designating an object J indicating the female talent.

The object information of the object J includes, for example, a name (stage name), a name of a production office to which the user belongs, a public profile, and the like as information on the female talent.
In addition to this, the object information includes, for example, information on clothes worn by the female talent, such as a brand name, a product name, and a store (including an EC (Electronic Commercial) site) that can be purchased. May be.
Thus, the viewer can obtain the object information of the object J specified by the viewer at an arbitrary timing.
Here, “arbitrary timing” means not only while watching a moving image, but also while watching a moving image different from the moving image, and viewing of the moving image itself ends. It is intended to include the timing etc. after performing.

In the present service, in a moving image, for each of one or more objects J that can be specified based on a viewer's operation, information for “providing” the object information to the viewer is linked and managed. In this manner, the information associated with the object J and “information for providing” the object information to the viewer is hereinafter referred to as “associated information”. As a result, the above-described services for viewers can be realized.

(4) The viewer service is realized by linking information in advance for each of one or more objects J that can be designated based on a viewer's operation in a moving image. The work of linking the link information to the object J is performed by a setter who uses the service for the setter.

The "linking information" linked to the object includes all information for "providing" the object information to the viewer. For example, in the case of the moving image L in FIG. 1, the following information can be adopted as the association information of the object J indicating a person (female talent).
That is, the name (stage name) of the female talent, the name of the production office to which the female talent belongs, the URL (Uniform Resource Locator) of the WEB page on which the published profile and the like (object information) are published, and the like are used as the linking information. Can be. In addition to the above, for example, as information relating to clothes worn by female talent, a URL of a WEB page on which a brand name, a product name, a store where purchase is possible, and the like (object information) are adopted as linking information. You can also.

Furthermore, adopting a URL as the "linking information" is merely an example.
For example, various keywords regarding the object J can be adopted as the link information. In this case, the viewer terminal, server, or the like can perform a search on a predetermined search WEB site using the keyword, and provide the search result to the viewer as object information.

Further, the number of pieces of link information linked to one object J is not limited to one, and may be plural.
For example, an authorized URL in the present service can be adopted as the first link information. In addition to the URL, a URL separately extracted by the present service (for example, a recommendation is automatically displayed) can be adopted as the second linked information. Then, by operating the terminal, the viewer may be enabled to select a desired one of the first linked information and the second linked information. In this case, the WEB site existing at the selected URL is provided to the viewer as object information of the object J.
In other words, the object information provided to the viewer for one object J is not limited to one, and may be plural.

The viewer can receive the object information of the object J by performing “operation to use” the association information associated with the predetermined object J to the terminal.
For example, when the link information is a URL, the "operation to use the link information" refers to an "operation to instruct to access the URL". In this case, the web site existing at the URL is displayed on the terminal of the viewer, and the object information posted on the web site is provided to the viewer.

Here, the timing at which the “operation to use” the linked information associated with the predetermined object J is not limited to when the moving image including the object J is being viewed. For example, it can be set to any timing while viewing another moving image or after ending viewing of a moving image.
As described above, in the present service, when the operation of designating the object J is performed, the operation using the association information associated with the predetermined object J can be performed at an arbitrary timing of the viewer. The association information associated with the object J is stored in a predetermined location (for example, a predetermined storage location in the viewing application).
As described above, the viewer can use the service for viewers to perform an operation using desired linking information at one or more times among the one or more pieces of linking information stored in the predetermined location. become able to.

Here, the “operation for designating the object J (operation for storing the association information in a predetermined location)” by the viewer is, specifically, a “TIG area” where the object J may exist in the moving image. Refers to an operation to specify an area called.
For example, a region indicated by a two-dot chain line in the moving image L in FIG. Here, when the viewer performs an “operation for specifying the TIG area A”, the operation becomes an “operation for specifying the object J”, and the object J existing in the TIG area A is specified.

In this service, when a tap operation is performed on any position in the TIG area A where the object J exists as a service for viewers, this is accepted as an “operation for specifying the object J”.
That is, the viewer specifies the object J corresponding to the TIG area A by performing an operation of tapping any position in the TIG area A, and stores the linking information of the object J in a predetermined location. Can be done.
For example, in the example of FIG. 1, when any position in the TIG area A is tapped, the link information of the object J corresponding to the TIG area A (for example, the URL of a WEB page on which the object information is posted) is displayed. It is stored in a predetermined location.

Here, in the present service, a place called “TIG stock” is adopted as a predetermined place where the association information is stored.
That is, the association information of the object J specified by the operation of tapping any position in the TIG area A by the viewer is stored and managed as “stock information” in “TIG stock”.
Here, the data format of the object information provided to the viewer does not depend on the data format of the corresponding object J, and may be any format such as a text data format, a still image data format, and a moving image data format. Can be adopted. The “TIG stock” is grasped as a stock page of the moving image, but can be extended to a common stock page straddling a plurality of moving images.
Specifically, for example, although not shown, the viewer presses a predetermined button displayed on the terminal (performs an operation of tapping) to thereby obtain one or more pieces of object information stored in the “TIG stock”. Can be displayed in a list.

Note that in the moving image, if the linked information is not linked to the object J tapped by the viewer, the linked information cannot be provided to the viewer.
That is, as described above, this service is realized only when various settings are set in advance by a setter or automatically set for a moving image displayed on a viewer terminal.
Specifically, the setter sets the TIG area A for each of the one or more objects J displayed in the moving image using the service for the setter, and links the link information to the TIG area A. (Hereinafter referred to as “linking work”), or the AI (artificial intelligence) or the like automatically performs the linking work on the system side, so that the viewer can be provided with the linking information for the first time.
For this reason, for the object J for which the setter has not performed the linking operation, even if the viewer performs the tapping operation, no response may be made, or the terminal that the linking information is not linked may be displayed. May be displayed.

As described above, according to the present service, the setter performs the linking operation, and the viewer taps any position in the TIG area A, so that the viewer can easily view the object information of the target object J. Can be obtained.

In this service, in addition to the above-described example of the base service, various services for further improving the convenience of the viewer and the setter are provided.
Specifically, “heat map service”, “story branch service”, “multilink service”, “voice TIG service”, “gesture TIG service”, and “real-time suggest service” are provided as examples of this service. Hereinafter, an overview of these various services will be described with reference to FIGS.

FIG. 2 is a diagram showing an outline of a heat map service which is an example of the present service.

The “heat map service” refers to a heat of the number of taps, which indicates how much the tap operation performed by the viewer W on the screen of the viewer terminal 3 including the TIG area is performed at what position (coordinate). A service represented by a map.
Here, the viewer W who has performed the tapping operation to be counted may be all the viewers W, or may be a viewer W satisfying a predetermined condition (for example, gender, age, etc.). In addition, a period can be set, and how much the viewer W has tapped during the set period can be represented by a heat map. Thereby, it is also possible to compare the number of taps in the period.

Specifically, in the heat map service, a stepwise threshold value is provided for the number of tap operations (the number of taps) for the TIG area, a heat map of the number of taps based on color and shading of color is generated, and a target moving image is generated. Are displayed in a superimposed manner.
For this reason, since the heat map service is information indicating a specific tapping operation performed on a moving image, the heat map service is mainly used by the setter C who performs the linking operation. Service for
By using the heat map service, the setter C can see at a glance which positions are tapped more or less in the TIG area where the object J exists. Can be. Also, the setter C can grasp at a glance which position other than the TIG area has been tapped.
Thereby, the setter C can correct the position of the TIG area A set to, for example, the moving image to a suitable position based on the heat map. Further, for example, a correction relating to the width of the initially set TIG area can be made. Further, for example, among the objects J to which the object information has not been linked, a new linking operation can be performed on the object J on which the tapping operation by the viewer W has been performed a lot. As a result, the convenience of the viewer can be improved.

In the heat map service, the degree of enhancement of the heat map can be set. As described above, the heat map provided by the heat map service is given a color or shading by providing a stepwise threshold value for the number of taps of the viewer W. The degree of emphasis of the heat map can be adjusted by changing a threshold value provided in a stepwise manner.
Thus, for example, it is possible to preferably generate a heat map for each of a moving image in which the number of viewers W exceeds 1,000,000 and a moving image in which the number of viewers W is about 100. That is, if five levels of thresholds are provided, a moving image in which the number of viewers W is 1,000,000 is, for example, the threshold of the number of taps in the first step is 200,000, and the threshold of the number of taps in the second step is 400,000 times, the threshold of the tap number of the third stage is 600,000 times, the threshold value of the tap number of the fourth stage is set to 800,000 times, and the threshold value of the tap number of the fifth stage is set to 1,000,000 times, Colors and shades of color can be applied.
On the other hand, in a moving image in which the number of viewers W is about 100, for example, the threshold value of the first-stage tap number is 20 times, the threshold value of the second-stage tap number is 40 times, and the third-stage tap number is The threshold value of the number of taps is set to 60 times, the threshold value of the tap number of the fourth step is set to 80 times, and the threshold value of the tap number of the fifth step is set to 100 times, so that the color and the shading of the color can be applied.

Specifically, for example, a heat map in which the setting of the degree of emphasis is set to “standard” is drawn on the upper left side of FIG. Further, a heat map in which the setting of the degree of emphasis is “+2” is drawn on the upper right side of FIG.
In this case, the heat map (upper right side in FIG. 2) in which the emphasis level is set to “+2” is better than the heat map (upper left side in FIG. 2) in which the emphasis level is set to “standard”. The small number of taps is also set to be displayed with colors and shades of color.
Thereby, the setter C can display the heat map while changing the setting of the degree of emphasis according to the number of taps.

On the lower left side of FIG. 2, an example is shown in which a TIG area is displayed in a superimposed manner on the heat map.
By displaying the TIG area A in a superimposed manner on the heat map, as described above, the setter C can correct the position of the TIG area A set in the moving image to a suitable position, for example. Further, for example, a correction relating to the width of the initially set TIG area can be made.
In the example shown on the lower left side of FIG. 2, it can be seen that a large number of tap operations are performed particularly on an area of the TIG areas A1 and A2 that is outside the TIG area A1. In this case, it indicates that inconvenience has occurred in the viewer W, for example, there was no reaction despite the tapping operation being performed, or a display indicating that the object information was not set was made.
For this reason, the setter C performs, for example, a correction to expand the TIG area A1 downward while referring to the heat map. Thereby, the convenience of the viewer W can be improved.

On the right side in the lower part of FIG. 2, an example is shown in which a balloon is displayed in a superimposed manner on the heat map.
Each of the balloons F1 and F2 shown on the lower right side in FIG. 2 can be arranged near the center of the TIG area. In this case, by displaying the balloons F1 and F2 in a superimposed manner on the heat map, the setter C can grasp the validity of the set position of the TIG area A.
In addition, since the balloon is displayed on the viewer terminal 3 while being superimposed on the moving image L, the balloon is a target when the viewer W performs a tap operation for acquiring object information. For this reason, when the number of taps at a position distant from the balloon as a target is large, there are some reasons, for example, that the balloon is difficult to see or that there is another target. I do. That is, by displaying the heat map, the setter C can grasp the correspondence between the balloon and the position where the tap operation was actually performed.
Thereby, the setter C can correct, for example, the position of the TIG area A set in the moving image to a suitable position. Further, for example, a correction relating to the width of the initially set TIG area can be made.

As described above, the heat map service is mainly provided as a service for setters, but can also be provided as a service for viewers.
That is, the viewer W can see what kind of object J other viewers W are interested in by looking at the heat map. In addition, it is possible to give an incentive for the user to tap the object J to the object J tapped by many viewers W. Also, the result of counting the number of taps can be used for various purposes. Specifically, for example, when the moving image L is a so-called live broadcast movie of a live concert, the song with the largest number of taps during the live concert can be adopted as the last encore song of the live concert. . That is, the heat map can be grasped not only as a map of the tapped position but also as a climax in the time zone of the reproduced moving image L.

FIG. 3 is a diagram showing an outline and a specific example of a story branch service which is an example of the present service.

The story branching service is a service in which a plurality of buttons indicating options for branching a story of a moving image are displayed as an object J in a moving image to be reproduced in a selectable manner.
Conventionally, a button for selecting a story of a moving image is displayed in a place different from the moving image, and when a viewer W performs an operation of selecting a story, a target moving image is reproduced. I was
On the other hand, in the story branch service which is an example of the present service, a button indicating an option is displayed in the moving image L by a branch configuration shown on the right side of FIG.
That is, the branch shown on the right side of FIG. 3 is a first-level branch including “stay”, “play”, “eat”, and “soak”, and a case where “play” is selected in the first-level branch. , “Spring”, “Summer”, “Autumn”, and “Winter”, and “Emphasis” and “Entertainment” when “Eat” is selected in the first hierarchy branch And a branch of the second hierarchy consisting of

The upper left part of FIG. 3 shows an example of a moving image top screen created based on the branch configuration shown on the right side of FIG.
That is, the top screen shown in the upper left part of FIG. 3 includes an object J1 described as "stay" and an object J2 described as "play", together with a guide text "select a theme to see". And an object J3 described as "eat" and an object J4 described as "soak" are displayed as selectable buttons.
When the viewer W performs an operation (tap operation) of selecting the object J3 described as “eat” among the objects J1 to J4, a moving image L (promotion video) having a content reminiscent of “eat” is reproduced. Is done. Thereafter, although not shown, a button labeled "emphasis on atmosphere" and a button labeled "emphasis on entertainment" are displayed so as to be selectable. Here, for example, when a button described as "atmosphere-oriented" is tapped, a moving image L (promotion video) having a content reminiscent of "atmosphere-oriented" is reproduced as an introduction. Thereafter, as shown in the lower left part of FIG. 3, for example, a moving image L (promotion video) of an inn with an emphasis on the atmosphere, such as local fish dishes being served on the backside of the hearth, with the theme of "eat" and "emphasis on the atmosphere" ) Is reproduced as object information. The moving image reproduced as the object information includes one or more objects J linked with the object information. Then, when any position in the TIG area A where the object J is present is tapped, it is stored in the area D indicating “TIG stock” at the right end of the screen.
In the example shown in the lower left part of FIG. 3, when any position in the TIG area A21 where the local fish dish as the object J21 exists is tapped, it is stored in the area D at the right end of the screen indicating “TIG stock”. You.

As described above, according to the story branching service, the TIG area A is set for each object J even at the branch destination. Therefore, when any position in the TIG area A is tapped, the tapped object J is displayed as "TIG area". Stock ". Further, it is also possible to add all the options to the “TIG stock” while returning to the top screen shown in the upper left part of FIG. 3 many times.
Further, in the example of FIG. 3, the story is branched into two layers, but the story can be branched into any number of layers.
Further, a configuration in which two-way branching is repeated may be adopted. In this case, it is possible to reproduce a substory as object information in each branch, while using only one main story.
The story branching service can be applied to, for example, a quiz moving image. In this case, for example, each of the correct and incorrect moving images can be reproduced as object information. Here, when the story branch service is applied to the moving image L of the quiz, even if the viewer W cannot correctly answer the quiz, it is possible to try again the problem that could not be answered correctly. In this case, it is possible to provide a difference in the display between the option that was answered once and was incorrect and the other option. Specifically, for example, although not shown, the same applies when the viewer W selects “A” and makes a mistake for a three-choice question where the choices are “A”, “B”, and “C”. When the problem is re-challenged, it can be displayed so that only the shade of “A” becomes lighter. Thus, the viewer W can answer the quiz without selecting “A” again.

FIG. 4 is a diagram showing another specific example of the story branching service which is an example of the present service.

By the structure of the branch shown in the upper part of FIG. 4, a button indicating an option is displayed in the moving image L.
That is, the branch shown in the upper part of FIG. 4 has a configuration in which the branch of “see again”, “see next”, and “see only how to make” is repeated.
The lower part of FIG. 4 shows an example of a top screen of a moving image L that is created based on the branch configuration shown in the upper part of FIG.
That is, the top screen shown in the lower part of FIG. 4 is accompanied by a guide sentence indicating “please click on a button like this!”, An object J31 indicated by “see next”, and “only see how to make”. Object J32 and an object J33 described as "See again" are displayed in a selectable manner.
Of these, when the object J33 described as “See again” is tapped, the moving image L indicating the procedure of the work once reproduced is reproduced again as object information.
Also, when the object J31 described as "See next" is tapped, the procedure of the work proceeds, and the moving image L indicating the procedure is reproduced as object information.
Further, when the object J32 described as “Look at only how to make” is tapped, a moving image L indicating only the procedure of the work is reproduced as object information.

FIG. 5 is a diagram showing an outline of a multilink service which is an example of the present service.

The multilink service is a service for adding link information.
According to the multilink service, the linking information can be additionally linked to the object J added to the “TIG stock”. The multilink service is a service for setters.

In the upper part of FIG. 5, a screen for setting the association information of the object J41 is drawn. As shown in the upper part of FIG. 5, the setter C can additionally set the link information H1 to H3 of the object J41.
In the lower part of FIG. 5, an example is shown in which the additionally set association information is displayed on the viewer terminal 3.
This allows the viewer W to freely select and purchase the object J41, for example, at the EC site or at an actual store. In addition, the object information can be used for various purposes, such as simply browsing an EC site, browsing specific information of a store, and confirming the location of a store.

FIG. 6 is a diagram showing an outline of a voice TIG service which is an example of the present service.

The voice TIG service is a service that recognizes the voice of the viewer W.
According to the voice TIG service, the viewer W can perform an operation by voice even when both hands are blocked and a finger cannot be operated.
Specifically, for example, as shown in FIG. 6, the viewer W can efficiently assemble the model using both hands when assembling the model or the like while watching the moving image L of the assembly manual. In this case, the operation on the viewer terminal 3 is performed by uttering the instruction content to the microphone I by voice.
Thereby, for example, a more detailed assembly manual can be acquired as object information of the model based on the operation of the voice of the viewer W.
Further, based on the voice operation of the viewer W, an image of the actual size of the part can be acquired and displayed as object information of some parts of the model.
For the moving image L, for example, operations such as reproduction, stop, forward for 10 seconds, and return for 10 seconds can be performed.
As shown in FIG. 6, the GUI is provided with an ON / OFF switch button G for the microphone I. Thereby, it is possible to prevent the microphone I from picking up a sound that is not necessary for operation.
In the example of FIG. 6, the viewer terminal 3 and the microphone I are connected by wire. However, the present invention is not limited to this. For example, the viewer terminal 3 and the microphone I may be wirelessly connected by Bluetooth (registered trademark) or the like. It may be built in the viewer terminal 3.

FIG. 7 is a diagram showing an outline of a gesture TIG service which is an example of the present service.

The gesture TIG service is a service that allows the viewer W to acquire object information only by making a gesture while viewing the moving image data displayed on the viewer terminal 3.
Specifically, for example, the viewer W performs an operation of selecting the object J by a gesture of squeezing his / her fist (so-called goo) or a gesture of opening the hand (so-called par). The user can access the object information of the created object J.
The gesture TIG service typically makes a gesture with respect to the camera of the viewer terminal 3 as shown at the left end of FIG. 7, but as shown in the center of FIG. They can be distributed simultaneously. In this case, the viewer W makes a gesture of selecting an object while watching the television V.
The gesture can be detected by a Web camera mounted on the viewer terminal 3 or various kinds of sensors.
In addition, as shown in the right end of FIG. 7, a gesture TIG service can be provided in a signage S at a store. In this case, for example, an operation of selecting and purchasing a product appearing in the moving image L can be performed by a gesture, and the product can be received and taken home on the spot.

FIG. 8 is a diagram showing an outline of a real-time suggest service which is an example of the present service.

The real-time suggestion service is a service that displays a timely advertisement for the viewer W on the moving image L.
That is, in the present service, basically, the linking information is linked in advance (or automatically) to every object J appearing in the moving image L. However, when the viewers W having different hobbies and preferences view the same moving image L, the object J of interest is usually different for each viewer W. For this reason, in the real-time suggestion service, the TIG area to be activated can be changed in accordance with the taste and preference of the viewer W.
Specifically, for example, as shown on the left side of FIG. 8, when a certain viewer W finishes viewing the first half of the moving image L, he or she frequently performs an operation of specifying a car as the object J. Assume a case. In this case, only the TIG area A of the car (or the TIG area A of the car is mainly used) is enabled in the latter half of the moving image L viewed by the viewer W, as shown in the upper right part of FIG. (Or automatically set).
That is, the operation of the viewer W to specify the object J is recorded as an actual result together with the content of the object J specified, and becomes an analysis target.
As a result, the tendency of the operation of the viewer W is grasped, and the TIG area to be displayed can be changed at any time according to the tendency of the operation.
Further, as shown in the lower right part of FIG. 8, the advertisement K of the car may be displayed as a wipe in the moving image L for the viewer W who prefers to acquire information about the car.

Next, the configuration of an information system for realizing the present service will be described.
FIG. 9 is a diagram illustrating an example of a configuration of an information processing system according to an embodiment of the present invention.

The information processing system shown in FIG. 9 is configured to include a management server 1, a setter terminal 2, a viewer terminal 3, and an external server 4.
Each of the management server 1, the setter terminal 2, the viewer terminal 3, and the external server 4 is mutually connected via a predetermined network N such as the Internet.

The management server 1 is an information processing device managed by a service provider (not shown). The management server 1 executes various processes for realizing the present service while appropriately communicating with the setter terminal 2 and the viewer terminal 3.

The setter terminal 2 is an information processing device operated by the setter C, and includes, for example, a personal computer, a smartphone, a tablet, and the like.

The viewer terminal 3 is an information processing device operated by the viewer W, and includes, for example, a personal computer, a smartphone, a tablet, and the like.

The external server 4 manages object information that can be provided to the viewer by the linking information, for example, when the linking information is a URL, various web sites (web sites on which the object information is posted) existing in the URL. .

FIG. 10 is a block diagram showing an example of a hardware configuration of a management server in the information processing system of FIG.

The management server 1 includes a CPU (Central Processing Unit) 11, a ROM (Read Only Memory) 12, a RAM (Random Access Memory) 13, a bus 14, an input / output interface 15, an input unit 16, and an output unit 17. , A storage unit 18, a communication unit 19, and a drive 20.

The CPU 11 executes various processes according to a program recorded in the ROM 12 or a program loaded from the storage unit 18 into the RAM 13.
The RAM 13 also stores data and the like necessary for the CPU 11 to execute various processes.

The CPU 11, the ROM 12, and the RAM 13 are connected to each other via the bus 14. The bus 14 is also connected to an input / output interface 15. The input / output interface 15 is connected to an input unit 16, an output unit 17, a storage unit 18, a communication unit 19, and a drive 20.

The input unit 16 is composed of, for example, a keyboard and outputs various information.
The output unit 17 includes a display such as a liquid crystal, a speaker, and the like, and outputs various types of information as images and sounds.
The storage unit 18 is configured by a DRAM (Dynamic Random Access Memory) or the like, and stores various data.
The communication unit 19 communicates with another device (for example, the setter terminal 2, the viewer terminal 3, the external server 4, and the like in FIG. 2) via a network N including the Internet.

The drive 20 is appropriately equipped with a removable medium 30 made of a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, or the like. The program read from the removable medium 30 by the drive 20 is installed in the storage unit 18 as needed.
Further, the removable medium 30 can also store various data stored in the storage unit 18 in the same manner as the storage unit 18.

Although not shown, the setter terminal 2, the viewer terminal 3, and the external server 4 in FIG. 9 can also have basically the same configuration as the hardware configuration shown in FIG. Therefore, description of the hardware configurations of the setter terminal 2, the viewer terminal 3, and the external server 4 will be omitted.

Execution of various processes including heat map processing, branch processing, link processing, audio processing, gesture processing, and suggestion processing in the management server 1 by cooperation of various hardware and various software of the management server 1 in FIG. Becomes possible. As a result, a service provider (not shown) can provide various services described below in addition to the above-described base service.

“Heat map processing” refers to processing for realizing the above-described heat map service.
"Branch processing" refers to processing for realizing the above-described story branch service.
"Link processing" refers to processing for realizing the above-described multilink service.
“Audio processing” refers to processing for realizing the audio TIG service described above.
“Gesture processing” refers to processing for realizing the above-described gesture TIG service.
“Suggest processing” refers to processing for realizing the above-described real-time suggest service.
Hereinafter, a functional configuration for executing a heat map process, a branch process, a link process, a voice process, a gesture process, and a suggest process in which the execution of the process is controlled in the management server 1 will be described.

FIG. 11 is a functional block diagram showing an example of a functional configuration for executing a heat map process, a branch process, a link process, a voice process, a gesture process, and a suggestion process among the functional configurations of the management server in FIG. It is.

As shown in FIG. 4, when the execution of the heat map process is controlled in the CPU 11 of the management server 1, the associating information management unit 101, the moving image presentation control unit 102, the designation reception unit 103, and the acquisition unit 104 , The providing unit 105 and the heat map unit 106 function.
When the execution of the branching process is controlled in the CPU 11, the associating information management unit 101, the moving image presentation control unit 102, the designation reception unit 103, the acquisition unit 104, the provision unit 105, the branch generation unit 107 function.
In the CPU 11, when the execution of the link processing is controlled, the linking information management unit 101, the moving image presentation control unit 102, the designation reception unit 103, the acquisition unit 104, and the provision unit 105 function.
In the CPU 11, when execution of the voice processing is controlled, the linking information management unit 101, the moving image presentation control unit 102, the designation reception unit 103, the acquisition unit 104, the provision unit 105, the speech recognition unit 108 function.
When the execution of the gesture processing is controlled in the CPU 11, the association information management unit 101, the moving image presentation control unit 102, the designation reception unit 103, the acquisition unit 104, the provision unit 105, the gesture recognition unit 109 function.
In the CPU 11, when the execution of the suggestion process is controlled, the linking information management unit 101, the moving image presentation control unit 102, the designation reception unit 103, the acquisition unit 104, the provision unit 105, the suggestion control unit 110 function.

The associating information management unit 101 provides the object information to the viewer W for the object J existing in the TIG area A specified by the viewer W as the first user in the displayed moving image L. One or more pieces of linking information to be linked are managed before being specified by the viewer W.
Specifically, the associating information management unit 101 performs the following processing before an operation (for example, a tap operation) for specifying the object J displayed on the moving image L is performed. That is, the associating information management unit 101 manages one or more pieces of associating information in association with each of the at least one object J stored and managed in the object DB 181 as the object J that can be displayed in the moving image L. I do.

The moving image presentation control unit 102 executes control for presenting the moving image L to the viewer W.
Specifically, the moving image presentation control unit 102 executes control for displaying the moving image L on the viewer terminal 3 of the viewer W.

When the viewer presenting the moving image performs a predetermined operation (for example, a tap operation) on the TIG area, the specification receiving unit 103 recognizes that the object J existing in the TIG area has been specified and performs the specification. Accept.

The acquisition unit 104 acquires the association information managed in association with the object J for which the specification has been accepted.
Specifically, for example, the acquisition unit 104 acquires the association information managed in association with the object J for which the specification by the viewer W has been accepted.

The providing unit 105 executes control for providing the object information to the viewer terminal 3 based on the link information acquired by the acquiring unit 104.

The heat map unit 106 executes control for presenting a moving image L on which one or more objects J can be displayed to the viewer terminal 3.
Specifically, for example, the control for presenting the moving image L in FIG.

The branch generation unit 107 generates information indicating a branch point at which the moving image branches into a plurality of stories.
Specifically, for example, as shown in FIGS. 3 and 4, the branch generation unit 107 generates information indicating a branch point at which the moving image L branches into a plurality of stories.

The voice recognition unit 108 recognizes the voice of the viewer W.
Specifically, for example, as shown in FIG. 6, the voice recognition unit 108 recognizes the voice of the viewer W input using the microphone I.

The gesture recognition unit 109 executes control for recognizing the gesture of the viewer W.
Specifically, for example, the gesture recognition unit 109 executes control for recognizing the gesture of the viewer W using a proximity sensor or the like mounted on the viewer terminal 3.

The suggestion control unit 110 executes a control for displaying a predetermined advertisement on the moving image L based on the operation results of the viewer W.
Specifically, for example, as illustrated in FIG. 8, the suggestion control unit 110 executes control for displaying the advertisement K on the moving image L based on the operation results of the viewer W.

Next, a specific example of the GUI function of the viewer terminal 3 will be described with reference to FIGS.

The upper part of FIG. 12 shows two specific examples of the collective TIG function.
The “batch TIG function” means that when “predetermined operation” is performed at “predetermined timing” during reproduction of the moving image L, all objects J in the frame (still image) displayed at that timing are displayed. This refers to a function that is collectively stored in the “TIG stock” (hereinafter, referred to as “collective TIG”).
Here, the content of the “predetermined operation” is not particularly limited. For example, in the example shown in the upper left part of FIG. 12, the batch TIG is executed as the “predetermined operation” at the “predetermined timing” during the reproduction of the moving image. An operation of tapping the button B1 for causing the user to perform the operation is performed. Then, all the objects J1 to J3 existing in the frame (still image) displayed at the “predetermined timing” are collectively TIGated to the area D at the right end of the screen indicating “TIG stock”.
In the example shown on the upper right side of FIG. 12, an operation of swiping to the area D at the right end of the screen using two fingers of the viewer W as “predetermined operation” at “predetermined timing” during reproduction of the moving image Is performed. Then, all the objects J1 to J3 existing in the frame (still image) displayed at the “predetermined timing” are collectively TIGated to the area D at the right end of the screen indicating “TIG stock”.

The lower part of FIG. 12 shows a specific example of the similar information presentation function.
The “similar information presentation function” refers to a function of providing information about a thing similar to the object J displayed on the moving image (hereinafter, referred to as “similar information”) to the viewer W.
Specifically, for example, as shown in the lower part of FIG. 12, when the object J1 appearing in the moving image is a “round neck long-sleeved shirt”, an operation of flicking the object J1 in the direction of the area E at the left end of the screen is performed. Done. Then, the object J1 is stored in the area E at the left end of the screen.
Thereafter, as shown in the lower part of FIG. 12, when the tap operation is performed on the object J1 stored in the area E, the similar object information of the object J1 is displayed. Specifically, for example, information on “round neck long-sleeved shirt” having a brand different from that of the object J1 is displayed as similar information. Thereby, for example, even if the object J1 appearing in the moving image is a thing that cannot be easily obtained by the viewer, such as an object having a rare value or an expensive object, a “similar object” is displayed. Information to obtain "things" can be obtained.

On the other hand, when it is desired to acquire not the similar object information but the object information of the object J appearing in the moving image L, an operation of flicking the object J2 in the direction of the area D at the right end of the screen is performed. Then, the object J2 is stored in the area D at the right end of the screen.
Thereafter, as shown in the lower part of FIG. 12, when the tap operation is performed on the object J2 stored in the area D, the object information of the object J2 is displayed.
As described above, by distinguishing between a method of acquiring information on a thing similar to the object J and a method of acquiring object information of the object J itself, the convenience of the viewer W can be improved.
Here, the similar information presentation function shown in the lower part of FIG. 12 is merely an example of a function of storing the object J separately in the area E and the area D.
In other words, the present service basically allows the user to easily save the object J in the “TIG stock” by performing an operation of tapping the object J. However, as shown in the lower part of FIG. 12, for example, a plurality of areas indicating storage in “TIG stock” may be provided so that the viewer W can determine which one to store.
Thus, when the viewer W performs an operation of selecting the object J, a part of the categorization performed in the “TIG stock” can be performed.
As a result, in addition to the example (similar information presentation function) shown in the lower part of FIG. 12, for example, the object J to be purchased immediately is stored in the area D, and the object J to be put into the cart is stored in the area E for the time being. , And so on.

The upper part of FIG. 13 shows a specific example of the screen shot function.
As described with reference to the upper part of FIG. 12, when the viewer W performs an operation of tapping the button B1 during reproduction of a moving image, all the objects J1 to J3 included in the frame (still image) are displayed. Stored in "TIG stock". At the same time, the stored frames (still images) are displayed in a list as a “screenshot list”, for example, as shown in the upper part of FIG.
Here, when one or more objects J included in the saved frame (still image) are associated with the associated information, the viewer W performs the following operation to obtain the object information. Can be obtained.
That is, the viewer W performs an operation of tapping any position of each of the one or more objects J included in the frame (still image) in the TIG area A, and thereby the object information of the object J is changed. Can be obtained.
Specifically, for example, in the example in the upper part of FIG. 13, when an operation of tapping any position of each of the TIG areas A1 to A3 of the objects J1 to J3 is performed, the object of each of the objects J1 to J3 is Information can be obtained.
Thus, for example, if the viewer W finds an anxious scene during the reproduction of a moving image, the viewer W may temporarily save the frame (still image) using the screen shot function and later slowly acquire the object information. it can.

The lower part of FIG. 13 shows a specific example of the pinch-in function.
As shown in the lower part of FIG. 13, the viewer W can display a person, music, a location, a controller, and the like outside the screen M by performing a pinch-in operation on the screen M.
Although not shown, if the viewer terminal 3 is a personal computer or the like and cannot perform a pinch-in operation, a separate button is provided so that a function corresponding to the pinch-in function can be executed. Can also.

The upper part of FIG. 14 shows a specific example of the simple translation function.
The “simple translation function” means that by tapping one of the words included in the text displayed in the telop or caption displayed during playback of the moving image, This function allows you to display a simple translation.
In addition, one or more words included in a character or a document written in a telop or a caption displayed during reproduction of a moving image can be regarded as an object J. Therefore, for example, similarly to the GUI shown in the upper part of FIG. 12 described above, by performing an operation of tapping the word as the object J, it is possible to save the word in the “TIG stock” indicated by the area D.
Furthermore, as shown in the upper part of FIG. 14, the word as the object J stored in the “TIG stock” (area D) is recorded in a word book that can be used by each of the viewers W. Then, when the viewer W taps an icon indicating a word recorded in a word book or “TIG stock” (area D), an accurate pronunciation of the word is reproduced by voice. Then, when the word is pronounced by the viewer W, the accuracy of the pronunciation of the viewer W is analyzed, and the correct answer rate indicating the degree of accuracy of the pronunciation can be displayed.

The lower part of FIG. 14 shows a specific example of the TIG stock.
The above-mentioned “TIG stock” can be simply displayed as a list of objects J. For example, as shown in the lower part of FIG. 14, the list is displayed in a form that is categorized into one or more books. You can also. The operation of categorizing the object J stored in the “TIG stock” can be manually performed by the setter C, or can be automatically performed using a technique such as AI (artificial intelligence). it can.
This allows the viewer W to quickly find the object information of the object J desired by himself / herself when trying to acquire the object information of the object J after viewing the moving image.

As described above, one embodiment of the present invention has been described. However, the present invention is not limited to the above-described embodiment, and includes modifications and improvements as long as the object of the present invention can be achieved. It is.

For example, in the above-described embodiment, what is specified as the object J is merely an example.
That is, the moving image L includes a myriad of candidates that can correspond to the object J. For this reason, as described above, by linking the linking information to as many objects J as possible in advance, the convenience of the viewer W can be further improved.

Also, in the above-described embodiment, when specified by the viewer W, the link information of the object J is stored in the “TIG stock” as stock information, but this is only an example. The linking information of the object J specified by the viewer W may not be stored as stock information.

Also, for example, FIG. 2 shows only one setter C, but this is merely an example, and a plurality of setters C may exist.

Also, for example, the shape of the TIG area is not limited to a quadrangle, but may be a free rectangle.

Also, for example, the moving images L shown in FIGS. 1 to 8 are merely examples, and may have other configurations.

Further, according to the present invention, in addition to the above services and effects, the following services and effects can be realized.
That is, the viewer W obtains information on clothes and ornaments worn by a person (for example, the female talent in FIG. 1) appearing in the moving image L while operating the viewer terminal 3. And can be purchased.
Further, the extent to which the viewer W performs the tap operation on the TIG area A can be fed back to the setter C or the person who provides the moving image L.
In addition, since the degree of setting the TIG area A in the moving image L is expected to change in accordance with the ability of the setter C, it is expected that the setter C as a professional having advanced skills will increase. .
In addition, although conventional sponsors use CM (commercial) as an advertising medium, it is expected that the number of sponsors using a moving image L as an advertising medium will increase.
Also, the viewer W can be set as the setter C to set the TIG area A in the moving image. That is, the viewer W can use the setting application described above.
Further, the viewer W can also distribute the image L in which the TIG area A is set.
Also, when the TIG area A corresponding to one object J is tapped, a plurality of link destinations (jump destinations) can be selected.
"TIG stock" can also be customized. In addition, the effect can be changed according to the specific mode of the operation for designating the object J. Specifically, for example, the effect can be changed by an operation angle, a tap time, a double tap, or the like. More specifically, for example, in a case where the first linking information and the second linking information are associated with the object J, the first linking information is stored when a deep pressing operation is performed, while the touch is performed twice (double tapping). ) And the second association information can be stored.
Further, the object J can be stocked by the movement of the eyes of the viewer W.

The system configuration shown in FIG. 9 and the hardware configuration of the management server 1 shown in FIG. 10 are merely examples for achieving the object of the present invention, and are not particularly limited.

The functional block diagram shown in FIG. 11 is merely an example and is not particularly limited. That is, it suffices that the information processing system has a function capable of executing the series of processes described above as a whole, and what kind of functional block is used to realize this function is not particularly limited to the example of FIG. .

Further, the location of the functional block is not limited to FIG. 11 and may be arbitrary.
For example, in the example of FIG. 11, the functional blocks necessary for executing the linking information providing process and the linking information setting support process are configured on the management server 1 side, but this is only an example. For example, by installing a dedicated application in the setter terminal 2 or the viewer terminal 3, at least a part of these functional blocks may be provided in the setter terminal 2 or the viewer terminal 3.
In addition, one functional block may be configured by hardware alone, may be configured by software alone, or may be configured by a combination thereof.

When the processing of each functional block is executed by software, a program constituting the software is installed on a computer or the like from a network or a recording medium.
The computer may be a computer embedded in dedicated hardware. In addition, the computer may be a computer that can execute various functions by installing various programs, for example, a general-purpose smartphone or a personal computer in addition to a server.

A recording medium including such a program is provided separately from the apparatus main body to provide the program to each user. It is composed of provided recording media and the like.

In this specification, steps for describing a program to be recorded on a recording medium are not limited to processing performed in chronological order according to the order, but are not necessarily performed in chronological order. This also includes the processing to be executed.

システム In this specification, the term “system” refers to an entire device including a plurality of devices and a plurality of means.

In summary, the information processing system to which the present invention is applied only needs to have the following configuration, and can take various embodiments.
That is, the information processing system to which the present invention is applied is:
It exists in a predetermined area (for example, TIG area A1 in FIG. 1) specified by a first user (for example, viewer W in FIG. 9) in the displayed moving image (for example, moving image L in FIG. 1). Information for providing predetermined information (for example, object information) to the first user for an object (for example, the object J1 indicating a female talent in FIG. 1) is provided before the designation (for example, when the moving image is displayed on the viewer terminal). A management unit (for example, the linking information management unit 101 in FIG. 11) that links the information at the timing before the information is displayed in FIG.
A presentation control unit (for example, a moving image presentation control unit 102 in FIG. 11) for executing control for presenting the moving image to the first user;
When a predetermined operation (for example, a tap operation) on the predetermined area by the first user in which the moving image is presented (for example, displayed on the viewer terminal 3 in FIG. 2 or the like) is performed, the moving image is present in the predetermined area. A first receiving unit (for example, the specification receiving unit 103 in FIG. 11) that recognizes that the specification of the object to be performed has been performed and receives the specification.
An acquisition unit (for example, the acquisition unit 104 in FIG. 11) for acquiring the association information managed in association with the object whose specification has been accepted;
Provided control means (for example, FIG. 11) for executing control for providing the predetermined information to the first user (for example, displaying it on the viewer terminal 3 in FIG. 2 or the like) based on the link information acquired by the acquisition means. Providing unit 105),
Is provided.

As a result, the management unit associates the object with the association information and manages the object, and the presentation control unit presents the moving image to the viewer. Then, the first receiving unit receives the specification of the object by the viewer, the obtaining unit obtains the linking information associated with the object, and the presentation control unit provides the viewer with predetermined information based on the linking information. I do.
As a result, the viewer can easily obtain the predetermined information on the object included in the moving image during the viewing of the moving image or at a timing after the viewing of the moving image.
Specifically, for example, the viewer W in the above-described embodiment easily acquires the object information regarding the object J included in the moving image L during the viewing of the moving image L or at a timing after the viewing of the moving image L. can do.

Further, information indicating a position on the moving image where the predetermined operation (for example, tap operation) by one or more users (for example, viewer W) has been performed is generated and presented in a predetermined format (for example, a heat map). A second presentation control unit (for example, the heat map unit 106) for performing the control may be further provided.

Accordingly, the second presentation control unit generates information indicating a position on the moving image where a predetermined operation has been performed by one or more users, and performs control for presenting in a predetermined format. In other words, it is possible to see at a glance which positions in the predetermined area where the object is present are specifically subjected to the predetermined operation, or which positions are not subjected to the predetermined operation. Further, it is possible to see at a glance which position other than the predetermined area has been subjected to the predetermined operation.
As a result, for example, the position of the predetermined area set in the moving image can be corrected to a suitable position. Further, for example, it is possible to make a correction relating to the width of the initially set predetermined area. Further, for example, a new associating operation can be performed on an object for which a predetermined operation has been frequently performed by a user among objects to which object information has not been associated so far.

Further, the second presentation control means may include, as information indicating a position on the moving image at which the predetermined operation by the one or more users is performed, a heat generated based on the number of the predetermined operations performed. Controls presented in the form of a map can be performed.

Accordingly, the second presentation control unit generates information indicating a position on the moving image where a predetermined operation has been performed by one or more users and executes control for presenting the information in the form of a heat map. In other words, it is possible to grasp at a glance, using a heat map, a specific area in which an object is present, a specific position where a specific operation is frequently performed, or a specific position where the specific operation is not performed. Can be. Further, it is possible to grasp at a glance which position other than the predetermined area has been subjected to the predetermined operation by using the heat map.
As a result, for example, the position of the predetermined area set in the moving image can be corrected to a suitable position. Further, for example, it is possible to make a correction relating to the width of the initially set predetermined area. Further, for example, a new associating operation can be performed on an object for which a predetermined operation has been frequently performed by a user among objects to which object information has not been associated so far.

備える Further, the image processing apparatus further includes a branch generation unit that generates information indicating a branch point at which the moving image is branched into a plurality of stories.

(4) Since the branch generation unit generates information indicating a branch point at which a moving image is branched into a plurality of stories, the above-described story branch service can be provided.

Furthermore, it is possible to further comprise a voice recognition means for recognizing the voice of the user.

Thereby, the voice recognition means recognizes the voice of the user, so that the above-mentioned voice TIG service can be provided.

In addition, it is possible to further comprise a gesture recognition unit for recognizing the gesture of the user.

Thereby, the gesture recognizing unit recognizes the gesture of the user, so that the above-described gesture TIG service can be provided.

Further, a suggestion control means for executing a control for displaying a predetermined advertisement (signage) on the moving image based on a result of the operation of the user may be further provided.

(4) Since the suggestion control means executes control for displaying a predetermined advertisement (signage) on a moving image based on the results of user operations, the above-described real-time suggestion service can be provided.

Further, the management means manages the object by associating the object with the plurality of pieces of the associating information,
The acquisition unit acquires the plurality of pieces of the association information managed in association with the object whose specification has been accepted,
The provision control means may execute a control for providing the predetermined information to the user based on the plurality of pieces of link information acquired by the acquisition means.

Thereby, the management unit associates and manages a plurality of pieces of linked information with the object, and the obtaining unit obtains and provides a plurality of pieces of linked information managed by being linked to the object specified by the user. The control means executes control for providing predetermined information to the user based on the plurality of pieces of link information acquired by the acquisition means. As a result, the above-described multilink service can be provided.

1: management server, 2: setter terminal, 3: viewer terminal, 4: external server, 11: CPU, 12: ROM, 13: RAM, 14: bus, 15: input / output interface, 16: input unit, 17 : Output unit, 18: storage unit, 19: communication unit, 20: drive, 30: removable medium, 101: linked information management unit, 102: moving image presentation control unit, 103: designation reception unit, 104: acquisition unit, 105 : Provision unit, 106: heat map unit, 107: branch generation unit, 108: speech recognition unit, 109: gesture recognition unit, 110: suggestion control unit, 181: object DB, C: setter, W: viewer, L : Moving image, J: Object, A: TIG area, F: Balloon, H: Link information, I: Microphone, G: ON / OFF switch button, V: Television, S: Storefront Ineji, K: advertising, B: Button, D: area, E: region, M: Screen, N: network

Claims

The object for providing the predetermined information to the user for the object existing in the predetermined region, which is specified by the user in the displayed moving image, is linked to the object before the specification is performed. Management means for managing information as linked information;
First presentation control means for performing control for presenting the moving image to the user;
When a predetermined operation is performed on the predetermined region by the user in which the moving image is presented, a first reception unit that recognizes that the specification of the object present in the predetermined region has been performed and receives the specification,
Acquisition means for acquiring the association information managed in association with the object whose specification has been accepted;
A providing control unit that executes control for providing the predetermined information to the user based on the link information acquired by the acquiring unit;
An information processing system comprising:
A second presentation control unit configured to generate information indicating a position on the moving image at which the predetermined operation by one or more of the users has been performed, and to perform a control of presenting in a predetermined style;
The information processing system according to claim 1.
The second presentation control unit may include, as information indicating a position on the moving image at which the one or more users have performed the predetermined operation, a heat map generated based on the number of the predetermined operations performed. Perform the controls presented in the form,
The information processing system according to claim 2.
The apparatus further includes a branch generation unit that generates information indicating a branch point at which the moving image branches into a plurality of stories,
The information processing system according to claim 1.
Further comprising a voice recognition means for recognizing the voice of the user,
The information processing system according to claim 1.
Further comprising a gesture recognition unit means for recognizing the gesture of the user,
The information processing system according to claim 1.
The system further includes a suggestion control unit 110 that executes a control of displaying a predetermined advertisement on the moving image based on a result of the operation of the user.
The information processing system according to claim 1.
The management means manages the object by associating the object with the plurality of pieces of the association information,
The acquisition unit acquires the plurality of pieces of the association information managed in association with the object whose specification has been accepted,
The provision control means executes control for providing the predetermined information to the user based on the plurality of pieces of link information acquired by the acquisition means.
The information processing system according to claim 1.