JP6744939B2 - Link destination designating interface device, viewer interface device, and computer program - Google Patents

Description

The present invention is, for example, an interface for designating a link destination configured so that a content provider side such as an advertiser can construct a mechanism for skipping a moving image content to a desired link destination during playback display on the viewer side. Device and viewer interface device configured to enable a viewer to jump to a desired link destination while playing back and displaying moving image content using the data for designating a link destination created by such a device And the technical field of computer programs that cause a computer to function as such a device.

As a system related to this type of device, various types have been proposed that are configured to display another content of a link destination associated with an object that constitutes the content being displayed (Patent Document 1). ~3).

JP, 2011-259184, A JP, 2010-108310, A JP, 2008-146492, A

However, in such a system, regarding the work of designating the link destination on the side of the content provider such as the advertiser, in performing the work of associating the link destination with the object existing in the video as a part of the video content. Basically, specialized knowledge such as computer program knowledge or system engineer knowledge is required, and the link destination is not configured to be specified or changed by a simple or quick operation. Alternatively, constructing a system or data for designating a link destination according to the content and movement of various moving image contents itself may be generally complicated and sophisticated.

Furthermore, the content itself that can specify the link destination may lose its arbitrariness. That is, the viewer may be able to select the link destination later only if the content is a dedicated content that is constructed in advance so that the link destination can be specified.

In particular, according to a study by the inventors of the present application, it is common that the link destinations desired to be specified on the content provider side such as an advertiser, an advertising agency, and a broadcasting station are frequently changed, added, or deleted. .. Therefore, in this type of system, it is considered desirable to be able to flexibly specify or change the link destination by a simple or quick operation.

The present invention is made, for example, in view of the above technical problems, and corresponds to an arbitrary object existing in the video content on the content provider side such as an advertiser, an advertising agency, and a broadcasting station. Then, it is an object of the present invention to provide an interface device for designating a link destination, which makes it possible to easily designate a desired link destination. The present invention is, for example, a viewer interface capable of jumping to a desired link destination on the side of a viewer who is playing back moving image content, using data for designating a link destination created by such a device. Another object is to provide a device. It is still another object of the present invention to provide a computer program capable of causing a computer to function as such an interface device.

In order to solve the above problems, the link destination designating interface device of the present invention includes a range designating unit capable of designating a desired range within a screen on which a moving image content is reproduced as a still image or a moving image, and the range designating unit. Range mark setting means for displaying a range mark indicating the range designated by the above on the video content in the screen, and a playback time of the video content in the screen where the video content is being played back. With the progress of the above, a movement operation means capable of moving the range mark in a desired direction, and a link capable of inputting link destination identification information for identifying a desired link destination corresponding to the range mark A holding unit that holds the position information indicating the position of the range mark in association with the first input unit, (i) the link destination identification information input by the link destination input unit, and (ii) each time within the reproduction time. The range designation means is configured to be able to designate the desired range by a frame that is expandable and contractable within the screen and has a predetermined shape in accordance with a predetermined type of designation operation. The moving operation means is configured to be able to move a frame mark indicating the frame as the range mark on the screen, and the range mark setting means further reproduces the still image or stop motion or slow reproduction of the moving image content. The range mark can be displayed over the moving image content in the displayed screen, and the moving operation means can further display the range mark on the moving image content that is still image playback, stop motion or slow playback. The range mark can be moved in a desired direction on the screen where is displayed in a superposed manner, and the link destination input means further superimposes it on the still image reproduction or stop motion or slow reproduction video content. It is possible to input the link destination identification information as corresponding to the range mark displayed as described above, and the holding means further holds the position information during a period in which the range mark is not moved within the screen. the frequency was lowered relatively to, during the period in which the range marked by the screen is moved, characterized by relatively raised Rukoto the frequency of holding the position information.

According to the interface device for designating a link destination of the present invention, the user side (that is, the person on the content provider side) of the device can easily perform the work of designating a desired link destination for any moving image content. In particular, even in an environment where it is strongly desired to easily specify, change, add, etc. link destinations, as a result, it is possible to easily specify, change, add, etc. desired link destinations corresponding to any object. It will be possible. Moreover, by adopting still image playback or stop motion or slow playback, the shape and size of the range mark, the positional relationship with the object to be associated, etc. can be initialized accurately or surely, and it is easier. It is possible to specify the link area in. At this time, the processing time, the processing amount, and the data amount can be reduced by raising or lowering the frequency of holding the position information according to the moving state of the range mark on the screen.

In order to solve the above problems, a first computer program of the present invention causes a computer to function as the above-described link designating interface device of the present invention.

According to the first computer program of the present invention, for example, it is read from a recording medium or the like storing the computer program into a computer system and executed, or after being downloaded into the computer system via a communication unit or the like. If executed, the above-mentioned link designating interface device according to the present invention can be realized relatively easily.

In order to solve the above problems, the viewer interface device of the present invention has the position information and the link destination identification generated by the above-described interface device for designating a link destination (including various aspects thereof) according to the present invention. A viewer interface device for selectively playing back the linked content, instead of or in addition to playing the moving image content, based on the information during the playing of the moving image content by the playing means. And a position selection means capable of selecting a desired display position or area on the screen where the moving image content is being reproduced as a still image or a moving image, and at least a part of the display position or area selected by the position designating means. Is a determination unit that determines whether or not the range indicated by the range mark defined by the position of the range mark indicated by the position information is included, and the determination unit determines that the at least part is included. And a link destination control means for controlling the reproducing means so that the content of the link destination indicated by the link destination identification information is reproduced as a still image or a moving image instead of or in addition to the moving image content. Equipped with.

According to the viewer interface device of the present invention, using the position information and the link destination identification information, which are the link destination specifying data created by the link destination specifying interface device of the present invention, the viewing during the reproduction of the moving image content is performed. The person can jump to the desired link destination.

In order to solve the above problems, a second computer program of the present invention causes a computer to function as the above-mentioned viewer interface device of the present invention.

According to the second computer program of the present invention, for example, if the computer program is read from a recording medium storing the computer program or the like and executed, or after being downloaded to the computer system via a communication unit or the like. If executed, the viewer interface device according to the present invention described above can be realized relatively easily.

Such effects and other advantages of the present invention will be made clear by the embodiments described below.

<Interface device for specifying link destination>
<1>
The interface device for designating a link destination according to the present exemplary embodiment provides a range designating unit capable of designating a desired range and a range designated by the range designating unit in a screen where a moving image content is being reproduced as a still image or a moving image. In the screen, a range mark setting means for displaying the range mark shown on the moving image content in an overlapping manner, and in the screen where the moving image content is being reproduced as a moving image, as the reproduction time of the moving image content elapses, A moving operation means capable of moving the range mark in a desired direction, and a link destination input means capable of inputting link destination identification information for identifying a desired link destination, as corresponding to the range mark, and i) a holding unit that holds the position information indicating the position of the range mark in association with the link destination identification information input by the link destination input unit and (ii) each time within the reproduction time.

According to the interface device for designating a link destination of the present embodiment, for example, the “user” side of the device, which is a content provider side such as an advertiser staff member, an advertising agency staff member, a broadcasting station staff member, etc. , Works as follows. The “content provider” here is typically a person who intends to provide a content to be a link destination or induces a viewer to the link destination, and is the same as the provider who provides the video content itself. May or may not be the same. The “object” according to the present invention or the embodiment is displayed in a form included in the moving image content, for example, beverages/food, containers of beverages/food, clothes, ornaments, vehicles, furniture, appliances. In the broad sense, if the part that can be distinguished from other parts in the video content so that the link destination can be specified as described below, the shape and outline are not clear. However, it corresponds to the “object” according to the present invention or the embodiment.
In a narrow sense, an “object” is an article that is displayed as a part of moving image content and is associated with a link destination. The link destination specifying interface device functions as a so-called GUI (graphical user interface) for such a user or content provider.

First, for example, a display means (that is, a display device having a “screen” according to the present invention or an embodiment, a display, etc.) included in, for example, a personal computer, a touch panel, a mobile, a mobile terminal device, a smartphone, a mobile phone, a high-performance television, etc. On the screen, the moving image content to which the link is attached is reproduced as a still image or a moving image. The moving image content is arbitrary such as a movie, drama, animation, documentary, variety, TV shopping, sports program, and the like. That is, it is not necessary that the content is created for attaching the link, and general content may be used. However, the moving image content may be configured so that the link can be pasted, easily pasted, or pasted.

In this state, the desired range is specified by the user of the device via the range specifying means on the screen. Before or after this, or simultaneously or in parallel, the range mark setting means displays the range mark indicating the specified range in a superimposed manner on the moving image content on the screen. The range mark may be, for example, a red line quadrangular or polygonal contour mark, or a round contour mark. Alternatively, it may be a mark with a mesh or a fluorescent pen, and is arbitrary as long as the range mark can be visually recognized on the screen. The range mark preferably has a contour in the sense that it defines a “range” that provides a criterion for determining whether or not to skip to the link destination, as described later. However, under the rule that "a certain size or shape of range is accompanied by its surroundings" that provides a criterion for whether to skip to the link destination, simply a dot mark or a predetermined mark indicating the center of the range, etc. It can be any type of icon.

As the “range designation means” according to the present invention or the embodiment, for example, it is possible to perform icon operation, drawing operation, display operation, etc. on the screen of a mouse, tablet, jog dial, trackball, keyboard, touch panel, etc. It is possible to adopt various existing operating devices. The “range mark setting means” according to the present invention or the embodiment provides various signals such as an image signal, an image control signal, a timing signal, a synchronization signal, etc. corresponding to an image to be displayed, such as a CPU, a microcomputer, and a memory. An existing device capable of controlling the display of the display means by providing the display means separate from itself or incorporated in itself (that is, the display means having the “screen” according to the present invention or the embodiment) It is composed of a part or all of various display control devices.

As described above, the range mark on the screen is initialized. From the viewpoint of initializing the shape and size of the range mark and the positional relationship with the object to be matched accurately or surely, the moving image content at this stage is still image playback or stop motion or slow playback. It is preferable that However, when the motion of the moving image content to be played back and the movement of the object in the moving image is scarce or hardly or not at all, or when the operation skill of the user of the device is high and quick operation is possible, slow playback, Such initial setting may be performed during moving image reproduction such as normal reproduction and high speed reproduction.

Then, the moving image content is played back with the range mark having been initialized as described above being superimposed on the moving image content. The moving image reproduction may be high-speed reproduction such as double-speed reproduction, low-speed reproduction such as slow reproduction, normal reproduction, variable reproduction, or frame advance.

In this state, the range mark is moved in the desired direction on the screen by the moving operation means as the reproduction time of the moving image content elapses. Typically, it is moved in a two-dimensional plane of the screen continuously or intermittently in all directions at an arbitrary speed. One or more stops may be included during the movement.

As the "moving operation means" according to the present invention or the embodiment, for example, various existing operation devices such as a mouse, a tablet, a jog dial, a trackball, a keyboard, a touch panel, etc. that can perform an icon operation on the screen are adopted. It is possible, and typically, the range mark is moved within the screen in the same manner as the icon is moved within the screen.

It is assumed that the link destination identification information for identifying a desired link destination corresponds to the above range mark, either before or after the designation operation by the range designation means and the setting operation by the range mark setting means. , Is input via the link destination input means. The “link destination input means” according to the present invention or the embodiment is an input means such as a keyboard, a tablet, a touch panel, a mouse or the like for inputting link destination identification information (for example, link destination address information). The "link destination" is the source of other video content, the source of other still image content, the Internet site, the video distribution site, the music distribution site, etc., which is being viewed in the environment where the viewer views the video content. It is arbitrary as long as it is an image providing source capable of displaying something on the screen instead of or in addition to the content (specifically, by switching display or window display). In any case, such sources are those identified by the linked identity.

After that, for example, the position information indicating the position of the range mark moved as described above is held in the holding unit including a memory, a storage device, a controller, and the like. The storage here may be performed away from the place operated by the user of the device via the communication means. That is, at least a part of the holding means may be located at a remote place.

At this time, in particular, the position information is held in association with the link destination identification information and each time within the reproduction time. “Each time” here means a case where the image frames forming the moving image content are regularly or continuously in a one-to-one or many-to-one fixed cycle, and when the image frames forming the moving image content are expressed. Including both irregular and irregular or intermittent cases. Particularly, the frequency of holding the position information is reduced during the period when the range mark is not moved, and one position information is held for the period when the range mark is not moved. Alternatively, the frequency of holding the position information is increased during the period when the range mark is moved, and one position information is held each time the range mark is moved (that is, one position information that is unchanged during the period when the range mark is not moved) is held. Including the case of doing.

As described above, regarding the “position of the range mark (that is, position information)”, it is associated with the reproduction time on the device without being associated with the corresponding object.

Moreover, as described above, regarding the "link destination (link destination identification information)", the device is associated with the range mark without being associated with the corresponding object.

Generally, when a link is pasted to an arbitrary object in video data, if you try to link to the content itself of the video content or the content itself/position of the object within the video content, image analysis or image recognition will occur. It requires very sophisticated data processing. Therefore, the required program becomes complicated and sophisticated, and the processing time processing amount and the data amount increase remarkably.

However, according to the present embodiment, the user of the device may perform a simple manual operation or the like via the moving operation means while looking at the moving image content and the range mark with his/her own eyes, and the position information obtained by this is It may be held by the holding means in a form associated with the reproduction time axis.
Before or after this, or simultaneously or in parallel, the link destination is linked to the range mark. Therefore, on the user side of the device, it is possible to put the link into practice easily. In particular, it is not necessary to link the link destination directly to the content itself of the video content or the content/position itself of the object, and the simple process of specifying the range and moving the range mark, or visually It can be executed in an easy-to-understand form.

As a result of the above, according to the present embodiment, it is not necessary for the user of the device to specify the link destination, that is, expertise such as computer program knowledge or system engineer knowledge. By setting range marks, moving operations, etc., it is easy to specify the link destination or to construct the data for specifying the link destination, regardless of the complexity and speed of the moving image content and movement. ..

On the contrary, as for the moving image content itself for which the link destination is specified, there is no particular limitation, and the user of the device can perform the range mark setting and its moving operation on the screen while watching the content. As long as it is optional. It is not necessary that the video content is a dedicated video content built in advance so that the link destination can be designated.

As described above, according to the present embodiment, the user side of the device (that is, the content provider side) can easily perform the work of designating a desired link destination for any moving image content. In particular, the link destination that the user of the device wants to specify is frequently changed, added, or deleted frequently due to the faster product cycle. Even in an environment where it is strongly desired to easily specify, change, add, etc. link destinations, as a result, it is possible to easily specify, set, change, add, etc. desired link destinations for any object. Becomes Further, the program required to realize the interface device for designating the link destination is simple, and the processing time processing amount and the data amount can be significantly reduced.
<2>
In one aspect of the link destination specifying interface device of the present embodiment, the holding unit holds, as the position information, position information indicating a relative position of the range mark with respect to the entire image of the moving image content.

According to this aspect, the "position of the range mark (positional information)" is not the position of the range mark with respect to the screen actually displayed on the display means or the position within the screen, but at each time point. Is a relative position to the entire image of the moving image content displayed on the screen (that is, the entire image including the image portion not visible on the screen).

Therefore, in the holding means, the corresponding object is associated with the corresponding object on the device regardless of the "position in the screen", more specifically, the "position in the display screen actually displayed on the display means". Position information indicating the position or coordinates of the range mark that cannot be held is held. Therefore, regardless of the specifications, standards, attributes, aspect ratio setting, magnification setting, cut-out display presence or absence of the display means used when the user of the device performs the operation of designating the link destination, Can be specified accurately or reliably.

Furthermore, the specifications, standards, attributes, vertical and horizontal directions of the display means (or reproduction means) used when the viewer selects the object in the video content later by selecting the position or area on the screen. Object selection can be performed accurately or reliably regardless of the ratio setting, the magnification setting, the presence or absence of cutout display, and the like.

In particular, according to the research conducted by the inventors of the present application, even if the same content is used, various aspect ratios and widths are provided for wide or normal large or small televisions, personal computers, mobile phones, smartphones, mobile phones, etc. It is important to realize a mechanism for associating such link destinations with display means (or reproduction means) having different horizontal and vertical magnifications and different cutout portions.

Here, there is no problem as long as the "entire image of the moving image content" is displayed on the "screen" of the display means (or reproduction means) used by the user or the viewer of the device without excess or deficiency. With the advent of various display means or reproduction means, such display is rather rare. Specifically, for example, there may be a case where “entire image area of moving image content>screen size” (only a part of the moving image content is displayed on the screen), and conversely, “entire image area of moving image content<screen "Size of" (when the video content is displayed only on a part of the screen), the video content is enlarged in the vertical or horizontal direction, and the vertical image, the horizontal image, or a part of the enlarged image or Or all may be displayed on screen.

However, according to this aspect, it is possible to easily perform the work of designating a desired link destination so as to be compatible with the display unit (or the reproducing unit) having various screens that can be used by the user of the device. Moreover, even if the link destination is simply specified as described above, as long as the range mark is set and moved properly, the display means (or the reproduction means) having the "screen" that can be used by the viewer side. ), the object displayed in the video content and the link destination that should correspond to the object do not deviate from each other.

The position of the range mark (positional information) is preferably a relative position to the entire image of the moving image content in this way, but it is not necessary. For example, it may be a relative position with respect to the entire screen of a display device, a display, etc. included in the reproducing means. In this case, the position information may be generated and held according to the specifications and standards of the display device or the reproduction device, and the position information may be used later according to the specifications and standards in the viewer interface device. Alternatively, a parameter indicating the specifications, standards, etc. of the display device or the playback device is generated and held in a form of being linked to the position information, and the viewer interface device will later display a position corresponding to the parameter with respect to the selected display position or area. Adjustment may be performed.
<3>
In this aspect, the holding unit uses, as the position information, a relative angle of the range mark with respect to an angle of view related to the entire image, at least one of four corners, an outer ring, or a reference position fixed in the entire image. Position information indicating the position may be held.

According to this structure, the holding unit holds the position information indicating the relative position of the range mark with respect to the entire image as the position information, and typically, the four corners of the entire image of the moving image content on the coordinates ( The xy coordinates in the case of (0,0), (1,0), (1,1), and (0,1) are held as position information.

Therefore, if the position information is used, the viewer can select the object regardless of the specifications and standards of the display unit (or the reproducing unit) used when the viewer selects the object on the moving image later. Can be done accurately or reliably.

<4>
In another aspect of the link destination designating interface device of the present embodiment, the holding unit holds the position information at each time during a period in which the range mark is being moved, and holds the position mark. The position information is not held for each time during the period when the movement is not performed.

According to this aspect, when the range mark is moved, the holding unit holds a plurality of pieces of position information, for example, for a plurality of frames during the moved period. On the other hand, when the range mark is not moved, the position information of one or n (where n is a natural number) smaller than the plurality of m (where m is a natural number) frames during the period when the range mark is not moved is provided. Hold.

Therefore, compared with the construction of various data for specifying a link for each frame of the video content as is done in the background art, by using a much smaller amount of data, the viewer can link the link destination on the video content. It is very advantageous in practice because you can build a mechanism to select it.

Note that the holding unit may hold the position information for each time of the reproduction time, that is, for each frame. In this case, a moving image that is different from the moving image content at the same playback time as the moving image content (that is, a range mark that moves, stands still, moves, or disappears or appears in the background screen over time). (Moving image data capable of reproducing the moving image) is similar to that recorded in the holding unit.
<5>
In another aspect of the interface device for designating link destination of the present embodiment, the link destination input means is configured to be capable of inputting a plurality of link destination identification information as corresponding to a plurality of objects in the moving image content. The holding unit holds a plurality of position information as the position information in association with the plurality of link destination identification information.

According to this aspect, an environment where the viewer can later select a plurality of link destinations in one moving image content can be easily constructed on the user side of the device.
<6>
In another aspect of the link-destination designating interface device of the present embodiment, the link-destination input means is capable of inputting a plurality of link-destination identification information relating to a plurality of link destinations according to a plurality of types of input operations, or Instead of or in addition to this, it is possible to input the link destination identification information while making it possible to select a plurality of display forms related to the link destination by different types of input operations.

According to this aspect, for example, a touch operation, a tap operation, a long press operation, a swipe operation, a drag operation, a slide operation, a rotation operation, a zoom operation, a pinch operation, a stretch operation, a flick operation, and the like via the link destination input means. The link destination identification information is input while it is possible to select a plurality of display modes related to the link destination by a plurality of types of input operations including one of them. Alternatively, instead of or in addition to this, link destination identification information that allows selection of a plurality of link destinations is input.

Therefore, an environment in which the linked content can be displayed in different display modes or different linked content can be displayed by performing different types of input operations for one object on the viewer side later. It can be easily constructed on the user side of the device.
<7>
In another aspect of the link destination designating interface device of the present embodiment, the range designating unit is capable of expanding and contracting the desired range within the screen in accordance with a predetermined type of designating operation. The frame is designated by a frame, and the movement operation means is configured to be able to move a frame mark indicating the frame as the range mark within the screen.

According to this aspect, when a predetermined type of designation operation is performed through the range designating unit, the range mark setting unit displays the range mark such as a rectangle, a polygon, a circle, and an ellipse in a stretchable manner. It Therefore, the user of the device can easily specify a range of appropriate size while visually confirming the moving image content and the frame mark superimposed on the moving image content on the screen. After that, since the frame mark indicating the range of the appropriate size may be moved via the moving operation means, the moving operation can be surely performed while visually confirming the moving operation.
<8>
In this aspect, the range designating unit is configured to be able to designate the desired range by expanding and contracting the four corners of the rectangle displayed in the screen, and the movement operating unit is configured to define the rectangle as the range mark. The frame mark indicating the frame may be configured to be movable within the screen.

According to this structure, when a predetermined type of designation operation is performed via the range designating unit, the range mark setting unit displays the rectangular frame mark so that its four corners can be expanded and contracted. Here, "expanding/contracting the four corners of a rectangle" means to be expanded/contracted relative to the entire image, and is not limited to the case where all four coordinates of the four corners are changed. Is fixed to the entire image, the other two corners are moved to the entire image, or one corner is fixed to the entire image and the other three corners are moved to the entire image. This is also intended to include cases where it is done. Therefore, on the user side of the device, it is possible to extremely easily specify an appropriate size range while visually confirming the moving image content and the frame mark overlaid on the moving image content in the screen. ..

In particular, if it is a rectangular frame mark, its position and size can be indicated by two coordinates, for example, the coordinates of the upper left corner and the coordinates of the lower right corner, and the operation of changing these two coordinates is rectangular. It is an operation to display the display freely. That is, the frame mark can be expanded and contracted by a simple operation. As described above, the coordinate axes at this time are based on the four corners of the entire image of the moving image content, regardless of the screen of the display means (or the reproduction means).
<9>
In another aspect of the interface device for designating a link destination of the present embodiment, the screen is a screen of a touch panel, and the movement operation unit triggers a touch of an operator on the touch panel to start movement of the range mark. The end of the contact is set as a trigger for ending the movement of the range mark.

According to this aspect, the operation performed by the user of the apparatus (that is, the “touch panel operator” here) from the start of movement of the range mark to the end of movement is further simplified, and as a whole, The range mark moving operation can be executed more easily and quickly.

The touch on the touch panel by the operator may be used as a trigger for starting the range designation operation via the designated range. In that case, the operator may further be configured to perform the operation until the end of the movement of the range mark as a series of contact operations without releasing the touch on the touch panel.
<Computer program for interface device for specifying link destination>
<10>
The first computer program of the present embodiment causes a computer to function as the link designating interface device (including various aspects thereof) according to the above-described embodiment.

According to the computer program of the present embodiment, a solid-state storage device that is removable from a computer system such as a recording medium such as a ROM, a CD-ROM, a DVD-ROM, a hard disk, or a USB (Universal Serial Bus) memory that stores the computer program. From the above, if the computer program is read into a computer system and executed, or if the computer program is downloaded to the computer system via, for example, communication means, and then executed, then the above-described present embodiment is realized. The link designating interface device (including its various aspects) can be realized relatively easily.
<Viewer interface device>
<11>
The first viewer interface device according to the present exemplary embodiment uses the position information and the link destination identification information generated by the link destination specifying interface device according to the present exemplary embodiment (however, including various aspects thereof). Based on the above, a viewer interface device for selectively causing the content of the link destination to be reproduced in place of or in addition to the reproduction of the moving image content during the reproduction of the moving image content by the reproduction means, At least a part of the display position or area selected by the position selecting means and a position selecting means capable of selecting a desired display position or area in the screen where the moving image content is still image reproduced or moving image reproduced, A determination unit that determines whether or not the range indicated by the range mark defined by the position of the range mark indicated by the position information is included, and the determination unit determines that the at least part is included. In this case, a link destination control means for controlling the reproducing means so as to reproduce the still image or the moving image of the content of the link destination indicated by the link destination identification information in place of or in addition to the moving image content. ..

According to the first viewer interface device of the present embodiment, the moving image content is stopped on the viewer side (that is, the user of the device) by the reproducing means having the “screen” according to the present invention or the embodiment. A desired display position or area is selected through the position selecting means in the screen where the image is being reproduced or the moving image is being reproduced. The “reproducing device” according to the present invention or the embodiment is an existing device having a display screen and configured to reproduce moving image content and display it on the screen. The reproducing means may be built in a personal computer, a tablet, a smartphone, a mobile phone, a mobile phone or the like, and is not particularly limited. It may have a voice output function in addition to the display function.

Regarding this position selection, more specifically, the place where the viewer recognizes by a click operation using a tablet, a mouse, a touch panel, a remote control, a keyboard, or the like, which constitutes the “position selection means” possessed by the viewer, is operated. A display position or display area, which is a part or the vicinity of the object in the video content of, is selected.

In addition, a special mark or special display indicating that a link destination exists as a corresponding object is displayed in the form of being overlapped with or adjacent to the object on the screen, or at a predetermined position on the screen. , May or may not be displayed separately.

In this way, when the display position or the display area is selected through the position selecting means on the screen, at least a part of the selected display position or area is determined by the determining means including the controller, the CPU, the memory and the like. , It is determined whether or not it is included in the range indicated by the preset range mark.

The range indicated by the range mark is determined from the position and shape of the range mark indicated by the position information held by the holding means in advance.

The position of the range mark is preferably a relative position to the entire image of the moving image content, but it need not be so. For example, it may be a relative position with respect to the entire screen of a display device, a display, etc. included in the reproducing means. In this case, the link destination specifying interface device previously generates and holds the position information according to the specifications and standards of the display device or the reproducing device, and the viewer interface device uses the position information according to the specifications and standards. You may be asked. Alternatively, in the interface device for designating the link destination, parameters indicating the specifications, standards, etc. of the display device or the playback device are generated and held in advance in a form associated with the position information, and the display position selected in the interface device for the viewer is selected. Alternatively, position adjustment may be performed on the area according to the parameter.

When the result of the determination by the determination means determines that the at least a part is included, for example, a display device, a display, a voice, etc., under the control of the link destination control means including a controller, a CPU, a memory, and the like. The content of the link destination is reproduced as a still image or a moving image in place of or in addition to the moving image content by the reproduction unit including an output device or the like. Here, the link destination is identified or indicated by the link destination identification information corresponding to the above position information (that is, corresponding to the range mark).

Therefore, when the viewer selects, on the screen, the vicinity of the object or the like that he or she visually recognizes, it becomes possible to reproduce the content of the link destination corresponding to the range mark, in other words, jump to the link destination. At this time, the range mark is associated with the desired link destination via the link destination identification information and the position information. Therefore, it is possible to jump to the link destination where the content provider intends to correspond to the object, that is, the desired link destination.

As a result, according to the first link destination designation interface device of the present embodiment, the position information and the link destination identification information, which are the link destination designation data created by the link destination designation interface device of the present embodiment, are used. Thus, the viewer who is playing the moving image content can jump to the desired link destination.
<12>
The second viewer interface device of the present embodiment is (i) a relative position of a desired range on the screen of the moving image content with respect to the entire image of the moving image content at each time within the reproduction time of the moving image content. Based on the positional information shown in association with each other, and (ii) the link destination identification information for identifying the desired link destination as the one corresponding to the desired range, the moving image content is selectively played back by the playback means. An interface device for a viewer for causing a linked content to be played in place of or in addition to playing the moving picture content, wherein a desired content is displayed on a screen where the moving picture content is played as a still image or a moving picture. Position selecting means capable of selecting a display position or area, and at least a part of the display position or area selected by the position selecting means is included in the desired range determined from the relative position indicated by the position information. Determining means for determining whether or not the link destination content is included, and when the determining means determines that the at least part is included, the content of the link destination indicated by the link destination identification information is replaced with the moving image content. In addition or in addition, a link destination control means for controlling the reproduction means is provided so as to reproduce a still image or a moving image.

The second viewer interface device of the present embodiment operates in substantially the same manner as the above-described first viewer interface device of the present embodiment.

Particularly in the second viewer interface device of the present embodiment, for example, when the aforementioned “range mark” is adopted, the “desired range” indicated by the range mark is held in advance by the holding means. It is determined from the location information. Here, the position indicated by the position information is a “relative position” with respect to the entire image of the moving image content.

That is, the "position in the desired range (positional information)" is displayed on the screen at each point in time, rather than being set as the position with respect to the screen actually displayed on the display means or the position within the screen. It is a relative position with respect to the entire image of the moving image content (that is, the entire image including the image portion not visible on the screen).

Therefore, the playback means (that is, the “screen” according to the present invention or the embodiment according to the present invention or the embodiment) that is used when the viewer selects the object in the video content by selecting the position or area on the screen. The object can be accurately or surely selected regardless of the specification, standard, attribute, aspect ratio setting, magnification setting, presence or absence of cutout display, etc.

In particular, according to the research conducted by the inventors of the present application, even if the same content is used, various aspect ratios and widths are provided for wide or normal large or small televisions, personal computers, mobile phones, smartphones, mobile phones, etc. According to the background art, it is complicated and difficult to realize such a mechanism for associating the link destinations with the reproducing unit or the displaying unit having different lateral magnifications and vertical magnifications or cutout portions. Alternatively, according to the background art, in order to correspond to such various reproducing means or display means, it becomes necessary to perform a complicated work of associating link destinations with each type.

However, according to the present embodiment, as long as the setting and moving operation of the desired range, such as the setting and moving operation of the range mark indicating the “desired range”, are appropriately performed, the viewer side Regardless of the type of playback means used, the object displayed in the video content and the link destination that should correspond to that object will not be displaced. Considering that the specifications, standards, types, etc. of the reproducing means are advancing day by day, it is very advantageous in practice that various reproducing means can be easily or directly supported.

As a result, according to the second viewer interface device of the present embodiment, the viewer is playing the video content using the position information and the link identification information, which are the data for specifying the link. It is possible to jump to a desired link destination.
<13>
In one aspect of the second viewer interface device of the present embodiment, the position information indicates a relative position of a range mark indicating the desired range with respect to the entire image area, and the link destination identification information indicates the range. The desired link destination is identified as corresponding to the mark, and the determination means determines whether the at least part is included in the range indicated by the range mark determined from the relative position indicated by the position information. Determine whether.

According to this aspect, the step of designating the link destination on the content provider side by adopting the “range mark” indicating the “desired range” as in the case of the first viewer interface device described above. Using the position information and the link destination identification information while increasing the efficiency and operability of each process and preventing the data volume from increasing at the stage of selecting a link destination on the viewer side, It becomes possible for the user to jump to a desired link destination while playing back the moving image content.
<14>
In another aspect of the second viewer interface device of the present embodiment, the position information is fixed in the angle of view, at least one of the four corners, the outer ring, or the entire region of the image, which is related to the entire region of the image. The relative position of the desired range with respect to a reference position is shown.

According to this aspect, the position information indicates, for example, the relative position of the range mark indicating the “desired range” with respect to the entire image area, and typically, the four corners of the entire image area of the moving image content are (0, 0) on the coordinates. ), (1,0), (1,1), and (0,1).

Therefore, it is possible to accurately or surely select an object regardless of the specifications and standards of the reproducing means used when the operation of selecting the object in the moving image content is performed by selecting the position or area. Problems such as displaying the content of a link destination related to an object other than the selected object are reliably prevented.
<15>
In another aspect of the second viewer interface device of the present embodiment, the link destination identification information is capable of identifying a plurality of link destination identification information related to a plurality of link destinations according to a plurality of types of input operations. Alternatively, or instead of or in addition to this, it is possible to identify a plurality of display forms related to the link destination by a plurality of types of input operations, and the determination means includes at least a part of the display. Whether or not the plurality of types of input operations are determined, the link destination control means determines the link destination identification according to the plurality of types of input operations determined by the determination means. The reproducing means is controlled so as to reproduce the still image or the moving image, instead of or in addition to the moving image content, the content of the link destination indicated by the information.

According to this aspect, for example, a plurality of types including one of a touch operation, a tap operation, a long press operation, a swipe operation, a slide operation, a drag device, a rotation operation, a zoom operation, a pinch operation, a stretch operation, a flick operation, and the like. The content of the link destination is reproduced as a still image or a moving image in place of or in addition to the moving image content according to the input operation. At this time, even if the same position or area is selected, reproduction control may be performed such that the link destinations are different according to different types of input operations. Alternatively, even when the same position or area is selected, reproduction control may be performed so that the same link destination has a different display form depending on a plurality of types of input operations.

As described above, different types of input operations are performed on the same object on the viewer side, so that different linked content can be displayed, or linked content can be displayed in different display modes.
<16>
In another aspect of the first or second viewer interface device of the present embodiment, the determination means includes at least a part of each time within the reproduction time associated with the position information. Or not.

According to this aspect, the reproduction in which at least a part of the display position or the display area selected on the screen by the determination unit is included in the range indicated by the range mark is associated with the position information. It is determined for each time in time.

“Each time” here means a case where the image frames forming the moving image content are regularly or continuously in a one-to-one or many-to-one fixed cycle, and when the image frames forming the moving image content are expressed. It is meant to include both an irregular cycle, an irregular case, and an intermittent case. In particular, the range mark that is found from the position information (specifically, from the temporal or spatial behavior of the electrical signal that is the source of the position information, such as the change in the value at each position, the generation frequency, and the generation time) This means that the determination frequency is reduced during the period when the range is not moved, and the determination operation is performed once for the period when the range is not moved. Alternatively, the determination frequency is increased during the period in which the range indicated by the range mark that is known from the position information is moved, and one determination operation is performed each time the range is moved (that is, the determination result is the same during the period in which the range is not moved). This is also intended to include the case where the determination operation is performed once).

In any case, once the moving image content is jumped to the linked content according to the selection of the display position or the display area, it is not necessary to perform the determination by the determining means for the moving image content thereafter.
<17>
In another aspect of the first or second viewer interface device of the present embodiment, the link destination control unit, when it is determined that the at least part is included, links the moving image content to the link destination. The reproducing means is controlled so as to be switched to the content and reproduced, and when the reproduction of the content of the link destination is completed, the reproducing means is controlled so as to reproduce the moving picture content from the time of switching.

According to this aspect, after jumping from a certain moving image content to the link destination once, when the reproduction of the jumping destination is completed, the moving image content before jumping to the link destination is reproduced again from the jumped place.
Therefore, for example, when playing a series of video content such as movies and dramas, the viewer can view the video content without excess or deficiency simply by interposing the viewing of the linked content. So convenient.

It should be noted that, for example, in the case of displaying the linked content in a window within the moving image content being viewed, it is also possible to adopt a configuration in which the linked content is played back while the moving image content is also played back.
<Computer program for viewer interface device>
<18>
The second computer program of the present embodiment causes the computer to function as the first or second viewer interface device according to the above-described embodiment (however, including various aspects thereof).

According to the second computer program of the present embodiment, a recording medium such as a ROM, a CD-ROM, a DVD-ROM, a hard disk or the like that stores the computer program, or a USB (Universal Serial Bus) memory that is detachable and attachable to a computer system. If the computer program is read from the model storage device and executed by the computer system, or if the computer program is executed by being downloaded to the computer system via, for example, communication means, the present embodiment described above is executed. The first or second viewer interface device (including various aspects thereof) according to the embodiment can be realized relatively easily.
<Recording medium>
The recording medium of this embodiment records the above-described first or second computer program of this embodiment.

According to the recording medium of the present embodiment, the first or the first embodiment of the present invention which is recorded by being attached to or connected to the computer system, or being inserted into an appropriate reading device provided or connected to the computer system. The second computer program can be read and executed by a computer system, and the above-described link destination designating interface device of the present embodiment and the first and second viewer interfaces can be realized relatively easily. ..

The operation and other advantages of the present embodiment will be made clear by the examples described below.

FIG. 3 is a block diagram of a link destination specifying interface device according to an embodiment. FIG. 3 is a block diagram of a viewer interface device according to an embodiment. FIG. 9 is a conceptual diagram showing a structure of link designation data generated by a link destination designation operation and used in a viewer interface device according to an embodiment. FIG. 3 is a conceptual block diagram showing a state in which a server device including a link destination designating interface device and a client device including a viewer interface device according to an embodiment are accommodated in a communication network. 7 is a flowchart (No. 1) showing the flow of an example of the operation of the interface device for designating a link destination according to the embodiment. 9 is a flowchart (No. 2) showing the flow of an example of the operation of the interface device for designating a link destination according to the embodiment. It is a flowchart (the 1) which shows the flow of the other example of operation|movement of the link destination designation|designated interface apparatus which concerns on an Example. It is a flowchart (the 2) which shows the flow of the other example of operation|movement of the link destination designation|designated interface apparatus which concerns on an Example. It is a flowchart which shows the flow of an example of operation|movement of the viewer interface device based on an Example. It is a conceptual diagram which shows the relationship between the moving image content, the data for link designation|designated, and reproduction time based on an Example. FIG. 7 is a conceptual diagram showing a state of one image for explaining the operation of the interface device for designating a link destination according to the embodiment. FIG. 9 is a conceptual diagram showing another image for explaining the operation of the link destination designation interface device according to the embodiment. FIG. 9 is a conceptual diagram showing another image for explaining the operation of the link destination designation interface device according to the embodiment. FIG. 9 is a conceptual diagram showing another image for explaining the operation of the link destination designation interface device according to the embodiment. FIG. 9 is a conceptual diagram showing another image for explaining the operation of the link destination designation interface device according to the embodiment. FIG. 9 is a conceptual diagram showing another image for explaining the operation of the link destination designation interface device according to the embodiment. FIG. 9 is a conceptual diagram showing another image for explaining the operation of the link destination designation interface device according to the embodiment. FIG. 9 is a conceptual diagram showing another image for explaining the operation of the link destination designation interface device according to the embodiment. FIG. 9 is a conceptual diagram showing another image for explaining the operation of the link destination designation interface device according to the embodiment. FIG. 9 is a conceptual diagram showing another image for explaining the operation of the link destination designation interface device according to the embodiment. FIG. 9 is a conceptual diagram showing another image for explaining the operation of the link destination designation interface device according to the embodiment. FIG. 9 is a conceptual diagram showing another image for explaining the operation of the link destination designation interface device according to the embodiment. FIG. 9 is a conceptual diagram showing another image for explaining the operation of the link destination designation interface device according to the embodiment. FIG. 9 is a conceptual diagram showing another image for explaining the operation of the link destination designation interface device according to the embodiment. FIG. 9 is a conceptual diagram showing another image for explaining the operation of the link destination designation interface device according to the embodiment. FIG. 9 is a conceptual diagram showing another image for explaining the operation of the link destination designation interface device according to the embodiment. FIG. 9 is a conceptual diagram showing another image for explaining the operation of the link destination designation interface device according to the embodiment. FIG. 9 is a conceptual diagram showing another image for explaining the operation of the link destination designation interface device according to the embodiment. FIG. 9 is a conceptual diagram showing another image for explaining the operation of the link destination designation interface device according to the embodiment. It is a conceptual diagram which shows the mode of one image for demonstrating operation|movement of the viewer side interface apparatus based on an Example. FIG. 8 is a conceptual diagram showing another image state for explaining the operation of the viewer side interface device in the example. FIG. 8 is a conceptual diagram showing another image state for explaining the operation of the viewer side interface device in the example.

First, with reference to the block diagram of FIG. 1, a basic configuration of a link destination specifying interface device according to an embodiment will be described. This device is used as a graphical user interface by a user of the device, which is a person who provides moving image content, such as an advertiser staff member, an advertising agency staff member, and a broadcasting station staff member.

In FIG. 1, the link destination specifying interface device 100 is configured to include a moving image reproducing device 101 with a link specifying function, an input device 110, and a display 120.

The input device 110 has, for example, a touch panel, a mouse, and the like. The display 120 includes, for example, a display such as a personal computer, a smart phone, and a tablet, and may be configured separately from the input device 110 or the video playback device 101 with a link designation function, or may be configured integrally.

The video playback device 101 with the link designation function inputs the data relating to the position and the like via the storage device 102 for storing the video data, the video playback unit 103 for playing back the video data from the storage device 102, and the input device 110. Of the position input unit 105, the storage device 106 that stores the link area information 1, 2,..., And the image display unit 107a that controls to display the image data on the display 120, and the range mark is displayed on the display 120 based on the link area information. The display control unit 107 includes an area information display unit 107b that performs control for displaying on the screen.

In the present example, an example of the “range designation unit” according to the present invention or the embodiment is configured to include the input device 110 and the position input unit 105. An example of the “range mark setting means” according to the present invention or the embodiment includes the area information display unit 107b. An example of the “moving operation means” according to the present invention or the embodiment includes the input device 110, the position input unit 105, and the area information display unit 107b. An example of the “link destination designating unit” according to the present invention or the embodiment includes the input device 110. An example of the “holding unit” according to the present invention or the embodiment is configured to include the storage device 106.

Next, the basic configuration of the viewer interface device according to the embodiment will be described with reference to the block diagram of FIG. This device is used as a graphical user interface by a user of the device, which is a viewer who views moving image content.

In FIG. 2, the viewer interface device 200 is configured to include a video playback device 201 with a link selection function, an input device 210, and a display 220.

The input device 210 has, for example, a touch panel, a mouse, and the like. The display 220 has, for example, a display such as a personal computer, a smart phone, and a tablet, and may be configured as a separate body from the input device 210 or the video playback device 201 with a link selection function, or may be configured integrally.

The video playback device 201 with a link selection function includes a communication unit 202, a content acquisition unit 203, a storage device 204 that stores video data and video correspondence information 205 (including link area information 1, 2, 3,...) And area information analysis. Display control of the display 220 including the unit 207, the transition information acquisition unit 208, the transition information extraction unit 211a and the transition information identification unit 211 including the region identification unit 211b, the video reproduction unit 212, the input gesture determination unit 213, and the video display unit 216a. A display control unit 216 for performing the above and a position input unit 218 are provided.

In this example, an example of the “position selection unit” according to the present invention or the embodiment is configured to include the input device 210 and the position input unit 218. An example of the “determination means” according to the present invention or the embodiment includes the area information analysis unit 207, the transition information identification unit 211, and the input gesture determination unit 213. An example of the “link destination control unit” according to the present invention or the embodiment includes the display control unit 216.

Next, with reference to the conceptual diagram of FIG. 3, the link destination specifying interface device 100 (see FIG. 1) according to the embodiment generates the image data and uses it in the viewer interface device 200 (see FIG. 2). A specific configuration of the link designation data will be described.

In FIG. 3, the link area information as an example of the “link designation data” according to the present embodiment is configured to include time information, time point information, coordinate information, gesture information, and transition information. Of these, the “coordinate information” constitutes an example of “position information” according to the present invention or the embodiment, and the “transition information” is an example of “link seat identification information” according to the present invention or the embodiment. I am configuring. Further, in the present embodiment, the “range mark” according to the present invention or the embodiment is a rectangular (rectangular) frame mark.

The “link area information” is information generated by the interface device for designating a link destination (see FIG. 1) as described in detail later, in response to generation/movement of a rectangular frame mark that is set and moved. The link area information is held in the storage device 106, then sent to the viewer interface device (see FIG. 2) via the Internet or the like as described later in detail, held in the storage device 204, and the link thereafter. This is information used for preselection.

The "time information" is, in seconds, the time elapsed after the frame mark corresponding to the link area information is set (in other words, the moving image content that was the target when the frame mark was set/moved). This is information indicating the time on the reproduction time axis. The time information is information indicating a variable length of time depending on whether or not the frame mark is moved. For example, for a time period when the frame mark is not moved or a small time period, the time information is 10 seconds. It is a value of information (“50S-60S” at the bottom in FIG. 3). On the other hand, for a time zone in which the frame mark has been moved or is large, the time information is a value of 2 seconds (“30S-32S” in the fourth row from the top in FIG. 3).

The "time point information" has a unit of second, and is a format in which the frequency changes with respect to each time information (in other words, according to the frequency with which the frame mark is moved), the timing at which the coordinate information is generated, That is, it is the information indicating the generation time of the coordinate information on the reproduction time axis of the moving image content.

The “coordinate information” is information indicating the relative position of the frame mark in the entire image of the moving image content. Moreover, in this example, since the frame mark is a rectangle or a rectangle, the outer ring shape including the position and size of the frame mark is determined only by the coordinates of the upper left corner and the lower right corner of the rectangle of the frame mark. Is relatively uniquely defined for the entire image of the moving image content.

More specifically, in the entire image of the moving image content, the upper left XY coordinate is (0.0, 0.0), the lower right XY coordinate is (1.0, 1.0), and the lower left XY coordinate is Is (0.0, 1.0), and the upper right XY coordinate is (1.0, 0.0).

For example, when the frame mark is set in the entire area of the image, the coordinate information includes two pieces of coordinate information of upper left coordinates (0.0, 0.0) and lower right coordinates (1.0, 1.0). do it. By using such coordinate information, the viewer interface device (see FIG. 2) can be controlled so that the link destination is selected regardless of which display position or area of the moving image content is selected.

For example, when the frame mark is set to the lower right quarter of the entire image, the coordinate information is set to the upper left coordinate (0.5, 0.5) and the lower right coordinate (1.0, 1.0). )And it is sufficient. By using such coordinate information, when the viewer interface device (see FIG. 2) selects the display position or area in the lower right quarter of the video content, the link destination is selected (other than that). Even if the display position or area within three quarters is selected, the link destination is not selected).

For example, when the frame mark is set in the right half of the entire image, the coordinate information is set to the upper left coordinate (0.5,0.0) and the lower right coordinate (1.0,1.0). Good. By using such coordinate information, when the viewer interface device (see FIG. 2) selects a display position or area in the right half of the moving image content, the link destination is selected (the other half is the left half). Even if the display position or area inside is selected, the link destination is not selected).

The “gesture” is information generated and held according to a plurality of types of input operations such as tap, swipe, and drag when a frame mark setting operation and a moving operation are performed.

For example, if the gesture here is “tap”, according to a predetermined rule, the viewer interface device 200 (see FIG. 2) is in the display position or area (that is, the frame mark) indicated by the corresponding coordinate information. When a "tap" is performed in the area corresponding to (1), it is possible to perform control so that the moving image content being reproduced is transitioned to another image.

For example, if the gesture here is “swipe”, according to a predetermined rule, the viewer interface device 200 (see FIG. 2) has a display position or area (that is, a frame mark) indicated by the corresponding coordinate information. When the "swipe" is performed in the area corresponding to (1), another image (still image or moving image) can be controlled to be displayed as a window for the moving image content being reproduced.

For example, if the gesture here is “drag”, according to a predetermined rule, the viewer interface device 200 (see FIG. 2) is in the display position or area indicated by the corresponding coordinate information (that is, the frame mark). When the "drag" is performed in the area corresponding to (1), it is possible to control to jump to the web page for the moving image content that is being reproduced, such as by displaying a window or switching all images.

Since the viewer interface device 200 (FIG. 2) is configured as described above, by using the link area information, for example, between 10 seconds and 15 seconds of the video content, somewhere in the video content. When the tap operation is performed with, the process of transitioning to another video can be executed. For example, if the swipe operation is performed in the lower right quarter of the moving image content for 15 to 20 seconds, the process of displaying the specific image prepared in advance can be executed. For example, when the drag operation is performed on the right half of the moving image content for 20 to 25 seconds of the moving image content, it is possible to execute the process of displaying a preset web page. For example, between 30 seconds and 32 seconds of moving image content, tap operations are performed in the area that moves from upper left to lower right without changing the size of the area where selection operations can be performed corresponding to the frame mark. Then, the process of transitioning to another video can be executed. For example, between 40 seconds and 42.5 seconds of the moving image content, the size of the area in which the selection operation can be performed corresponding to the frame mark extends from the upper left quarter to the entire image, and the swipe operation is performed in the area. When is performed, the process of displaying the specific image prepared in advance can be executed. For example, during 50 to 60 seconds of the moving image content, the area in which the selection operation can be executed corresponding to the frame mark is instantly dragged within the area changed from upper left to lower right at 55 seconds. When the operation is performed, a process of displaying a preset web page can be executed.

As described above, the "link area information" is linked to the coordinate information corresponding to the transition information and the time point information, and the system (for the display position and area, in particular) that may exist in the moving image content. Above, it is not tied at all. As a result of the series of operations by the user of the link destination specifying interface device 100 (see FIG. 1) that performs the link destination specifying operation while appropriately recognizing the existence of the object in the moving image content, the “link area information” is , Objects (particularly their display positions and areas).

Since the information indicating the presence or absence and the position of the object is not included in the link area information in any case, the link area information (particularly, the data generation work, the amount of data, the data structure, etc.) is the type of object, the movement, and the like. As shown in FIG. 3, it is generally simple, without depending on the speed, complexity, complexity, ambiguity, etc. This is a great advantage in practice.

Moreover, in the example shown in FIG. 3, the coordinate information is held or generated and held only when the coordinate information is changed (that is, only when the moving operation is performed on the frame mark). That is, since the link area information has time information in addition to the time information, it is not necessary to have time information, coordinate information, etc. for a time zone without time information. Therefore, it is not necessary to redundantly hold or generate and hold the coordinate information and the like having the same value, so that the amount of data can be prevented from increasing and the load in each process can be reduced.

Next, with reference to the block diagram of FIG. 4, regarding the overall configuration of a system including a server device including the interface device for specifying link destination illustrated in FIG. 1 and a client device including the interface device for viewer illustrated in FIG. ,explain.

In FIG. 4, the Internet 1000 includes a server device 500 including a link destination designating interface device 100 (see FIG. 1), a link destination content server device 600 that provides link destination content to the server device 500, and a server device 500. A video content server device 700 for providing video content and a plurality of client devices 1200 each including a viewer interface device 200 are housed.

The server device 500 is composed of, for example, a personal computer, a workstation, a mobile device, etc., and the optical disc 100d can be loaded therein. If a computer program that is stored in the optical disc 100d and causes the computer to execute each process (see FIGS. 5 to 8) related to the link destination designation on the content provider side as described in detail later is executed. The interface device 100 for specifying the link destination (see FIG. 1) can be realized relatively easily in the server device 500. Alternatively, such a computer program may be downloaded to the server device 500 via the Internet 100.

The client device 1200 is composed of, for example, a personal computer, a high-performance television, a mobile phone, a smart phone, etc., and the optical disc 200d can be mounted therein. If a computer program stored in the optical disc 200d and causing a computer to execute each process (see FIG. 9) relating to link destination selection on the viewer side, which will be described in detail later, is read and executed, the inside of the client device 1200 In addition, the viewer interface device 200 (see FIG. 2) can be realized relatively easily. Alternatively, such a computer program may be downloaded to the client device 1200 via the Internet 1000.

Next, referring to the flowcharts of FIGS. 5 and 6 together with FIGS. 1 to 4, the operation of the link destination designating interface device 100 having the basic configuration shown in FIG. 1 will be described together with its detailed configuration. At this time, of the conceptual diagrams relating to the operation of the link destination designating interface device 100 shown in FIGS. 10 to 18, the drawings related to the respective operations or steps described below are appropriately referred to.

In FIG. 5, first, the selection of which moving image content is designated as the link destination, that is, the operation of selecting the video data stored in the storage device 102 is performed via the input device 110 (step S11).

Next, the initial setting of the link area information (see FIG. 3) required each time the frame mark is set, that is, the operation related to the new addition of the area information is performed via the input device 110 (step S12). That is, the link area information that is initially empty is newly generated and stored in the storage device 106.

Next, the gesture and transition information (see FIG. 3) are set for the newly added link area information via the input device 110 (step S13). That is, in the storage device 106, the columns of the gesture and transition information for the frame mark to be set next are filled in the newly stored empty link area information.

Next, in the video reproducing unit 103, the work of advancing the selected video data by fast-forwarding, time-specified forwarding, etc. is performed until the video time when the link area information is generated (step S14).

Next, the video reproduced by the video reproduction unit 103 and the video display unit 107a is displayed on the display 120, and preferably, a still image is reproduced. In this state, the input device 110 and the position input unit 105 set the upper left coordinate and the lower right coordinate of the frame mark. At this time, the area information display unit 107b displays the frame marks during the setting work and at the time of the completion of the setting in a form superimposed on the image on the screen of the display 120. Finally, a frame mark having the size and position for which the setting is completed at the video time of the video displayed at this point is displayed in the screen of the display 120 in a form of being superimposed on the video ( Step S15).

Here, as shown in FIG. 10, for example, a video that is an example of “moving image content” according to the present invention or embodiment is a video time t (that is, video) that is an example of “playback time” according to the present invention or embodiment. It is composed of a plurality of frame images for the image time t) on the time axis. The x coordinate and the y coordinate are commonly defined for all frame images. According to the specifications, standards, etc. of the display 120, the general hand does not display the frame edge portion of the frame image in the form of being projected, or actively displays the frame image in the screen of the display 120. Only the part is displayed in a cutout form, or the aspect ratio is changed and displayed. However, particularly in the present embodiment, the x-coordinate and the y-coordinate are defined as relative positions of the frame video with respect to the entire image (that is, the entire image).

More specifically, as shown in FIG. 11, for example, the upper left corner of the entire image of the frame image is set to coordinates (0, 0), and the lower right corner of the entire image of the frame image is set to coordinates (1, 1). To be done. Therefore, the coordinates do not depend on the number of vertical and horizontal pixels or the vertical and horizontal scale ratio on the screen of the display 120. Further, the relationship with the display 220 (see FIG. 2) on the viewer side later does not depend on the number of vertical and horizontal pixels or the vertical and horizontal scale ratio in the screen of the display 220.

As shown in FIG. 12, for example, in step S15, at the video time t1, first, a video including a “face” is displayed by still image reproduction on the screen of the display 120. At this time, it is assumed that the "face" displayed on the screen by the user who operates the input device 110 while watching the screen of the display 120 is one "object" to which the link is attached.

As a result, when the user performs an input operation on the input device 110 while looking at the display 120, a rectangular frame mark surrounding the link area illustrated by the gray portion is set to surround the “face”.

At this time, the frame mark is represented by relative coordinates with respect to the entire area of the image of the image, and the upper left coordinate a1 (a1x, a1y) and the lower right coordinate b1 (b1x, b1y) uniquely correspond to the image time t1. Is set.

The “link area” according to the present embodiment is a partial area in the image where transition is performed when an action such as tapping, swiping, or dragging is actually performed in the viewer interface device later. The link area does not have to be visually displayed later on the viewer interface device, and is not displayed in this embodiment either. The “frame mark” according to the present embodiment is a frame mark that indicates, on the display 120, a region to which a transition is made when an action such as tap, swipe, or drag is subsequently caused in the interface device for designating a link destination. .. Simply, as shown in FIG. 12, it may be a rectangular frame-shaped mark that surrounds the entire rectangular link area. Such a frame mark is, for example, a thin red line or a thin fluorescent color line so that it can be visually recognized regardless of the content of the image, and is a frame to be displayed superimposed on the image within the screen of the display 120. Is displayed in.

For example, particularly in the present embodiment, the frame mark is configured to be expandable/contractible within the screen and movable in the vertical and horizontal directions through the input device 110, for example, by utilizing a zoom operation on the touch panel.

According to this structure, the user can easily specify the frame mark having an appropriate size while visually confirming the image and the stretchable frame mark superimposed on the image on the screen. After that, the frame mark indicating the range of the appropriate size may be moved and operated through the input device 110, which is convenient.

On the other hand, as shown in FIG. 13, for example, the frame mark is a frame-shaped mark surrounding an ellipse (that is, a gray area in the figure), and the link area is an ellipse (that is, a gray area in the figure). May be Also in this case, if the rule that the frame mark and the link area are elliptical inscribed in the rectangle is set in advance, the frame mark or the lower right coordinate of the rectangle shown by the dotted line in the figure can be used. The link area can be uniquely set for the video time t1.

In FIG. 13, the frame mark is set as a rectangular mark indicated by a dotted line in the figure (that is, while the rectangular frame mark is displayed on the display 120), and the frame mark has a different shape while having a predetermined relationship with the frame mark. That is, an elliptical link area may be set. As long as the rules are set in advance and the user of the interface device for designating the link destination is informed in this way, the shapes of the frame mark and the link area may be the same or different from each other, and each shape itself is arbitrary. However, the shape is not limited to a rectangle or a circle, and may be a polygon or the like.

In this way, the gesture and transition information set in step S13 are defined for the coordinate information indicating the frame mark or the link area (gray area in FIGS. 12 and 13). That is, a portion of the link area information (see FIG. 3) for the video time t1 is generated and filled.

In FIG. 5 again, the moving image reproduction of the video is started, and the frame mark moving operation is performed via the input device 110 in which the user watching the image on the display 120 performs the manual operation. When the moving image reproduction of the video is started, the moving operation of the frame mark and the recording of the coordinate information, the time information, and the time point information forming the link area information corresponding thereto are started (step S16).

For example, if the input device 110 is a mouse, such moving image reproduction and information recording may be started in response to the operation of pressing the left button. Alternatively, if the input device 110 is a touch panel, such moving image reproduction and information recording may be started in response to an operation of touching the screen of the display 120.

Further, it is determined whether or not the coordinate information from the position input unit 105 or the position signal which is the source of the coordinate information is updated in response to the user's operation of moving the frame mark on the display 12 (step S17). .. For example, if the input device 110 is a mouse or a touch panel, it is monitored whether or not it has been dragged.

If it is determined that the information has been updated (step S17: YES), the display by the area information display unit 107a is performed according to the change in the coordinate information input from the position input unit 105 or the position signal that is the source of the coordinate information. Under control, the frame mark is moved on the display 120. Typically, the user manually operates the input device 110 while seeing a moving object (for example, the face shown in FIG. 12) in a moving image being reproduced, so as to follow the movement of the object. The frame mark is moved.

In parallel with this, coordinate information indicating the display area of the frame mark is generated from the movement information from the position input unit 105, stored in the storage device 106 in association with time information and time point information at each video time t. (Step S18).

As described above, in this embodiment, the information recording is performed only when the movement operation of the frame mark is performed through the input device 110 (for example, the mouse or the touch panel is dragged), and the data amount is reduced. Enlargement is prevented in advance.

After the coordinate information is stored in step S18 or when it is determined that the coordinate information from the position input unit 105 has not been updated (step S17: NO), the process of FIG. 6 is performed.

Here, of the processes in steps S17 and S18, the case where the link area is not moved will be described with reference to FIGS. 14 and 15.

As shown in FIG. 14, for example, when the link area is not moved (that is, step S17: NO), the video time t3 at which the setting of the link area in the video is desired to be started is designated via the input device 110. This designation is performed using, for example, a standard IF (interface) of a smartphone device, which is an example of the input device 110, for designating time. For example, when the video time t3 is designated, the video is in a paused state. In that state, the upper left position a3 and the lower right position b3 of the frame mark are designated on the screen of the display 120 via the input device 110 such as a touch panel and a mouse. This operation is performed in the link area designation mode. When the upper left position a3 is specified, (a3x, a3y) is generated as the coordinate indicating it, and when the upper left position b3 is specified, (b3x, b3y) is generated as the coordinate indicating the position, and the area link information It is stored in the storage device 106 as a part of coordinate information.

Next, the link area recording mode is set, and, for example, after the touch panel that forms the input device 110 is tapped and the contact is maintained as it is, or the mouse that forms the input device 110 is clicked, Playback continues. In parallel with this, link area information (that is, coordinate information, time information, time point information, etc.) is generated.

As shown in FIG. 15, for example, at a video time t4 after the video time t3 shown in FIG. 14, the finger is released from the touch panel constituting the input device 110 (the touch is released) or the mouse click is released. To be done. Then, the video is stopped under the control of the display control unit 107. The frame mark at this time has been moved to the upper left position a4 and the lower right position b4. By these operations, the link area between the video times t3 and t4 at which the link area is desired to be set can be specified very effectively and practically.

It should be noted that while the speed of the original video is changed, while the video is played back (for example, fast forward playback or slow playback is performed), the operations related to the start, continuation, and end of such video playback are the same. Execution is possible, and by doing so, the link area can be specified more easily during the video time t3 to t4.

Here, of the processes in steps S17 and S18, the case where the link area is moved will be described with reference to FIGS. 16 to 18.

As shown in FIG. 16, for example, when moving a link area, an example in which a car runs through from left to right on the screen as an image is assumed here. At this time, the position of the automobile is position C5 at video time t5, position C6 at video time t6, and position C7 at video time t7. The video exists as a number of time-series frame videos continuously during the video time t5 to t8, but in this example, for convenience of explanation, a video content existing only at three time points (that is, three frames) is taken as an example. First, the case of moving the link area will be described.

As shown in FIG. 17, for example, as in the case of FIG. 14, the video time at which the setting of the link area in the video is to be started is designated via the input device 110. For example, when the video time t5 is specified, the video is temporarily stopped, and the upper left position c5a and the lower right position c5b of the frame mark are specified on the screen of the display 120 via the input device 110. This operation is performed in the link area designation mode.

Subsequently, the link area recording mode is set, and, for example, when the touch panel constituting the input device 110 is tapped or the mouse is clicked, the recording of the link area information is started at the video time t5. Further, for example, by continuously tapping the touch panel configuring the input device 110 or continuously clicking the mouse, link area information (that is, coordinate information, time information, time point information, etc.) is generated from the video time t5 to t6. Will be done.

As shown in FIG. 18, for example, the position of the automobile in the video on the screen of the display 120 is moved from the position c5 to the position C6 in response to the video time t5 to t6.
During the video time t5 to t6, by using the user's vision such as the touch panel being slid while being continuously tapped or the mouse being being moved while being clicked, by the user's manual operation of the input device 110. The frame mark follows the movement of the automobile on the screen of the display 120 by the manual operation of. Along with the movement of the frame mark, the coordinate information determined from the frame mark at each reproduction time is generated as a part of the link area information (see FIG. 3) together with the time information and the time point information.

As described above, according to the present embodiment, it is possible to continuously and simply specify the link area simply and practically by an operation utilizing the visual sense of the human being as a user without having to analyze the object in the video at all.

Subsequently, in FIG. 6, after the processing of step S17 or S18 of FIG. 5, the video reproducing unit 103 determines whether or not the reproduction position of the video currently being reproduced is the end (step S19). When the determination is made (step S19: NO), it is further determined whether or not the input of the coordinate information from the position input unit 105 or the position signal which is the source of the coordinate information is stopped (step S20). For example, if the input device 110 is a mouse, the determination here may be monitoring whether the left button is released. If the input device 110 is a touch panel, it may be monitored whether or not the user's hand is released from the touch panel.

If it is determined that the vehicle is not stopped (step S20: NO), the process returns to step S17 shown in FIG. 5, and the subsequent processes are repeatedly executed.

On the other hand, if it is determined in step S19 that the video reproduction position is at the end (step S19: YES) or if it is determined in step S20 that the video has been stopped (step S20: YES), it has been generated up to this point. The coordinate information is saved in the storage device 106 as link area information (see FIG. 3) together with the time information and the time point information (step S21).

Next, it is determined whether or not additional link area information is to be added to the storage device 106 to be generated and held (step S22). If it is to be added (step S22: YES), step S12 already shown in FIG. The process returns to and the subsequent processes are repeatedly executed.

On the other hand, when the link area information is not additionally generated and held (step S22: NO), the link area information (see FIG. 3) in which each item is properly filled is stored in the storage device 106 and the link destination is designated. A series of processing related to is completed.

As described above, the operation for generating and holding the link area information (see FIG. 3) is completed in the link destination specifying interface device (see FIG. 1).

As described above, according to the interface device 100 for designating the link destination of the present embodiment, the frame mark is changed to the manual operation of the user as the video time elapses due to the functions of the input device 110, the position input unit 105, and the like. According to the desired direction. Before or after this, or in parallel, the recording device 106 holds link area information including coordinate information, time point information, and the like. At this time, regarding the transition information that constitutes an example of the “link destination (link destination identification information)” according to the present invention or the embodiment, the frame mark or the coordinate thereof is not associated with the corresponding object on the system, without being associated with the corresponding object. It is associated with the link area information including the position. Therefore, advanced data processing such as image analysis such as object analysis and image recognition is not required.

As described above, according to this embodiment, the user of the interface device 100 for designating the link destination (that is, the person on the content provider side) can easily perform the work of designating the desired link destination for any video content. ..

Particularly in the present embodiment, the coordinate information forming the link area information is the coordinate information indicating the relative position of the frame mark or the relative position of the link area with respect to the entire image of the video content. Therefore, the user of the interface device 100 for designating the link destination can accurately or surely designate the link destination regardless of the specifications and standards of the display 120 used when performing the operation of designating the link destination.

In this embodiment, in particular, the frame mark is a frame mark having a rectangular shape that can be changed to a desired size at a desired position on the screen of the display 120 (see FIG. 12), which is very convenient in practice.

In the present embodiment, in particular, the frame mark is indicated by the coordinates of the two corners (that is, the upper left coordinate and the lower right coordinate) of the relative position of the frame mark with respect to the entire image as the relative position with respect to the entire image. From the viewpoint of the user who handles the visual and input devices 110, this brings the practical benefit of being visually understandable and easy to operate.

In this embodiment, in particular, the coordinate information is recorded during the period when the frame mark is moved, and the coordinate information having the same value may not be redundantly recorded during the period when the frame mark is not moved. Therefore, it is possible to efficiently avoid the enlargement of the data to be handled, without causing the original function to deteriorate.

In the present embodiment, in particular, a plurality of transition information relating to a plurality of link destinations can be input according to a plurality of types of input operations such as tap, swipe, and drag on the input device 110. Therefore, the viewer-side interface device 200 can easily construct an environment in which different linked content is displayed by performing different types of input operations for one object.

Next, another example of the operation of the link destination designating interface device 100 described with reference to FIG. 4 will be described with reference to the flowcharts of FIGS. 7 and 8. In the figure, the same steps as those in FIGS. 5 and 6 are designated by the same step numbers, and the description thereof will be appropriately omitted. At this time, of the conceptual diagrams relating to the operation of the link destination designating interface device 100 shown in FIGS. 19 to 23, the drawings associated with the respective operations or steps described below are referred to as appropriate.

7, steps S11 to S18 are performed as in FIG. 5, and steps S19 to S20 in FIG. 6 are performed as in FIG.

In FIG. 8, when the process of step S20 is completed (step S20: YES), whether or not to continue editing, that is, the video content for which the link area information has been generated until now is further processed. Whether to generate and hold the link area information is determined based on a command to that effect input through the input device 110 (step S201). For example, when two or more link areas are discontinuous on the video time axis for the same video content, the editing here is continued. Alternatively, when there are a plurality of objects in the video content and a plurality of link destinations respectively corresponding to them are specified, the editing here is continued.

When it is determined that the editing is to be continued (step S201: YES), the video is advanced to the position where the video to be further specified as the link destination is restarted (more specifically, the video reproduction. On the time axis, the playback position is advanced or returned). After that, the process returns to step S15 of FIG. 7, and the subsequent processes are repeatedly executed. That is, as the editing is continued, the transition destination or gesture is changed, the size of the frame mark is changed, or the initial position is changed by the operation of the input device 110 by the user, and the operation of moving the frame mark after the change is newly performed. Editing is continued by being executed in response to such objects.

When it is determined in step S201 that editing is not to be continued (step S201: NO), the processes of steps S21 to S23 are performed as in FIG. 6, and the series of processes related to link destination designation is completed.

Here, of the processes including steps S201 and S202, a case where the link area is discontinuous and designated in two times will be described with reference to FIGS. 19 to 23.

As shown in FIG. 19, for example, an example in which a car runs through from left to right on the screen as an image is assumed here. At this time, the position of the automobile is the position C8 at the video time t8 (see FIG. 20), the position C9 at the video time t9 (see FIG. 21), and the position C11 at the video time t11 (see FIG. 22), The position is C12 at the video time t12 (see FIG. 23). The video is continuously present as a number of time-series frame videos during the video time t8 to t9, during the video time t9 to t10, during the video time t10 to t11, and during the video time t11 to t12. However, in this example, for the sake of convenience of description, the case where the link area is moved will be described taking the video content existing only at five time points (that is, five frames) as an example.

As shown in FIG. 20, for example, as in the case of FIG. 14, the video time at which the setting of the link area in the video is desired to be started is designated via the input device 110. For example, when the video time t8 is specified, the video is temporarily stopped, and the upper left position c8ax and the lower right position c8by of the frame mark are specified on the screen of the display 120 via the input device 110. This operation is performed in the link area designation mode.

Subsequently, the link area recording mode is set, and, for example, when the touch panel constituting the input device 110 is tapped or the mouse is clicked, the recording of the link area information is started at the video time t8. Further, for example, by continuously tapping the touch panel constituting the input device 110 or continuously clicking the mouse, link area information (that is, coordinate information, time information, time point information, etc.) is generated from the video time t8 to t9. Will be done.

As shown in FIG. 21, for example, the position of the automobile in the image on the screen of the display 120 is moved from the position C8 to the position C9 in response to the image time t8 to t9.
During the video time t8 to t9, by the user's visual operation such as the touch panel being slid while being continuously tapped or the mouse being being moved while being clicked, by the user's manual operation of the input device 110. The frame mark follows the movement of the automobile on the screen of the display 120 by the manual operation of. Along with the movement of the frame mark, the coordinate information determined from the frame mark at each reproduction time is generated as a part of the link area information (see FIG. 3) together with the time information and the time point information.

Further, the display 120 is displayed under the control of the display control unit 107, for example, by an operation via the input device 110 such as a user releasing a touch on the touch panel or releasing a mouse click. The video is paused. At this time, the frame mark may be displayed as it is, may be temporarily erased, or the display mode may be changed.

Then, as shown in FIG. 22, for example, the image is in the pause state at the image time t9. In this state, when the video time T11 is designated as the video to be played back by the input device 110, the video after the automobile discontinuously or instantaneously moves to the position C11 under the control of the video playback unit 103 is played back. To be done. Then, the link area recording mode is changed again. In this link area recording mode, for example, when the touch panel constituting the input device 110 is tapped or the mouse is clicked, the recording of the link area information is started at the video time t11. Furthermore, for example, by continuously tapping the touch panel constituting the input device 110 or continuously clicking the mouse, link area information (that is, coordinate information, time information, time point information, etc.) is generated from the video time t11 to t12. Will be done.

Subsequently, as shown in FIG. 23, for example, the position of the automobile in the image on the screen of the display 120 is moved from the position C11 to the position C12 in response to the image time t11 to t12. During the video time t11 to t12, by using the user's vision such as the touch panel being slid while being continuously tapped or the mouse being being clicked and moved by a manual operation by the user. The frame mark follows the movement of the automobile on the screen of the display 120 by the manual operation of. Along with the movement of the frame mark, the coordinate information determined from the frame mark at each reproduction time is generated as a part of the link area information (see FIG. 3) together with the time information and the time point information.

As described above with reference to FIGS. 20 to 23, according to the present embodiment, the link areas are discontinuously discontinuous on the video time axis between the video times t8 to t9 and the video times t11 to t12. Is set. At this time, the playback time t9 to t11 can be a time when the link area is not set. Moreover, according to the present embodiment, the coordinate information is not generated between the reproduction times t9 and t11. That is, in order to specify a desired link destination, unnecessary data is prevented from being generated, or unnecessary data is not taken into the link area information, so that the data amount as a whole is enlarged. It can be prevented.

As described above, the operation of generating and holding the link area information (see FIG. 3) in the link destination specifying interface device (see FIG. 1) shown in the flowcharts of FIGS. 7 and 8 is completed. In the present embodiment, particularly when the same video content has two or more link areas which are discontinuous on the video time axis, the link area information (see FIG. 3) is efficiently generated and held. It is possible and practically very convenient.

Next, with reference to FIG. 24 to FIG. 28, the link area or the size of the frame mark, which is appropriately executed by the user interface device for designating the link destination according to the present embodiment, is generated as the link area information during the video reproduction. A description is added about the case of changing during the work.

As shown in FIG. 24, for example, as in the case of FIG. 14, the video time at which the setting of the link area in the video is desired to be started is designated via the input device 110. For example, when the video time t13 is specified, the video is temporarily stopped, and the upper left position c13a and the lower right position c13b of the frame mark are specified on the screen of the display 120 via the input device 110. This operation is performed in the link area designation mode.

Then, the link area recording mode is set, and, for example, when the touch panel constituting the input device 110 is tapped or the mouse is clicked, the recording of the link area information is started at the video time t13. Further, for example, by continuously tapping the touch panel configuring the input device 110 or continuously clicking the mouse, link area information (that is, coordinate information, time information, time point information, etc.) is generated from the video time t13 to t14. Will be done.

After that, as shown in FIG. 25, for example, the position of the automobile in the image on the screen of the display 120 is moved from the position c13 to the position c14 in response to the image time t13 to t14. At that time, at the video time t13, for example, the touch panel constituting the input device 110 is tapped or the mouse is clicked, and further, while the contact (click) is maintained, the tap position or the click position is adjusted to the car in the video. Slide or move. By these operations, the coordinates c14a and the coordinates c14b are recorded at the video time t14. After that, at the video time t14, when the touch on the touch panel is released or the mouse click is released, the video is paused. That is, the still image is temporarily reproduced.

Subsequently, as shown in FIG. 26, for example, at the video time t14, the upper left position and the lower right position of the frame mark are changed with respect to the video being reproduced as a still image by the same operation as in FIG. That is, the area and shape of the link area are changed. In the examples shown in FIGS. 25 to 26, the lower right coordinate is moved to the lower right while the upper left coordinate of the frame mark or the link area is fixed, and the size is increased.

After that, as shown in FIG. 27, for example, at the video time t14, the moving image reproduction is restarted, that is, the link area recording mode is restarted. For example, when the touch panel constituting the input device 110 is tapped or the mouse is clicked, the recording of the link area information is restarted at the video time t14.

Further, as shown in FIG. 28, for example, by continuously tapping the touch panel constituting the input device 110 or continuously clicking the mouse, link area information (that is, coordinate information, time information, Time point information, etc.) is generated. At this time, the link area information is generated by the frame mark whose size and shape are changed in FIG.

As described above with reference to FIGS. 24 to 28, according to the present embodiment, the size of the link area is changed at the video time t14 which is in the middle of the video time t13 to t15. That is, it is possible to appropriately set the size of the link area even when the size of the object existing in the image is changed in the middle of the image as is generally the case. In addition, it can be executed through a simple operation on the input device 110, which is very convenient in practice.

Further, as shown in FIG. 29, for example, in the present embodiment described above, a plurality of objects appear in the same video content at the same time or in parallel, and a mechanism for separately linking to each of them is provided. The construction can also be executed by the link destination designation user interface device 100. That is, the operation of the link area recording mode via the input device 110 by the user may be performed on a plurality of occasions corresponding to a plurality of objects.

More specifically, the process of step S15 shown in FIG. 5 or 7 is performed a plurality of times, and at the video time t16, the coordinates d16a and d16b that specify one link area and the coordinates that specify another link area. d16c and coordinates d16d may be designated, and two frame marks (that is, two link areas) may be set.

In this case, the setting of the frame mark (that is, the process of step S15, etc.) may be performed for the same video image that is being reproduced as a still image for a plurality of pieces of link area information, or a plurality of pieces of link area information may be generated. This may be performed for video contents that are being reproduced as different still images with respect to the generation of link area information. In the example of FIG. 29, the case where two link areas are designated is shown, but it is also possible to designate three or more link areas according to the content of the video content by the same operation.

As described above, according to this embodiment, the environment for allowing the viewer interface device 200 to select a plurality of link destinations in one video content later can be easily constructed by the link specifying interface device 100. It is convenient.

Next, referring to the flowchart of FIG. 9 together with FIGS. 1 to 4, the operation of the viewer interface device 200 having the basic configuration shown in FIG. 2 will be described together with its detailed configuration.

In FIG. 9, first, the content acquisition unit 203 acquires the video data via the communication unit 202, and the link area information (see FIG. 3) is stored in the storage device 204 together with the video data (step S101). .. The acquisition here is performed, for example, via the Internet as shown in FIG.

The video correspondence information 205 according to the present embodiment includes a plurality of pieces of link area information 1, 2,... And has been previously generated and held by the link destination designation device 100. When the image correspondence information is acquired, the area information analysis unit 207 analyzes the coordinate information (see FIG. 3) of each link area information forming the image correspondence information. That is, each link area previously designated by the link destination designation interface device 100 is specified.

In parallel or before or after this, the transition information acquisition unit 208 acquires transition information (see FIG. 3) of each link area information. That is, the link destination (specifically, other video, Web page, specific image, etc.) of each link area previously specified by the link destination specifying interface device 100 is specified.

From these, it is clarified by the information acquisition and information analysis here how the content provider has pasted the link destination. The process relating to the video correspondence information in step S101 may be automatically executed by the viewer interface device 200 in accordance with the acquisition of the video data without the viewer being aware of it.

Next, the video reproduction is started before or after the acquisition of the video data and the link area information (step S102). Specifically, the video data as time-series data is reproduced by the video reproduction unit 212 and reproduced on the display 220 under the control of the video display unit 216a.

During this video reproduction, it is monitored whether or not a predetermined operation in the input device 210 is performed on the video portion defined by the link area region analyzed and identified in step S101 among the displayed video. (Step S103).

More specifically, at each time of the video time, the behavior (that is, temporal and spatial change) of the operation signal indicating the presence or absence of the operation, the operation position, and the like from the input device 210 via the position input unit 218. Based on this, the input gesture specifying unit 301 specifies which kind of predetermined operation among taps, swipes, drags, etc. has been performed (or no operation has been performed). In parallel with this, or before or after this, the reproduction time identifying unit 302 identifies at what timing such a predetermined operation is performed based on the behavior of the operation signal. In parallel with this, or before or after this, based on the behavior of the operation signal, the area search unit 303 identifies which image portion the predetermined operation has been performed. When a valid predetermined operation is performed, the transition information extraction unit 211a extracts the transition information related to the valid predetermined operation and passes it to the transition information acquisition unit 208 so that the corresponding transition operation is performed. ..

When it is determined that no gesture is performed (step S103: NO), the monitoring in step S103 is repeatedly continued unless the reproduction of the image ends (step S107: NO).

Corresponding to the case where the gesture or operation performed by the viewer on the input device 210 is “video”, that is, “play a specified video” according to a preset rule in the monitoring in step S103. If it is determined that the image is present, the process proceeds to step S104, and under the control of the display control unit 216, the image reproduced on the display 220 is switched to the image designated by the image (step S104). Furthermore, the process returns to step S101, and the subsequent processing is repeated in the same manner. At this time, the video designated by the video (that is, a video different from the video that has been played so far) is indicated by the transition information included in the link area information, and the transition information acquisition unit 208 has already performed the transition (step S102). Since it has been acquired, it is possible to switch images quickly or instantaneously.

Corresponding to the case where the gesture or operation performed by the viewer on the input device 210 in the monitoring in step S103 is “Web”, that is, “displaying a Web page” according to a preset rule. If it is determined that the web page is displayed, the process proceeds to step S105, and the video reproduced on the display 220 is switched to the display of the Web page under the control of the display control unit 216 (step S105). Then, it progresses to step S107. At this time, the display of the Web page is indicated by the transition information included in the link area information, and has already been acquired by the transition information acquisition unit 208 (in step S102). Can be displayed.

When the gesture or operation performed by the viewer on the input device 210 is the “image”, that is, the “image display”, which is the specific image according to the preset rule, in the monitoring in step S103. When it is determined that they correspond, the process proceeds to step S106, and the video reproduced on the display 220 is switched to the display of the image under the control of the display control unit 216 (step S106). Then, it progresses to step S107. At this time, the display of the image is indicated by the transition information included in the link area information, and has already been acquired (at step S102) by the transition information acquisition unit 208, so that the image can be displayed quickly or instantaneously. It is possible.

In any case, when it is determined in step S107 that the reproduction of the video has ended, the series of processes according to the present embodiment ends.

In the present embodiment, under the control of the display control unit 216, (i) reproduction of another image through step S104, (ii) reproduction of a web page through S105, and (iii) step S106. When the display of the image is finished, the video content that was originally started to be played back in step S102 may be played back in a form of being restarted from the switching point. With such a configuration, for example, when playing a series of meaning video contents such as movies and dramas, the viewer only needs to intervene to view the linked content, and It is convenient because you can watch it without any shortage.

Alternatively, at least one of (i) reproduction of another video through step S104, (ii) reproduction of a web page through S105, and (iii) display of an image through step S106 is initially performed in step S102. Alternatively, a configuration may be adopted in which a window is displayed in the video content that has been started to be played back (a configuration in which the video content that has been played back from the beginning is continuously played).

As described above, according to the present embodiment, by using the link area information previously generated by the link destination designating interface device 100 (see FIG. 1), the viewer interface device 200 (see FIG. 2) can be used to display the image. It is possible to jump to a desired link destination while reproducing the content.

Particularly, in the present embodiment, the operation of selecting an object in the video content is performed on the viewer side by, for example, the specifications, standards, etc. of the display 220 that is used by the viewer for various purposes, or the enlargement/reduction of the display or the cutout of the display. It can be done accurately or surely. This point will be further described with reference to FIGS. 30 to 32.

That is, as shown in FIG. 30, at the stage of reproducing after designating the link area information, even if the angle of view Xz at the time of recording is changed to A times and Yz is changed to B times, the upper leftmost point of the image is displayed. There is no change in treating the coordinates as coordinates (0, 0) and the lower right corner as coordinates (1, 1).

Therefore, as shown in FIG. 31, the two coordinates aa3 and b3 that determine the link area at the time of reproduction are calculated based on the ratio information when the maximum of each of the x axis and the y axis is 1. Therefore, even if the image is “enlarged” or “reduced” in the x-axis and y-axis at the same size during playback, even if the scale is changed to a horizontally-long or vertically-long image by changing the x-axis and y-axis to different magnifications , The area to be set as the link area at the time of recording can be kept at the time of reproduction.

Further, depending on the specifications of the display 220 (especially in the case of a small display), only the portion near the center of the image is cut out and displayed or reduced. At this time, for example, even if the image on the display 110 on the content provider side performing the link designation operation is the standard image (see FIG. 29), on the reduced or cutout image on the display 220 on the viewer side shown in FIG. 32, For each of the plurality of link areas, the link destination intended to correspond to the object the viewer intends to select is accurately displayed.

As described above, according to the present embodiment, the video content can be jumped to a desired link destination during playback regardless of the type of the display 220 used in the viewer interface device 200, which is very convenient in practice. ..

By its nature, it is basically desirable for viewers to provide a wide variety of link destinations that take into account the latest situation, rather than obsolete link destinations. While watching as many versatile video contents as possible (especially, ordinary programs, movies, dramas, etc. that can be enjoyed without being aware of the link), it is sometimes desirable to be able to jump to the link destination flexibly. Moreover, it is a reality that a wide variety of displays are used on the viewer side.

According to the present embodiment described in detail above, the content provider side can easily or inexpensively specify the link destination, and the viewer side can obtain a desired (including the latest link destination) on the video content. It is possible to realize an environment in which you can fly to a link with a high degree of freedom.

The present invention is not limited to the above-described embodiments or examples, and can be appropriately modified within the scope of the gist or concept of the invention that can be read from the claims and the entire specification, and a link accompanied by such modification The designation interface device, the viewer interface device, and the computer program are also included in the technical scope of the present invention.

100... Interface device for link designation, 101... Video playback device with link designation function, 110... Input device, 120... Display, 200... Interface device for viewer, 201... Movie playback device with link selection function, 210... Input device, 220... Display

Claims (5)

Range specifying means capable of specifying a desired range within a screen where the video content is being played back as a still image or video,
Range mark setting means for displaying a range mark indicating the range designated by the range designating means on the moving image content in the screen,
A moving operation means capable of moving the range mark in a desired direction as the reproduction time of the moving image content elapses in a screen where the moving image content is being reproduced as a moving image;
Link destination input means capable of inputting link destination identification information for identifying a desired link destination, as corresponding to the range mark,
(I) Link destination identification information input by the link destination input means, and (ii) holding means for holding position information indicating the position of the range mark in association with each time within the reproduction time,
The range designating unit is configured to be capable of designating the desired range by a frame that is expandable and contractable within the screen and has a predetermined shape in accordance with a predetermined type of designation operation,
The moving operation means is configured to move a frame mark indicating the frame as the range mark on the screen,
The range mark setting means can further display the range mark on the moving image content in a screen where the moving image content is being played back as a still image or in stop motion or in slow motion.
The movement operation means is further capable of moving the range mark in a desired direction within a screen in which the range mark is superimposed and displayed on the moving image content being played back in the still image, stop motion or slow motion. ,
The link destination input means is further capable of inputting the link destination identification information as corresponding to the range mark displayed over the still image reproduction or stop motion or moving image content being slow reproduced,
The holding means further lowers the frequency of holding the position information relatively during the period when the range mark is not moved within the screen, and during the period when the range mark is moved within the screen, An interface device for designating a link destination, which relatively increases the frequency of holding the position information. The holding unit holds, as the position information, one position information that is invariable as the position information with respect to the non-moving period, and one position information is stored every time the range mark is moved within the screen. The interface device for designating a link destination according to claim 1, wherein the interface device for designating the link destination is held one by one. The range mark setting means can further display the range mark on the moving image content in a screen where the moving image content is being played at high speed.
The movement operation means is further capable of moving the range mark in a desired direction within a screen in which the range mark is displayed over the high-speed reproduced moving image content,
The link destination input means is further capable of inputting the link destination identification information corresponding to the range mark displayed overlaid on the moving image content being played at high speed. The interface device for designating a link destination according to claim 1. The range designating unit is configured to be able to designate the desired range by expanding and contracting the four corners of the rectangle displayed in the screen,
The interface device for designating a link destination according to claim 1, wherein the movement operation means is configured to move a frame mark indicating the rectangular frame as the range mark on the screen. A computer program that causes a computer to function as the link-designating interface device according to claim 1.

Images