WO2016043238A1

WO2016043238A1 - Content reproduction device, content reproduction method and program

Info

Publication number: WO2016043238A1
Application number: PCT/JP2015/076351
Authority: WO
Inventors: 仙場　祐二
Original assignee: ヤマハ株式会社
Priority date: 2014-09-19
Filing date: 2015-09-16
Publication date: 2016-03-24
Also published as: JP2016063471A

Abstract

In the present invention, a content reproduction device is provided with: a reproduction unit that has a display screen and that reproduces first content, which is a movie, and displays the first content on the display screen; a designation detecting unit that detects a designated position on the display screen designated by a user; and a control unit that causes the reproducing unit to reproduce a second content, which is an image related to the object or the scene that is being displayed at the detected designated position.

Description

Content reproduction apparatus, content reproduction method, and program

The present invention relates to a content reproduction apparatus, a content reproduction method, and a program for effectively reproducing advertisement content in parallel with reproduction of main content such as television broadcasting.
This application claims priority based on Japanese Patent Application No. 2014-191484 for which it applied to Japan on September 19, 2014, and uses the content here.

In television broadcasting, advertising content (advertising video) is broadcast for about one to several minutes between main content which is a television program. Viewers often leave the television while the advertisement is being broadcast. For this reason, advertising was not effective. In addition, since the advertisement being broadcast is not necessarily an advertisement for a product related to the content of the main content, the advertisement often does not attract the viewer's interest.

Patent Document 1 discloses an advertisement providing system that acquires and displays an advertisement video corresponding to a viewing history from the Internet based on the user's viewing history.

Japanese Unexamined Patent Publication No. 2014-093695

However, the advertisement providing system disclosed in Patent Document 1 stores a viewing history for each viewing time, and selects an advertisement video based on the stored content. This system does not select an advertisement video according to the current interest of the user (viewer). For this reason, the advertisement by the system disclosed in Patent Document 1 has not replaced the current television advertisement.

An example of the object of the present invention is to provide a content reproduction apparatus, a content reproduction method, and a program capable of efficiently displaying a video (for example, an advertisement) corresponding to a user's interest.

A content reproduction apparatus according to an embodiment of the present invention has a display screen, reproduces the first content that is a moving image, and displays the first content on the display screen, and the display specified by the user A designation detection unit that detects a designated position on the screen; and a control unit that causes the reproduction unit to reproduce the second content that is an image related to the object or scene displayed at the detected designated position.

A content reproduction method according to an embodiment of the present invention is a content reproduction method for a content reproduction apparatus having a display screen, wherein the first content that is a moving image is reproduced and the first content is displayed on the display screen. , Detecting a specified position on the display screen specified by the user, and reproducing the second content that is an image related to the object or scene displayed at the detected specified position.

A program according to an embodiment of the present invention causes a content playback device having a display screen to play back the first content that is a moving image and display the first content on the display screen, on the display screen specified by the user. The designated position is detected, and the second content that is an image related to the object or scene displayed at the detected designated position is reproduced.

According to an embodiment of the present invention, a user is interested by displaying a video (for example, an advertisement) related to an object or scene displayed at a specified position on a display screen specified by the user. Images can be displayed efficiently.

It is a figure which shows the structure of the broadcasting system with which embodiment of this invention is applied. It is a block diagram which shows the television receiver of the broadcast system shown in FIG. It is a schematic diagram which shows the example of the television program displayed on the display of the television receiver shown in FIG. It is a schematic diagram which shows the example of the advertisement image | video of the television program displayed on the display of the television receiver shown in FIG. It is a schematic diagram which shows the example of the television program displayed on the display of the television receiver shown in FIG. It is a schematic diagram which shows the example of the advertisement image | video of the television program displayed on the display of the television receiver shown in FIG. It is a figure which shows the display thing table contained in the memory | storage part of the television receiver shown in FIG. It is a figure which shows the gaze detection part of the modification of the television receiver of the broadcast system shown in FIG. It is a figure which shows the flowchart which shows operation | movement of the control part of the television receiver of the broadcast system shown in FIG.

A broadcasting system to which an embodiment of the present invention is applied will be described with reference to the drawings. FIG. 1 is a configuration diagram of a broadcasting system. The broadcast system includes a television receiver 1, a broadcast station 10, and an advertisement server 11. The broadcast system and the television receiver 1 may be an example of a content reproduction device. The broadcast station 10 may be an example of a first content supply unit. The advertisement server 11 may be an example of a second content supply unit. The broadcast station 10 is a digital terrestrial broadcast station. The broadcasting station 10 uses one frequency band divided into 13 segments in the UHF (ultra high frequency) band, and one program of high definition (HD: high definition) or two programs of normal image quality (SD: standard definition). Broadcast. The television receiver 1 is a device that receives and reproduces a television broadcast broadcast by the broadcast station 10. The television receiver 1 has a function of receiving a television broadcast. The television receiver 1 is connected to the recording unit 3 and the pointing detection unit 2. The television receiver 1 may incorporate a recording unit 3 and a pointing detection unit 2.

When an object or scene of interest (hereinafter referred to as a display object) is displayed during playback of a TV program (first content), the user (viewer) uses an infrared remote control device 4. The display object is designated (pointed). When the television receiver 1 detects pointing by the user, the television receiver 1 determines to which display object of the video being played is pointing. Furthermore, the television receiver 1 reproduces an advertisement video (second content) related to the determined display object. The advertisement video may be stored in advance in the television receiver 1 or the recording unit 3. The advertisement video may be acquired from the Internet 12 or the like each time. Information indicating the display object displayed at the coordinates on the pointed screen is stored in the display object table of the television receiver 1. The television receiver 1 acquires the display object table via the television broadcast or the Internet 12.

The television receiver 1 is connected to the advertisement server 11 via the Internet 12. The television receiver 1 acquires an advertisement video from the advertisement server 11 or the broadcast station 10. Regardless of the television program that is the first content, the television receiver 1 may acquire an advertisement video and record it in the recording unit 3 periodically, for example. When the advertising video is designated, the television receiver 1 may access the advertising server 11 and acquire the advertising video. When broadcasting two programs with normal image quality, the broadcast station 10 may broadcast a television program as the first content as the first program and an advertisement video as the second content as the second program. . Each advertisement video is about 15 seconds. Therefore, 40 advertising videos can be broadcast (transmitted) in 10 minutes. In this case, the television receiver 1 may record the advertisement video in the recording unit 3 and reproduce the designated advertisement video.

The pointing detection unit 2 detects the direction of the infrared remote control device 4 operated by the user. The pointing detection unit 2 may be an example of a designation detection unit. The infrared remote control device 4 has a pointing button 4A. The infrared remote control device 4 transmits a predetermined pointing signal when the pointing button 4A is turned on by the user. When receiving a pointing signal from the infrared remote control device 4, the television receiver 1 (that is, the pointing detection unit 2) detects the direction of the infrared remote control device 4 at that time. The television receiver 1 (that is, the pointing detection unit 2) detects which position of the display 1A of the television receiver 1 is pointed based on the detected orientation. As a method for detecting the pointing position by the infrared remote controller 4, for example, a method disclosed in Japanese Patent Application Laid-Open No. 2007-256100 may be used, but the method is not limited to this method. The present application incorporates the contents of US Pat. No. 7,831,064 corresponding to Japanese Unexamined Patent Publication No. 2007-256100. The infrared remote control device 4 has functions such as channel switching and volume adjustment in addition to the pointing function.

FIG. 2 is a block diagram of the television receiver 1. The television receiver 1 includes a control unit 20, a tuner (television broadcast tuner) 21, an image processing unit 22, a display unit 23, a storage unit 25, a remote control reception unit 26, and an Internet communication unit 27. The tuner 21 receives a television broadcast broadcast in the UHF band and decodes a video signal and an audio signal. The image processing unit 22 inputs the video signal decoded by the tuner 21 to the display unit 23 or records (records) it in the storage unit 25. The image processing unit 22 reproduces the video signal recorded in the storage unit 25 as necessary. The operation of the image processing unit 22 will be described later. The display unit 23 develops the video signal input from the image processing unit 22 and displays it on the display (display screen) 1A.

The storage unit 25 includes a hard disk drive or the like, and stores a video signal (video data) and a display object table 25A. The remote control receiving unit 26 receives and decodes the infrared signal transmitted from the infrared remote control device 4. Further, when receiving a pointing signal, the remote control receiving unit 26 detects the direction in which the infrared remote control device 4 is facing and notifies the control unit 20 of the detected direction. The Internet communication unit 27 communicates with the advertisement server 11 via the Internet 12, and acquires an advertisement video file, a display object table 25A, and the like. The display object table 25A may be included in the broadcast wave. In this case, the image processing unit 22 may extract the display object table 25 </ b> A from the broadcast wave and store it in the storage unit 25.

The pointing detection unit 2 shown in FIG. 1 is realized as a partial function of the remote control reception unit 26. The recording unit 3 illustrated in FIG. 1 is realized as a function in which the image processing unit 22, the storage unit 25, the control unit 20, and software cooperate.

The advertisement video may be reproduced on the display 1A in full screen. A small window may be displayed in the display 1A, and an advertisement video may be displayed in the small window. When displaying the advertising video on the full screen, the image processing unit 22 reproduces the advertising video while recording the television program (first content) received by the tuner 21 in the storage unit 25. After the advertisement video is reproduced, the image processing unit 22 reads and reproduces the video signal of the television program recorded in the storage unit 25 and records the video signal of the television program received by the tuner 21 in the storage unit 25. That is, the image processing unit 22 performs delayed playback using a FIFO (first in, first out). When displaying the advertising video in the small window, the image processing unit 22 creates a small window area for the advertising video in the video of the television program reproduced at that time, and displays the advertising video in that area.
As a specific example, as shown in FIG. 3A, a case where the display 1A displays a coffee cup placed on a table as an image of a TV broadcast drama program (an example of a TV program) will be described. In this case, when the coffee cup is pointed, as shown in FIG. 3B, a coffee package that is an advertisement image related to the coffee cup is displayed.
As another specific example, as shown in FIG. 4A, a case will be described in which a display 1A displays a scene of a competition as a video of a TV broadcast drama program (an example of a TV program). In this case, when the player or the track is pointed, as shown in FIG. 4B, the wear, which is an advertisement video related to the student race, is displayed in the small window.
In the example shown in FIGS. 3B and 4B, the advertisement image displayed on the display 1A may be an advertisement image of a sponsor of the drama program, and the manufacturer of the prop used in the drama program (included in the image of the drama program) May be an advertising video.

FIG. 5 shows the display object table 25A. The display object table 25 </ b> A may be acquired from the advertisement server 11 by the Internet communication unit 27 and stored in the storage unit 25. The display object table 25 </ b> A may be broadcast together with the video of the television program, extracted by the image processing unit 22, and stored in the storage unit 25. In the display object table 25A, the time (time) in the program, the coordinates (location) on the screen, the display object displayed at the coordinates (location) at that time, and the selection information of the advertisement video related to the display object Are stored in association with each other. The selection information may be a file name or directory of a file stored in the storage unit 25. The selection information may be a URL (Uniform Resource Locator) for accessing content stored in the advertisement server 11. The selection information may be a URL indicating a general Internet page. When the screen is pointed by the user, the image processing unit 22 detects the time of the program being played and the pointed coordinates when the pointing is performed, and uses the detected time and coordinates to display the display object table 25A. Search and select the corresponding advertisement video. For example, in the display object table 25A, a product used in a program having a scenario such as a drama, a store visited by the program, a signboard of a baseball field, and the like are adopted as the display object.

In the display object table 25A shown in FIG. 5, a momentary time is designated as the time, and one point is designated as the coordinate. However, it is not limited to such a method. A time range (period) may be designated as time, and a wide range (region) may be designated as coordinates.

FIG. 6 is a diagram showing another form of pointing detection. In the example illustrated in FIG. 6, the user's line of sight is detected, and a point on the display 1 </ b> A that the user is gazing at is set as a pointing point. In the example illustrated in FIG. 6, the broadcasting system includes a remote control receiver 26 and a line-of-sight detection unit 30 in order to detect the user's line of sight in addition to the configuration illustrated in FIG. 1. The line-of-sight detection unit 30 may be an example of a designation detection unit. The remote control receiver 26 and the line-of-sight detection unit 30 are connected to the television receiver 1. The remote control receiving unit 26 and the line-of-sight detection unit 30 may be built in the television receiver 1. That is, the television receiver 1 may further include a remote control receiving unit 26 and a line-of-sight detection unit 30 in addition to the configuration shown in FIG. The line-of-sight detection unit 30 includes one or a plurality of cameras 31 provided in the vicinity of the display 1A. The camera 31 captures the user's face. The line-of-sight detection unit 30 detects the user's line of sight based on the user's face image captured by the camera 31. For example, a method described in Japanese Patent Application Laid-Open No. 2005-185431 may be used as the gaze detection method, but is not limited to this method. The present application incorporates the contents of US Pat. No. 7,533,989 corresponding to Japanese Patent Application Laid-Open No. 2005-185431. When the user turns on the pointing button 4A of the infrared remote controller 4 and transmits a pointing signal, the control unit 20 of the television receiver 1 causes the line-of-sight detection unit 30 to detect the line of sight of the user at that time, and the detected line of sight It is determined that a point on the direction display 1A is pointed. Even if there is no instruction from the user, the control unit 20 may cause the line-of-sight detection unit 30 to detect the user's line of sight at a predetermined timing or periodically to specify what the user is watching in the program. The advertisement display timing in this case will be described. The control unit 20 once stops the reproduction and display of the program after the reproduction of the program has elapsed for a predetermined time or at the chapter separation of the program. The control unit 20 searches the display object table 25A from changes in time and position of the line of sight movement so far, determines an advertisement to be reproduced, and displays it. This point will be described later. The pointing detection function based on the direction of the infrared remote controller 4 and the pointing detection function based on the line of sight shown in FIG. 6 are not alternative, and the television receiver 1 may have both functions.

FIG. 7 is a flowchart showing the operation of the control unit 20 of the television receiver 1. This process is repeatedly executed, for example, every 20 milliseconds. In this flowchart, the control unit 20 has an advertisement selection function using both pointing detection based on the direction of the infrared remote control device 4 and pointing detection based on the user's line of sight. That is, in the pointing detection based on the direction of the infrared remote control device 4, the control unit 20 detects a positive pointing operation of the user who has operated the infrared remote control device 4, and an advertisement related to the display object designated by the pointing operation. Select a video. In the pointing detection based on the user's line of sight, the control unit 20 selects an advertisement video related to the display object that is determined to be gazing based on the user's line of sight when the user does not perform an active pointing operation. To do.

First, the control unit 20 determines whether there is a pointing operation by the infrared remote control device 4 (step S1). When it is determined that there is no pointing operation by the infrared remote controller 4 (NO in step S1), the control unit 20 determines whether a non-designated time without a pointing operation has reached a predetermined time (for example, 15 minutes) (step S2). ). When it is determined that there is no pointing operation and the non-designated time has not reached the predetermined time (NO in steps S1 and S2), the control unit 20 detects the user's line of sight (step S21). Control part 20 may repeat processing of Step S21 for every predetermined time (for example, 1 second) until a user's look is detected. The control unit 20 calculates a display object (or advertisement video) corresponding to the coordinates of the detected line of sight on the display 1A using the display object table 25A (step S22). The control unit 20 stores the calculated display object (or advertisement video) in the gaze object list 25B set in the storage unit 25 (step S23). The control unit 20 returns to the process of step S2 after the process of step S23.

When it is determined that the pointing operation has been performed in step S1 (YES in step S1), the control unit 20 reads the detected coordinates (detection position) from the remote control reception unit 26 (step S11). The control unit 20 searches the display object table 25A using the detected coordinates (step S12), and selects an advertisement video related to the display object corresponding to the coordinates (step S13). Then, the control unit 20 reads out the advertisement video from the storage unit 25, or accesses the advertisement server 11 or other sites via the Internet 12, and downloads (or streams) the advertisement video for reproduction, or An advertisement video web page is displayed (step S14). Since the pointing operation has been executed, the control unit 20 resets the non-designated time to an initial value (for example, 0 seconds), and erases the display object (or advertisement video) stored in the watch list 25B (step) S15).

When the non-designated time in which there is no pointing operation by the user has reached a predetermined time (YES in step S2), the stored content of the watch object list 25B is read, the display object that has been watched most frequently is determined, and related to the display object The advertisement video to be selected is selected (step S31). Then, the advertisement video is read from the storage unit 25, or the advertisement server 11 or other site is accessed via the Internet 12, and the advertisement video is downloaded (or streamed) to be reproduced or the advertisement video web page is displayed. It is displayed (step S32). Since the advertisement video has been reproduced, the control unit 20 resets the non-designated time to an initial value (for example, 0 seconds), and erases the display object (or advertisement video) stored in the watch list 25B (step) S33).

As described above, the advertisement video may be displayed on the entire screen of the display 1A or may be displayed with a small window in the screen. The reproduction of the advertisement video when the pointing operation is performed (step S14) is performed on the entire screen, and the reproduction of the advertisement video based on the gaze detection (gaze object list 25B) when there is no pointing operation (step S32) is a small window. You may make it perform.

In the above description, the case where the first content is a television program and the second content is an advertisement video has been described. However, in this embodiment, the first content and the second content are not limited to these. The first content may be a video acquired from the Internet. *

A program for realizing the function of each device (for example, broadcasting system, television receiver 1) according to the embodiment described above is recorded on a computer-readable recording medium, and the program recorded on the recording medium is recorded. Processing may be performed by causing the computer system to read and execute the processing.

The “computer system” referred to here may include hardware such as an operating system (OS) and peripheral devices.
“Computer-readable recording medium” refers to a flexible disk, a magneto-optical disk, a ROM (Read Only Memory), a writable nonvolatile memory such as a flash memory, a portable medium such as a DVD (Digital Versatile Disk), and a computer system. Includes a storage device such as a built-in hard disk.

The “computer-readable recording medium” is a volatile memory (for example, DRAM (Dynamic Random Access) in a computer system that serves as a server or a client when a program is transmitted via a network such as the Internet or a communication line such as a telephone line. Memory)) that holds a program for a certain period of time.
The above program may be transmitted from a computer system storing the program in a storage device or the like to another computer system via a transmission medium or by a transmission wave in the transmission medium. A “transmission medium” for transmitting a program refers to a medium having a function of transmitting information, such as a network (communication network) such as the Internet or a communication line (communication line) such as a telephone line.
The above program may be a program for realizing a part of the functions described above.
The above program may be a so-called difference file (difference program) that can realize the above-described functions in combination with a program already recorded in the computer system.

The present invention may be applied to a content reproduction device, a content reproduction method, and a program.

DESCRIPTION OF SYMBOLS 1 Television receiver 1A Display 2 Pointing detection part 4 Infrared remote control 4A Pointing button 10 Broadcast station 11 Advertising server 21 Tuner 25 Memory | storage part 25A Display object table 26 Remote control receiving part 30 Eye-gaze detection part 31 Camera

Claims

A playback unit that has a display screen, plays back the first content that is a moving image, and displays the first content on the display screen;
A designation detector for detecting a designated position on the display screen designated by a user;
A control unit that causes the playback unit to play back the second content that is an image related to the object or scene displayed at the detected designated position;
A content playback apparatus comprising:
The content playback apparatus according to claim 1, wherein the control unit selects the second content based on the detected designated position and a playback time of the first content.
A storage unit that stores a table that stores a reproduction time of the first content, a position on the display screen, and selection information related to the second content in a state of being associated with each other;
The content reproduction apparatus according to claim 1, wherein the control unit selects the second content with reference to the table.
The control unit causes the playback unit to play back the second content when the designated position is detected while the playback unit is displaying the first content. The content reproduction device according to one item.
A first content supply unit for supplying the first content;
A second content supply unit for supplying the second content;
The content reproduction apparatus according to claim 1, further comprising:
The content reproduction according to any one of claims 1 to 5, wherein the designation detection unit detects a direction in which a remote controller operated by a user is facing, and determines the designated position based on the detected direction. apparatus.
The content reproduction device according to any one of claims 1 to 5, wherein the designation detection unit detects a user's line of sight and determines the designated position based on a direction in which the detected line of sight is facing.
Detecting a plurality of designated positions on the display screen designated by the user;
The content reproduction device according to claim 7, wherein the control unit accumulates and stores the plurality of designated positions, and selects the second content based on the plurality of designated positions.
The first content supply unit includes a television broadcast tuner,
The content reproduction apparatus according to claim 5, wherein the second content supply unit includes an Internet communication unit.
The first content is a video of a TV broadcast drama program,
The content reproduction apparatus according to claim 9, wherein the second content is an advertisement video of an object or a scene included in the first content.
A content playback method for a content playback device having a display screen,
Playing back the first content that is a video to display the first content on the display screen,
Detect a specified position on the display screen specified by the user,
A content reproduction method comprising: reproducing the second content that is an image related to the object or scene displayed at the detected designated position.
In a content playback device having a display screen,
Playing back the first content that is a video to display the first content on the display screen,
Detect a specified position on the display screen specified by the user,
A program for executing reproduction of the second content that is an image related to the object or scene displayed at the detected designated position.