WO2013065221A1

WO2013065221A1 - Transmission terminal, reception terminal, and method for sending information

Info

Publication number: WO2013065221A1
Application number: PCT/JP2012/005492
Authority: WO
Inventors: 幹直池田
Original assignee: パナソニック株式会社
Priority date: 2011-11-04
Filing date: 2012-08-30
Publication date: 2013-05-10
Also published as: JPWO2013065221A1

Abstract

According to the present invention, a transmission terminal (1) receives an instruction to capture content. The transmission terminal (1) captures a specific scene of the content and acquires a capture image. The transmission terminal (1) transmits scene identification information for the capture image to a reception terminal (2). The transmission terminal (1) receives the input of message information. The transmission terminal (1) transmits the message information to the reception terminal (2). The reception terminal (2) receives the scene identification information. The reception terminal (2) captures the specific scene on the basis of the scene identification information and acquires the capture image. The reception terminal (2) receives the message information from the transmission terminal (1). The reception terminal (2) composites the message information with the capture image.

Description

Transmission terminal, reception terminal, and information transmission method

The present invention relates to an information transmission method for transmitting information input at a transmission terminal to a reception terminal.

In recent years, a video sharing service that allows users to communicate with each other via a video by displaying each user's comments as an overlay on the video or in a list below the video has attracted attention. However, such video sharing services are based on the premise that comments entered on a text basis are displayed in correspondence with the playback time of the video, so people and objects displayed in a specific scene of the video are directly specified. It is difficult to make comments.

If you want to add a comment by directly specifying a person or object displayed in a specific scene of the video, on the sending user terminal, capture the specific scene in the video and capture it with a free curve It is conceivable to superimpose characters, figures, and the like by handwriting input or text input as a comment, and transmit the captured image with the comment superimposed to the server or the receiving user terminal.

However, it is a right included in the copyright of the copyright holder to transmit data including a captured image obtained by capturing a specific scene of a moving image, which is a copyrighted work, to the server or the receiving user terminal. There is a risk of infringing on a public transmission right or a transmission enabling right (for example, Article 23, Paragraph 1, Article 2, Paragraph 9, Item 5 of Japan). There is also a problem that a load is applied to the communication network when the amount of data of a captured image in which characters, graphics, and the like are superimposed as comments is large.

By the way, for the purpose of solving problems related to copyright infringement of videos and restrictions on communication processing capability, the sending user terminal sends the comment and comment elapsed time to the server, and the receiving user terminal inputs the comment and comment Is received from a server and a comment corresponding to the elapsed time is displayed on a screen during the reproduction of the moving image (for example, see Patent Document 1).

JP 2009-94653 A

However, in Patent Document 1, on the assumption that the receiving user terminal holds the content, the comment and the elapsed time in the specific scene of the content are displayed in association with each other. When recording is not performed, the comment from the transmission-side user cannot be displayed in association with the elapsed time in the specific scene of the content. That is, in such a case, the transmission-side user cannot accurately transmit information using the comment and the specific scene of the content to the reception-side user.

Also, as shown in Patent Document 1, it is troublesome for the receiving side user to record all the content commented by the transmitting side user at the receiving side user terminal and to hold the recorded content.

Further, in Patent Document 1, since it is assumed that the receiving side user views the broadcast program after the broadcast of the broadcast program is finished, the receiving side user can comment the transmission side user's comment on the broadcast program in real time during the broadcast. I can't confirm.

The present invention has been made in view of the above points, and on the premise of avoiding copyright infringement and reducing the network load, the transmission information including comments from the sending user is accurately and in real time. It is an object of the present invention to provide an information transmission method that can be transmitted to a receiving side user and can eliminate the troublesomeness of recording the content at the receiving side user terminal and holding the recorded content.

A transmitting terminal disclosed below captures an image indicating any scene of the displayed moving image content, a reproducing unit that reproduces the moving image content, a display unit that displays the moving image content reproduced by the reproducing unit, and A receiving unit that receives input of transfer information related to the captured image, a processor that generates or acquires scene specifying information that is information specifying the image captured in the memory, and the transfer information And a transmitting unit that transmits scene specifying information for specifying an image related to the transmission information to the receiving terminal, wherein the receiving terminal receives the video content reproduced by the reproducing unit. Scene identification obtained from another source different from the transmission terminal and received from the transmission unit among the obtained video content Capturing an image showing a scene specified by broadcast, and displays the transmission information received from the transmitting unit together with the captured image.

The receiving terminal disclosed below includes a playback unit that plays back video content, a display unit that displays the video content played back by the playback unit, scene specification information that specifies transmission information and an image associated with the transmission information, A receiving unit, and a memory that captures an image indicating a scene specified by the scene specifying information received from the transmitting terminal among the displayed moving image content, and a receiving terminal comprising: The display unit displays the captured information received from the transmission terminal together with the captured image, and the transmission terminal obtains the moving image content reproduced by the reproduction unit from another source different from the reception terminal. , Capturing an image showing any scene of the obtained moving image content, and transmitting information related to the captured image The scene identification information that is information for identifying the captured image is generated or acquired, and the transmission information and the scene identification information for identifying the image related to the transmission information are transmitted to the receiving terminal. To send.

The information transmission system disclosed below is an information transmission system including a transmission terminal possessed by a transmission user and a reception terminal that is a reception terminal that can communicate with the transmission terminal and that the reception user has. Scene identification information for identifying a specific scene in the content is transmitted to the receiving terminal, and transmission information to be displayed in association with the captured image captured based on the scene identification information is displayed on the receiving terminal. A transmission information transmitting unit for transmitting, and the receiving terminal captures a specific scene in the content that can be viewed by the receiving user based on the scene identification information received from the transmitting terminal, and receives a captured image on the receiving side Receiving side captured image acquisition unit, the transmission information received from the transmitting terminal, and the receiving side And an image combining unit for combining the Yapucha image.

An information transmission system disclosed below is an information transmission system including a transmission terminal and a reception terminal capable of communicating with the transmission terminal. The transmission terminal is configured to transmit the user with respect to real-time content being viewed by the user. A capture instruction receiving unit that receives a capture instruction, a transmission side capture image acquisition unit that captures at least one specific scene in the real-time content and acquires a transmission side capture image based on the capture instruction, and the transmission A scene identification information transmission unit that transmits scene identification information that identifies a specific scene of the side capture image to the receiving terminal, and a transmission information reception that receives input of transmission information to be displayed superimposed on the transmission side capture image from the user And the information received by the transmission information receiving unit A transmission information transmission unit that transmits information to the reception terminal, the reception terminal based on the scene identification information reception unit that receives scene identification information from the transmission terminal and the received scene identification information, Capture a specific scene in the real-time content and acquire a capture image on the reception side, capture information acquisition unit for receiving the transmission information from the transmission terminal, and the received transmission information, An image superimposing unit that superimposes on the reception-side captured image.

An information transmission system disclosed below is an information transmission system including a transmission terminal, a reception terminal, the transmission terminal, and a management server capable of communicating with the reception terminal, and the transmission terminal is viewed by a user. A capture instruction receiving unit that receives a capture instruction from the user for the real-time content in the transmission, and a transmission side that captures at least one specific scene in the real-time content and acquires a transmission-side capture image based on the capture instruction Capture image acquisition unit, scene identification information for identifying a specific scene of the capture image on the transmission side, a scene identification information transmission unit for transmitting to the management server, and input of transmission information to be displayed superimposed on the capture image on the transmission side A reception information receiving unit for receiving the information from the user, and the transmission A transmission information transmission unit that transmits the transmission information received by the information reception unit to the management server, and the management server distributes the scene identification information received from the transmission terminal to the reception terminal. A scene identification information distribution unit that performs the above-described transmission information received from the transmission terminal and a transmission information distribution unit that distributes the transmission information to the reception terminal. The reception terminal receives scene identification information from the management server. Based on the received scene identification information, an information receiving unit, a receiving-side captured image acquisition unit that captures a specific scene in the real-time content and acquires a receiving-side captured image, and the transmission information from the management server A transmission information receiving unit for receiving, and an image superimposing unit for superimposing the received transmission information on the capture image on the receiving side.

According to the disclosure of the present specification, on the premise of avoiding copyright infringement and reducing the network load, transmission information including comments from the transmitting user is accurately and in real time transmitted to the receiving user, and It is possible to eliminate the complexity of recording content in the receiving user terminal and maintaining the recorded content.

FIG. 1 is a diagram illustrating an example of a system configuration of an information transmission system according to the first embodiment. FIG. 2 is a diagram illustrating an example of a hardware configuration in which the first transmission terminal 20 illustrated in FIG. 1 is realized using a CPU. FIG. 3 is a diagram illustrating an example of a hardware configuration in which the second transmission terminal 30 illustrated in FIG. 1 is realized using a CPU. FIG. 4 is a diagram illustrating an example of a hardware configuration in which the receiving terminal 2 illustrated in FIG. 1 is realized using a CPU. FIG. 5 is a diagram showing an example of a flowchart showing processing when the transmission terminal 1 (the first transmission terminal 20 and the second transmission terminal 30) transmits the transmission information of the user who views real-time content to the reception terminal 2. It is. FIG. 6A is a diagram illustrating an example when real-time content is displayed on the display 201 of the first transmission terminal 20. FIG. 6B is a diagram illustrating an example when a display screen is displayed on the touch panel display 301 of the second transmission terminal 30. FIG. 6C is a diagram illustrating an example when a captured image of real-time content is displayed on the touch panel display 301 of the second transmission terminal 30. FIG. 7A is a diagram illustrating an example of captured image data 205b held in the first transmission terminal 20. FIG. 7B is a diagram illustrating an example of the captured image data 205b held in the first transmission terminal 20. FIG. 8A is a diagram illustrating an example of the scene identification information data 205c held in the first transmission terminal 20. FIG. 8B is a diagram showing an example of the scene identification information data 205c held in the first transmission terminal 20. FIG. 9A is a diagram illustrating an example of captured image data 405b held in the receiving terminal 2. FIG. 9B is a diagram illustrating an example of captured image data 405b held in the receiving terminal 2. FIG. 10A is a diagram illustrating an example when the transmission information regarding the captured image displayed on the touch panel display 301 of the second transmission terminal 30 is input. FIG. 10B is a diagram illustrating an example of transmission information input by the user on the touch panel display 301 of the second transmission terminal 30. FIG. 11A is a diagram illustrating an example of the transmission information data 305 c held in the second transmission terminal 30. FIG. 11B is a diagram illustrating an example of the transmission information data 305 c held in the second transmission terminal 30. FIG. 12A is a diagram illustrating an example of transmission information received by the receiving terminal 2 from the second transmitting terminal 30. FIG. 12B is a diagram illustrating an example when a capture image is displayed on the display 401 of the receiving terminal 2. FIG. 12C is a diagram illustrating an example of a superimposed image generated by superimposing a capture image and transmission information on the reception terminal 2. FIG. 13A is a diagram illustrating an example when a superimposed image is displayed on real-time content on the display 401 of the receiving terminal 2. FIG. 13B is a diagram illustrating an example when a superimposed image is displayed on the tablet terminal included in the reception terminal 2. FIG. 14 is a diagram illustrating an example of a system configuration of an information transmission system when the transmission terminal 1 is configured by one device. FIG. 15 is a diagram illustrating an example of a system configuration of the information transmission system when the first transmission terminal 20 includes the transmission information transmission unit 16. FIG. 16 is a diagram illustrating an example of a system configuration of the information transmission system when the second transmission terminal 30 includes the scene identification information transmission unit 14. FIG. 17 is a diagram illustrating an example of a system configuration of the information transmission system when the transmission terminal 1 and the reception terminal 2 are configured to receive real-time content from the content distribution server 4. FIG. 18A is a diagram illustrating an example of a configuration of a receiving terminal when the receiving terminal 2 is configured by two devices. FIG. 18B is a diagram illustrating an example of a configuration of the receiving terminal when the first receiving terminal 40 includes the transmission information receiving unit 26. FIG. 18C is a diagram illustrating an example of the configuration of the receiving terminal when the second receiving terminal 50 is configured to include the scene identification information receiving unit 27. FIG. 18D is a diagram illustrating an example of the configuration of the receiving terminal when the first receiving terminal 40 includes the transmission information receiving unit 26 and the second receiving terminal 50 includes the scene identification information receiving unit 27. FIG. 18E is a diagram illustrating an example of the configuration of the receiving terminal when the first receiving terminal 40 includes the image superimposing unit 24. FIG. 19 is a diagram illustrating an example of a system configuration of an information transmission system according to the second embodiment. FIG. 20 is a diagram illustrating an example of a hardware configuration in which the management server 5 illustrated in FIG. 19 is realized using a CPU. FIG. 21A shows processing when the transmitting terminal 1 (the first transmitting terminal 20 and the second transmitting terminal 30) transmits the transmission information of the user who views real-time content to the receiving terminal 2 via the management server. It is a figure which shows an example of the flowchart shown. FIG. 21B shows processing when the transmitting terminal 1 (the first transmitting terminal 20 and the second transmitting terminal 30) transmits the transmission information of the user who views real-time content to the receiving terminal 2 via the management server. It is a figure which shows an example of the flowchart shown. FIG. 22 is a diagram illustrating an example when a superimposed image is displayed on real-time content on the display 401 of the receiving terminal 2. FIG. 23A is a diagram schematically illustrating a relationship of main data transmitted and received between the transmission terminal 1 and the reception terminal 2. FIG. 23B is a diagram schematically illustrating a relationship between main data transmitted and received between the transmission terminal 1 and the reception terminal 2. FIG. 23C is a diagram schematically illustrating a relationship of main data transmitted / received between the transmission terminal 1 and the reception terminal 2. FIG. 23D is a diagram schematically illustrating a relationship of main data transmitted and received between the transmission terminal 1 and the reception terminal 2. FIG. 23E is a diagram schematically illustrating a relationship of main data transmitted and received among the transmission terminal 1, the management server 5, and the reception terminal 2. FIG. 24 is a diagram illustrating an example of a system configuration of an information transmission system according to the fourth embodiment. FIG. 25 shows processing in the case where the transmission terminal 1 (the first transmission terminal 20 and the second transmission terminal 30) transmits quiz information as transmission information to the reception terminal 2 in the information transmission system of the fourth embodiment. It is a figure which shows an example of the flowchart shown. FIG. 26 is a diagram illustrating an example when a display screen is displayed on the touch panel display 301 of the second transmission terminal 30. FIG. 27 is a diagram illustrating an example of a flowchart of quiz information creation processing executed by the second transmission terminal 30 in the information transmission system according to the fourth embodiment. FIG. 28 is a diagram illustrating an example when an image selection screen is displayed on the touch panel display 301 of the second transmission terminal 30. FIG. 29 is a diagram illustrating an example when a quiz setting screen is displayed on the touch panel display 301 of the second transmission terminal 30. FIG. 30 is a diagram illustrating an example when a quiz screen is displayed on the touch panel display 301 of the second transmission terminal 30. FIG. 31 is a diagram illustrating an example of the transmission information data 305 c held as quiz information in the second transmission terminal 30. FIG. 32 is a diagram illustrating an example when the quiz image 121 is superimposed and displayed on the real-time content. FIG. 33 is a diagram illustrating an example of a system configuration of an information transmission system according to the fifth embodiment. FIG. 34 shows processing in the case where the transmission terminal 1 (the first transmission terminal 20 and the second transmission terminal 30) transmits advertisement information as transmission information to the reception terminal 2 in the information transmission system of the fifth embodiment. It is a figure which shows an example of the flowchart shown. FIG. 35 is a diagram illustrating an example when a display screen is displayed on the touch panel display 301 of the second transmission terminal 30. FIG. 36 is a diagram illustrating an example of a flowchart of the advertisement information creation process executed by the second transmission terminal 30 in the information transmission system of the fifth embodiment. FIG. 37 is a diagram illustrating an example when an image selection screen is displayed on the touch panel display 301 of the second transmission terminal 30. FIG. 38 is a diagram illustrating an example when an advertisement setting screen is displayed on the touch panel display 301 of the second transmission terminal 30. FIG. 39 is a diagram illustrating an example when an advertisement screen is displayed on the touch panel display 301 of the second transmission terminal 30. FIG. 40 is a diagram illustrating an example when the advertisement image 122 is superimposed and displayed on the real-time content. FIG. 41 is a diagram illustrating an example of a system configuration of an information transmission system according to the sixth embodiment. FIG. 42 shows processing when the transmitting terminal 1 (the first transmitting terminal 20 and the second transmitting terminal 30) transmits game information as transmitted information to the receiving terminal 2 in the information transmitting system of the sixth embodiment. It is a figure which shows an example of the flowchart shown. FIG. 43 is a diagram illustrating an example when a display screen is displayed on the touch panel display 301 of the second transmission terminal 30. FIG. 44 is a diagram illustrating an example of a flowchart of game information creation processing executed by the second transmission terminal 30 in the information transmission system of the fifth embodiment. FIG. 45 is a diagram illustrating an example when an image selection screen is displayed on the touch panel display 301 of the second transmission terminal 30. FIG. 46 is a diagram illustrating an example when a game setting screen is displayed on the touch panel display 301 of the second transmission terminal 30. FIG. 47 is a diagram illustrating an example when a game screen is displayed on the touch panel display 301 of the second transmission terminal 30. FIG. 48 is a diagram showing an example when the game image 123 is superimposed and displayed on the real-time content.

Hereinafter, embodiments of the present invention will be specifically described with reference to the drawings.

[1. First Embodiment]
Hereinafter, an information transmission system using a television receiver will be described as an example. A television receiver is a device that can receive a radio wave of a television broadcast and allow a user to view real-time content. In the present embodiment, real-time content refers to content that is distributed all at once, such as a broadcast program in which television broadcasting is performed, and can be viewed by each viewing user at the same timing. Therefore, the real-time content is a concept including a broadcast program of live broadcast or recorded broadcast.

[1-1. System configuration]
FIG. 1 is a diagram illustrating an example of a system configuration of an information transmission system according to the first embodiment. In this system configuration, the transmission terminal 1 (the first transmission terminal 20 and the second transmission terminal 30) and the reception terminal 2 are connected via a network N so that they can communicate with each other. The network N can be realized by the Internet, a local area network (LAN), a wide area network (WAN), or the like.

The transmission terminal 1 includes a first transmission terminal 20 and a second transmission terminal 30. Each of the first transmission terminal 20 and the reception terminal 2 can receive broadcast radio waves (for example, terrestrial digital broadcast radio waves) from the broadcast station 3 and allow the user to view real-time content that is a broadcast program.

For example, the first transmission terminal 20 and the reception terminal 2 are television receivers. Note that the first transmission terminal 20 or the reception terminal 2 can be a device device (for example, a disk recording / playback device) that incorporates a tuner capable of receiving a television broadcast.

For example, the second transmission terminal 30 is a tablet terminal that can communicate with the first transmission terminal 20. In addition, the 2nd transmission terminal 30 can be used as the smart phone provided with the touchscreen display etc.

The first transmitting terminal 20 or the receiving terminal 2 is a device device (for example, a set-top box or a disk recording / playback device) having a built-in tuner capable of receiving a television broadcast via a network such as a cable TV. Can do.

In FIG. 1, only one receiving terminal 2 that can communicate with the transmitting terminal 1 is shown, but a plurality of receiving terminals 2 may exist. In FIG. 1, only one set of the combination of the transmission terminal 1 and the reception terminal 2 is described, but a plurality of combinations may exist.

[1-2. Outline of processing]
Hereinafter, an outline of processing of the information transmission system according to the first embodiment will be described with reference to a functional block diagram. In the first transmission terminal 20, the second transmission terminal 30, and the reception terminal 2 in FIG. 1, a functional block diagram showing functional units included in each device is described.

The first transmission terminal 20 includes a real-time content reception unit 11 (a reproduction unit that reproduces moving image content), an image display unit 12 (a display unit that displays moving image content), and a transmission side buffer unit 13 (a part or all of the moving image content). A buffer unit for temporarily storing), a scene identification information transmission unit 14 (a transmission unit for transmitting scene specifying information), and a transmission side capture image acquisition unit 15. The second transmission terminal 30 includes a transmission information transmission unit 16, a capture instruction reception unit 17, a transmission information reception unit 18 (a reception unit that receives input of transmission information), and a captured image display unit 19. The receiving terminal 2 includes a real-time content receiving unit 21 (a reproducing unit that reproduces moving image content), an image display unit 22 (a display unit that displays moving image content), and a receiving side buffer unit 23 (a part or all of the moving image content is temporarily stored). And a superimposing section 24, a receiving side capture image acquiring section 25, a transmission information receiving section 26, and a scene identification information receiving section 27 (receiving section for receiving scene specifying information).

The real-time content receiver 11 in the first transmission terminal 20 receives and reproduces a broadcast program broadcasted by the broadcast station 3 as real-time content. The image display unit 12 in the first transmission terminal 20 displays an image (for example, a moving image) of the content received and reproduced by the real-time content reception unit 11 in the first transmission terminal 20 so that the user of the transmission terminal 1 can view the content. Let The transmission side buffer unit 13 in the first transmission terminal 20 temporarily stores part or all of the content image displayed by the image display unit 12 in the first transmission terminal 20.

In the above description, the transmission side buffer unit 13 temporarily stores part or all of the content image displayed by the image display unit 12. However, the content image output by the real-time content reception unit 11 is used. A part or all of the above may be temporarily stored. Further, the transmission-side buffer unit 13 may be arranged between the real-time content reception unit 11 and the image display unit 12 so that the image display unit 12 displays an image of the content output from the transmission-side buffer unit 13. .

The capture instruction receiving unit 17 in the second transmission terminal 30 is a user who is viewing this content for a capture instruction for capturing an image of the content displayed by the image display unit 12 in the first transmission terminal 20 at a specific timing. Accept from. The transmission side capture image acquisition unit 15 in the first transmission terminal 20 captures by capturing at least one specific scene in the real-time content based on the capture instruction received by the capture instruction reception unit 17 in the second transmission terminal 30. The image is acquired in a memory, for example. The scene identification information transmission unit 14 in the first transmission terminal 20 is, for example, scene identification information generated or acquired by a processor, and specifies the capture image acquired by the transmission side capture image acquisition unit 15 in the first transmission terminal 20. Scene identification information for identifying a scene is transmitted to the receiving terminal 2.

The capture image display unit 19 in the second transmission terminal 30 displays the capture image (for example, a still image) acquired by the transmission side capture image acquisition unit 15 in the first transmission terminal 20. The transmission information reception unit 18 in the second transmission terminal 30 receives input of transmission information to be displayed superimposed on the capture image displayed by the capture image display unit 19 in the second transmission terminal 30 from the user. The transmission information transmission unit 16 in the second transmission terminal 30 transmits the transmission information received from the user by the transmission information reception unit 18 in the second transmission terminal 30 to the reception terminal 2.

The real-time content receiving unit 21 in the receiving terminal 2 receives and reproduces a broadcast program broadcasted by the broadcast station 3 as real-time content, as in the case of the real-time content receiving unit 11 in the first transmitting terminal 20. Similar to the case of the image display unit 12 in the first transmission terminal 20, the image display unit 22 in the reception terminal 2 displays content images (for example, moving images) received and reproduced by the real-time content reception unit 21 in the reception terminal 2. Thus, the user of the receiving terminal 2 is allowed to view the content. The receiving side buffer unit 23 in the receiving terminal 2 temporarily stores part or all of the content image displayed by the image display unit 22 in the receiving terminal 2.

In the above description, the reception-side buffer unit 23 temporarily stores part or all of the content image displayed by the image display unit 22, but the content image received by the real-time content reception unit 21. A part or all of the above may be temporarily stored. Further, the receiving side buffer unit 23 is positioned between the real-time content receiving unit 21 and the image display unit 22, and the image display unit 22 displays the image of the content stored in the receiving side buffer unit 23. Also good.

The scene identification information receiving unit 27 in the receiving terminal 2 receives scene identification information for identifying a specific scene of the captured image acquired by the transmitting-side captured image acquiring unit 15 of the first transmitting terminal 20 from the first transmitting terminal. . Based on the scene identification information received by the scene identification information receiving unit 27 in the receiving terminal 2 from the first transmitting terminal 20, the receiving side capture image acquiring unit 25 in the receiving terminal 2 has at least one specific scene in the real-time content, For example, a captured image is acquired by capturing in a memory.

The transmission information receiving unit 26 in the receiving terminal 2 receives the transmission information received from the user by the transmission information receiving unit 18 in the second transmitting terminal 30 from the second transmitting terminal 30. The image superimposing unit 24 in the receiving terminal 2 generates a superimposed image by superimposing the transmission information received by the transmission information receiving unit 26 in the receiving terminal 2 on the captured image acquired by the receiving side capture image acquiring unit 25 in the receiving terminal 2. To do. The image display unit 22 in the receiving terminal 2 displays the superimposed image generated by the image superimposing unit 24 in the receiving terminal 2 so that the user of the receiving terminal 2 can visually recognize the superimposed image.

Each functional unit shown in FIG. 1 (real-time content receiving unit 11, image display unit 12, scene identification information transmission unit 14, transmission side capture image acquisition unit 15, transmission information transmission unit 16, capture instruction reception unit 17, transmission information reception Unit 18, captured image display unit 19, real-time content reception unit 21, image display unit 22, image superimposition unit 24, reception side capture image acquisition unit 25, transmission information reception unit 26, and scene identification information reception unit 27) It includes the functions of the CPU realized by the above. In the present specification, the program includes not only a program that can be directly executed by the CPU, but also a source format program, a compressed program, an encrypted program, and the like.

[1-3. Hardware configuration]
[1-3-1. First transmitting terminal 20]
FIG. 2 is a diagram illustrating an example of a hardware configuration in which the first transmission terminal 20 illustrated in FIG. 1 is realized using a CPU. The first transmission terminal 20 includes a display 201, a CPU (Central Processing Unit) 202, a RAM (Random Access Memory) 203, an operation button 204, a flash memory 205, a ROM (Read Only Memory) 206, a tuner circuit 207, and a first communication circuit. 208, a second communication circuit 209, and an external connection port 210. These are connected to each other via an internal bus 200.

The display 201 can display an image of real-time content output according to a command from the CPU 202. The CPU 202 can execute processing based on an OS (Operating System) 206a and a first transmission terminal control program 205a. The RAM 203 can provide an address space to the CPU 202. The operation button 204 can accept a basic operation of the first transmission terminal 20 (for example, a power on / off operation) from the user. The flash memory 205 can hold the first transmission terminal control program 205a.

The external connection port 210 can be connected to an external connection type hard disk drive 211. The external connection port 210 can be connected to an external device that can be connected based on, for example, the USB (Universal Serial Bus) standard or the IEEE 1394 standard. A part of the externally connected hard disk drive 211 can function as the ring buffer 203a. Further, the external connection type hard disk drive 211 can hold captured image data 205b, scene identification information data 205c, and the like.

Note that any or all of the ring buffer 203a, the captured image data 205b, and the scene identification information data 205c are stored in the RAM 203, the flash memory 205, an internal connection type hard disk drive (not shown), and a network connection type hard disk drive (not shown). Alternatively, it may be held in a network storage (not shown). For example, an internal connection type hard disk drive (not shown) is a hard disk drive that is directly connected to the internal bus 200 without going through the external connection port 210. For example, a network-connected hard disk drive (not shown) is a hard disk drive connected via a network N such as the Internet. For example, the network storage (not shown) is a file server (not shown) connected via a network N such as the Internet.

The ROM 206 can hold the OS 206a. The tuner circuit 207 can receive a plurality of radio waves of broadcast programs broadcast by the broadcast station 3.

The first communication circuit 208 can communicate with the receiving terminal 2 via the network N (FIG. 1). The first communication circuit 208 can perform communication using, for example, TCP / IP (Transmission Control Protocol / Internet Protocol). The second communication circuit 209 can communicate with the second transmission terminal 30. The second communication circuit 209 is, for example, wireless communication based on a standard such as IrDA (trademark), Bluetooth (trademark), Wireless USB, or Wi-Fi (trademark), USB (Universal Serial Bus), or HDMI (High-Definition Multimedia Interface). ) Etc. are possible.

As an example, the real-time content reception unit 11, the image display unit 12, the scene identification information transmission unit 14, and the transmission side capture image acquisition unit 15 included in the first transmission terminal 20 illustrated in FIG. This is realized by executing the terminal control program 205a (FIG. 2). The real-time content received by the real-time content receiver 11 shown in FIG. 1 or the real-time content displayed by the image display unit 12 shown in FIG. 1 is, for example, the ring buffer 203a (FIG. 2) of the externally connected hard disk drive 211. ). The captured image acquired by the transmission-side captured image acquisition unit 15 illustrated in FIG. 1 is held in the captured image data 205b (FIG. 2) of the external connection type hard disk drive 211 as an example. The scene identification information for identifying the specific scene of the captured image acquired by the transmission-side captured image acquisition unit 15 illustrated in FIG. 1 is held in the scene identification information data 205c (FIG. 2) of the externally connected hard disk drive 211 as an example. The

[1-3-2. Second transmitting terminal 30]
FIG. 3 is a diagram illustrating an example of a hardware configuration in which the second transmission terminal 30 illustrated in FIG. 1 is realized using a CPU. The second transmission terminal 30 includes a touch panel display 301, a CPU 302, a RAM 303, operation buttons 304, a flash memory 305, a ROM 306, a first communication circuit 307, and a second communication circuit 308.

The touch panel display 301 can display a captured image output by a command from the CPU 302 on the screen. In addition, the touch panel display 301 can accept an instruction operation (for example, a contact operation by a user's fingertip or stylus) that specifies a position on the screen from the user.

The CPU 302 can execute processing based on the OS 306a and the second transmission terminal control program 305a. The RAM 303 can provide an address space to the CPU 302. The operation button 304 can accept a basic operation (for example, a power on / off operation) of the second transmission terminal 30 from the user.

The flash memory 305 can hold the second transmission terminal control program 305a, capture image data 305b, transmission information data 305c, and the like. The ROM 306 can hold the OS 306a. Note that the captured image data 305 b and the transmission information data 305 c may be held in the RAM 303.

The first communication circuit 307 can communicate with the receiving terminal 2 via the network N (FIG. 1) as in the case of the first transmitting terminal 20. The first communication circuit 307 can perform communication by, for example, TCP / IP, as in the case of the first transmission terminal 20. The second communication circuit 308 can communicate with the first transmission terminal 20. As in the case of the first transmission terminal 20, the second communication circuit 308 is configured to perform wireless communication based on standards such as IrDA (trademark), Bluetooth (trademark), Wireless USB, or Wi-Fi (trademark), USB, or HDMI. Wired communication based on standards such as (trademark) is possible.

As an example, the transmission information transmission unit 16, the capture instruction reception unit 17, the transmission information reception unit 18, and the captured image display unit 19 configuring the second transmission terminal 30 illustrated in FIG. This is realized by executing the program 305a (FIG. 3). The captured image acquired by the transmission-side captured image acquisition unit 15 illustrated in FIG. 1 is held in captured image data 305b (FIG. 3) of the flash memory 305 as an example. The transmission information received by the transmission information receiving unit 18 shown in FIG. 1 from the user is held in the transmission information data 305c (FIG. 3) of the flash memory 305 as an example.

[1-3-3. Receiving terminal 2]
FIG. 4 is a diagram illustrating an example of a hardware configuration in which the receiving terminal 2 illustrated in FIG. 1 is realized using a CPU. The receiving terminal 2 includes a display 401, a CPU 402, a RAM 403, operation buttons 404, a flash memory 405, a ROM 406, a tuner circuit 407, a communication circuit 408, and an external connection port 410. These are connected to each other via an internal bus 400.

The display 401 can display an image of real-time content output in accordance with an instruction from the CPU 402. The CPU 402 can execute processing based on the OS 406a and the receiving terminal control program 405a. The RAM 403 can provide an address space to the CPU 402. The operation button 404 can accept a basic operation of the receiving terminal 2 (for example, a power on / off operation) from the user. The flash memory 405 can hold a receiving terminal control program 405a.

The external connection port 410 can be connected to an external connection type hard disk drive 411. The external connection port 410 can connect an external device that can be connected based on, for example, the USB standard or the IEEE1394 standard. A part of the externally connected hard disk drive 411 can function as the ring buffer 403a. The external connection type hard disk drive 411 can hold capture image data 405b, transmission information data 405c, and the like.

Note that any or all of the ring buffer 403a, the captured image data 405b, and the transmission information data 405c are stored in the RAM 403, the flash memory 405, an internal connection type hard disk drive (not shown), a network connection type hard disk drive (not shown), or It may be held in a network storage (not shown). For example, an internal connection type hard disk drive (not shown) is a hard disk drive that is directly connected to the internal bus 400 without going through the external connection port 410. For example, a network-connected hard disk drive (not shown) is a hard disk drive connected via a network N such as the Internet. For example, the network storage (not shown) is a file server (not shown) connected via a network N such as the Internet.

The ROM 406 can hold the OS 406a. The tuner circuit 407 can receive a plurality of radio waves of a broadcast program broadcast by the broadcast station 3 as in the case of the first transmission terminal 20 or the second transmission terminal 30. The communication circuit 408 can communicate with the first transmission terminal 20 and the second transmission terminal 30 via the network N (FIG. 1). The communication circuit 408 can perform communication by TCP / IP, for example, as in the case of the first transmission terminal 20 or the second transmission terminal 30.

The real-time content receiving unit 21, the image display unit 22, the image superimposing unit 24, the receiving side capture image acquiring unit 25, the transmission information receiving unit 26, and the scene identification information receiving unit 27 that constitute the receiving terminal 2 shown in FIG. As an example, it is realized by executing the receiving terminal control program 405a (FIG. 4) on the CPU 402. The real-time content received by the real-time content receiving unit 21 shown in FIG. 1 or the real-time content displayed by the image display unit 22 shown in FIG. 1 is, for example, the ring buffer 403a (see FIG. 4) of the externally connected hard disk drive 411. ). The captured image acquired by the reception-side captured image acquisition unit 25 illustrated in FIG. 1 is held in the captured image data 405b (FIG. 4) of the externally connected hard disk drive 411 as an example. The transmission information received from the second transmission terminal by the transmission information receiving unit 26 shown in FIG. 1 is held in the transmission information data 405c (FIG. 4) of the external connection type hard disk drive 411 as an example.

[1-4. Processing details]
Details of processing in this embodiment will be described with reference to FIGS. 5 to 13B. FIG. 5 shows a case where the transmission terminal 1 (the first transmission terminal 20 and the second transmission terminal 30) transmits the transmission information of the user who views real-time content to the reception terminal 2 in the information transmission system of the present embodiment. It is a figure which shows an example of the flowchart which shows a process.

FIG. 6A is a diagram illustrating an example when real-time content is displayed on the display 201 of the first transmission terminal 20. FIG. 6B is a diagram illustrating an example when a display screen is displayed on the touch panel display 301 of the second transmission terminal 30. FIG. 6C is a diagram illustrating an example when a captured image of real-time content is displayed on the touch panel display 301 of the second transmission terminal 30.

7A and 7B are diagrams illustrating an example of the captured image data 205b held in the first transmission terminal 20. 8A and 8B are diagrams illustrating an example of the scene identification information data 205c held in the first transmission terminal 20. 9A and 9B are diagrams illustrating an example of the captured image data 405b held in the receiving terminal 2.

FIG. 10A is a diagram illustrating an example in a case where transmission information related to a captured image displayed on the touch panel display 301 of the second transmission terminal 30 is input. FIG. 10B is a diagram illustrating an example of transmission information input by the user on the touch panel display 301 of the second transmission terminal 30. 11A and 11B are diagrams illustrating an example of the transmission information data 305c held in the second transmission terminal 30. FIG.

FIG. 12A is a diagram illustrating an example of transmission information received by the receiving terminal 2 from the second transmitting terminal 30. FIG. 12B is a diagram illustrating an example when a capture image is displayed on the display 401 of the receiving terminal 2. FIG. 12C is a diagram illustrating an example of a superimposed image generated by superimposing a capture image and transmission information on the reception terminal 2.

FIG. 13A is a diagram illustrating an example when a superimposed image is displayed on real-time content on the display 401 of the receiving terminal 2. FIG. 13B is a diagram illustrating an example when a superimposed image is displayed on a tablet terminal included in the reception terminal 2.

[1-4-1. Capture instruction at first transmission terminal]
The CPU 202 of the first transmission terminal 20, which is a television receiver, receives a broadcast program broadcast by the broadcast station 3 as real time content and displays the received real time content on the display 201. Thereby, the user of the 1st transmission terminal 20 can view real-time content (for example, refer to Drawing 6A).

As shown in the flowchart of FIG. 5, the CPU 202 of the first transmission terminal 20 records the real-time content displayed on the display 201 in the ring buffer 203a (FIG. 2) (step S501). The ring buffer 203a can hold an image of content displayed in the past or an image of content received in the past for a predetermined time. In the present embodiment, the ring buffer 203a holds a frame of a content video every predetermined time (for example, every second) for a predetermined time, but all the frames of the content video (for example, 30 frames per second) for a predetermined time. It may be held.

The user can use the second transmission terminal 30 that is a tablet type terminal while viewing real-time content on the first transmission terminal 20 that is a television receiver. In the present embodiment, it is assumed that the second transmission terminal 30 that is a tablet-type terminal is connected to the first transmission terminal 20 that is a television receiver so as to be able to communicate in advance.

The CPU 302 of the second transmission terminal 30 determines whether or not the capture instruction button has been pressed by the user (step S511). For example, when the CPU 302 detects that the capture instruction button 311 (FIG. 6B) displayed on the touch panel display 301 of the second transmission terminal 30 has been pressed with the user's fingertip, stylus, or the like, the capture instruction button It is determined that is pressed.

If it is determined that the capture instruction button 311 has been pressed (Yes in step S511), the CPU 302 of the second transmission terminal 30 transmits capture instruction data to the first transmission terminal 20 (step S512).

Upon receiving the capture instruction data, the CPU 202 of the first transmission terminal 20 acquires a plurality of captured images by capturing a plurality of frames including a specific scene of the real-time content currently displayed on the display 201, The acquired captured image is recorded in the captured image data 205b (step S502). For example, the CPU 202 refers to the frames displayed in the past recorded in the ring buffer 203a, and records 701 to 705 indicating five captured images with different reproduction times 73 by 1 second as shown in FIG. 7A. Record.

As shown in FIG. 7A, for example, the CPU 202 records the actual data of the captured image 74 in the captured image data 205b in association with each data of the broadcast station ID 71, the program ID 72, and the reproduction time 73. For example, the record 703 in FIG. 7A includes data such as a broadcasting station ID 71 “B001”, a program ID 72 “P101”, a reproduction time 73 “18:15:03”, and a captured image 74 “(S_Cap003.bmp)”. In FIG. 7A, the actual data of the captured image 74 is expressed using a file name indicating an image file, such as “(S_Cap001.bmp)”.

When a transmission standard based on MPEG-2 systems (Moving Picture Experts Group 2 Systems) is used for television broadcasting, the reproduction time 73 is a reproduction time included in header information of a PES (Packetized Elementary Stream) packet. it can.

As shown in FIG. 7A, the CPU 202 records, for example, captured image data for frames of 2 seconds before and after the record 703 as

records

701, 702, 704, and 705. In this way, by including in the captured image a frame at a timing before and after receiving the transmission of the capture instruction data from the second transmitting terminal 30, and allowing the user to select an arbitrary captured image therefrom, As described above, the time lag between the time when the user presses the capture instruction button 311 of the second transmission terminal 30 and the time when the content is actually captured at the first transmission terminal 20 can be eliminated. In addition, since the user can select an arbitrary captured image from a plurality of captured images, even if the image that the user tried to capture differs from the actually captured image, the image that the user tried to capture can be selected. You can choose again.

As shown in FIG. 7B, the CPU 202 issues unique ID numbers (identification numbers) corresponding to the respective records (records 701 to 705) of the captured image data 205b shown in FIG. 7A. ID numbers 75 “ID001” to “ID005” can be added to each record. In this case, as will be described later, the receiving terminal 2 can identify the captured image based on the ID number.

Subsequently, the CPU 202 of the first transmission terminal 20 transmits the scene identification information of the captured image to the reception terminal 2 (step S503). The scene identification information is information for identifying a specific scene of the captured image. Specifically, for example, a combination of the broadcast station ID 71, program ID 72, and playback time 73 data recorded in the captured image data 205b shown in FIG. 7A corresponds to the scene identification information. For example, the CPU 202 creates the scene identification information data 205c (records 801 to 805) shown in FIG. 8A based on the broadcast station ID 71, program ID 72, and playback time 73 data shown in FIG. 7A, and the created scene identification information data 205c is transmitted to the receiving terminal 2.

As shown in FIG. 7B, when each data of the ID number 75 is added to each record (records 701 to 705) of the captured image data 205b, the CPU 202 displays the scene identification information as shown in FIG. 8B. The scene identification information is created by adding the data of ID numbers 84 “ID001” to “ID005” to the records (records 801 to 805) of the data 205c.

As in the case of the first transmission terminal 20, the CPU 402 of the receiving terminal 2, which is a television receiver, receives a broadcast program broadcast by the broadcast station 3 as real-time content and displays the received real-time content on the display 401. Thereby, the user of the receiving terminal 2 can view real-time content.

The CPU 402 of the receiving terminal 2 records the real-time content displayed on the display 401 in the ring buffer 403a (FIG. 4) as in the case of the first transmitting terminal 20 (step S531). Similarly to the ring buffer 203a of the first transmission terminal 20, the ring buffer 403a can hold a frame of a content video every predetermined time (for example, every second) for a predetermined time.

The CPU 402 of the receiving terminal 2 receives scene identification information for identifying a specific scene of the captured image from the first transmitting terminal 20 (step S532). For example, the CPU 402 receives all the records 801 to 805 of the scene identification information data 205c shown in FIG. 8A or 8B.

Based on the scene identification information received from the first transmission terminal 20, the CPU 402 of the receiving terminal 2 acquires a plurality of captured images by capturing a plurality of frames including a specific scene indicated by the scene identification information, and acquires the acquired captures. The image is recorded in the captured image data 405b (step S533). For example, the CPU 402 refers to a frame displayed in the past recorded in the ring buffer 403a (FIG. 4), and as shown in FIG. 9A, a record 901 indicating five captured images having different reproduction times 93 by 1 second. Record ~ 905.

As shown in FIG. 9A, for example, the CPU 402 records the actual data of the captured image 94 in the captured image data 405b in association with each data of the broadcast station ID 91, the program ID 92, and the reproduction time 93. For example, the record 903 in FIG. 9A includes data such as a broadcasting station ID 91 “B001”, a program ID 92 “P101”, a reproduction time 93 “18:15:03”, and a captured image 94 “(R_Cap003.bmp)”. In FIG. 9A, the actual data of the captured image 94 is expressed using a file name indicating an image file, for example, “(R_Cap001.bmp)”.

Here, as shown in FIG. 9A, the CPU 402 of the receiving terminal 2 records records 901 to 905 indicating five captured images having different reproduction times 93 by 1 second. As illustrated in FIG. 9A, the CPU 402 records, for example, the record image 903 of the captured image data of the frame that was displayed when the first transmission terminal 20 received the capture instruction data from the second transmission terminal 30. To do. Similarly to the case of the first transmission terminal 20, the CPU 402 records the captured image data for the frames of 2 seconds before and after the record 903 as

records

901, 902, 904, and 905.

If an ID number is assigned to each record (records 801 to 805) of the identification information data 205c received from the first transmission terminal 20, the CPU 402 records each record (records 801 to 805) of the identification information data 205c. As shown in FIG. 9B, each data indicating the assigned ID number (for example, each data of ID numbers 84 “ID001” to “ID005” shown in FIG. 8B) is set as ID numbers 95 “ID001” to “ID005”. Are recorded in association with the respective records (records 901 to 905).

[1-4-2. Input of transmission information at the second transmitting terminal]
In step S <b> 504 of FIG. 5, the CPU 202 of the first transmission terminal 20 transmits the plurality of capture images acquired in step S <b> 502 to the second transmission terminal 30. For example, the CPU 202 transmits captured image data based on the records 701 to 705 illustrated in FIG. 7A or 7B to the second transmission terminal 30.

The CPU 302 of the second transmission terminal 30 records the captured image based on the data acquired from the first transmission terminal 20 in the captured image data 305b of the flash memory 305 and displays it on the touch panel display 301 (step S513). An example of the captured image data 305b of the second transmission terminal 30 is the same as that shown in FIG. 7A or FIG. 7B in the first transmission terminal 20.

As shown in FIG. 6C, for example, the CPU 302 displays one of the captured images based on the data acquired from the first transmission terminal 20 in the captured image display area 300 including the center of the screen. For example, the capture image displayed by default in the capture image display area 300 can be a capture image corresponding to the record 703 in the capture image data 205b illustrated in FIG. 7A or 7B.

Further, the CPU 302 displays five thumbnail images 321 to 325 at the lower part of the captured image display area 300. The thumbnail images 321 to 325 are obtained by reducing and displaying captured images corresponding to the records 701 to 705 in the captured image data 205b shown in FIG. 7A or 7B. When any of the thumbnail images 321 to 325 is selected by the user, the CPU 302 can enlarge and display the captured image corresponding to the selected thumbnail image in the captured image display area 300.

In this way, by displaying the five thumbnail images 321 to 325 in the capture image display area 300, the time when the user of the transmission terminal 1 presses the capture instruction button 311 of the second transmission terminal 30, and the first transmission terminal 20 are displayed. The user of the transmission terminal 1 can select a captured image at a desired timing even if there is a time lag between the time at which the content is actually captured. In addition, since the user can select an arbitrary captured image from the five thumbnail images 321 to 325, the image that the user tried to capture is different from the image actually captured by the first transmission terminal 20. Also, the user can reselect the image that he tried to capture.

Note that the information transmission system of the present embodiment further improves the operability of the user by further increasing the number of thumbnail images displayed and allowing the user to select a desired captured image by a slide operation or the like. Can do.

The CPU 302 of the second transmission terminal 30 receives an input of transmission information to be superimposed on the captured image displayed in the captured image display area 300 from the user (step S514). For example, the user performs an operation of directly writing the transmission information on the captured image displayed in the captured image display area 300 using the user's fingertip, stylus, or the like, or an operation of attaching the selected image to the captured image. Communication information can be entered.

As shown in FIG. 6C, the CPU 302 of the second transmission terminal 30 displays a plurality of input operation icons in the vicinity of the capture image display area 300 on the touch panel display 301, for example. For example, the CPU 302 displays a plurality of image selection icons 326 adjacent to the right side of the captured image display area 300. The user can input an image (for example, a hat) of the image selection icon 326 as transmission information by dragging and dropping any one of the image selection icons 326 to the captured image display area 300.

In addition, when the image of the image selection icon 326 is selected, the identification code of the object indicating the icon can be included in the transmission information. In addition, information such as a display position, a display size, a display color, or a visual effect of an object indicating an icon can be included in the transmission information. In this case, the receiving terminal 2 acquires an icon image based on the identification code of the object indicating the icon. For this reason, it is not necessary to transmit / receive icon image data.

Further, as shown in FIG. 6C, the CPU 302 displays tool selection icons 331 to 339 adjacent to the right side of the image selection icon 326, for example. For example, the user can perform an input operation corresponding to the tapped tool selection icon by tapping any of the tool selection icons 331 to 339.

For example, a user who has selected a tool selection icon 331 indicating a pencil tool can perform an input operation using a free curve. For example, the user who has selected the tool selection icon 332 indicating the line color / line type change tool can perform an operation of changing the color and type of the free curve. For example, a user who has selected a tool selection icon 333 indicating an eraser tool can perform an operation of deleting input characters, graphics, and the like.

For example, a user who has selected a tool selection icon 334 indicating a text input tool can perform an operation of inputting text characters. In this case, the user can input text characters using a software keyboard displayed on the touch panel display 301. In addition, when a user inputs a text character into a capture image using a text input tool, it is preferable to include position information of the input text character in the capture image in the transmission information. Thereby, in the receiving terminal 2, a text character can be displayed on the position based on position information, and transmission information can be transmitted correctly.

For example, a user who has selected the tool selection icon 335 indicating a quadrangle input tool can perform an operation of inputting a quadrangle. For example, the user who has selected the tool selection icon 336 indicating the range selection tool can perform an operation of selecting an arbitrary range in the captured image.

For example, the user who has selected the tool selection icon 337 indicating the magnifying glass tool can perform an operation of enlarging or reducing the captured image. For example, the user who has selected the tool selection icon 338 indicating an ellipse tool can perform an operation of inputting an ellipse. For example, the user who has selected the tool selection icon 339 indicating the color selection tool can perform an operation of adding a color to an arbitrary range in the captured image.

Using the icons and tools described above, the user can input arbitrary transmission information on the captured image display area 300 as shown in FIG. 10A. In this case, the transmission information is displayed superimposed on the captured image in the captured image display area 300.

For example, as shown in FIG. 10A, the user can input a surrounding line 101 surrounding the dumbbell 330, which is a display object in the captured image, as transmission information. Further, for example, as shown in FIG. 10A, the user can input a free curve indicating “I want this!” As transmission information on the top of the dumbbell 330 that is a display object in the captured image.

In step S515 of FIG. 5, the CPU 302 determines whether or not the input of the transmission information by the user is completed. For example, when the CPU 302 detects that the input completion button 312 (FIG. 10A) displayed on the touch panel display 301 of the second transmission terminal 30 is pressed by the user's fingertip or stylus, the transmission information Judge that input is complete.

If the CPU 302 determines that the input of the transfer information has been completed (step S515, Yes), the CPU 302 associates the scene identification information of the captured image on which the transfer information is superimposed with the input transfer information data, and the flash memory 305. Is recorded in the transmission information data 305c (step S516).

For example, the CPU 302 generates scene identification information by combining the data of the broadcast station ID 71, the program ID 72, and the reproduction time 73 of the record 703 (FIG. 7A) held in the captured image data 305b, and generates the generated scene identification information. Correlate with the transmitted information. Specifically, as shown in FIG. 11A, the CPU 302 converts the data of the broadcast station ID 111 “B001”, the program ID 112 “P101”, and the reproduction time 113 “18:15:03” into the actual data “( Com001.bmp) ”is recorded in the transmission information data 305c. Note that the captured image data itself on which the transmission information is to be superimposed is not recorded in the transmission information data 305c.

As shown in FIG. 7B, when an ID number is added to each record (records 701 to 705) of the captured image data 305b, the CPU 302 generates scene identification information including the ID number, The generated scene identification information can be associated with the transmission information. Specifically, as illustrated in FIG. 11B, the CPU 302 replaces the broadcast station ID 111 “B001”, the program ID 112 “P101”, and the reproduction time 113 “18:15:03” illustrated in FIG. 11A with an ID number. The data of 115 “ID003” is recorded in the transmission information data 305 c in association with the actual data “(Com001.bmp)” of the transmission information 114.

Note that the transmission information is still image data, and can be, for example, raster image bitmap image data. The still image data of the transmission information can be in a vector format in which the line thickness, color, etc. can be changed for each line.

Subsequently, the CPU 302 of the second transmission terminal 30 transmits the transmission information in which the scene identification information is associated in step S516 to the reception terminal 2 (step S517). For example, the CPU 302 transmits the data of the record 1100 of the transmission information data 305c illustrated in FIG. 11A or 11B to the receiving terminal 2. Therefore, the captured image data itself on which the transmission information is superimposed is not transmitted to the receiving terminal 2.

[1-4-3. Display of superimposed image on receiving terminal 2]
In step S534 of FIG. 5, the CPU 402 of the receiving terminal 2 receives and records the transmission information from the second transmitting terminal 30. For example, the CPU 402 receives the data of the record 1100 of the transmission information data 305c shown in FIG. 11A or FIG. 11B from the second transmission terminal and records it in the transmission information data 405c of the external connection type hard disk drive 411. The transmission information data 405c of the receiving terminal 2 is the same as that shown in FIG. 11A or FIG. 11B in the second transmitting terminal 30.

Subsequently, the CPU 402 of the receiving terminal 2 generates a superimposed image obtained by superimposing the transmission information received in step S534 on the captured image recorded in the captured image data 405b in step S533 (step S535).

For example, the CPU 402 acquires, from the transmission information data 405c, still image data of transmission information (for example, FIG. 12A) indicating the surrounding line 101 and the free curve 102 indicating "I want this!"

As shown in FIG. 11A, the actual data “(Com001.bmp)” of the transmission information 114 held in the transmission information data 405c includes the broadcast station ID 111 “B001”, the program ID 112 “P101”, and the reproduction time 113 “18: 15:03 ”. Therefore, the CPU 402 captures actual data of the captured image associated with the same data values as the data of the broadcast station ID 111 “B001”, the program ID 112 “P101”, and the reproduction time 113 “18:15:03”. Obtained from the image data 405b. For example, in the record 903 of FIG. 9A, the CPU 402 records the actual data “(R_Cap003) of the captured image 94 associated with the broadcasting station ID 91“ B001 ”, the program ID 92“ P101 ”, and the reproduction time 93“ 18:15:03 ”. .bmp) ".

When receiving the transmission information including the ID number from the second transmission terminal 30, the CPU 402 of the receiving terminal 2 acquires the actual data of the captured image from the captured image data 405 b based on the ID number included in the transmission information. . Specifically, as illustrated in FIG. 11B, when the transmission information data 405c including the data of ID number 115 “ID003” is received, the CPU 402 is associated with the same data value as the data of ID number 115 “ID003”. The actual captured image data “(R_Cap003.bmp)” is acquired from the record 903 of the captured image data 405b shown in FIG. 9B. In this case, the receiving terminal 2 can specify the captured image based on the ID number.

As described above, for example, the CPU 402 of the receiving terminal 2 superimposes the transmission information (Com001.bmp) illustrated in FIG. 12A on the captured image (R_Cap003.bmp) illustrated in FIG. 12B, thereby superimposing the image 120 illustrated in FIG. 12C. Can be generated. Here, the superimposed image 120 illustrated in FIG. 12C matches the image displayed in the captured image display area 300 illustrated in FIG. 10A.

The CPU 402 of the receiving terminal 2 displays the generated superimposed image (step S536). The CPU 402 displays the superimposed image 120 illustrated in FIG. 12C on the display 401 of the receiving terminal 2. As illustrated in FIG. 13A, for example, the CPU 402 causes the superimposed image 120 to be superimposed and displayed on the content screen 130 that the user of the receiving terminal 2 is viewing.

Further, when the receiving terminal 2 includes the tablet terminal 40, the superimposed image 120 can be displayed on the touch panel display of the tablet terminal 40 as shown in FIG. 13B. When the tablet terminal 40 of the receiving terminal 2 has the same configuration as that of the second transmitting terminal 30 (FIG. 3), the user of the receiving terminal 2 transmits transmission information to the user of the transmitting terminal 1. Can do. In this case, the user of the transmission terminal 1 and the user of the reception terminal 2 can exchange the transmission information about the captured image of the real-time content being viewed, thereby enabling two-way communication.

The CPU 202 of the first transmission terminal 20 returns to step S501 after executing step S504, and repeats the above processing (steps S501 to S504). After executing step S517, the CPU 302 of the second transmission terminal 30 returns to step S511 and repeats the above processing (steps S511 to S517). After executing step S536, the CPU 402 of the receiving terminal 2 returns to step S531, and repeats the above processing (steps S531 to S536).

[1-5. Modified example]
[1-5-1. First Modification]
In the information transmission system described above, the transmission terminal 1 includes two devices, the first transmission terminal 20 and the second transmission terminal 30, but the transmission terminal 1 can be configured with one device.

FIG. 14 is a diagram illustrating an example of a system configuration of an information transmission system when the transmission terminal 1 is configured by a single device. As shown in FIG. 14, the transmission terminal 1 includes a real-time content reception unit 11, an image display unit 12, a transmission side buffer unit 13, a scene identification information transmission unit 14, a transmission side capture image acquisition unit 15, a transmission information transmission unit 16, A capture instruction receiving unit 17, a transmission information receiving unit 18, and a captured image display unit 19 are provided.

For example, the transmission information reception unit 18 is connected to the transmission terminal 1 with a pen tablet, a liquid crystal pen tablet, a touch pad, a touch panel, a mouse, an air mouse (a mouse capable of posture recognition in space), a pointer (a position on the display). Input information using a pointing device such as a touch panel or a touch panel. In addition, each function part in the transmission terminal 1 and the reception terminal 2 of this modification is the same as each function part in FIG.

[1-5-2. Second Modification]
In the information transmission system described above, the second transmission terminal 30 includes the transmission information transmission unit 16, but the first transmission terminal 20 may include the transmission information transmission unit 16.

FIG. 15 is a diagram illustrating an example of a system configuration of the information transmission system when the first transmission terminal 20 includes the transmission information transmission unit 16. As shown in FIG. 15, the first transmission terminal 20 includes a real-time content reception unit 11, an image display unit 12, a transmission side buffer unit 13, a scene identification information transmission unit 14, a transmission side capture image acquisition unit 15, and a transmission information transmission unit. 16. The second transmission terminal 30 includes a capture instruction receiving unit 17, a transmission information receiving unit 18, and a captured image display unit 19. In addition, each function part in the 1st transmission terminal 20, the 2nd transmission terminal 30, and the receiving terminal 2 of this modification is the same as each function part of FIG.

[1-5-3. Third Modification]
In the information transmission system described above, the first transmission terminal 20 includes the scene identification information transmission unit 14, but the second transmission terminal 30 may include the scene identification information transmission unit 14.

FIG. 16 is a diagram illustrating an example of a system configuration of the information transmission system when the second transmission terminal 30 includes the scene identification information transmission unit 14. As shown in FIG. 16, the first transmission terminal 20 includes a real-time content reception unit 11, an image display unit 12, a transmission side buffer unit 13, and a transmission side capture image acquisition unit 15. The second transmission terminal 30 includes a scene identification information transmission unit 14, a transmission information transmission unit 16, a capture instruction reception unit 17, a transmission information reception unit 18, and a captured image display unit 19. In addition, each function part in the 1st transmission terminal 20, the 2nd transmission terminal 30, and the receiving terminal 2 of this modification is the same as each function part of FIG.

[1-5-4. Fourth Modification]
The information transmission system described above is configured such that each of the transmission terminal 1 and the reception terminal 2 receives real-time content from the broadcast station 3, but each of the transmission terminal 1 and the reception terminal 2 receives real-time content via the Internet. It is also possible to receive real-time content from a content distribution server that can distribute the content.

FIG. 17 is a diagram showing an example of the system configuration of the information transmission system in the case where the configuration is such that real-time content is received from the content distribution server. As shown in FIG. 17, the real-time content reception unit 11 of the first transmission terminal 20 and the real-time content reception unit 21 of the reception terminal 2 can receive real-time content from the content distribution server 4. In this case, the real-time content is content that is distributed in a streaming format, for example, and can be viewed simultaneously by each user in a plurality of terminals. In addition, each other function part in the 1st transmission terminal 20, the 2nd transmission terminal 30, and the receiving terminal 2 of this modification is the same as that of each function part of FIG.

[1-5-5. Fifth Modification]
In the information transmission system described above, each of the transmission terminal 1 and the reception terminal 2 uses the ring buffer (203a or 403a) to refer to frames displayed in the past, and captures five captured images with different reproduction times by 1 second. It was set as the structure recorded. However, one or both of the transmission terminal 1 and the reception terminal 2 can be configured not to use a ring buffer.

When the transmission terminal 1 does not use the ring buffer 203a, scene identification information is created based on one captured image captured at the timing when a capture instruction is received from the user. The above configuration is, for example, between the time when the user desires to capture, the time when the user presses the capture instruction button 311 of the second transmission terminal 30, and the time when the content is actually captured at the first transmission terminal 20. It is preferable to employ when the time lag between each time is small.

When the receiving terminal 2 does not use the ring buffer 403a, a superimposed image is generated based on one captured image captured at the timing when the scene identification information is received from the transmitting terminal 1. The above configuration is preferably employed, for example, when the communication speed between the transmission terminal 1 and the reception terminal 2 is high.

[1-5-6. Sixth Modification]
In the information transmission system described above, the receiving terminal 2 is configured by one device, but the receiving terminal 2 may be configured to include two devices. FIG. 18A is a diagram illustrating an example of a configuration of a receiving terminal when the receiving terminal 1 is configured by two devices. As illustrated in FIG. 18A, the receiving terminal 1 includes a first receiving terminal 40 and a second receiving terminal 50. Note that the transmitting terminal may have any of the configurations described above.

For example, the first receiving terminal 40 is a television receiver having the same hardware configuration as in FIG. Note that the first receiving terminal 40 may be a device device (for example, a disk recording / playback device) that incorporates a tuner capable of receiving a television broadcast. The first receiving terminal 40 may be a device device (for example, a set top box or a disk recording / playback device) that incorporates a tuner that can receive a television broadcast via a network such as a cable television. The first receiving terminal 40 can communicate with the transmitting terminal 1 and the second receiving terminal 50.

For example, the second receiving terminal 50 is a tablet-type terminal having the same hardware configuration as in FIG. The second receiving terminal 50 can be a smartphone equipped with a touch panel display or the like. The second receiving terminal 50 can communicate with the transmitting terminal 1 and the first receiving terminal 40.

As shown in FIG. 18A, the first receiving terminal 40 includes a real-time content receiving unit 21, an image display unit 22, a receiving side buffer unit 23, a receiving side captured image acquisition unit 25, and a scene identification information receiving unit 27. The second receiving terminal 50 includes an image superimposing unit 24, an image display unit (superimposed image display unit) 28, and a transmission information receiving unit 26.

The image display unit 28 in the second receiving terminal 50 can display the superimposed image generated by the image superimposing unit 24. In addition, the image display unit 28 can display an image (for example, a moving image) of the content received by the real-time content receiving unit 21 and allow the user of the receiving terminal 2 to view the content. In addition, each other function part in the transmission terminal 1 of this modification and the receiving terminal 2 is the same as that of each function part of FIG.

[1-5-7. Seventh Modification]
In the information transmission system of the sixth modified example described above, the second receiving terminal 50 is configured to include the transmitted information receiving unit 26, but the first receiving terminal 40 is configured to include the transmitted information receiving unit 26. You can also.

FIG. 18B is a diagram illustrating an example of the configuration of the receiving terminal when the first receiving terminal 40 includes the transmission information receiving unit 26. As shown in FIG. 18B, the first receiving terminal 40 includes a real-time content receiving unit 21, an image display unit 22, a receiving-side buffer unit 23, a receiving-side captured image acquisition unit 25, a scene identification information receiving unit 27, and a transmission information receiving unit. 26. The second receiving terminal 50 includes an image superimposing unit 24 and an image display unit 28. In addition, each function part in the transmission terminal 1, the 1st receiving terminal 40, and the 2nd receiving terminal 50 of this modification is the same as that of each function part, such as FIG. 1 and FIG. 18A.

[1-5-8. Eighth Modification]
In the information transmission system of the sixth modification described above, the first receiving terminal 40 includes the scene identification information receiving unit 27, but the second receiving terminal 50 includes the scene identification information receiving unit 27. You can also

FIG. 18C is a diagram illustrating an example of a configuration of the receiving terminal when the second receiving terminal 40 includes the scene identification information receiving unit 27. As shown in FIG. 18C, the first receiving terminal 40 includes a real-time content receiving unit 21, an image display unit 22, a receiving side buffer unit 23, and a receiving side captured image acquisition unit 25. The second receiving terminal 50 includes a scene identification information receiving unit 27, an image superimposing unit 24, an image display unit 28, and a transmission information receiving unit 26. In addition, each function part in the transmission terminal 1, the 1st receiving terminal 40, and the 2nd receiving terminal 50 of this modification is the same as that of each function part, such as FIG. 1 and FIG. 18A.

[1-5-9. Ninth Modification]
In the information transmission system of the sixth modified example described above, the first receiving terminal 40 includes the scene identification information receiving unit 27 and the second receiving terminal 50 includes the transmission information receiving unit 26. In addition, the first receiving terminal 40 may include the transmission information receiving unit 26, and the second receiving terminal 50 may include the scene identification information receiving unit 27.

FIG. 18D is a diagram illustrating an example of a configuration of the receiving terminal when the first receiving terminal 40 includes the transmission information receiving unit 26 and the second receiving terminal 50 includes the scene identification information receiving unit 27. As illustrated in FIG. 18D, the first receiving terminal 40 includes a real-time content receiving unit 21, an image display unit 22, a receiving-side buffer unit 23, a receiving-side captured image acquisition unit 25, and a transmission information receiving unit 26. The second receiving terminal 50 includes a scene identification information receiving unit 27, an image superimposing unit 24, and an image display unit 28. In addition, each function part in the transmission terminal 1, the 1st receiving terminal 40, and the 2nd receiving terminal 50 of this modification is the same as that of each function part, such as FIG. 1 and FIG. 18A.

[1-5-10. Tenth Modification]
In the information transmission systems of the sixth to ninth modifications described above, the second receiving terminal 50 includes the image superimposing unit 24. However, the first receiving terminal 40 includes the image superimposing unit 24. It can also be configured.

FIG. 18E is a diagram illustrating an example of the configuration of the receiving terminal when the first receiving terminal 40 in the sixth modification (FIG. 18B) includes the image superimposing unit 24. As shown in FIG. 18E, the first receiving terminal 40 includes a real-time content receiving unit 21, an image display unit 22, a receiving-side buffer unit 23, a receiving-side captured image acquisition unit 25, a scene identification information receiving unit 27, and a transmission information receiving unit. 26 and an image superimposing unit 24. The second receiving terminal 50 includes an image display unit 28. 18A, 18C, and 18D, the first receiving terminal 40 may include the image superimposing unit 24. In addition, each function part in the transmission terminal 1, the 1st receiving terminal 40, and the 2nd receiving terminal 50 of this modification is the same as that of each function part, such as FIG. 1 and FIG. 18A.

[1-6. Summary]
As described above, according to the information transmission system disclosed in this embodiment, the transmission information is superimposed on the transmission terminal 1 (the first transmission terminal 20 and the second transmission terminal 30) without transmitting the capture image. The captured image can be displayed on the receiving terminal 2. Further, since the transmission terminal 1 does not need to transmit the captured image to the reception terminal 2, it is possible to reduce the network load by suppressing the transmission data amount.

Further, according to the information transmission system disclosed in this embodiment, when the transmission terminal 1 transmits the scene identification information of the captured image to the reception terminal 2 (step S503), the reception terminal 2 is based on the received scene identification information. A specific scene is captured and a captured image is recorded (step S533). For this reason, the user of the receiving terminal 2 does not need to record a broadcast program beforehand in the receiving terminal 2. Thereby, the trouble of the user of the receiving terminal 2 recording the content and holding the recorded content can be eliminated.

Also, according to the information transmission system disclosed in this embodiment, when the transmission terminal 1 transmits the transmission information associated with the scene identification information to the reception terminal 2 (step S517), the reception terminal 2 receives the received scene identification. The received transmission information is superimposed on the captured image based on the information to generate a superimposed image (step S535). For this reason, the transmission information from the user of the transmission terminal 1 can be transmitted to the user of the reception terminal 2 accurately and in real time.

In the present embodiment, the real-time content receiving unit 11 and the image display unit 12 in the first transmission terminal 20 include the processing function of step S501 in FIG. 5 as an example. The transmission side capture image acquisition unit 15 in the first transmission terminal 20 includes the processing function of step S502 of FIG. 5 as an example. The scene identification information transmission unit 14 in the first transmission terminal 20 includes the processing function of step S503 in FIG. 5 as an example.

In the present embodiment, the capture instruction reception unit 17 in the second transmission terminal 30 includes the processing function of step S511 in FIG. 5 as an example. The captured image display unit 19 in the second transmission terminal 30 includes the processing function of step S513 in FIG. 5 as an example. The transmission information reception unit 18 in the second transmission terminal 30 includes the processing function of step S514 in FIG. 5 as an example. The transmission information transmission unit 16 in the second transmission terminal 30 includes the processing function of step S517 in FIG. 5 as an example.

In the present embodiment, the real-time content receiving unit 21 and the image display unit 22 in the receiving terminal 2 include the processing function of step S531 in FIG. 5 as an example. The scene identification information receiving unit 27 in the receiving terminal 2 includes the processing function of step S532 in FIG. 5 as an example. The receiving side capture image acquisition unit 25 in the receiving terminal 2 includes the processing function of step S533 in FIG. 5 as an example. The transmission information receiving unit 26 in the receiving terminal 2 includes the processing function of step S534 in FIG. 5 as an example. The image superimposing unit 24 in the receiving terminal 2 includes the processing function of step S535 in FIG. 5 as an example.

In the present embodiment, the case where the present invention is applied to an information transmission system has been described as an example, but the scope of application of the present invention is not limited to this. For example, the information transmission system of the present invention can be applied to a web system. In this case, each function part of the transmission terminal 1 (the 1st transmission terminal 20, the 2nd transmission terminal 30) and the reception terminal 2 is implement | achieved by the computer apparatus, tablet PC, tablet, smart phone, or mobile phone etc. which have a browser function etc. be able to.

[2. Second Embodiment]
In the above embodiment, the information transmission system is configured such that the transmission terminal 1 and the reception terminal 2 communicate with each other via the network N, but can be connected to the transmission terminal 1 and the reception terminal 2 via the network N, respectively. A simple management server can be provided. In the present embodiment, the same reference numerals are given to functional units or elements common to those in the first embodiment, and a duplicate description thereof is omitted.

[2-1. System configuration]
FIG. 19 is a diagram illustrating an example of a system configuration of an information transmission system according to the second embodiment. In this system configuration, the transmission terminal 1 (the first transmission terminal 20 and the second transmission terminal 30), the reception terminal 2a, the reception terminal 2b, the reception terminal 2c, and the management server 5 are connected via the network N so that they can communicate with each other. Has been. For example, the management server 5 is a computer device.

In FIG. 19, three receiving terminals, that is, the receiving terminal 2a, the receiving terminal 2b, and the receiving terminal 2c are shown, but there may be one or more receiving terminals. In FIG. 19, only one transmission terminal 1 and management server 5 are shown, but there may be a plurality of each.

[2-2. Outline of processing]
Hereinafter, an outline of processing of the information transmission system according to the second embodiment will be described using a functional block diagram. The management server 5 includes a scene identification information distribution unit 51 and a transmission information distribution unit 52. The scene identification information distribution unit 51 in the management server 5 distributes the scene identification information received from the transmission terminal 1 to each of the reception terminal 2a, the reception terminal 2b, and the reception terminal 2c. The transmission information distribution unit 52 in the management server 5 distributes the transmission information received from the transmission terminal 1 to each of the reception terminal 2a, the reception terminal 2b, and the reception terminal 2c.

As described above, the management server 5 distributes the scene identification information and the transmission information received from the transmission terminal 1 to each of the reception terminal 2b and the reception terminal 2c, so that the captured image and the transmission information based on the scene identification information are transmitted. It can be shared among the terminal 1, the receiving terminal 2a, the receiving terminal 2b, and the receiving terminal 2c. For example, when the management server 5 is an SNS (Social Network Service) server or a chat server, it is possible to communicate between a plurality of users via transmission information transmitted from the transmission terminal.

[2-3. Hardware configuration of management server 5]
FIG. 20 is a diagram illustrating an example of a hardware configuration in which the management server 5 illustrated in FIG. 19 is realized using a CPU. The management server 5 includes a display 601, a CPU 602, a RAM 603, a keyboard / mouse 604, a hard disk drive 605, and a communication circuit 606.

The display 601 can display images of various data output in accordance with instructions from the CPU 602. The CPU 602 can execute processing based on the OS (not shown) and the management server control program 605a. The memory 603 can provide an address space to the CPU 602. The keyboard / mouse 604 can accept the operation of the management server 5 from the user.

The hard disk drive 605 can hold a management server control program 605a, scene identification information data 605b, transmission information data 605c, and the like. The management server control program 605a can be, for example, a communication program that can provide SNS and chat service.

Note that the scene identification information data 205b or the transmission information data 605c may be held in the memory 603. The communication circuit 606 can communicate with the transmission terminal 1, the reception terminal 2a, the reception terminal 2b, the reception terminal 2c, and the like via the network N (FIG. 19).

As an example, the scene identification information distribution unit 51 and the transmission information distribution unit 52 included in the management server 5 illustrated in FIG. 19 are realized by executing the management server control program 605a on the CPU 602. The scene identification information received by the scene identification information distribution unit 51 from the transmission terminal 1 is held in the scene identification information data 605b of the hard disk drive 605 as an example. The transmission information received by the transmission information distribution unit 52 from the transmission terminal 1 is held in the transmission information data 605c of the hard disk drive 605 as an example.

[2-4. Processing details]
Details of processing in the present embodiment will be described with reference to FIGS. 21A, 21 </ b> B, and 22. FIG. 21A and FIG. 21B show that the transmission terminal 1 (the first transmission terminal 20 and the second transmission terminal 30) in the information transmission system of the present embodiment passes through the management server to the reception terminal 2a, the reception terminal 2b, and It is a figure which shows an example of the flowchart which shows the process in the case of transmitting the transmission information of the user who views a real-time content to the receiving terminal 2c (henceforth only "receiving terminal 2"). 21A and 21B are the same as those shown in FIG. 5 except that the management server 5 is interposed between the first transmission terminal 20, the second transmission terminal 30, and the reception terminal 2. It is the same as the processing. Hereinafter, differences from FIG. 5 will be described.

The CPU 202 of the first transmission terminal 20 transmits the scene identification information of the captured image to the management server 5 (step S503). The CPU 602 of the management server 5 receives the scene identification information from the first transmission terminal 20 and records it in the scene identification information data 605b of the hard disk drive 605 (step S521). An example of the scene identification information data 605b is the same as that in FIG. 8A or FIG. 8B.

The CPU 602 of the management server 5 distributes the scene identification information received from the first transmission terminal 20 to the reception terminal 2 (step S522). The CPU 402 of the receiving terminal 2 receives scene identification information for identifying a specific scene of the captured image from the management server 5 (step S532a).

In step S517a, the CPU 302 of the second transmission terminal 30 transmits the transmission information associated with the scene identification information to the management server 5 in step S516. The CPU 602 of the management server 5 receives the transmission information from the second transmission terminal 30 and records it in the transmission information data 605c of the hard disk drive 605 (step S523). An example of the transmission information data 605c is the same as that in FIG. 11A or FIG. 11B.

The CPU 602 of the management server 5 transmits the transmission information received from the second transmission terminal 30 to the reception terminal 2 (step S524). The CPU 402 of the receiving terminal 2 receives and records the transmission information from the management server 5 (step S534a).

In step S536, the CPU 402 of the receiving terminal 2 can display the generated superimposed image, for example, in a chat format. As illustrated in FIG. 22, for example, the CPU 402 displays the superimposed image 120 illustrated in FIG. 12C on the content screen 130 that the user of the receiving terminal 2 is viewing. At this time, the CPU 402 displays the superimposed image 120 in a chat format in association with the icon 140 indicating “Mr. C”, for example.

The CPU 402 displays, in a chat format, a captured image 142 in which the icon image 103 (hat) selected by the image selection icon 326 (FIG. 6C) is superimposed in association with the icon 141 indicating “Mr. B”, for example. . When only text characters are input without specifying a capture image, for example, the input text character “This movie is fun!” 144 is displayed in a chat format in association with the icon 143 indicating “Mr. A”. To do.

The CPU 602 of the management server 5 returns to step S521 after executing step S524, and repeats the above processing (steps S521 to S524).

In this embodiment, the scene identification information distribution unit 51 in the management server 5 includes the processing functions of steps S521 and S522 of FIG. 21A as an example. The transmission information distribution unit 52 in the management server 5 includes the processing functions of steps S523 and S524 in FIG. 21B as an example.

[2-5. Others]
In FIG. 19 described in the present embodiment, the configurations of the transmission terminal 1 (the first transmission terminal 20 and the second transmission terminal 30) and the reception terminal 2 are the same as those illustrated in FIG. 1 of the first embodiment. Although similar, this embodiment is applicable to other configurations. For example, the configuration of the transmission terminal 1 or the reception terminal 2 in this embodiment is the same as that of the first to tenth modifications in the first embodiment (transmission terminal 1 (first transmission terminal 20 and second transmission terminal 2). Transmission terminal 30) or reception terminal 2 (first reception terminal 40 and second reception terminal 50)).

[3. Third Embodiment]
[3-1. Send / receive data]
[3-1-1. Linking by playback time etc.]
FIG. 23A is a diagram schematically illustrating a relationship between data transmitted and received between the transmission terminal 1 and the reception terminal 2 in the embodiment.

As shown in FIG. 23A, the transmission terminal 1 transmits scene identification information including the reproduction time (hereinafter referred to as “reproduction time etc. 281”) to the reception terminal 2. The receiving terminal 2 acquires the captured image 283 based on the reproduction time 281 received from the transmitting terminal 1.

Further, the transmission terminal 1 transmits the reproduction time 281 and the transmission information 282 to the reception terminal 2. The receiving terminal 2 generates a superimposed image by associating the captured image 283 acquired above with the transmission information 282 based on the reproduction time 281 received together with the transmission information 282 from the transmission terminal 1.

As described above, in the above embodiment, the transmission terminal 1 (the first transmission terminal 20 or the second transmission terminal 30) and the reception terminal 2 associate the capture image 283 with the transmission information 282 using the reproduction time 281 or the like. ing.

However, the data linking the captured image 283 and the transmission information 282 is not limited to the reproduction time 281 or the like. FIG. 23B to FIG. 23E are diagrams schematically illustrating a relationship of data transmitted and received between the transmission terminal 1 and the reception terminal 2 in different embodiments.

[3-1-2. Linking by ID number issued by sending terminal 1]
As illustrated in FIG. 23B, the transmission terminal 1 issues an ID number and transmits scene identification information (hereinafter referred to as “ID number 284”) including the issued ID number to the reception terminal 2. The receiving terminal 2 acquires the captured image 283 when receiving the ID number 284 from the transmitting terminal 1, and associates the acquired captured image 283 with the received ID number 284.

Further, the transmission terminal 1 transmits the ID number 284 and the transmission information 282 issued above to the reception terminal 2. Based on the ID number 284 received together with the transmission information 282 from the transmission terminal 1, the reception terminal 2 generates a superimposed image by associating the captured image 283 acquired above with the transmission information 202.

As described above, the transmission terminal 1 (the first transmission terminal 20 or the second transmission terminal 30) and the reception terminal 2 use the ID number 284 issued by the transmission terminal 1 to associate the capture image 283 with the transmission information 282. be able to.

[3-1-3. Linking by ID number issued by sending terminal 1 and playback time]
As shown in FIG. 23C, the transmission terminal 1 issues an ID number associated with the reproduction time and the like, and scene identification information (hereinafter referred to as “ID number 284”) including the reproduction time and the ID number corresponding to the reproduction time. Or “reproduction time etc. 281”) is transmitted to the receiving terminal 2. The receiving terminal 2 acquires the captured image 283 based on the reproduction time 281 received from the transmitting terminal 1, and associates the acquired captured image 283 with the received ID number 284.

Further, the transmission terminal 1 transmits the ID number 284 and the transmission information 282 issued above to the reception terminal 2. Based on the ID number 284 received together with the transmission information 282 from the transmission terminal 1, the reception terminal 2 generates a superimposed image by associating the captured image 283 acquired in the above with the transmission information 282.

[3-1-4. Linking by ID number issued by receiving terminal 2]
As illustrated in FIG. 23D, the transmission terminal 1 transmits scene identification information including a capture instruction (hereinafter, “capture instruction 285”) to the reception terminal 2. The receiving terminal 2 acquires the capture image 283 at the time of receiving the capture instruction 285 from the transmission terminal 1, issues an ID number, associates the issued ID number with the acquired capture image 283, and issues the issued ID The number is transmitted to the transmission terminal 1. That is, the capture instruction 285 transmitted by the transmission terminal 1 can be data (for example, a predetermined code such as “TRG”) that functions as a trigger for causing the reception terminal 2 to acquire a captured image.

Further, the transmission terminal 1 transmits the ID number 284 and the transmission information 282 received from the reception terminal 2 to the reception terminal 2. Based on the ID number 284 received together with the transmission information 282 from the transmission terminal 1, the reception terminal 2 generates a superimposed image by associating the captured image 283 acquired in the above with the transmission information 282.

Thus, the transmission terminal 1 (the first transmission terminal 20 or the second transmission terminal 30) and the reception terminal 2 use the ID number 284 issued by the reception terminal 2 to associate the capture image 283 with the transmission information 282. be able to.

[3-1-5. Association with ID number issued by management server 5]
As illustrated in FIG. 23E, the transmission terminal 1 transmits scene identification information including a capture instruction (hereinafter, referred to as “capture instruction 285”) to the management server 5. The management server 5 issues an ID number when receiving the capture instruction 285 from the transmission terminal 1 and transmits the issued ID number to both the transmission terminal 1 and the reception terminal 2. That is, the capture instruction 285 transmitted by the transmission terminal 1 can be data (for example, a predetermined code such as “CAP”) that functions as a trigger for causing the management server 5 to issue an ID number.

Further, the receiving terminal 2 acquires the captured image 283 when the ID number 284 is received from the management server 5, and associates the acquired captured image 283 with the received ID number 284.

Further, the transmission terminal 1 transmits the ID number 284 and the transmission information 282 received from the management server 5 to the reception terminal 2 via the management server 5. Based on the ID number 284 received together with the transmission information 282 from the transmission terminal 1 via the management server 5, the reception terminal 2 generates a superimposed image by associating the captured image 283 acquired above with the transmission information 282. To do.

As described above, the transmission terminal 1 (the first transmission terminal 20 or the second transmission terminal 30) and the reception terminal 2 use the ID number 284 issued by the management server 5 to associate the capture image 283 with the transmission information 282. be able to.

[4. Fourth Embodiment]
In the above embodiment, the example in which the transmission information is displayed superimposed on the capture image has been described, but the transmission information and the capture image may be displayed in association with each other. In the present embodiment, an example will be described in which transmission information displayed in association with a captured image is quiz information for giving a quiz to a receiving user. In the present embodiment, functional units or elements that are common to the first to third embodiments are given the same reference numerals, and redundant descriptions thereof are omitted.

[4-1. System configuration]
FIG. 24 is a diagram illustrating an example of a system configuration of an information transmission system according to the fourth embodiment. In this system configuration, as in the first embodiment, the transmission terminal 1 (the first transmission terminal 20 and the second transmission terminal 30) and the reception terminal 2 are connected via a network N so as to be able to communicate with each other. .

[4-2. Outline of processing]
Hereinafter, an outline of processing of the information transmission system according to the fourth embodiment will be described with reference to a functional block diagram. In the first transmitting terminal 20, the second transmitting terminal 30, and the receiving terminal 2 in FIG. 24, a functional block diagram showing functional units included in each device is described.

The first transmission terminal 20 includes a quiz information creation unit 181 and a quiz information transmission unit 161 instead of the transmission information transmission unit 16 and the transmission information reception unit 18 illustrated in FIG. 1 of the first embodiment. The receiving terminal 2 includes an image composition unit 241 and a quiz information receiving unit 261 instead of the image superimposing unit 24 and the transmission information receiving unit 26 illustrated in FIG. 1 of the first embodiment.

The quiz information creation unit 181 in the second transmission terminal 30 receives quiz setting input related to the captured image displayed by the capture image display unit 19 in the second transmission terminal 30 and generates quiz information. The quiz information transmission unit 161 in the second transmission terminal 30 transmits the quiz information generated by the quiz information creation unit 181 in the second transmission terminal 30 to the reception terminal 2.

The quiz information receiving unit 261 in the receiving terminal 2 receives from the second transmitting terminal 30 the quiz information generated by the quiz information creating unit 161 in the second transmitting terminal 30 receiving the setting input. The image combining unit 241 in the receiving terminal 2 combines the quiz information received by the quiz information receiving unit 261 in the receiving terminal 2 and the captured image acquired by the receiving side capture image acquiring unit 25 in the receiving terminal 2 to generate a combined image. Generate. The image display unit 22 in the receiving terminal 2 displays the synthesized image generated by the image synthesizing unit 241 in the receiving terminal 2 and causes the user of the receiving terminal 2 to visually recognize the synthesized image. In the present invention, combining two or more images is a superordinate concept of superposing two or more images. That is, image composition is a broad concept including image superposition.

The quiz information transmission unit 161, the quiz information creation unit 181, the image composition unit 241 and the quiz information reception unit 261 shown in FIG. 24 each include a CPU function realized by a program.

[4-3. Processing details]
Details of processing in the present embodiment will be described with reference to FIGS. 25 to 32. FIG. 25 and FIG. 27 respectively show a case where the transmission terminal 1 (the first transmission terminal 20 and the second transmission terminal 30) transmits quiz information as transmission information to the reception terminal 2 in the information transmission system of the present embodiment. It is a figure which shows an example of the flowchart which shows the process of.

FIG. 26 is a diagram illustrating an example when a display screen is displayed on the touch panel display 301 of the second transmission terminal 30. FIG. 28 is a diagram illustrating an example when a captured image of real-time content is displayed on the touch panel display 301 of the second transmission terminal 30. FIG. 29 is a diagram illustrating an example when a quiz setting screen is displayed on the touch panel display 301 of the second transmission terminal 30. FIG. 30 is a diagram illustrating an example when a quiz screen is displayed on the touch panel display 301 of the second transmission terminal 30. FIG. 31 is a diagram illustrating an example of the transmission information data 305 c held as quiz information in the second transmission terminal 30.

In each process of the flowchart shown in FIG. 25, each process other than steps S511a, S514a, S516a, S517a, S534a, S535a, and S536a is the same as the process shown in FIG. In the following, description will be made focusing on the differences between FIG. 25 and FIG.

[4-3-1. Creation of quiz information at the second transmitting terminal]
In the flowchart of FIG. 25, the CPU 302 of the second transmission terminal 30 determines whether or not the quiz creation button has been pressed by the user (step S511a). For example, when the CPU 302 detects that the quiz creation button 313 (FIG. 26) displayed on the touch panel display 301 of the second transmission terminal 30 has been pressed with the user's fingertip or stylus, the quiz creation button It is determined that is pressed.

When it is determined that the quiz creation button 313 has been pressed (Yes in step S511a), the CPU 302 of the second transmission terminal 30 transmits capture instruction data to the first transmission terminal 20 as in the first embodiment (step S511). S512).

When the capture instruction data is transmitted to the first transmission terminal 20, the CPU 302 of the second transmission terminal 30 executes a quiz information creation process (step S514a). FIG. 27 is a diagram illustrating an example of a flowchart of quiz information creation processing. In the flowchart of FIG. 27, the CPU 302 of the second transmission terminal 30 displays an image selection screen on the touch panel display 301 (step S621).

FIG. 28 is a diagram illustrating an example when an image selection screen is displayed on the touch panel display 301 of the second transmission terminal 30. On the image selection screen shown in FIG. 28, a partial selection button 2801 for selecting a part of the image and an entire selection button 2802 for selecting the entire image are displayed. When the partial selection button 2801 is pressed, a selection frame 2811 for selecting a part of the image is displayed on the image. Note that the user can select a desired image portion by, for example, dragging the frame of the selection frame 2811 to change the shape and size. In the present embodiment, as shown in FIG. 28, it is assumed that a character face portion is selected in a selection frame 2811.

The CPU 302 of the second transmission terminal 30 determines whether or not selection completion is instructed on the image selection screen (step S622). For example, when the CPU 302 detects that the “Next” button 2813 (FIG. 28) displayed on the touch panel display 301 of the second transmission terminal 30 is pressed with the user's fingertip or stylus, the image selection is performed. It is determined that selection completion is instructed on the screen (step S622, Yes determination). When the “return” button 2812 (FIG. 28) is pressed, the CPU 302 returns to step S511 to display the previous display screen (FIG. 26).

In step S623 of FIG. 27, the CPU 302 of the second transmission terminal 30 displays a quiz setting screen on the touch panel display 301. FIG. 29 is a diagram illustrating an example when a quiz setting screen is displayed on the touch panel display 301 of the second transmission terminal 30. The quiz setting screen shown in FIG. 29 displays a setting field 2901 related to “question type”, a setting field 2902 related to “answer format”, and a setting field 2903 related to “subject” for each quiz to be created.

For example, in the setting field 2901 relating to the “question format”, a “question” format that uses a complete sentence for the question sentence, or a “fill-in” form that uses a sentence that is partially missing in the question sentence can be set as the question format for the quiz. It is. Note that the setting item related to “question type” is not limited to “question” or “fill-in”. In addition, setting items related to “problem format” can be extracted from data stored in advance or acquired from another device via the Internet, for example.

Also, for example, in the setting field 2902 regarding “answer format”, the “4 choice” format for selecting an answer from four choices, the “2 choice” format for selecting an answer from two choices, or the answer as a character "Character input" format entered with can be set as a quiz answer format. Note that the setting item related to “answer format” is not limited to “4 choices”, “2 choices”, or “character input”. In addition, the setting items related to “answer format” can be extracted from data stored in advance, or can be acquired from another device via the Internet.

Also, for example, in the setting field 2903 regarding “theme”, “character”, “thing”, “background”, or the like can be set as a keyword as a quiz theme. The keyword that is the subject of the quiz is extracted based on, for example, metadata associated with the position of the captured image on the content. For this reason, a keyword highly relevant to the captured image can be presented as a candidate for the subject. The keywords related to the subject can be extracted from data stored in advance or acquired from another device via the Internet.

The CPU 302 of the second transmission terminal 30 determines whether or not setting completion is instructed on the quiz setting screen (step S624). For example, when the CPU 302 detects that the “quiz creation” button 2912 (FIG. 29) displayed on the touch panel display 301 of the second transmission terminal 30 is pressed with the fingertip of the user or the stylus, the quiz It is determined that setting completion is instructed on the setting screen (step S624, Yes determination). If the “return” button 2911 is pressed, the CPU 302 returns to step S621 and displays the previous image selection screen (FIG. 28).

In step S625 of FIG. 27, the CPU 302 of the second transmission terminal 30 generates a quiz screen based on the various setting data (question format, answer format and subject) set on the quiz setting screen (FIG. 29) described above, The generated quiz screen is displayed on the touch panel display 301. The quiz screen can be generated using a quiz generation program (not shown) that can automatically generate a quiz screen by inputting various setting data (question format, answer format and subject).

FIG. 30 is a diagram illustrating an example when a quiz screen is displayed on the touch panel display 301 of the second transmission terminal 30. In the quiz screen shown in FIG. 30, for example, the question format is “Question” (“What is the name of this character?” 3002), and the answer format is “4 choices” (“1. John”, “2. George”). , “3. Paul”, “4. Apple” (3003) and the theme is “Character” (“What is the name of this character?” 3002). Further, the selection image 3001 displayed on the quiz screen is the same as the image selected by the user in step S621.

The quiz screen can be generated based on metadata associated with the position of the captured image on the content, for example. For example, the CPU 302 identifies the name of the character appearing at the time of the captured image from the metadata, and sets it as the correct answer for the quiz. Further, the CPU 302 can extract information related to other options of the quiz from the dictionary or obtain it from another device via the Internet.

In addition, the user can correct the contents of the quiz displayed on the quiz screen by pressing the “correct” button 3012 on the quiz screen. For example, when the correction button 3012 is pressed, the quiz screen shifts to the correction mode, and correction input of each character and correction of the position, size, range, or the like of an image or a figure can be appropriately performed (step). S626, Yes judgment). If the “return” button 3011 is pressed, the CPU 302 returns to step S625 and displays the quiz setting screen (FIG. 29), which is the previous screen.

In correct mode, it is desirable that correct options cannot be corrected. For example, in FIG. 30, another option and the display mode may be changed so that the correct option “2. George” cannot be corrected (for example, the correct answer option is displayed in a different color from the other options). .

The user can complete the quiz screen by pressing the “complete” button 3013 (No in step S626). Here, the data for configuring the quiz screen is held in the flash memory 305 as quiz information, for example. Note that the quiz information does not include the captured image data itself.

If the CPU 302 determines that the quiz screen has been completed by completing the quiz information creation process in step S514a, the CPU 302 associates the quiz information data with the scene identification information of the captured image captured in step S502, for example, flash. The transmission information data 305c in the memory 305 is recorded (step S516a).

For example, as shown in FIG. 31, the CPU 302 converts the data of the broadcast station ID 111 “B001”, the program ID 112 “P101”, and the reproduction time 113 “18:15:03” into the actual data “(Quiz001.html) of the quiz information 114a. ) "And recorded in the transmission information data 305c. As described above, the captured image data itself is not recorded in the transmission information data 305c. The data format of the actual data of the quiz information 114a may be a format other than html (for example, CSS (Cascading Style Style Sheets)).

Subsequently, the CPU 302 of the second transmission terminal 30 transmits the quiz information associated with the scene identification information in the above step S516a to the reception terminal 2 (step S517a). For example, the CPU 302 transmits the data of the record 1100 of the transmission information data 305c illustrated in FIG. Therefore, the captured image data itself to which the quiz information is associated is not transmitted to the receiving terminal 2.

[4-3-2. Display of quiz image on receiving terminal 2]
In step S534a in FIG. 25, the CPU 402 of the receiving terminal 2 receives and records quiz information from the second transmitting terminal 30. For example, the CPU 402 receives the data of the record 1100 of the transmission information data 305c shown in FIG. 31 from the second transmission terminal and records it in the transmission information data 405c of the external connection type hard disk drive 411. The transmission information data 405c of the receiving terminal 2 is the same as that shown in FIG. 31 in the second transmitting terminal 30.

Subsequently, the CPU 402 of the receiving terminal 2 generates a quiz image by synthesizing the capture image recorded in the capture image data 405b in step S533 and the quiz information received in step S534a (step S535a).

The CPU 402 of the receiving terminal 2 displays the generated quiz image (step S536a). As illustrated in FIG. 32, for example, the CPU 402 causes the quiz image 121 to be superimposed and displayed on the content screen 130 being viewed by the user of the receiving terminal 2.

[4-4. Modified example]
As a modification of the image selection shown in step S621 (FIG. 27), instead of an image, a sound reproduced together with the image, a character recognizable on the image, or the like may be selected. In this case, a quiz relating to voice, characters, etc. is created.

As a modification of the quiz screen shown in step S625 (FIG. 27), an image or icon (eg, a thumbnail image) in the content may be used as an option. In this case, the image to be used as an option is specified by the reproduction time and the coordinate position, information on the reproduction time and the coordinate position of each image is included in the quiz information, and each image is specified and displayed on the receiving terminal 2. What is necessary is just to comprise.

In the quiz information creation process (FIG. 27) in step S514a, the user selects an image (step S621), inputs quiz settings (step S623), and corrects the quiz screen (step S625), thereby quiz screen. However, the CPU 302 of the second transmission terminal 30 may automatically create a quiz screen. In this case, the user can create a quiz simply by pressing the “quiz creation” button 313 in FIG. In addition, the CPU 302 of the second transmission terminal 30 may automatically execute at least one of image selection (step S621), quiz setting input (step S623), and quiz screen correction (step S625). .

In step S621, the image selected in the selection frame 2811 is used as it is for the quiz, but a processed image of the selected image or the entire image may be used for the quiz. For example, an image on which edge detection is performed, an image on which another image is superimposed as shown in the first embodiment, or the like can be used for the quiz. In this case, the edge detection range and position information and the information of the image to be superimposed are included in the quiz information and transmitted to the receiving terminal 2.

Also, an advertisement corresponding to the theme of the quiz may be displayed on the quiz screen. Note that the advertisement may be set manually by the user or automatically by the CPU 302. Furthermore, the link information of the advertisement to be displayed may be included in the quiz information, and the receiving terminal 2 may display the advertisement based on the link information.

[5. Fifth Embodiment]
In the above-described embodiment, an example in which the transmission information is quiz information has been described as an example of displaying the transmission information and the captured image in association with each other. However, advertisement information may be created instead of the quiz information. In the present embodiment, an example will be described in which transmission information displayed in association with a captured image is advertisement information for allowing a receiving-side user to view. In the present embodiment, functional units or elements that are common to the first to fourth embodiments are given the same reference numerals, and duplicate descriptions thereof are omitted.

[5-1. System configuration]
FIG. 33 is a diagram illustrating an example of a system configuration of an information transmission system according to the fifth embodiment. In this system configuration, as in the first embodiment, the transmission terminal 1 (the first transmission terminal 20 and the second transmission terminal 30) and the reception terminal 2 are connected via a network N so as to be able to communicate with each other. .

[5-2. Outline of processing]
Hereinafter, an outline of processing of the information transmission system according to the fifth embodiment will be described with reference to a functional block diagram. In the first transmission terminal 20, the second transmission terminal 30, and the reception terminal 2 in FIG. 33, a functional block diagram showing functional units included in each device is described.

The first transmission terminal 20 includes an advertisement information creation unit 182 and an advertisement information transmission unit 162 in place of the transmission information transmission unit 16 and the transmission information reception unit 18 illustrated in FIG. 1 of the first embodiment. The receiving terminal 2 includes an image composition unit 242 and an advertisement information receiving unit 262 instead of the image superimposing unit 24 and the transmission information receiving unit 26 illustrated in FIG. 1 of the first embodiment.

The advertisement information creation unit 182 in the second transmission terminal 30 receives advertisement setting input related to the capture image displayed by the capture image display unit 19 in the second transmission terminal 30 and generates advertisement information. The advertisement information transmission unit 162 in the second transmission terminal 30 transmits the advertisement information generated by the advertisement information creation unit 182 in the second transmission terminal 30 to the reception terminal 2.

The advertisement information receiving unit 262 in the receiving terminal 2 receives from the second transmitting terminal 30 the advertising information generated by the advertisement information creating unit 162 in the second transmitting terminal 30 receiving the setting input. The image combining unit 242 in the receiving terminal 2 combines the advertisement information received by the advertisement information receiving unit 262 in the receiving terminal 2 and the captured image acquired by the receiving side capture image acquiring unit 25 in the receiving terminal 2 to generate a combined image. Generate. The image display unit 22 in the receiving terminal 2 displays the synthesized image generated by the image synthesizing unit 242 in the receiving terminal 2 so that the user of the receiving terminal 2 can visually recognize the synthesized image.

33. Each of the advertisement information transmission unit 162, the advertisement information creation unit 182, the image composition unit 242 and the advertisement information reception unit 262 shown in FIG. 33 includes a CPU function realized by a program.

[5-3. Processing details]
Details of processing in this embodiment will be described with reference to FIGS. FIG. 34 and FIG. 36 respectively show a case where the transmission terminal 1 (the first transmission terminal 20 and the second transmission terminal 30) transmits advertisement information as transmission information to the reception terminal 2 in the information transmission system of the present embodiment. It is a figure which shows an example of the flowchart which shows the process of.

FIG. 35 is a diagram illustrating an example when a display screen is displayed on the touch panel display 301 of the second transmission terminal 30. FIG. 37 is a diagram illustrating an example when a captured image of real-time content is displayed on the touch panel display 301 of the second transmission terminal 30. FIG. 38 is a diagram illustrating an example when an advertisement setting screen is displayed on the touch panel display 301 of the second transmission terminal 30. FIG. 39 is a diagram illustrating an example when an advertisement screen is displayed on the touch panel display 301 of the second transmission terminal 30.

In each process of the flowchart shown in FIG. 34, each process other than steps S511b, S514b, S516b, S517b, S534b, S535b, and S536b is the same as the process shown in FIG. In the following, the description will be focused on the difference between FIG. 34 and FIG.

[5-3-1. Creation of advertisement information in the second sending terminal]
In the flowchart of FIG. 34, the CPU 302 of the second transmission terminal 30 determines whether or not the advertisement creation button has been pressed by the user (step S511b). For example, if the CPU 302 detects that the advertisement creation button 314 (FIG. 35) displayed on the touch panel display 301 of the second transmission terminal 30 has been pressed with the user's fingertip or stylus, the advertisement creation button It is determined that is pressed.

If it is determined that the advertisement creation button 314 has been pressed (step S511b, Yes determination), the CPU 302 of the second transmission terminal 30 transmits capture instruction data to the first transmission terminal 20 as in the first embodiment (step S512).

When transmitting the capture instruction data to the first transmission terminal 20, the CPU 302 of the second transmission terminal 30 executes an advertisement information creation process (step S514b). FIG. 35 is a diagram illustrating an example of a flowchart of the advertisement information creation process. In the flowchart in FIG. 36, the CPU 302 of the second transmission terminal 30 displays an image selection screen on the touch panel display 301 (step S631).

FIG. 37 is a diagram illustrating an example when an image selection screen is displayed on the touch panel display 301 of the second transmission terminal 30. As in the fourth embodiment, a partial selection button 2801 for selecting a part of an image and an entire selection button 2802 for selecting the entire image are displayed on the image selection screen shown in FIG. . When the partial selection button 2801 is pressed, a selection frame 2811 for selecting a part of the image is displayed on the image as in the fourth embodiment.

The CPU 302 of the second transmission terminal 30 determines whether or not selection completion is instructed on the image selection screen (step S632). For example, when the CPU 302 detects that the “Next” button 2813 (FIG. 37) displayed on the touch panel display 301 of the second transmission terminal 30 is pressed with the user's fingertip or stylus, the image selection is performed. It is determined that selection completion is instructed on the screen (step S632, Yes determination).

36, in step S633, the CPU 302 of the second transmission terminal 30 displays an advertisement setting screen on the touch panel display 301. FIG. 38 is a diagram illustrating an example when an advertisement setting screen is displayed on the touch panel display 301 of the second transmission terminal 30. The advertisement setting screen shown in FIG. 38 displays a setting field 3701 related to “product selection”, a setting field 3702 related to “purchase information”, and a setting field 3703 related to “review information” for the advertisement to be created. The

For example, in the setting column 3701 regarding “product selection”, for example, a list of works released by a person related to the captured image in FIG. 37 is displayed so as to be selectable. Note that the person related to the captured image can be specified from, for example, metadata associated with the position of the captured image on the content. For example, when the person on the captured image is a singer, a music CD released by the singer is displayed in the product selection field. The information on the music CD released by the singer can be extracted from data stored in advance or acquired from another device via the Internet, for example. Note that the setting item regarding “product selection” is not limited to the music CD.

Also, for example, in the setting field 3702 regarding “purchase information”, information related to the purchase destination of the product displayed in the product selection field is displayed in a selectable manner. Note that the setting item related to “purchase information” is not limited to “URL1”, “URL2”, or “URL3”. In addition, setting items related to “purchase information” can be extracted from data stored in advance, or can be acquired from another device via the Internet.

Also, for example, in the setting field 3703 regarding “review”, it is possible to input so-called review information about the person (singer) related to the captured image in FIG. The word-of-mouth information can be extracted from prestored data or acquired from another device via the Internet.

The CPU 302 of the second transmission terminal 30 determines whether setting completion is instructed on the advertisement setting screen (step S634). For example, when the CPU 302 detects that the “create advertisement” button 3712 (FIG. 38) displayed on the touch panel display 301 of the second transmission terminal 30 is pressed with the fingertip of the user or the stylus, the advertisement is displayed. It is determined that setting completion is instructed on the setting screen (step S634, Yes determination). If the “return” button 3711 is pressed, the CPU 302 returns to step S631 and displays the previous image selection screen (FIG. 37).

In step S635 of FIG. 36, the CPU 302 of the second transmission terminal 30 generates an advertisement screen based on the various setting data (product selection, purchaser information and word-of-mouth information) set on the advertisement setting screen (FIG. 38) described above. Then, the generated advertisement screen is displayed on the touch panel display 301. The advertisement screen can be generated using an advertisement generation program (not shown) that can automatically generate an advertisement screen by inputting various setting data (product selection, purchaser information and review information). .

FIG. 39 is a diagram illustrating an example when an advertisement screen is displayed on the touch panel display 301 of the second transmission terminal 30. 39, for example, the product information is “Best 1 (A child)” 3801, the purchase destination information is “URL1” 3802, and the word-of-mouth information is “Singing power is amazing!” 3803. The case shows the created advertisement.

As in the fourth embodiment, the user can correct the content of the advertisement displayed on the advertisement screen by pressing the “modify” button 3812 on the advertisement screen. For example, when the correction button 3812 is pressed, the advertisement screen shifts to a correction mode, and correction input of each character and correction of the position, size, range, etc. of an image or a figure can be made as appropriate (step). S636, Yes judgment). When the “return” button 3811 is pressed, the CPU 302 returns to step S633 and displays the advertisement setting screen (FIG. 38), which is the previous screen.

In the correction mode, it is desirable that the product information cannot be corrected. For example, in FIG. 38, it is desirable that “best 1 (A child)”, which is product information, cannot be corrected.

The user can complete the advertisement screen by pressing the “complete” button 3813 (No in step S636). Here, data for configuring the advertisement screen is held as advertisement information in, for example, the flash memory 305.

If it is determined that the advertisement screen has been completed by completing the advertisement information creation process in step S514b, the CPU 302 associates the scene identification information of the captured image captured in step S502 with the advertisement information data, for example, flash. It is recorded in the transmission information data 305c of the memory 305 (step S516b).

An example of the transmission information data 305c is basically the same as FIG. However, in this embodiment, instead of the actual data “(Quiz001.html)” of the quiz information 114a, for example, actual data “(Adv001.html)” of the advertisement information 114b is recorded.

Subsequently, the CPU 302 of the second transmission terminal 30 transmits the advertisement information associated with the scene identification information in the above step S516b to the reception terminal 2 (step S517b). For example, the CPU 302 transmits the data of the record 1100 of the transmission information data 305c illustrated in FIG. Therefore, the captured image data itself to which the advertisement information is associated is not transmitted to the receiving terminal 2.

[5-3-2. Display of advertisement image on receiving terminal 2]
In step S534b of FIG. 34, the CPU 402 of the receiving terminal 2 receives the advertisement information from the second transmitting terminal 30 and records it. For example, the CPU 402 receives the data of the record 1100 of the transmission information data 305c shown in FIG. 31 from the second transmission terminal and records it in the transmission information data 405c of the external connection type hard disk drive 411.

Subsequently, the CPU 402 of the receiving terminal 2 generates an advertisement image by combining the captured image recorded in the captured image data 405b in step S533 and the advertisement information received in step S534b (step S535b).

The CPU 402 of the receiving terminal 2 displays the generated advertisement image (step S536b). As illustrated in FIG. 40, for example, the CPU 402 causes the advertisement image 122 to be superimposed and displayed on the content screen 130 being viewed by the user of the receiving terminal 2.

When the user of the receiving terminal 2 actually purchases a product via the link information (for example, “URL1” 3802) displayed on the advertising image 122, the user of the transmitting terminal 1 who created the advertising image 122 is notified. You may introduce an affiliate to be paid a reward. Thereby, the strong motivation for advertisement preparation can be given to the user of a transmission terminal.

[5-4. Modified example]
As a modification of the image selection shown in step S631 (FIG. 36), instead of an image, sound reproduced along with the image, characters recognizable on the image, or the like may be selected. In this case, an advertisement related to voice, characters, etc. is created.

In the advertisement information creation process (FIG. 34) in step S514b, the user selects an image (step S631), inputs advertisement settings (step S623), and modifies the advertisement screen (step S635). However, the CPU 302 of the second transmission terminal 30 may automatically create an advertisement screen. In this case, the user can create an advertisement simply by pressing the “Create Advertisement” button 314 in FIG. Further, the CPU 302 of the second transmission terminal 30 may automatically execute at least one of image selection (step S631), advertisement setting input (step S633), and advertisement screen modification (step S635). .

[6. Sixth Embodiment]
In the above embodiment, the example in which the transmission information is quiz information or advertising information has been described as an example of displaying the transmission information and the captured image in association with each other. However, even if a game is created instead of the quiz information or advertising information, Good. In the present embodiment, an example will be described in which the transmission information displayed in association with the captured image is game information for causing the receiving user to execute the game. In the present embodiment, the same reference numerals are given to the functional units or elements common to the first to fifth embodiments, and a duplicate description thereof will be omitted.

[6-1. System configuration]
FIG. 41 is a diagram illustrating an example of a system configuration of an information transmission system according to the sixth embodiment. In this system configuration, as in the first embodiment, the transmission terminal 1 (the first transmission terminal 20 and the second transmission terminal 30) and the reception terminal 2 are connected via a network N so as to be able to communicate with each other. .

[6-2. Outline of processing]
Hereinafter, an outline of processing of the information transmission system according to the sixth embodiment will be described with reference to a functional block diagram. In the first transmission terminal 20, the second transmission terminal 30, and the reception terminal 2 in FIG. 41, a functional block diagram showing functional units included in each device is described.

The first transmission terminal 20 includes a game information creation unit 183 and a game information transmission unit 163 instead of the transmission information transmission unit 16 and the transmission information reception unit 18 illustrated in FIG. 1 of the first embodiment. The receiving terminal 2 includes an image composition unit 243 and a game information receiving unit 263 instead of the image superimposing unit 24 and the transmission information receiving unit 26 illustrated in FIG. 1 of the first embodiment.

The game information creation unit 183 in the second transmission terminal 30 receives game setting input related to the captured image displayed by the capture image display unit 19 in the second transmission terminal 30 and generates game information. The game information transmission unit 163 in the second transmission terminal 30 transmits the game information generated by the game information creation unit 183 in the second transmission terminal 30 to the reception terminal 2.

The game information receiving unit 263 in the receiving terminal 2 receives from the second transmitting terminal 30 the game information generated by the game information creating unit 163 in the second transmitting terminal 30 receiving the setting input. The image combining unit 243 in the receiving terminal 2 combines the advertisement information received by the game information receiving unit 263 in the receiving terminal 2 and the captured image acquired by the receiving side capture image acquiring unit 25 in the receiving terminal 2 to generate a combined image. Generate. The image display unit 22 in the receiving terminal 2 displays the synthesized image generated by the image synthesizing unit 242 in the receiving terminal 2 so that the user of the receiving terminal 2 can visually recognize the synthesized image.

41. The game information transmission unit 163, the game information creation unit 183, the image synthesis unit 243, and the game information reception unit 263 shown in FIG. 41 each include a CPU function realized by a program.

[6-3. Processing details]
Details of processing in this embodiment will be described with reference to FIGS. FIG. 42 and FIG. 44 show a case where the transmission terminal 1 (first transmission terminal 20 and second transmission terminal 30) transmits game information as transmission information to the reception terminal 2 in the information transmission system of the present embodiment, respectively. It is a figure which shows an example of the flowchart which shows the process of.

FIG. 43 is a diagram illustrating an example when a display screen is displayed on the touch panel display 301 of the second transmission terminal 30. FIG. 45 is a diagram illustrating an example when a captured image of real-time content is displayed on the touch panel display 301 of the second transmission terminal 30. FIG. 46 is a diagram illustrating an example when a game selection screen is displayed on the touch panel display 301 of the second transmission terminal 30. FIG. 47 is a diagram illustrating an example when a game screen is displayed on the touch panel display 301 of the second transmission terminal 30.

In each process of the flowchart shown in FIG. 43, each process other than steps S511c, S514c, S516c, S517c, S534c, S535c, and S536c is the same as the process shown in FIG. In the following, description will be made focusing on the differences between FIG. 43 and FIG.

[6-3-1. Creation of game information in second transmission terminal]
In the flowchart of FIG. 43, the CPU 302 of the second transmission terminal 30 determines whether or not the game creation button has been pressed by the user (step S511c). For example, when the CPU 302 detects that the game creation button 315 (FIG. 43) displayed on the touch panel display 301 of the second transmission terminal 30 has been pressed with the user's fingertip or stylus, the game creation button It is determined that is pressed.

If it is determined that the game creation button 314 has been pressed (step S511c, Yes determination), the CPU 302 of the second transmission terminal 30 transmits capture instruction data to the first transmission terminal 20 as in the first embodiment (step S512).

When the capture instruction data is transmitted to the first transmission terminal 20, the CPU 302 of the second transmission terminal 30 executes a game information creation process (step S514c). FIG. 44 is a diagram illustrating an example of a flowchart of the game information creation process. 44, the CPU 302 of the second transmission terminal 30 displays an image selection screen on the touch panel display 301 (step S641).

FIG. 45 is a diagram illustrating an example when an image selection screen is displayed on the touch panel display 301 of the second transmission terminal 30. The image selection screen shown in FIG. 45 displays a partial selection button 2801 for selecting a part of the image and an entire selection button 2802 for selecting the entire image, respectively, as in the fourth embodiment. . When the partial selection button 2801 is pressed, a selection frame 2811 for selecting a part of the image is displayed on the image as in the fourth embodiment.

The CPU 302 of the second transmission terminal 30 determines whether or not selection completion is instructed on the image selection screen (step S642). For example, when the CPU 302 detects that the “next” button 2813 (FIG. 45) displayed on the touch panel display 301 of the second transmission terminal 30 is pressed with the user's fingertip or stylus, the image selection is performed. It is determined that selection completion is instructed on the screen (step S642, Yes determination).

44, in step S643, the CPU 302 of the second transmission terminal 30 displays a game selection screen on the touch panel display 301. FIG. 46 is a diagram illustrating an example when a game selection screen is displayed on the touch panel display 301 of the second transmission terminal 30. The game selection screen shown in FIG. 46 is configured so that the type of game to be created can be selected. For example, the game selection screen is configured such that each game such as “15 puzzle” 4601, “find mistake” 4602, or “nervation” 4603 can be selected.

The CPU 302 of the second transmission terminal 30 determines whether or not selection completion is instructed on the game selection screen (step S634). For example, when the CPU 302 detects that the “create game” button 4612 (FIG. 46) displayed on the touch panel display 301 of the second transmission terminal 30 has been pressed with the user's fingertip or stylus, the advertisement It is determined that setting completion has been instructed on the setting screen (step S644, Yes determination). If the “return” button 4611 is pressed, the CPU 302 returns to step S641 and displays the previous image selection screen (FIG. 45).

In step S645 of FIG. 44, the CPU 302 of the second transmission terminal 30 is based on the game type (“15 puzzle”, “look for mistake” or “nervation”) selected on the above-described game selection screen (FIG. 46). A game screen is generated, and the generated game screen is displayed on the touch panel display 301. The game screen is generated by using a game generation program (not shown) that can automatically generate a game screen by inputting a game type (“15 puzzle”, “find mistake” or “nervation”). It can be carried out.

FIG. 47 is a diagram illustrating an example in which an advertisement screen is displayed on the touch panel display 301 of the second transmission terminal 30. The game screen shown in FIG. 47 displays, for example, a 15 puzzle game in which the captured image is equally divided into 16 blocks and an image 4701 in which the lower right block is deleted is displayed, and each block is slid to complete the original image. Show.

Similarly to the fourth embodiment, the user can correct the content of the advertisement displayed on the game screen by pressing the “correct” button 4712 on the game screen. For example, when the correction button 4712 is pressed, the game screen shifts to the correction mode, and correction input of each character and correction of the position, size, range, or the like of an image or a figure can be appropriately made (step) S646, Yes judgment). If the “return” button 4711 is pressed, the CPU 302 returns to step S643 and displays the previous game selection screen (FIG. 44).

The user can complete the game screen by pressing the “complete” button 4713 (step S646, No determination). Here, data for configuring the game screen is held as game information, for example, in the flash memory 305.

When it is determined that the game screen is completed by completing the game information creation process in step S514c, the CPU 302 associates the scene identification information of the captured image captured in step S502 with the game information data, for example, flash. The transmission information data 305c in the memory 305 is recorded (step S516c).

An example of the transmission information data 305c is basically the same as FIG. However, in this embodiment, instead of the actual data “(Quiz001.html)” of the quiz information 114a, for example, actual data “(Game001.html)” of the game information 114c is recorded. It should be noted that the data format of the actual data of the game information 114a may be a format other than html (for example, CSS (Cascading Style Style Sheets) or Flash).

Subsequently, the CPU 302 of the second transmission terminal 30 transmits the advertisement information associated with the scene identification information in step S516c to the reception terminal 2 (step S517c). For example, the CPU 302 transmits the data of the record 1100 of the transmission information data 305c illustrated in FIG. Therefore, the captured image data itself to which the game information is associated is not transmitted to the receiving terminal 2. Specifically, information such as how to use a target captured image to generate a game image is included in the game information and transmitted.

[6-3-2. Display of game on receiving terminal 2]
In step S534c of FIG. 42, the CPU 402 of the receiving terminal 2 receives and records game information from the second transmitting terminal 30. For example, the CPU 402 receives the data of the record 1100 of the transmission information data 305c shown in FIG. 31 from the second transmission terminal and records it in the transmission information data 405c of the external connection type hard disk drive 411.

Subsequently, the CPU 402 of the receiving terminal 2 generates an advertisement image by combining the captured image recorded in the captured image data 405b in step S533 and the game information received in step S534c (step S535c).

The CPU 402 of the receiving terminal 2 displays the generated game image (step S536c). As shown in FIG. 48, for example, the CPU 402 causes the game image 123 to be superimposed and displayed on the content screen 130 that the user of the receiving terminal 2 is viewing.

[6-4. Modified example]
In the above description, an example of a “15 puzzle” game has been described, but the present invention can also be applied to other games using captured images. For example, in the case of the “search for mistakes” game, another image in which a part of the original image is changed can be generated and the user can point out a different part. Further, in the case of the “nervation” game, the character of the captured image can be adopted as a pattern of playing cards, and the card with the same pattern can be turned over and hit.

In the game information creation process (FIG. 44) in step S514c, the user selects an image (step S641), selects a game (step S643), and modifies the game screen (step S645). Although the example which produces is demonstrated, it is good also as a structure which CPU302 of the 2nd transmission terminal 30 produces a game screen automatically. In this case, the user can create a game simply by pressing the “create game” button 315 in FIG. The CPU 302 of the second transmission terminal 30 may automatically execute at least one of image selection (step S641), game selection (step S643), and game screen correction (step S645).

[7. Other Embodiments]
In each of the above embodiments, when the receiving terminal 1 is a device (multi-tuner compatible device) having a plurality of tuners, each process can be executed in the background regardless of the program that the user is viewing. In addition, when scene identification information is received from the transmission terminal 1, only the reception-side captured image acquisition unit 25 is executed, and when the user views the target content, the image superimposing unit 24 or the image composition unit 241 is executed. It may be. Further, the transmission information receiving unit 26, the quiz information receiving unit 261, the advertisement information receiving unit 262, and the game information receiving unit 263 receive the transmission information, quiz information, and the like from the transmission terminal only when the scene identification information is received from the transmission terminal 1. Advertisement information or game information may be acquired. Thereby, efficient processing becomes possible.

In each of the above embodiments, an information transmission system using a television receiver has been described. However, at least one of the transmission terminal 1, the first transmission terminal 20, the second transmission terminal 30, and the reception terminal 2 is a recorder device, a tablet terminal. Or it may be a smartphone.

It is good also as a structure which posts quiz information to a SNS server combining the said 2nd Embodiment and the said 4th Embodiment. Thereby, quiz information can be shared among a plurality of users, and each user can display a quiz using their copyright content. Moreover, it is good also as a structure which replaces with a SNS server and records transmission information (for example, quiz information etc.) in a home server. Thereby, each user can display transmission information (for example, a quiz etc.) using the content shared between families.

In the above embodiment, an example in which various types of transmission information are created in the transmission terminal 1 has been described. However, transmission information may be created in advance according to content. For example, when the transmission terminal 1 is a broadcaster's server, if the content distributed to the reception terminal 2 can be acquired, the transmission information corresponding to the acquired content can be transmitted. In this case, the scene identification information recorded in the transmission information may be automatically transmitted to the receiving terminal 2. As a result, information such as quizzes, advertisements, and games for the user of the receiving terminal can be distributed on the broadcast provider side in accordance with the reproduction of the content, and entertainment in content distribution can be enhanced.

In the above embodiment, the functional blocks shown in FIGS. 1, 14 to 17, 18A to 18E, 19, and 24 are realized by processing of a CPU that executes software. However, some or all of them can be realized by hardware such as a logic circuit. Note that it is possible to cause the OS to further execute a part of the processing of the program.

As mentioned above, although embodiment of this invention was described, this invention is not restricted to embodiment mentioned above. The present invention can be modified in various ways within the disclosed scope, and embodiments obtained by appropriately combining the technical means or embodiments disclosed herein are also included in the technical scope of the present invention. . The effects described in the embodiments of the present invention are only the most preferable effects resulting from the present invention, and the effects of the present invention are limited to those described in the embodiments of the present invention. is not.

The present application is useful for an information transmission system that transmits information input at a transmission terminal to a reception terminal.

DESCRIPTION OF SYMBOLS 1 Transmission terminal 2 Reception terminal 3 Broadcasting station 11 Real-time content reception part 12 Image display part 13 Transmission side buffer part 14 Scene identification information transmission part 15 Transmission side capture image acquisition part 16 Transmission information transmission part 17 Capture instruction reception part 18 Transmission information reception Unit 19 capture image display unit 20 first transmission terminal 21 real-time content reception unit 22 image display unit 23 reception side buffer unit 24 image superposition unit 25 reception side capture image acquisition unit 26 transmission information reception unit 27 scene identification information reception unit 30 second Sending terminal N network

Claims

A playback unit for playing back video content;
A display unit for displaying the video content reproduced by the reproduction unit;
A memory that captures an image indicating any scene of the displayed video content;
A reception unit that receives input of transmission information related to the captured image;
A processor that generates or obtains scene identification information that is information identifying an image captured in the memory;
A transmission unit comprising: a transmission unit that transmits the transmission information and scene specification information for specifying an image related to the transmission information to a reception terminal;
The receiving terminal obtains the moving image content reproduced by the reproducing unit from another source different from the transmitting terminal, and of the obtained moving image content, specifies a scene specified by the scene specifying information received from the transmitting unit. Capturing the image shown and displaying the transmitted information received from the transmitter along with the captured image;
Sending terminal.
A playback unit for playing back video content;
A display unit for displaying the video content reproduced by the reproduction unit;
A receiving unit that receives the transmission information and scene specifying information for specifying an image related to the transmission information from the transmission terminal;
A memory that captures an image indicating a scene specified by the scene specifying information received from the transmitting terminal among the displayed moving image content, and a receiving terminal comprising:
The display unit displays the transmission information received from the transmission terminal together with the captured image,
The transmitting terminal obtains the moving image content reproduced by the reproducing unit from another source different from the receiving terminal, captures an image indicating any scene of the obtained moving image content, and the captured Scene specifying information for receiving input of transmission information related to an image, generating or acquiring scene specifying information that is information for specifying the captured image, and specifying the transmission information and an image related to the transmission information; To the receiving terminal,
Receiving terminal.
The transmitting unit of the transmitting terminal transmits the transmission information and the scene specifying information to the receiving terminal via a management server,
The receiving terminal receives the transmission information and the scene specifying information from the transmission unit via the management server.
The transmission terminal according to claim 1.
The transmitting terminal transmits the transmission information and the scene specifying information to the receiving terminal via a management server,
The receiving unit of the receiving terminal receives the transmission information and the scene specifying information from the transmitting terminal via a management server.
The receiving terminal according to claim 2.
The transmitting terminal further includes a buffer unit that temporarily stores part or all of the moving image content, and the memory captures a scene in the moving image content stored in the buffer unit.
The transmission terminal according to claim 1 or 3.
The receiving terminal further includes a buffer unit that temporarily stores a part or all of the video content, and the memory captures a scene in the video content stored in the buffer unit.
The receiving terminal according to claim 2 or 4.
The transmission terminal or the reception terminal further includes a content reception unit that receives the video content.
The transmission terminal according to claim 1, 3 or 5.
The transmission terminal or the reception terminal further includes a content reception unit that receives the video content.
The receiving terminal as described in any one of Claim 2, 4 or 6.
The transmitting terminal includes a first transmitting terminal and a second transmitting terminal,
The first transmission terminal includes the reproduction unit and the display unit,
The second transmission terminal includes the memory and the reception unit.
The transmission terminal according to any one of claims 1, 3, 5 and 7.
The receiving terminal includes a first receiving terminal and a second receiving terminal,
The first receiving terminal includes the reproducing unit and the receiving unit,
The second receiving terminal includes the display unit and the memory.
The receiving terminal according to any one of claims 2, 4, 6, and 8.
The scene identification information includes an identification number issued by the transmission terminal.
The transmission terminal according to any one of claims 1, 3, 5, 7, and 9.
The scene identification information includes an identification number issued by the transmission terminal.
The receiving terminal according to any one of claims 2, 4, 6, 8, or 10.
The transmission information is quiz information for giving a quiz at the receiving terminal.
The transmission terminal according to any one of claims 1, 3, 5, 7, 9, or 11.
The transmission information is quiz information for giving a quiz at the receiving terminal.
The receiving terminal according to any one of claims 2, 4, 6, 8, 10, or 12.
The transmission information is advertisement information for allowing an advertisement to be viewed on the receiving terminal.
The transmission terminal according to any one of claims 1, 3, 5, 7, 9, or 11.
The transmission information is advertisement information for allowing an advertisement to be viewed on the receiving terminal.
The receiving terminal according to any one of claims 2, 4, 6, 8, 10, or 12.
The transmission information is game information for executing a game on the receiving terminal.
The transmission terminal according to any one of claims 1, 3, 5, 7, 9, or 11.
The transmission information is game information for executing a game on the receiving terminal.
The receiving terminal according to any one of claims 2, 4, 6, 8, 10, or 12.
A program for realizing a transmission terminal using a computer,
Playback processing to play video content,
A display process for displaying the video content reproduced in the reproduction process;
A process of capturing an image indicating any scene of the displayed video content in a memory;
A reception process for receiving input of transmission information related to the captured image;
Processing for generating or acquiring scene specifying information which is information for specifying an image captured in the memory;
Causing the computer to execute transmission processing for transmitting the transmission information and scene specification information for specifying an image related to the transmission information to a receiving terminal;
The receiving terminal obtains the moving image content reproduced by the transmitting terminal from another source different from the transmitting terminal, and the scene specified by the scene specifying information received from the transmitting terminal among the obtained moving image content. Capturing an image indicating and displaying the communication information received from the transmitting terminal together with the captured image;
program.
A program for realizing a receiving terminal using a computer,
Playback processing to play video content,
A display process for displaying the video content reproduced in the reproduction process;
A reception process for receiving the transmission information and scene specifying information for specifying an image related to the transmission information from the transmission terminal;
A process of capturing, in a memory, an image indicating a scene specified by the scene specifying information received from the transmitting terminal among the displayed moving image content;
The display process displays transmission information received from the transmitting terminal together with the captured image,
The transmitting terminal obtains the moving image content reproduced by the receiving terminal from another source different from the receiving terminal, captures an image indicating any scene of the acquired moving image content, and the captured Scene specifying information for receiving input of transmission information related to an image, generating or acquiring scene specifying information that is information for specifying the captured image, and specifying the transmission information and an image related to the transmission information; To the receiving terminal,
program.
An information transmission method using a transmitting terminal and a receiving terminal,
The transmitting terminal is
A playback process for playing back video content;
A display step for displaying the video content reproduced in the reproduction step;
Capturing an image indicating any scene of the displayed moving image content in a memory;
A receiving step for receiving input of transmission information related to the captured image;
Generating or acquiring scene specifying information which is information for specifying an image captured in the memory;
Transmitting the transmission information and scene specifying information for specifying an image related to the transmission information to a receiving terminal, and
The receiving terminal obtains the moving image content reproduced by the transmitting terminal from another source different from the transmitting terminal, and the scene specified by the scene specifying information received from the transmitting terminal among the obtained moving image content. Capturing an image indicating and displaying the communication information received from the transmitting terminal together with the captured image;
Information transmission method.
An information transmission method using a transmitting terminal and a receiving terminal,
The receiving terminal is
A playback process for playing back video content;
A display step for displaying the video content reproduced in the reproduction step;
A reception step of receiving from the transmitting terminal the transmission information and scene specifying information for specifying an image related to the transmission information;
A step of capturing, in a memory, an image indicating a scene specified by the scene specifying information received from the transmitting terminal among the displayed moving image content,
The display step displays the transmission information received from the transmission terminal together with the captured image,
The transmitting terminal obtains the moving image content reproduced by the receiving terminal from another source different from the receiving terminal, captures an image indicating any scene of the acquired moving image content, and the captured Scene specifying information for receiving input of transmission information related to an image, generating or acquiring scene specifying information that is information for specifying the captured image, and specifying the transmission information and an image related to the transmission information; To the receiving terminal,
Information transmission method.