JP2007304978A - Image display system, image display device, communication terminal device, device control method, and content control method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an image display system capable of obtaining an operation system with high degree of freedom according to the kind of the content, an image display device, a communication terminal device, a device control method, and a content control method. <P>SOLUTION: The image display device transmits operation panel data corresponding to the content displayed on a first display means to the communication terminal device. The communication terminal device uses the operation panel data to display an operation panel image for controlling the content displayed on the first display means. The image display device controls the content in response to a control signal for controlling the content by command input to the operation panel image. <P>COPYRIGHT: (C)2008,JPO&INPIT

Description

  The present invention relates to a video display system, a video display device, a communication terminal device, a device control method, and a content control method, and in particular, a video display system, a video display device, a communication terminal device, and a device that provide an operation panel related to content. The present invention relates to a control method and a content control method.

  In recent years, devices conforming to a standard (hereinafter also referred to as inter-device communication standard) for enabling data communication with each other among a plurality of types of devices in a home are becoming widespread. The inter-device communication standard is, for example, a DLNA (Digital Living Network Alliance) standard. Devices conforming to the inter-device communication standard are, for example, a television receiver, an HDD (Hard disk drive) recorder, an audio device, and the like. In addition, a device compliant with the inter-device communication standard is generally connectable to a network such as the Internet via a network device such as a router.

  In general, a device that conforms to a communication standard between different devices that can be connected to a network is a device that can be operated by a remote controller. Therefore, it is required to operate a plurality of types of devices that can be operated with a remote controller and can be connected to a network with a single device.

  In JP 2002-135810 A (Patent Document 1), a communication terminal device such as a mobile phone that can be connected to a network such as the Internet and has a very high penetration rate operates a device that can be connected to the network. A technique for use as a remote controller is disclosed.

  Japanese Patent Laid-Open No. 2001-275173 (Patent Document 2) displays an operation screen corresponding to the type of device to be operated (hereinafter also referred to as an operated device) on the operation side device, A technique of using a device as a remote control for operating a device to be operated is disclosed.

Japanese Patent Laid-Open No. 2001-136585 (Patent Document 3) discloses an image displaying a plurality of rectangles respectively corresponding to the arrangement positions of a plurality of hyperlink character strings in a Web page displayed on an operated device. A technique is disclosed in which a hyperlink character string can be easily designated by displaying it on a display unit having a touch panel function of a remote controller.
JP 2002-135810 A JP 2001-275173 A JP 2001-136585 A

  However, in the technique disclosed in Japanese Patent Laid-Open No. 2001-275173 (Patent Document 2), the operation screen displayed on the operation side device is only the one corresponding to the operated device. For this reason, there is a problem that operations that can be controlled by the device on the operation side are limited.

  Further, with the technique disclosed in Japanese Patent Laid-Open No. 2001-136585 (Patent Document 3), an image capable of designating a hyperlink character string in a Web page displayed on the operated device is simply displayed on the remote control. Only. Therefore, there is a problem that operations that can be controlled by the remote control are limited.

  The present invention has been made to solve the above-described problems, and an object of the present invention is to provide a video display system capable of obtaining an operation system having a high degree of freedom according to the type of content. is there.

  Another object of the present invention is to provide a video display device capable of obtaining an operation system having a high degree of freedom according to the type of content.

  Still another object of the present invention is to provide a communication terminal device capable of obtaining an operation system having a high degree of freedom according to the type of content.

  Still another object of the present invention is to provide an apparatus control method capable of obtaining an operation system having a high degree of freedom according to the type of content.

  Still another object of the present invention is to provide a content control method capable of obtaining an operation system with a high degree of freedom according to the type of content.

  In order to solve the above-described problem, according to one aspect of the present invention, a video display system including a communication terminal device and a video display device, which are capable of data communication with each other, the video display device The server is capable of data communication with the server to be distributed, the server transmits the content and operation panel data for controlling the content to the video display device, and the video display device receives the content and the operation panel data. A communication terminal comprising: reception means; first display means for displaying the received content; and first transmission means for transmitting operation panel data corresponding to the content displayed on the first display means to the communication terminal device. The apparatus uses second operation means for receiving operation panel data, and the content displayed on the first display means using the operation panel data. First display means for displaying an operation panel image for control, and second transmission means for transmitting a control signal for controlling content to the video display device by inputting an instruction to the operation panel image. The receiving means receives the control signal, and the video display device further includes control means for controlling the content in accordance with the received control signal.

  According to another aspect of the present invention, there is provided a video display system including a communication terminal device and a video display device that are capable of data communication with each other, and the video display device is capable of data communication with a server that distributes content. And the server transmits the content and operation metadata for controlling the content to the video display device. The video display device receives the received content and the first receiving means for receiving the content and the operation metadata. First display means for displaying; storage means for storing a plurality of types of operation panel generation part data for generating an operation panel image for controlling content displayed on the first display means; operation metadata; Generating means for generating an operation panel image using one or more operation panel generation part data related to the operation metadata; First communication means for transmitting panel image data to the communication terminal device, and the communication terminal device uses the second reception means for receiving operation panel image data and the operation panel image data for operation. A second display unit that displays a panel image; and a second transmission unit that transmits a control signal for controlling the content to the video display device in response to an instruction input to the operation panel image. The video display device further includes a control unit that receives the signal and controls the content in accordance with the received control signal.

  According to still another aspect of the present invention, there is provided a video display device capable of data communication with a communication terminal device provided with a display unit and a server that distributes content and operation metadata for controlling the content, the video display device Includes a receiving unit that receives content and operation metadata, a display unit that displays the received content, and a plurality of types of operation panels for generating an operation panel image for controlling the content displayed on the display unit. Storage means for storing generated part data, operation metadata, generation means for generating an operation panel image using one or more operation panel generation part data related to the operation metadata, and data of the operation panel image Is transmitted to the communication terminal device, and the receiving means is displayed on the display unit of the communication terminal device. By an instruction input to create panel image, and receives a control signal for controlling the content, the image display device, in accordance with the received control signal, further comprising a control means for controlling the content.

  According to still another aspect of the present invention, a video display system including a communication terminal device and a video display device capable of data communication with each other, the video display device being capable of data communication with a server that distributes content The server transmits the content and operation metadata for controlling the content to the video display device, and the video display device receives the content and the operation metadata, and the received content. And a first transmission means for transmitting the received operation metadata to the communication terminal device. The communication terminal device includes a second reception means for receiving the operation metadata, and a first display. Storage means for storing a plurality of types of operation panel generation part data for generating an operation panel image for controlling the content displayed on the means Using the operation metadata and one or more operation panel generation part data related to the operation metadata, generating means for generating an operation panel image, second display means for displaying the operation panel image, and an operation panel And a second transmission unit that transmits a control signal for controlling the content to the video display device by inputting an instruction to the image, the first reception unit receives the control signal, and the video display device receives the received control signal. Control means for controlling content according to the signal is further provided.

  According to still another aspect of the present invention, a display unit is provided, and the content and operation metadata for controlling the content received from the server are transmitted, and the control signal for controlling the content is received. The communication terminal device is capable of data communication with a video display device that controls content, and the communication terminal device receives operation metadata for controlling content displayed on the display unit of the video display device. Storage means for storing a plurality of types of operation panel generation part data for generating an operation panel image for controlling the content displayed on the display unit, operation metadata, and 1 related to the operation metadata Using the above operation panel generation part data, generation means for generating an operation panel image and display of the operation panel image That includes a display unit, an instruction input by the operation panel image, a control signal for controlling the content, and transmission means for transmitting to the video display device.

  According to still another aspect of the present invention, a video display system including a communication terminal device and a video display device capable of data communication with each other, the video display device being capable of data communication with a server that distributes content The server transmits the content and operation data for controlling the content to the video display device, and the video display device displays the received content and the first receiving means for receiving the content and the operation data. A first display means for transmitting the received operation data to the communication terminal device, the communication terminal device using the operation data and the second receiving means for receiving the operation data, A second display means for displaying an operation panel image for controlling the content displayed on the first display means, and an instruction input for the operation panel image, Second transmission means for transmitting a control signal for controlling the content to the video display device, the first reception means receives the control signal, and the video display device receives the content in accordance with the received control signal. Control means for controlling

  According to still another aspect of the present invention, first control for causing a video display device provided with a first display unit and a communication terminal device provided with a second display unit, which are capable of data communication with each other, to be executed respectively. And a second control method, wherein the video display device is capable of data communication with a server that distributes the content, and the server transmits the content and operation data for controlling the content to the video The first control method transmits the content and the operation data to the display device, the first reception step of receiving the content and the operation data, the first display step of displaying the received content on the first display unit, and the received operation data. A first transmission step of transmitting to the terminal device, wherein the second control method uses the operation data to receive the first display using the second reception step of receiving the operation data. A display step for displaying an operation panel image for controlling the content displayed on the second display unit, and a control signal for controlling the content by inputting an instruction to the operation panel image. A first transmission step for receiving the control signal, and the first control method further includes a control step for controlling the content in accordance with the received control signal.

  A content control method according to still another aspect of the present invention includes a reception step of receiving content and operation data for controlling the content, a first display step of displaying the received content, and operation data. A second display step for displaying an operation panel image for controlling the content displayed in the first display step.

  The video display system according to the present invention includes a communication terminal device and a video display device. The video display device transmits operation panel data corresponding to the content displayed on the first display means to the communication terminal device. The communication terminal device uses the operation panel data to display an operation panel image for controlling the content displayed on the first display means. The video display device controls the content in accordance with a control signal for controlling the content by inputting an instruction to the operation panel image.

  Therefore, the content can be controlled using an operation panel image suitable for controlling the content. As a result, it is possible to obtain an operation system with a high degree of freedom according to the type of content.

  The video display system according to the present invention includes a communication terminal device and a video display device. The video display device uses the operation metadata and the operation panel generation part data to generate an operation panel image for controlling the content displayed on the first display means, Send to the communication terminal. The communication terminal device displays an operation panel image. The video display device controls the content in accordance with a control signal for controlling the content by inputting an instruction to the operation panel image.

  Therefore, the content can be controlled using an operation panel image suitable for controlling the content. As a result, it is possible to obtain an operation system with a high degree of freedom according to the type of content.

  The video display device according to the present invention uses the operation metadata and the operation panel generation part data to generate an operation panel image for controlling the content displayed on the display means, and the operation panel image data Is transmitted to the communication terminal device. The video display device controls the content according to a control signal for controlling the content by an instruction input to the operation panel image displayed on the display unit of the communication terminal device.

  Therefore, the content can be controlled using an operation panel image suitable for controlling the content. As a result, it is possible to obtain an operation system with a high degree of freedom according to the type of content.

  The video display system according to the present invention includes a communication terminal device and a video display device. The video display device displays the content by the first display means, and transmits the received operation metadata to the communication terminal device. The communication terminal device uses the operation metadata and the operation panel generation part data to generate an operation panel image for controlling the content displayed on the first display means, and displays the operation panel image. The video display device controls the content in accordance with a control signal for controlling the content by inputting an instruction to the operation panel image.

  Therefore, the content can be controlled using an operation panel image suitable for controlling the content. As a result, it is possible to obtain an operation system with a high degree of freedom according to the type of content.

  The communication terminal device according to the present invention uses the operation metadata and the operation panel generation part data to generate an operation panel image for controlling the content displayed on the display unit of the video display device. A panel image is displayed, and a control signal for controlling content by inputting an instruction to the operation panel image is transmitted to the video display device. The video display device controls content according to the control signal.

  Therefore, the content can be controlled using an operation panel image suitable for controlling the content. As a result, it is possible to obtain an operation system with a high degree of freedom according to the type of content.

  The video display system according to the present invention includes a communication terminal device and a video display device. The video display device displays the content by the first display means, and transmits the received operation data to the communication terminal device. The communication terminal device uses the operation data to display an operation panel image for controlling the content displayed on the first display means. The video display device controls the content in accordance with a control signal for controlling the content by inputting an instruction to the operation panel image.

  Therefore, the content can be controlled using an operation panel image suitable for controlling the content. As a result, it is possible to obtain an operation system with a high degree of freedom according to the type of content.

  The device control method according to the present invention includes a first control method and a second control method for causing a video display device provided with a first display unit and a communication terminal device provided with a second display unit to execute the respective methods. It is an apparatus control method including. The first control method includes a step of displaying content on the first display unit and transmitting the received operation data to the communication terminal device. The second control method includes a step of displaying an operation panel image for controlling the content displayed on the first display unit using the operation data. The first control method includes a step of controlling the content according to a control signal for controlling the content based on an instruction input to the operation panel image.

  Therefore, the content can be controlled using an operation panel image suitable for controlling the content. As a result, it is possible to obtain an operation system with a high degree of freedom according to the type of content.

  The content control method according to the present invention displays received content and displays an operation panel image for controlling the displayed content using operation data.

  Therefore, the content can be controlled using an operation panel image suitable for controlling the content. As a result, it is possible to obtain an operation system with a high degree of freedom according to the type of content.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings. In the following description, the same parts are denoted by the same reference numerals. Their names and functions are also the same. Therefore, detailed description thereof will not be repeated.

  The content handled in the present invention intends digital data such as video, audio, and images, and additional information related to them, related information, operation information, and the like. Of course, it is not limited to digital data as long as it is handled in the same way. In addition, one content can be provided from a plurality of networks as long as it can be provided via a network such as a television broadcast, an Internet broadcast, or a mobile phone network.

<First Embodiment>
FIG. 1 is a diagram showing a configuration of a network system 1000 according to the present embodiment. With reference to FIG. 1, a network system 1000 includes a home network 501.

  Home network 501 is, for example, a network provided in a home. The home is, for example, a user's home, a company, or the like. Home network 501 includes communication terminal device 500, video display device 600, and communication unit 50.

  Communication terminal device 500 is a PDA (Personal Digital Assistance). Communication terminal device 500 has a telephone function. Communication terminal device 500 may not have a telephone function. Communication terminal device 500 is not limited to a PDA, and may be any device (for example, a PC (Personal Computer) or a mobile phone) as long as it has a communication function and is portable.

  The communication terminal device 500 can perform data communication with the telephone network 60 by radio. The telephone network 60 is a telephone network for mobile phones, for example. Note that when the communication terminal device 500 performs data communication with the telephone network 60, a packet fee corresponding to the amount of data used at the time of data communication is generated.

  The video display device 600 is a liquid crystal television. The video display device 600 is not limited to a liquid crystal television, and may be any device that can display an image. Video display device 600 may be, for example, a plasma television. The video display device 600 may be a device that includes a display device for displaying an image and an image data transmission device that transmits image data to be displayed on the display device. The image data transmitting device is, for example, an STB (Set Top Box), HDD recorder, DVD (Digital Versatile Disc) recorder, or the like.

  Communication terminal device 500 and video display device 600 perform data communication wirelessly or by wire. That is, the communication terminal device 500 and the video display device 600 constitute a video display system.

  The communication unit 50 has a function of performing data communication with each of the communication terminal device 500, the video display device 600, and the network 70. The network 70 is an external network such as the Internet.

  The communication unit 50 has a function of performing data communication using a wireless technology based on any of IEEE802.11a, IEEE802.11b, and IEEE802.11g, which are wireless LAN standards. Note that the radio technology is not limited to a technology based on any of IEEE 802.11a, IEEE 802.11b, and IEEE 802.11g, and may be other radio technologies. Therefore, communication unit 50 can perform data communication with each of communication terminal device 500, video display device 600, and network 70 wirelessly.

  The communication unit 50 further has a communication interface function (for example, a router function) using Ethernet (registered trademark). Therefore, the communication unit 50 can perform data communication with each of the communication terminal device 500, the video display device 600, and the network 70, for example, via a LAN cable. That is, the communication unit 50 can perform data communication with each of the communication terminal device 500, the video display device 600, and the network 70 by wire.

  The network 70 can perform data communication with the telephone network 60 by radio or wire. Therefore, the communication terminal device 500 can perform data communication with the network 70 via the telephone network 60.

  Network system 1000 further includes service server 800A, search server 800S, and Web server 800W.

  The service server 800A is a server that provides content, information related to the content, and the like. The content is, for example, a moving image or music data. For example, when the content is a moving image of a program, the information related to the content is, for example, program information. Service server 800A is a PC. The service server 800A is not limited to a PC, and any device can be used as long as it has a function of providing content such as moving images, content such as music data, information related to the content, and the like. May be.

  The service server 800A records all the programs of all the channels in the period from the current date and time to the date and time before a predetermined period (for example, 24 hours), and stores recorded data obtained by recording the program. Service server 800A automatically deletes recorded data after a predetermined period (for example, 24 hours) from the current date and time. Therefore, the service server 800A stores the recording data of all the programs of all the channels in the period from the current date and time to the date and time before the predetermined period. If there is a recording data distribution request, the service server 800A transmits or performs streaming distribution of the recording data requested to be distributed to the apparatus that has requested the recording data distribution.

  Further, the service server 800A stores in advance a program currently being broadcast and moving image data scheduled to be broadcast for a predetermined period (for example, 24 hours). If there is a distribution request for moving image data of a program that is currently being broadcast, the distribution-requested moving image data is streamed to the apparatus that has requested the distribution of moving image data.

  When a search server 800S receives a keyword as search information from a terminal device connected to the network 70, the search server 800S searches a URL (Uniform Resource Locator) of a Web page of information related to the received keyword. The search server 800S is a PC. The search server 800S is not limited to a PC, and when receiving a keyword from a terminal device connected to the network 70, the search server 800S searches for a URL (Uniform Resource Locator) of a Web page of information related to the received keyword. Any device having a function may be used.

  Web server 800W is a server that provides data of a plurality of Web pages corresponding to each of a plurality of types of information. Web server 800W provides data of a plurality of Web pages corresponding to information related to a movie, for example. Web server 800W is a PC. Web server 800W is not limited to a PC, and may be any device that has a function of providing data of a plurality of Web pages corresponding to each of a plurality of types of information.

  Each of service server 800A, search server 800S, and Web server 800W performs data communication with network 70 in a wireless or wired manner.

  In the present embodiment, it is assumed that communication unit 50 can perform high-speed data communication with each of communication terminal device 500, video display device 600, and network 70. The communication unit 50 is assumed to be capable of data communication with each of the communication terminal device 500, the video display device 600, and the network 70, for example, at a maximum speed of 100 Mbps (Mega bit per second).

  In addition, it is assumed that the network 70 can perform high-speed data communication with each of the communication unit 50, the telephone network 60, the service server 800A, the search server 800S, and the Web server 800W. It is assumed that the network 70 can perform data communication with each of the communication unit 50, the telephone network 60, the service server 800A, the search server 800S, and the Web server 800W, for example, at a maximum speed of 100 Mbps. Therefore, for example, it is assumed that the maximum speed of data communication between the video display device 600 and the network 70 is 100 Mbps. For example, it is assumed that the maximum speed of data communication between the communication terminal device 500 and the network 70 is 100 Mbps.

  It is assumed that the data communication speed between communication terminal device 500 and telephone network 60 is slower than the data communication speed between communication terminal device 500 and network 70. Assume that the maximum speed of data communication between communication terminal device 500 and telephone network 60 is, for example, 256 kbps.

  Further, it is assumed that the data communication speed between the communication terminal device 500 and the video display device 600 is sufficiently higher than the data communication speed between the communication terminal device 500 and the telephone network 60. It is assumed that the maximum speed of data communication between the communication terminal device 500 and the video display device 600 is 4 Mbps, for example.

Next, the communication terminal device 500 will be described in detail.
FIG. 2 is a diagram showing the external appearance of the communication terminal device 500 from the front. Referring to FIG. 2, communication terminal device 500 includes a display unit 530, an audio output unit 570, an LED 576, and an input unit 540.

  The display unit 530 has a function of displaying characters, images, and the like. The display unit 530 is a device using any one of an LCD panel (Liquid Crystal Display Panel), an FED panel (Field Emission Display Panel), and an organic EL display panel (Organic Electroluminescence Display Panel). Note that the display unit 530 may be a device using a panel of a display method other than the above.

  The resolution of the display unit 530 is horizontal 480 (dots) × vertical 640 (dots). The resolution of the display unit 530 is not limited to horizontal 480 (dots) × vertical 640 (dots), and may be another resolution (for example, horizontal 240 (dots) × vertical 320 (dots)). .

  The display unit 530 has a touch panel function that allows the user to input information by directly touching the screen. Display unit 530 transmits the position information of the user touching the screen to control unit 510 described later. Control unit 510 performs predetermined processing based on the received position information.

  The voice output unit 570 has a function of outputting the voice of the telephone. Audio output unit 570 includes a speaker that outputs audio. The audio output unit 570 outputs audio based on audio data received from the control unit 510 described later from the speaker.

  The LED 576 performs light notification according to processing performed in the communication terminal device 500. For example, the LED 576 blinks light when an incoming call is received.

  The input unit 540 includes a button group 541. The button group 541 includes direction buttons 541A, 541B, 541C, 541D, and an enter button 541E. The direction buttons 541A, 541B, 541C, and 541D are displayed when an image is displayed on the display unit 530 by a pressing operation (hereinafter also referred to as a short pressing operation) for a short time (for example, less than 0.5 seconds) by the user. This is a button for moving an object to be moved (for example, a cursor, etc.) in the image vertically and horizontally. Specifically, the direction buttons 541A, 541B, 541C, and 541D in which a short press operation has been performed are buttons for moving the cursor up, down, left, and right, respectively, for example. Further, for example, the screen can be scrolled up, down, left, and right, respectively, by a pressing operation (hereinafter, also referred to as a long pressing operation) for a long time (for example, one second or more) by the user.

  The determination button 541E is a button for determining an item or the like selected by a short press operation of the direction buttons 541A, 541B, 541C, 541D, for example.

  Input unit 540 further includes function buttons 542A, 542B, 543A, and 543B. Each of the function buttons 542A and 542B is a button for starting a program or the like preset by the user, for example, by a short press operation.

  The function button 543A is a button for starting a call by a short press operation when a call is made to the communication terminal device 500. The function button button 543B is a button for ending the call by a short press operation when the communication terminal device 500 is in a call. The function button 543B is a button for switching the power of the communication terminal device 500 on and off by a user's long-time (for example, 1 second or longer) pressing operation (hereinafter also referred to as a long pressing operation). is there.

  The input unit 540 transmits a button signal corresponding to a short-pressed or long-pressed button among a plurality of buttons included in the input unit 540 to the control unit 510 described later. That is, the input unit 540 is an interface for the user to operate the communication terminal device 500. Hereinafter, an operation of the input unit 540 or a touch operation on the display unit 530 by the user is also referred to as an interface operation M.

  Communication terminal device 500 further includes a voice input unit 574. The voice input unit 574 has a function of inputting voice during a call. The voice input unit 574 includes a microphone for inputting voice. The voice input unit 574 converts voice acquired by the microphone into voice data, and transmits the voice data to the control unit 510 described later in the communication terminal device 500.

  FIG. 3 is a diagram showing an appearance of the communication terminal device 500 from the left side. Referring to FIG. 3, communication terminal apparatus 500 includes a recording medium insertion unit 550A. The recording medium insertion unit 550A is a part that inserts a recording medium, which will be described later, into the communication terminal device 500.

  FIG. 4 is a diagram showing the appearance of the communication terminal device 500 from the back. With reference to FIG. 4, communication terminal apparatus 500 further includes an audio output unit 572 and an imaging unit 578. The audio output unit 572 has a function of outputting audio corresponding to processing performed by the control unit 510 described later. The sound output unit 572 includes a speaker that outputs sound. The audio output unit 572 outputs audio based on audio data received from the control unit 510 described later from the speaker.

  The imaging unit 578 has a function of performing an imaging process for imaging a subject to be imaged. The imaging unit 578 includes an imaging lens, a light receiving unit, and a color filter unit (not shown). The light receiving unit has a function of converting input light into an electrical signal. The light receiving unit is composed of a plurality of light receiving elements. The light receiving element is an element using, for example, a CCD (Charge Coupled Device) image sensor or a CMOS (Complementary Metal Oxide Semiconductor) image sensor.

  The color filter unit is composed of a plurality of color filters. The color filter is a filter corresponding to each of R, G, and B. The plurality of color filters are provided corresponding to the plurality of light receiving elements, respectively.

  The following processing is performed in the imaging processing. First, the imaging unit 578 inputs light reflected by the subject to be imaged and incident on the imaging lens to the light receiving unit via the color filter unit. The light receiving unit converts the input light into an electrical signal. The imaging unit 578 converts the converted electrical signal into digital data (hereinafter also referred to as captured image data).

  FIG. 5 is a block diagram showing an internal configuration of communication terminal apparatus 500. FIG. 5 also shows a recording medium 555 for explanation. A recording medium 555 stores a program 180 described later. That is, the program 180 is recorded on a medium or the like and distributed as a program product. The recording medium 555 is also distributed as a program product.

  Referring to FIG. 5, communication terminal apparatus 500 further includes a control unit 510, a temporary storage unit 522, and a storage unit 520.

  The storage unit 520 has a function of storing data in a nonvolatile manner. The storage unit 520 is accessed by the control unit 510. The storage unit 520 is a medium (for example, a flash memory) that can hold data in a nonvolatile manner even when power is not supplied. The storage unit 520 stores a program 180, recording data to be described later, various other data, and the like. The program 180 includes a remote control program described later.

  Control unit 510 has a function of performing various types of processing, arithmetic processing, and the like for each unit in communication terminal device 500 in accordance with program 180 stored in storage unit 520. The controller 510 may be any of a microprocessor, a field programmable gate array (FPGA), an application specific integrated circuit (ASIC), a digital signal processor (DSP), and other circuits having arithmetic functions.

  Temporary storage unit 522 is accessed as data by control unit 510 and used as a work memory for temporarily storing data. The temporary storage unit 522 includes a RAM (Random Access Memory), an SRAM (Static Random Access Memory), a DRAM (Dynamic Random Access Memory), an SDRAM (Synchronous DRAM), a DDR-SDRAM (Double Data Rate SDRAM), and an RDRAM (Rambus Dynamic Random). (Access Memory), Direct-RDRAM (Direct Rambus Dynamic Random Access Memory), or any other circuit having a configuration capable of storing and storing data in a volatile manner.

  Communication terminal device 500 further includes an antenna 502, a tuner 505, and a data processing unit 507.

  The antenna 502 is connected to the tuner 505. The tuner 505 receives a broadcast signal having a frequency instructed by the control unit 510 via the antenna 502. The tuner 505 has a function of receiving broadcast signals based on digital broadcasting and analog broadcasting.

  The broadcast signal includes image data and audio data. When the broadcast signal is a signal based on digital broadcasting, the broadcast signal further includes text data, EPG (Electric Program Guide) data, BML (Broadcast Markup Language) data, and the like. The EPG data is data indicating a plurality of program information. BML data is data for controlling the arrangement position and operation of each of image data, audio data, and text data. The tuner 505 transmits the received broadcast signal to the data processing unit 507.

  The data processing unit 507 demodulates the received broadcast signal to obtain demodulated data. When the received broadcast signal is a signal based on analog broadcast, the data processing unit 507 performs the following processing. First, the data processing unit 507 decodes the demodulated data into image data and audio data.

  When the data processing unit 507 receives a display instruction for causing the display unit 530 to display an image from the control unit 510, the data processing unit 507 transmits the image data to a VDP (Video Display Processor) 532 described later. When receiving the image data, the VDP 532 displays an image (moving image or still image) based on the image data on the display unit 530.

  In addition, when the data processing unit 507 receives a recording instruction for performing a recording process from the control unit 510, the data processing unit 507 compresses the image data and the audio data and stores the compressed image data and the audio data in the storage unit 520. The recorded data in this case is also referred to as content below. The recorded data is data compressed in MPEG (Moving Picture Experts Group) 4 format. The recorded data is not limited to data compressed in the MPEG4 format, and may be data compressed in another format. Here, other formats include, for example, MPEG1, MPEG2, H.264. H.264 or the like.

  When the received broadcast signal is a signal based on digital broadcast, the data processing unit 507 performs the following processing. First, the data processing unit 507 decodes the demodulated data based on a digital broadcast protocol to obtain decoded data. The decoded data includes image data, audio data, text data, EPG data, and BML data. Image data and audio data included in the decoded data are data compressed in the MPEG4 format. The image data and audio data included in the decoded data are not limited to data compressed in the MPEG4 format, and may be data compressed in other formats. Here, other formats include, for example, MPEG1, MPEG2, H.264. H.264 or the like.

  When the data processing unit 507 receives a display instruction for displaying an image on the display unit 530 from the control unit 510, the data processing unit 507 transmits the image data included in the decoded data of the channel specified by the display instruction to the VDP 532 described later. Send. When receiving the image data, the VDP 532 displays an image (moving image or still image) based on the image data on the display unit 530.

  Further, when receiving a recording instruction for performing a recording process from the control unit 510, the data processing unit 507 stores the decoded data of the channel designated by the recording instruction in the storage unit 520 as the recording data. The recorded data in this case is also referred to as content below. In this case, the recorded data includes image data, audio data, text data, and BML data.

  The communication terminal device 500 further includes a VDP 532, a CGROM (Character Graphic Read Only Memory) 534, and a VRAM (Video Random Access Memory) 536.

  The CGROM 534 stores font data, graphic data, and the like. The VRAM 536 has a function of temporarily storing image data.

  Control unit 510 issues a drawing instruction to VDP 532 according to program 180 stored in storage unit 520. The drawing instruction is an instruction for generating an image and causing the display unit 530 to display the image.

  The VDP 532 is connected to the display unit 530. The VDP 532 reads necessary data from the CGROM 534 in accordance with a drawing instruction from the control unit 510 and generates an image using the VRAM 536. The VDP 532 reads out the image data stored in the VRAM 536 and causes the display unit 530 to display an image based on the image data.

  Communication terminal device 500 further includes an input unit 540 and a recording medium access unit 550.

  Control unit 510 receives, from input unit 540, a button signal corresponding to a button that has been subjected to a short press operation or a long press operation among the plurality of buttons included in input unit 540. Control unit 510 performs processing according to the received button signal.

  The recording medium access unit 550 can access the recording medium 555 when the recording medium 555 is inserted (attached) to the communication terminal device 500 from the recording medium insertion unit 550A. As a result, the recording medium access unit 550 can read the program 180 from the recording medium 555 on which the program 180 is recorded.

  The program 180 stored in the recording medium 555 is read by the recording medium access unit 550 by the installation process of the control unit 510, and the control unit 510 stores the program 180 in the storage unit 520. The installation processing program is stored in advance in the storage unit 520, and the installation processing is performed by the control unit 510 based on the installation processing program.

  Note that the program 180 may not be installed in the storage unit 520. In this case, control unit 510 reads program 180 stored in recording medium 555 via recording medium access unit 550, and performs predetermined processing based on program 180. The recording medium 555 further records content data and the like. The content data is, for example, music data, moving image data, and the like.

  The recording medium 555 includes a floppy (registered trademark) disk, CF (Compact Flash) card, SM (Smart Media (registered trademark)), MMC (Multi Media Card), SD (Secure Digital) memory card, memory stick (registered trademark), Any of a xD picture card, a non-volatile memory other than the above, and a magnetic storage medium such as an HDD (Hard Disk Drive) may be used.

Communication terminal device 500 further includes a communication unit 560 and a communication unit 562.
Communication unit 560 exchanges data with control unit 510. The communication unit 560 has a function of transmitting and receiving data to and from the video display device 600 in a wired or wireless manner.

  The communication unit 560 has a function of a communication interface that performs serial transfer based on the USB (Universal Serial Bus) 1.1 or USB 2.0 standard. Note that the standard of the communication interface for performing serial transfer is not limited to USB 1.1 or USB 2.0, but may be another standard.

  Note that the communication unit 560 may have a function of a communication interface that performs parallel transfer. The communication interface that performs parallel transfer is, for example, an interface that conforms to a Centronics standard or an IEEE 1284 (Institute of Electrical and Electronic Engineers 1284) standard. Further, the communication unit 560 may have a communication interface function based on the IEEE 1394 or SCSI standard.

  Communication unit 560 further has a wireless data communication function. The wireless data communication function has a function of performing data communication wirelessly using Bluetooth. Note that the wireless data communication is not limited to a method using Bluetooth, and may be another communication method using infrared light, for example. Communication unit 560 performs data communication with video display device 600 wirelessly in response to a control instruction from control unit 510.

  Communication unit 562 exchanges data with control unit 510. The communication unit 562 has a function of performing data communication using a wireless technology based on any one of IEEE802.11a, IEEE802.11b, and IEEE802.11g, which are wireless LAN standards. Note that the radio technology is not limited to a technology based on any of IEEE 802.11a, IEEE 802.11b, and IEEE 802.11g, and may be other radio technologies. Therefore, communication unit 562 can perform data communication with communication unit 50 wirelessly.

  The communication unit 562 further has a communication interface function using Ethernet (registered trademark). Therefore, the communication unit 562 can perform data communication with the communication unit 50 via, for example, a LAN cable.

  Therefore, communication terminal device 500 according to the present embodiment can also download a program from network 70 via communication unit 50 and communication unit 562 and store the program in storage unit 520. In this case, the downloaded program is the program 180.

  Control unit 510 performs predetermined processing in accordance with a program (program 180) downloaded from network 70. The download program is stored in advance in the storage unit 520, and the download process is performed by the control unit 510 based on the download program.

Communication terminal device 500 further includes an antenna 564 and a communication unit 566.
The antenna 564 is connected to the communication unit 566. The communication unit 566 has a function of transmitting and receiving a wireless communication signal using the antenna 564. The communication unit 566 receives a wireless communication signal having a frequency designated by the control unit 510 via the antenna 564. The wireless communication signal is a signal including voice data, character data, image data, and the like.

  Communication unit 566 uses antenna 564 to communicate with the nearest base station (not shown) using a wireless communication signal. The nearest base station can communicate with the telephone network 60. Therefore, the communication unit 566 uses the antenna 564 to communicate with the telephone network 60 via the nearest base station using a wireless communication signal. When receiving the wireless communication signal, the communication unit 566 demodulates the wireless communication signal and transmits data based on the demodulated wireless communication signal to the control unit 510. Further, when transmitting a wireless communication signal, the communication unit 566 receives data (for example, audio data) from the control unit 510 and converts the data into a wireless communication signal based on a predetermined protocol. Communication unit 566 then uses antenna 564 to transmit the converted wireless communication signal to telephone network 60 via the nearest base station (not shown).

  The communication unit 566 can also acquire information indicating the position of the base station (hereinafter also referred to as base station position information) by communicating with the nearest base station. The communication unit 566 transmits the acquired base station position information to the control unit 510 in response to a control instruction from the control unit 510. Control unit 510 can roughly grasp the position of communication terminal apparatus 500 based on the received base station position information.

  The communication unit 566 has a GPS (Global Positioning System) function. The GPS (Global Positioning System) function is a function for communicating with an artificial satellite and acquiring information (hereinafter also referred to as GPS position information) of the position (position based on latitude, longitude, altitude, etc.) of the communication terminal device 500. is there. The communication unit 566 acquires GPS position information in response to a control instruction from the control unit 510 and transmits it to the control unit 510.

  Control unit 510 performs data communication with voice output units 570 and 572 and voice input unit 574 described above.

  When control unit 510 transmits audio data to audio output unit 570, audio output unit 570 outputs audio based on the audio data received from control unit 510 from the speaker. When control unit 510 transmits audio data to audio output unit 572, audio output unit 572 outputs audio based on the audio data received from control unit 510 from the speaker.

  When the user utters voice to the microphone included in the voice input unit 574, the voice input unit 574 converts voice acquired by the microphone into voice data, and transmits the voice data to the control unit 510.

  The control unit 510 performs data communication with the LED 576 and the imaging unit 578 described above. The LED 576 emits light based on a control instruction from the control unit 510.

  The imaging unit 578 performs the above-described imaging processing based on a control instruction from the control unit 510 and transmits captured image data to the control unit 510. Upon receiving the captured image data, control unit 510 stores the captured image data in any of temporary storage unit 522, storage unit 520, and recording medium 555.

  Communication terminal device 500 further includes a vibration unit 579. The vibration unit 579 has a function of vibrating the communication terminal device 500 based on a control instruction from the control unit 510. The vibration unit 579 vibrates the communication terminal device 500 based on a control instruction from the control unit 510 when, for example, an incoming call or an e-mail is received.

Next, the video display device 600 will be described in detail.
FIG. 6 is a diagram showing the external appearance of the video display device 600 from the front. Referring to FIG. 6, video display device 600 includes a display unit 630 and an audio output unit 670.

  The display unit 630 has a function of displaying characters, images, and the like. The display unit 630 is a device using any one of an LCD panel, a CRT (Cathode Ray Tube), an FED panel, a PDP (Plasma Display Panel), and an organic EL display panel. Note that the display unit 630 may be a device using a panel with a display method other than the above. The resolution of the display unit 630 is larger than the resolution of the display unit 530. For example, the resolution of the display unit 630 is a resolution of horizontal 1366 (dots) × vertical 768 (dots) at which a PC image can be displayed. The resolution of the display unit 630 is not limited to horizontal 1366 (dots) × vertical 768 (dots), but may be other resolutions (for example, 1024 × 768). The aspect ratio of the display unit 630 displaying the video is 16: 9. The aspect ratio is not limited to 16: 9, and may be 4: 3, for example.

  The audio output unit 670 has a function of outputting audio corresponding to processing performed by the control unit 610 described later. Audio output unit 670 includes a speaker that outputs audio. The audio output unit 670 outputs audio based on audio data received from the control unit 610 described later from the speaker.

  FIG. 7 is a block diagram showing an internal configuration of the video display device 600. FIG. 7 also shows a recording medium 555A for explanation. A recording medium 555A records a program 180A described later. That is, the program 180A is recorded on a medium or the like and distributed as a program product. The recording medium 555A is also distributed as a program product.

  Referring to FIG. 7, video display device 600 further includes a control unit 610, a temporary storage unit 622, and a storage unit 620.

  The storage unit 620 has a function of storing data in a nonvolatile manner. The storage unit 620 is accessed by the control unit 610. The storage unit 620 is a hard disk capable of storing a large amount of data. Note that the storage unit 620 is not limited to a hard disk, and may be any medium (for example, a flash memory) that can hold data in a nonvolatile manner even when power is not supplied. The storage unit 620 stores a program 180A, recording data to be described later, other various data, and the like.

  Control unit 610 has a function of performing various types of processing, arithmetic processing, and the like for each unit in video display device 600 in accordance with program 180A stored in storage unit 620. Since control unit 610 is similar to control unit 510 described above, detailed description will not be repeated.

  The temporary storage unit 622 is used as a work memory that is accessed by the control unit 610 and temporarily stores data. Since temporary storage unit 622 is similar to temporary storage unit 522 described above, detailed description thereof will not be repeated.

  The video display device 600 further includes an antenna 602, a tuner 605, and a data processing unit 607.

  The antenna 602 is connected to the tuner 605. The tuner 605 receives a broadcast signal having a frequency instructed by the control unit 610 via the antenna 602. The tuner 605 has a function of receiving broadcast signals based on digital broadcasting and analog broadcasting.

  The broadcast signal includes image data and audio data. When the broadcast signal is a signal based on digital broadcasting, the broadcast signal further includes text data, EPG data, the aforementioned BML data, and the like. The tuner 605 transmits the received broadcast signal to the data processing unit 607.

  The data processing unit 607 demodulates the received broadcast signal to obtain demodulated data. When the received broadcast signal is a signal based on analog broadcast, the data processing unit 607 performs the following processing. First, the data processing unit 607 decodes the demodulated data into image data and audio data.

  When the data processing unit 607 receives a display instruction for displaying an image on the display unit 630 from the control unit 610, the data processing unit 607 transmits the image data to the VDP 632 described later. When receiving the image data, the VDP 632 displays an image (moving image or still image) based on the image data on the display unit 630.

  In addition, when the data processing unit 607 receives a recording instruction for performing a recording process from the control unit 610, the data processing unit 607 compresses the image data and the audio data, and stores them in the storage unit 620 as recorded data. The recorded data is data compressed in the MPEG2 format. The recorded data is not limited to data compressed in the MPEG2 format, and may be data compressed in another format. Here, other formats include, for example, MPEG1, H.264, and the like. H.264 or the like.

  When the received broadcast signal is a signal based on digital broadcast, the data processing unit 607 performs the following processing. First, the data processing unit 607 decodes the demodulated data based on a digital broadcast protocol to obtain decoded data. The decoded data includes image data, audio data, text data, EPG data, and BML data. Image data and audio data included in the decoded data are data compressed in the MPEG2 format. The image data and audio data included in the decoded data are not limited to data compressed in the MPEG2 format, and may be data compressed in other formats. Here, other formats include, for example, MPEG1, H.264, and the like. H.264 or the like.

  When the data processing unit 607 receives a display instruction for causing the display unit 630 to display the image data from the control unit 610, the data processing unit 607 converts the image data included in the decoded data of the channel designated by the display instruction into a VDP 632 described later. Send to. When receiving the image data, the VDP 632 displays an image (moving image or still image) based on the image data on the display unit 630.

  Hereinafter, an image based on a broadcast signal received by the tuner 605 and displayed on the display unit 630 is also referred to as a TV image. Note that the number of types of TV image channels that can be directly selected by pressing the numeric buttons “1” to “12” provided on the remote controller 300 to be described later for operating the video display device 600 is as follows. Assume that the maximum is 12. As a matter of course, the more number buttons provided on the remote controller 300, the larger the number of TV image channel types that can be directly selected.

  Remote control channel numbers “1” to “12” are set in the numeric buttons “1” to “12” of the remote control 300, respectively. For example, the remote control channel number “3” is set to the numeric button “3”. One TV image channel can be registered in one remote control channel number. For example, it is assumed that the TV image channel number “8” is registered for the remote control channel number “1”. In this case, the numeric button “1” of the remote controller 300 is pressed by the user, so that a remote control signal for selecting a TV image of the channel number “8” is transmitted from the remote controller 300 to the video display device 600. Sent.

  Note that the video display device 600 has a function of simultaneously displaying a plurality of types of TV images on the display unit 630. In addition, the video display device 600 has a function of simultaneously displaying a TV image and other types of images on the display unit 630.

  In addition, when the data processing unit 607 receives a recording instruction for performing a recording process from the control unit 610, the data processing unit 607 causes the storage unit 620 to store the decoded data of the channel designated by the recording instruction as the recording data. The recorded data in this case is also referred to as content below. In this case, the recorded data includes image data, audio data, text data, and BML data.

  The video display device 600 further includes a VDP 632, a CGROM 634, and a VRAM 636.

  Similar to the CGROM 534, the CGROM 634 stores font data, graphic data, and the like. The VRAM 636 has a function of temporarily storing image data.

  The control unit 610 issues a drawing instruction to the VDP 632 according to the program 180A stored in the storage unit 620. The drawing instruction is an instruction for generating an image and causing the display unit 630 to display the image.

  The VDP 632 is connected to the display unit 630. The VDP 632 reads necessary data from the CGROM 634 in response to a drawing instruction from the control unit 610 and generates an image using the VRAM 636. The VDP 632 reads out the image data stored in the VRAM 636 and causes the display unit 630 to display an image based on the image data.

  The video display device 600 further includes an input unit 640 and a recording medium access unit 650.

  Input unit 640 includes a plurality of buttons (not shown). The plurality of buttons are provided outside the video display device 600. When any one of the buttons is pressed by the user, the input unit 640 transmits a button signal corresponding to the pressed button to the control unit 610. Control unit 610 performs predetermined processing based on the received button signal. Hereinafter, the button operation of the input unit 640 by the user is also referred to as an interface operation T.

  The recording medium access unit 650 has a function of reading the program 180A from the recording medium 555A on which the program 180A is recorded. The program 180A stored in the recording medium 555A is read by the recording medium access unit 650 by the installation process of the control unit 610, and the control unit 610 stores the program 180A in the storage unit 620. The installation processing program is stored in advance in the storage unit 620, and the installation processing is performed by the control unit 610 based on the installation processing program.

  Note that the program 180A may not be installed in the storage unit 620. In this case, control unit 610 reads program 180A stored in recording medium 555A via recording medium access unit 650, and performs predetermined processing based on program 180A. Content data and the like are also recorded on recording medium 555A. The content data is, for example, music data, moving image data, and the like.

  The recording medium 555A includes a BD (Blu-ray Disc), an HD-DVD (High-Definition Digital Versatile Disc), a DVD-ROM (Digital Versatile Disk Read Only Memory), a DVD-R (Digital Versatile Disk Recordable), and a DVD-RAM. (Digital Versatile Disk Random Access Memory), DVD + RW (Digital Versatile Disk Re-Writable), DVD-RW, CD-ROM (Compact Disk Read Only Memory), MO (Magneto Optical Disk), floppy (registered trademark) disk, CF card SM (Smart Media (registered trademark)), MMC, SD memory card, Memory Stick (registered trademark), xD picture card, USB memory, magnetic tape, and non-volatile memory other than those described above.

Video display device 600 further includes a communication unit 660 and a communication unit 662.
Communication unit 660 exchanges data with control unit 610. The communication unit 660 has a function of transmitting / receiving data to / from the communication terminal device 500 in a wired or wireless manner. Communication unit 660 has the same configuration and function as communication unit 560 described above, and therefore detailed description will not be repeated.

  Communication unit 662 transmits / receives data to / from control unit 610. Since communication unit 662 has the same configuration and function as communication unit 562 described above, detailed description will not be repeated. Therefore, communication unit 662 can perform data communication with communication unit 50 wirelessly. Communication unit 662 can perform data communication with communication unit 50 via, for example, a LAN cable.

  Therefore, video display apparatus 600 according to the present embodiment can also download a program from network 70 via communication unit 50 and communication unit 662 and store the program in storage unit 620. In this case, the downloaded program is the program 180A.

  Control unit 610 performs predetermined processing according to a program (program 180A) downloaded from network 70. The download program is stored in advance in the storage unit 620, and the download process is performed by the control unit 610 based on the download program.

  Video display device 600 further includes a remote control signal receiver 680. The remote control signal receiving unit 680 has a function of receiving a remote control signal for operating the video display device 600 output from the remote control (remote controller) 300. Remote control signal receiving unit 680 transmits the received remote control signal to control unit 610. Control unit 610 performs corresponding processing in accordance with the received remote control signal. As described above, the remote controller 300 is provided with numeric buttons “1” to “12” for selecting a TV image. Hereinafter, the operation of the remote controller 300 by the user is also referred to as an interface operation T.

  In addition, it can be assumed that the above-described communication terminal device 500 has the function of the remote controller 300, and there can be assumed a case where there are two communication terminal devices 500 and a remote controller 300 and a case where only one of them exists.

  The control unit 610 performs data communication with the voice output unit 670 described above. When control unit 610 transmits audio data to audio output unit 670, audio output unit 670 outputs audio based on the audio data received from control unit 610 from the speaker.

  FIG. 8 is a block diagram showing the internal configuration of the service server 800A. Referring to FIG. 8, service server 800A includes a display unit 830, a control unit 810, a temporary storage unit 822, and a storage unit 820.

  The display unit 830 has a function of displaying characters, images, and the like. Since display unit 830 is similar to display unit 630 described above, detailed description will not be repeated.

  The storage unit 820 has a function of storing data in a nonvolatile manner. The storage unit 820 is accessed by the control unit 810. The storage unit 820 is a hard disk capable of storing a large amount of data. Note that the storage unit 820 is not limited to a hard disk, and may be any medium (for example, a flash memory) that can hold data in a nonvolatile manner even when power is not supplied. The storage unit 820 stores a program 180B, recording data, content data, various other data, and the like.

  Control unit 810 has a function of performing various types of processing, arithmetic processing, and the like for each unit in service server 800A in accordance with program 180B stored in storage unit 820. Since control unit 810 is similar to control unit 510 described above, detailed description will not be repeated.

  The temporary storage unit 822 is accessed as data by the control unit 810, and is used as a work memory that temporarily stores data. Since temporary storage unit 822 is similar to temporary storage unit 522 described above, detailed description thereof will not be repeated.

  The service server 800A further includes a VDP 832, a CGROM 834, and a VRAM 836.

  Like the CGROM 534, the CGROM 834 stores font data, graphic data, and the like. The VRAM 836 has a function of temporarily storing image data.

  The control unit 810 issues a drawing instruction to the VDP 832 in accordance with the program 180B stored in the storage unit 820. The drawing instruction is an instruction for generating an image and causing the display unit 830 to display the image.

  The VDP 832 is connected to the display unit 830. The VDP 832 reads necessary data from the CGROM 834 in response to a drawing instruction from the control unit 810 and generates an image using the VRAM 836. The VDP 832 reads out the image data stored in the VRAM 836 and causes the display unit 830 to display an image based on the image data.

Service server 800A further includes an input unit 840.
A mouse 842 and a keyboard 844 are connected to the input unit 840. The user uses the mouse 842 or the keyboard 844 to give an instruction to the service server 800A. An input instruction from the mouse 842 or the keyboard 844 is transmitted to the control unit 810 via the input unit 840. Control unit 810 performs predetermined processing based on an input instruction from input unit 840.

The service server 800A further includes a communication unit 860 and a communication unit 862.
The communication unit 860 performs data transmission / reception with the control unit 810. The communication unit 860 has a function of transmitting and receiving data to and from other devices not shown in a wired or wireless manner. Communication unit 860 has the same configuration and function as communication unit 560 described above, and therefore detailed description will not be repeated.

  Communication unit 862 transmits and receives data to and from control unit 810. Since communication unit 862 has the same configuration and function as communication unit 562 described above, detailed description will not be repeated. Accordingly, the communication unit 862 can perform data communication with the network 70 wirelessly. The communication unit 862 can perform data communication with the network 70 via, for example, a LAN cable.

  Each of search server 800S and Web server 800W has the same configuration as that of service server 800A described above, and thus detailed description will not be repeated.

  Next, processing for using communication terminal device 500 as a remote controller for operating video display device 600 (hereinafter also referred to as a display device remote controller) will be described. When control unit 510 executes a remote control program of program 180 by interface operation M, communication terminal device 500 can be used as a display device remote control. In this case, the following remote control image MG100 is displayed on display unit 530.

  FIG. 9 is a diagram showing a remote control image MG100 as an example. Referring to FIG. 9, button images MBG110, MBG120, and MBG130 are arranged in remote control image MG100.

  Each of the button images MBG110, MBG120, and MBG130 is pressed by the interface operation M, so that the control unit 510 transmits a corresponding remote control signal described later to the video display device 600 using the communication unit 560. It is a button image for doing.

  The button image MBG110 is a button image for transmitting a power supply remote control signal to the video display device 600 by being pressed by the interface operation M. The power remote control signal is a remote control signal for switching between a state where the power of the video display device 600 is on and a state where the power of the video display device 600 is off.

  The button image MBG 120 is a button image for transmitting a program guide display remote control signal to the video display device 600 by being pressed by the interface operation M. The program guide display remote control signal is a remote control signal for causing the display unit 630 of the video display device 600 to display a program guide image to be described later.

  The button image MBG 130 is a button image for transmitting a menu display remote control signal to the video display device 600 by being pressed by the interface operation M. The menu display remote control signal is a remote control signal for causing a display unit 630 of the video display device 600 to display a menu image to be described later.

  In remote control image MG100, button images MBG142, MBG144, MBG152, and MBG154 are further arranged. Each of the button images MBG142, MBG144, MBG152, and MBG154 is pressed by the interface operation M, so that the control unit 510 uses a communication unit 560 to transmit a corresponding remote control signal to be described later to the video display device 600. It is a button image for transmitting to.

  The button image MBG 142 is a button image for transmitting a volume up remote control signal to the video display device 600 by being pressed by the interface operation M. The volume up remote control signal is a remote control signal for increasing the sound output from the audio output unit 670 of the video display device 600. The button image MBG 144 is a button image for transmitting a volume down remote control signal to the video display device 600 by being pressed by the interface operation M. The volume down remote control signal is a remote control signal for reducing the sound output from the audio output unit 670 of the video display device 600.

  The button image MBG 152 is a button image for transmitting a channel plus remote control signal to the video display device 600 by being pressed by the interface operation M. The channel plus remote control signal is a remote control signal for incrementing the remote control channel number by 1 when a TV image is displayed on the display unit 630 of the video display device 600. When the remote control channel number is “12” and the above-described process of incrementing by 1 is performed, the remote control channel number is “1”.

  The button image MBG154 is a button image for transmitting a channel minus remote control signal to the video display device 600 by being pressed by the interface operation M. The channel minus remote control signal is a remote control signal for decrementing the remote control channel number by 1 when a TV image is displayed on the display unit 630 of the video display device 600. When the remote control channel number is “1” and the above decrementing process is performed, the remote control channel number is “12”.

  In remote control image MG100, button images MBG170 and MBG180 are further arranged. Each of the button images MBG 170 and MBG 180 is pressed by the interface operation M so that the control unit 510 transmits a corresponding remote control signal to be described later to the video display device 600 using the communication unit 560. It is a button image.

  The button image MBG 170 is a button image for transmitting a set image display remote control signal to the video display device 600 by being pressed by the interface operation M. The setting image display remote control signal is a remote control signal for causing the display unit 630 of the video display device 600 to display a setting image to be described later. Button image MBG 180 is a button image for transmitting a detailed remote control image display remote control signal to video display device 600 by being pressed by interface operation M. The detailed remote control image display remote control signal is a remote control signal for causing the display unit 630 of the video display device 600 to display a detailed remote control image. The detailed remote control image is an image for transmitting a remote control signal other than a remote control signal frequently used for the video display device 600 to the video display device 600.

  Hereinafter, the operation mode of the communication terminal device 500 when the communication terminal device 500 can operate the video display device 600 by transmitting a remote control signal to the video display device 600 is also referred to as a remote control mode.

  Next, processing for the video display apparatus 600 to receive content from the service server 800A (hereinafter also referred to as content handling processing) will be described. It is assumed that remote control image MG100 is displayed on display unit 530 of communication terminal device 500. In this case, it is assumed that communication terminal apparatus 500 is set to the remote control mode.

  FIG. 10 is a flowchart of the content handling process. FIG. 10 shows processing performed in each of communication terminal device 500, video display device 600, and service server 800A.

In communication terminal device 500, first, the process of step S110 is performed.
In step S110, control unit 510 determines whether or not there is a list acquisition operation. The list acquisition operation is an operation for causing the display unit 530 to display a list of contents that can be acquired from the service server 800A. Specifically, the list acquisition operation is an interface operation M for pressing the button image MBG130 in FIG. If YES in step S110, the process proceeds to step S111. On the other hand, if NO at step S110, the process at step S110 is performed again.

  In step S111, list acquisition processing is performed. In the list acquisition process, first, control unit 510 transmits a list acquisition remote control signal as a list acquisition request to video display device 600 using communication unit 560. The list acquisition remote control signal is a remote control signal for causing the video display device 600 to acquire a list of contents that can be acquired from the service server 800A.

  In video display device 600, first, the process of step S120 is performed. In step S120, control unit 610 determines whether or not a list acquisition remote control signal as a list acquisition request has been received. If YES in step S120, the process proceeds to step S121. On the other hand, if NO at step S120, the process at step S120 is performed again.

  In step S121, list acquisition processing A is performed. In the list acquisition process A, first, the control unit 610 uses the communication unit 662 to transmit a list acquisition request A for acquiring a list of contents that can be acquired from the service server 800A to the service server 800A.

In service server 800A, first, the process of step S140 is performed.
In step S140, control unit 810 determines whether or not list acquisition request A has been received. If YES in step S140, the process proceeds to step S141. On the other hand, if NO at step S140, the process at step S140 is performed again.

  In step S141, the control unit 810 transmits the following list data D100, which is data of a distributable content list, to the device that transmitted the list acquisition request A. Thereafter, the process of step S141 ends.

  FIG. 11 is a diagram showing list data D100 as an example. Referring to FIG. 11, list data D100 includes a plurality of pieces of content information. The “management number” is a number for managing each of a plurality of pieces of content information. The “ID number” is a number for identifying content. “Title” indicates the title of the corresponding content.

  Referring to FIG. 10 again, in video display device 600, in list acquisition process A, control unit 610 receives list data D100. When receiving the list data D100, the control unit 610 stores the list data D100 in the storage unit 620. Then, the control unit 610 generates the following list image TG200 using the VDP 632 based on the list data D100, and causes the display unit 630 to display the generated list image TG200.

  FIG. 12 is a diagram showing a list image TG200 as an example. Referring to FIG. 12, button images TBG211, TBG212, TBG213, TBG214, TBG215, TBG216, TBG217, TBG218, and TBG219 are arranged in list image TG200. Each of the button images TBG211, TBG212, TBG213, TBG214, TBG215, TBG216, TBG217, TBG218, and TBG219 displays the title of the content.

  Each of the button images TBG211, TBG212, TBG213, TBG214, TBG215, TBG216, TBG217, TBG218, and TBG219 is a button image for acquiring the corresponding content from the service server 800A by being pressed.

  The list image TG200 may be an image on which an electronic program guide generated based on EPG data is displayed. In this case, each of the button images TBG211, TBG212, TBG213, TBG214, TBG215, TBG216, TBG217, TBG218, and TBG219 is a button image for acquiring a moving image of the program.

  Referring to FIG. 10 again, in list acquisition processing A in step S121, control unit 610 further transmits (transfers) received list data D100 to communication terminal device 500 using communication unit 660. . Thereafter, the process of step S121 ends.

  In communication terminal device 500, in list acquisition processing in step S111, control unit 510 further receives list data D100. When receiving the list data D100, the control unit 510 stores the list data D100 in the storage unit 520. Then, control unit 510 generates the following list image MG200 using VDP 632 based on list data D100, and causes display unit 630 to display the generated list image MG200. And the process of step S111 is complete | finished.

  FIG. 13 is a diagram showing a list image MG200 as an example. Referring to FIG. 13, content list image G210 and button images MBG170 and MBG280 are arranged in list image MG200.

  The content list image G210 is an image that displays content that can be acquired from the service server 800A as a button image. Button images MBG211, MBG212, MBG213, MBG214, MBG215, MBG216, MBG217, MBG218, and MBG219 are arranged in the content list image G210. Each of the button images MBG211, MBG212, MBG213, MBG214, MBG215, MBG216, MBG217, MBG218, and MBG219 displays the title of the content.

  Each of the button images MBG211, MBG212, MBG213, MBG214, MBG215, MBG216, MBG217, MBG218, MBG219 is pressed down by the interface operation M, and thereby the list image TG200 displayed on the video display device 600 is displayed. It is a button image for transmitting a remote control signal for pressing the button image displaying the same title to the video display device 600.

  For example, when the button image MBG211 that displays the title “B movie” is pressed by the interface operation M, the control unit 510 displays the button image TBG211 that displays the title “B movie” in the list image TG200. A remote control signal for the pressing process is transmitted to the video display device 600.

  Since button image MBG 170 is similar to button image MBG 170 in remote control image MG100 in FIG. 9, detailed description will not be repeated. The button image 280 is a button image for causing the display unit 530 to display the image of the remote control image MG100 in FIG. 9 instead of the list image MG200 by being pressed by the interface operation M.

  Remote control image MG100 may be an image on which an electronic program guide generated based on EPG data is displayed. In this case, each of the button images MBG211, MBG212, MBG213, MBG214, MBG215, MBG216, MBG217, MBG218, and MBG219 is a button image for acquiring a moving image of the program.

  Referring to FIG. 10 again, in communication terminal device 500, when the process of step S111 ends, the process proceeds to step S112.

  In step S112, control unit 510 determines whether or not there is a content acquisition operation. The content acquisition operation is an operation for receiving content from the service server 800A. Specifically, the content acquisition operation is an operation of pressing one of the button images MBG211, MBG212, MBG213, MBG214, MBG215, MBG216, MBG217, MBG218, and MBG219 by the interface operation M.

  If YES in step S112, the process proceeds to step S113. On the other hand, if NO at step S112, the process at step S112 is performed again. Here, assuming that there is a content acquisition operation for pressing the button image MBG211 that displays the title “B movie” by the interface operation M, the process proceeds to step S113. Hereinafter, the content requested to be acquired from the service server 800A by the content acquisition operation is referred to as an acquisition request content.

  In step S113, control unit 510 transmits a content acquisition remote control signal as a content acquisition request to video display device 600 using communication unit 560. Then, the process of step S113 ends. In this case, the content acquisition remote control signal is a remote control signal for receiving the acquisition request content with the title “B movie” from the service server 800A.

  In the video display device 600, when the process of step S121 ends, the process proceeds to step S122.

  In step S122, control unit 610 determines whether or not a content acquisition remote control signal as a content acquisition request has been received. If YES in step S122, the process proceeds to step S123. On the other hand, if NO at step S122, the process at step S122 is performed again. Here, assuming that the content acquisition remote control signal for receiving the acquisition request content with the title “B movie” is received as the content acquisition request, the process proceeds to step S123.

  In step S123, control unit 610 uses communication unit 662 to transmit content acquisition request A for acquiring content specified by the received content acquisition remote control signal to service server 800A from service server 800A. Thereafter, the process of step S123 ends. The content acquisition request A includes an ID number for specifying the acquisition request content. Here, it is assumed that the content acquisition request A includes an ID number “1234” for specifying the acquisition request content whose title is “B movie”.

  In service server 800A, when the process of step S141 ends, the process proceeds to step S142.

  In step S142, control unit 810 determines whether or not content acquisition request A has been received. If YES in step S142, the process proceeds to step S143. On the other hand, if NO at step S142, the process at step S142 is performed again.

  In step S143, control unit 810 transmits data necessary for content reproduction (hereinafter also referred to as content reproduction necessary data) to video display device 600. Thereafter, the process of step S143 ends. The content reproduction necessary data includes content basic data D200, time table data D210, and CM table data D220 described below.

  The content basic data is data corresponding to an ID number for specifying the acquisition request content included in the content acquisition request A. The content basic data corresponding to the ID number for specifying the content included in the content acquisition request A is stored in advance in the storage unit 820 of the service server 800A. Therefore, the content basic data D200 is also stored in the storage unit 820 of the service server 800A in advance.

  FIG. 14 is a diagram showing content basic data D200 as an example. Referring to FIG. 14, the “time table URL” is a URL of the following time table data D210 necessary for reproducing the acquisition request content. The time table data D210 is stored in the storage unit 820.

  FIG. 15 is a diagram showing time table data D210 as an example. The time table data D210 is data in which information such as the reproduction timing of the acquisition request content is described. The detailed description of the time table data D210 will be described later.

  Referring to FIG. 14 again, “CM insertion count” is the number of times a CM image is displayed when the acquisition request content is reproduced. For example, when the “CM insertion count” is “3”, the number of times the CM image is displayed during the reproduction of the acquisition request content is three. Therefore, the acquisition request content is divided into the number of contents obtained by adding “1” to “CM insertion count”. In the present embodiment, since the “CM insertion count” is “3”, the acquisition request content is divided into four contents. When “CM insertion count” is “0”, one acquisition request content may include a CM image.

  The “CM table URL” is a URL of the following CM table data D220 necessary for specifying the CM data. The CM table data D220 is stored in the storage unit 820.

  FIG. 16 is a diagram showing CM table data D220 as an example. Referring to FIG. 16, “CM number” is a number for specifying CM data. “URL” is the URL of CM data corresponding to the “CM number” in the corresponding row.

  Referring to FIG. 14 again, the URLs of contents 1 to 4 are the URLs of four divided acquisition request contents. “Variable” in the row corresponding to “operation panel” means that the operation panel for controlling the reproduction of the content is permitted to be changed during the period when the acquisition requested content is being reproduced. When “Fixed” is set instead of “Variable”, the operation panel does not change during the period when the acquisition request content is being reproduced. Further, when “standard” is used instead of “variable”, display is performed by executing a general content reproduction program installed in the communication terminal device 500 in advance during a period in which the acquisition request content is being reproduced. The operation panel to be used will be used.

  The “operation panel xxURL” is the URL of operation panel data. In the present embodiment, three operation panels are used as an example during the reproduction period of the acquisition request content. In the following, an image showing an operation panel is also referred to as an operation panel image.

  Referring to FIG. 15 again, the “period number” is a number for specifying the content reproduction period. For example, the period indicated by “00: 00: 00-00: 14: 00” with the “period number” being “1” is from the time when the reproduction of the acquisition request content is started (hereinafter also referred to as the reproduction start time). The period from the reproduction start time to the time when 14 minutes have elapsed is shown. For example, during the period in which the “period number” is “1”, the moving image data whose file name is “1234-1.mpg” is reproduced on the video display device 600. In the present embodiment, the moving image displayed on display unit 630 of video display device 600 is an image obtained by reproducing (decoding processing) moving image data compressed in the MPEG2 format. Note that the compression format of moving image data is not limited to the MPEG2 format, and may be data compressed in another format. Here, the other format is, for example, H.264. H.264 or the like.

  In the time table data D210, the “CM number” corresponding to “0001”, “0007”, and “0189”, which is specified by the CM table data D220 in the period where the “period number” is “2”, respectively. This indicates that moving image data whose file names are “CM0001.mpg”, “CM0007.mpg”, and “CM0189.mpg” are reproduced in order.

  Further, the time table data D210 indicates that an operation panel image based on data having a file name “cont1234aa.html” is used in a period in which the “period number” is “1” to “4”. The operation panel image is an image displayed on the display unit 530 of the communication terminal device 500 by processing to be described later. The operation panel image is an image for performing processing such as content reproduction control. The operation panel image described below is an image generated based on data in the HTML (HyperText Markup Language) format. Hereinafter, the data for generating the operation panel image is also referred to as operation panel generation data. The operation panel generation data is data whose file name is “cont1234aa.html”, for example.

  The operation panel image is not limited to an image generated by data in HTML format, and may be an image generated by data in another format. The operation panel image generated by the operation panel generation data whose file name is “cont1234aa.html” is assumed to be the following operation panel image PG100.

  FIG. 17 is a diagram showing an operation panel image PG100 as an example. Referring to FIG. 17, operation panel image PG100 includes play button image PBG110, pause button image PBG112, stop button image PBG120, rewind button image PBG132, fast forward button image PBG134, and record button image PBG140. And are arranged. That is, the operation panel image PG100 is an image in which a plurality of button images are arranged at positions designated by operation panel generation data whose file name is “cont1234aa.html”. In the following, image data (for example, button image data) necessary for generating an operation panel image based on the operation panel generation data is also referred to as operation panel generation part data. The operation panel generation data includes information on the vertical and horizontal sizes of the operation panel image, information on a plurality of relative coordinate values for arranging a plurality of button images in the operation panel image, information on the name of the button image, and the like. .

  The button image names of play button image PBG110, pause button image PBG112, stop button image PBG120, rewind button image PBG132, fast forward button image PBG134, and record button image PBG140 are “play”, “pause”, and “stop”, respectively. ”,“ Rewind ”,“ fast forward ”and“ record ”.

  The reproduction button image PBG110 is a button image for reproducing content by being pressed by the interface operation M. The pause button image PBG 112 is a button image for temporarily stopping the content being reproduced by being pressed by the interface operation M. When the reproduction of the content is paused, when the pause button image PBG 112 is pressed by the interface operation M, the reproduction of the content is resumed.

  The stop button image PBG120 is a button image for stopping the reproduction of content by being pressed by the interface operation M. The rewind button image PBG 132 is a button image for making the playback position of the content a position before a predetermined period (for example, 15 seconds) by being pressed once by the interface operation M. The fast-forward button image PBG134 is a button image for fast-forward playback of content. Specifically, the fast-forward button image PBG134 is a button image that is pressed once by the interface operation M to make the content playback location a location after a predetermined period (for example, 15 seconds). .

  The recording button image PBG 140 is a button image for performing the above-described recording processing by being pressed by the interface operation M.

  Referring to FIG. 10 again, in the video display device 600, when the process of step S123 ends, the process proceeds to step S124.

  In step S124, control unit 610 receives content reproduction necessary data, and stores the received content reproduction necessary data in storage unit 620. Thereafter, the process proceeds to step S125.

  In step S125, control unit 610 receives necessary data from service server 800A based on content basic data D200, time table data D210, and CM table data D220 included in the received content reproduction necessary data. Perform processing.

  Specifically, control unit 610 performs processing for receiving data corresponding to period number n (natural number) of time table data D210 (hereinafter also referred to as period number n data) from service server 800A. Note that the initial value of n is “1”. More specifically, control unit 610 transmits a period number n data acquisition request for acquiring period number n data to service server 800A. Thereafter, the process of step S125 ends. When n is “1”, the period number n data is also referred to as period number 1 data. When n is “1”, the period number 1 data includes moving image data with a file name “1234-1.mpg”, operation panel generation data with a file name “cont1234aa.html”, and the operation panel. This data includes operation panel generation part data corresponding to the generation data.

  In step S125, the operation panel generation data and the operation panel generation part data already received are not requested to be acquired.

  In service server 800A, when the process of step S143 ends, the process proceeds to step S144.

  In step S144, control unit 810 determines whether or not a period number n data acquisition request has been received. If YES in step S144, the process proceeds to step S144A. On the other hand, if NO at step S144, the process at step S144 is performed again.

  In step S144A, control unit 810 transmits period number n data requested by the period number n data acquisition request to video display device 600. As described above, when n is “1”, the period number n data (period number 1 data) is the moving image data whose file name is “1234-1.mpg” and the file name is “cont1234aa.html”. This data includes certain operation panel generation data and operation panel generation part data corresponding to the operation panel generation data. The moving image data included in the period number n data has a large data capacity. Therefore, the control unit 810 distributes the moving image data to the video display device 600 in a streaming manner. Note that when the streaming distribution of the requested moving image data is completed, the process of step S144A ends, and the process of step S144 is performed again.

  In video display device 600, when the process of step S125 ends, the process proceeds to step S125A.

  In step S125A, control unit 610 receives period number n data. Thus, control unit 610 receives operation panel generation data and operation panel generation part data included in period number n data. Note that the moving image data included in the period number n data that is distributed by streaming is sequentially received by the control unit 610. In other words, the moving image data is continuously received by the control unit 610 even after the process of step S125A is completed. Note that the moving image data as the content includes operation metadata for performing processing such as reproduction control of the content (moving image data). Note that the operation metadata is not included in the moving image data as the content, and may be added. In the following description, it is assumed that the operation metadata is not included in the content and may be added. Here, the operation metadata is, for example, operation metadata D300 described below.

  The control unit 610 stores the received operation metadata in the temporary storage unit 622. Thereafter, the process proceeds to step S125B. Hereinafter, data including operation panel generation data and operation panel generation part data is also referred to as operation panel data. The operation metadata D300 is data corresponding to operation panel data including operation panel generation data whose file name is “cont1234aa.html”. That is, the operation metadata D300 is data corresponding to the operation panel image PG100 generated by the operation panel data.

  FIG. 18 is a diagram illustrating operation metadata D300 as an example. Referring to FIG. 18, “content type” indicates the type of content data. “Genre” indicates information on the genre of the content. The “button image name” is a name of a button image displayed in an operation panel image for performing processing such as content reproduction control. The “link character string” is a hyperlink character string. A hyperlink character string is a character string for displaying another Web page. “Control” is control performed by the video display apparatus 600 when a “button image” or “hyperlink character string” with a corresponding name is pressed or clicked by the interface operation M. For example, the control “playback” is control for playing back content.

  Referring to FIG. 17 again, as described above, the button image names of the playback button image PBG110, the pause button image PBG112, the stop button image PBG120, the rewind button image PBG132, the fast forward button image PBG134, and the record button image PBG140 are as follows. , “Play”, “Pause”, “Stop”, “Rewind”, “Fast forward” and “Record”, respectively.

  Referring to FIG. 10 again, in step S125B, control unit 610 transmits operation panel data included in the received period number n data to communication terminal device 500. If operation panel data is not included in the received period number n data, control unit 610 does not perform processing for transmitting operation panel data to communication terminal device 500. Thereafter, the process of step S125B ends.

In communication terminal device 500, the process proceeds to step S114 after the process of step S113.
In step S114, control unit 510 determines whether the first operation panel data or operation panel data different from the already received operation panel data has been received. If YES in step S114, the process proceeds to step S115. On the other hand, if NO at step S114, the process at step S114 is performed again. When the process of step S114 is performed for the first time, it is determined that the first operation panel data has been received, and the process proceeds to step S115. Here, assuming that operation panel data including operation panel generation data and operation panel generation part data has been received, the process proceeds to step S115.

  In step S115, an operation panel image display process is performed. In the operation panel image display process, the control unit 510 uses the VDP 532 to generate an operation panel image based on the operation panel generation data that is HTML data using the operation panel generation part data, and the generated operation A panel image is displayed on the display unit 530. Thereafter, the process of step S115 ends. Note that the generated operation panel image is, for example, the operation panel image PG100 of FIG.

  When the operation panel image is smaller than the image size that can be displayed on the display unit 530 and an image generated by executing another program (hereinafter also referred to as an execution program image) is displayed on the display unit 530. A composite image in which the operation panel image is displayed in front of the execution program image may be displayed on the display unit 530. The composite image is, for example, the following composite image MG300. Only the generated operation panel image may be displayed on display unit 530.

  FIG. 19 is a diagram illustrating a composite image MG300 as an example. Referring to FIG. 19, composite image MG300 is an image in which operation panel image PG100 is arranged in the execution program image. The execution program image is an image for browsing e-mails, for example. The execution program image is an image for creating a sentence, for example.

  Referring to FIG. 10 again, when the process of step S115 ends, the process proceeds to step S116.

  In step S116, control unit 510 executes an operation determination process described later. The operation determination process is a process performed independently of other processes. If the operation determination process has already been performed, the control unit 510 ends the operation determination process that is being executed, and executes a new operation determination process. When the process of step S116 ends, the process of step S114 is performed again.

  In video display device 600, when the process of step S125B ends, the process proceeds to step S126.

In step S126, content processing is performed.
FIG. 20 is a flowchart of the operation determination process and the content process. Referring to FIG. 20, in the content process, first, the process of step S220 is performed.

  In step S220, control unit 610 executes content display processing. The content display process is a process performed independently of the content process and other processes. Thereafter, the process of step S220 ends.

  In the content display processing, the control unit 610 uses the VDP 632 to perform streaming for displaying an image based on the moving image data on the display unit 630 while receiving the moving image data included in the period number n data from the service server 800A. Reproduction display processing is performed. In addition, when the reception of moving image data included in the period number n data (for example, period number 1 data) is completed and the reproduction of the image based on the moving image data is completed, the content display process ends.

In the operation determination process, first, the process of step S210 is performed.
In step S210, control unit 510 determines whether or not there is a display control operation. The display control operation is an interface operation M for pressing the button image in the operation panel image displayed on the display unit 530. If YES in step S210, the process proceeds to step S212. On the other hand, if NO at step S210, the process at step S210 is performed again.

  For example, when the operation panel image displayed on the display unit 530 is the operation panel image PG100 of FIG. 17, the display control operation is, for example, an interface operation M for pressing the stop button image PBG120.

  In step S <b> 212, control unit 510 transmits a control remote control signal to video display device 600 using communication unit 560. When the display control operation is, for example, an interface operation M for pressing the stop button image PBG120, the control remote control signal is “stop” information that is the name of the stop button image PBG120 in the operation panel image PG100. Remote control signal including When the process of step S212 is completed, the process of step S210 is performed again.

  In the content process, when the process of step S220 is completed, the process proceeds to step S222.

  In step S222, control unit 610 determines whether or not operation panel data that is different from the first operation panel data or the operation panel data that has already been received is received. That is, the control panel 610 includes operation panel data in the period number n data received in the process of step S125A, and the received operation panel data is the first operation panel data or already received operation panel data. It is determined whether the operation panel data is different. If YES in step S222, the process proceeds to step S224. On the other hand, if NO at step S222, the process proceeds to step S226. When the process of step S222 is performed for the first time, it is determined that the first operation panel data has been received, and the process proceeds to step S224.

  In step S224, control unit 610 executes control signal handling processing for handling the control remote control signal transmitted from communication terminal apparatus 500. The control signal handling process is a process performed independently of other processes. If the control signal handling process has already been executed, the control unit 610 ends the control signal handling process being executed, and executes a new control signal handling process. When the process of step S224 ends, the process proceeds to step S226.

In the control signal handling process, first, the process of step S230 is performed.
In step S230, control unit 610 determines whether a control remote control signal has been received or not. If YES at step S230, the process proceeds to step S232. On the other hand, if NO at step S230, the process at step S230 is performed again. Here, as an example, it is assumed that a control remote control signal including information of “stop” which is the name of the stop button image PBG 120 is received.

  In step S232, control remote control signal response processing is performed. In the control remote control signal corresponding processing, processing according to the received control remote control signal is performed. For example, when a control image is displayed on the display unit 630 and a control remote control signal including information “stop”, which is the name of the stop button image PBG120, is received, the control unit 610 displays the operation meta data shown in FIG. The control corresponding to the button image name “stop” is performed with reference to the data D300. That is, the control unit 610 stops the reproduction of the moving image displayed on the display unit 630 and deletes the moving image displayed on the display unit 630.

  In addition, when a moving image is displayed on the display unit 630, when the control remote control signal including the information “pause” that is the name of the pause button image PBG 112 is received, the control unit 610 stops the above-described stop. Similar to the case where the control remote control signal including the information “stop” which is the name of the button image PBG 120 is received, the operation metadata D300 is referred to and the moving image displayed on the display unit 630 is temporarily stopped. .

  In addition, when the image is not displayed on the display unit 630 and when the moving image displayed on the display unit 630 is temporarily stopped, the information of “play” that is the name of the play button image PBG110 is included. When the control remote control signal is received, the control unit 610 refers to the operation metadata D300 and starts the reproduction of the moving image from the place where the reproduction of the moving image is stopped.

  If a control remote control signal including information of “rewind” that is the name of the rewind button image PBG 132 is received while a moving image is displayed on the display unit 630, the control unit 610 displays the operation metadata. Referring to D300, the playback position of the moving image displayed on display unit 630 is changed to a position before a predetermined period (for example, 15 seconds), and the moving image is played back from the changed position.

  When the control remote control signal including the information “fast forward” that is the name of the fast forward button image PBG 134 is received while the moving image is displayed on the display unit 630, the control unit 610 stores the operation metadata D300. With reference, the playback position of the moving image displayed on the display unit 630 is changed to a position after a predetermined period (for example, 15 seconds), and the moving image is played back from the changed position. If the video display device 600 has not yet received the corresponding moving image data from the service server 800A after the predetermined period, the above processing is not performed. Thereafter, the process of step S232 ends, and the process of step S230 is performed again.

  In the content process, when the process of step S224 ends, the process proceeds to step S226.

  In step S226, control unit 610 determines whether or not reception of moving image data included in period number n data (for example, period number 1 data) has been completed in the content display process. If YES in step S226, the content process ends, the process returns to the process of the video display device 600 in FIG. 10, and the process proceeds to step S127 subsequent to step S126. On the other hand, if NO at step S226, the process at step S226 is performed again. Even if the processing of step S226 is completed, the content display processing is continued until the reproduction of the image based on the moving image data that has been received is completed. As described above, in the content display process, when the reception of the moving image data included in the period number n data (period number 1 data) is completed and the reproduction of the image based on the moving image data is completed, the content display is performed. The process ends.

  Referring to FIG. 10 again, when the process of step S126 ends, the process proceeds to step S127.

  In step S127, the control unit 610 completes the reception of the moving image data as all contents corresponding to all the period numbers described in the time table data D210 in FIG. It is determined whether or not the reproduction of the moving image data has been completed. If YES in step S127, the process of step S122 is performed again. On the other hand, if NO at step S127, the process proceeds to step S127A.

  In step S127A, control unit 610 increments the value of n by 1. Thereafter, the process of step S125 is performed again. Here, the process performed in step S125 will be described assuming that the value of n becomes “2” after the process in step S127A.

  In step S125, since n is “2”, the control unit 610 receives period number n data (period number 2 data) corresponding to the period number “2” of the time table data D210 from the service server 800A. Perform the following process. More specifically, control unit 610 transmits a period number n data acquisition request for acquiring period number 2 data to service server 800A. Thereafter, the process of step S125 ends. When n is “2”, the period number 2 data is a file identified by the CM table data D220 in FIG. 16 and corresponding to “CM number” “0001”, “0007”, “0189”, respectively. The data includes a plurality of moving image data whose names are “CM0001.mpg”, “CM0007.mpg”, and “CM0189.mpg”.

  As described above, in step S125, the operation panel generation data and operation panel generation part data that have already been received are not requested to be acquired. Therefore, the period number 2 data requested for acquisition does not include operation panel generation data and operation panel generation part data that have already been received. In other words, the operation panel generation data having the file name “cont1234aa.html” and the corresponding operation panel generation part data that have already been received are not included in the period number 2 data requested for acquisition in this case.

  In service server 800A, after step S144A ends, the process of step S144 is performed.

  In step S144, the processing described above is performed. Here, assuming that the period number n data acquisition request is received, the process proceeds to step S144A.

  In step S144A, control unit 810 transmits period number n data requested by the period number n data acquisition request to video display device 600. As described above, when n is “2”, the period number 2 data has a “CM number” corresponding to “0001”, “0007”, “0189”, and file names “CM0001.mpg”, “ “CM0007.mpg” and “CM0189.mpg” are data including a plurality of moving image data.

  The moving image data included in the period number 2 data has a large data capacity. Therefore, the control unit 810 distributes the moving image data to the video display device 600 in a streaming manner. The moving image data as the content includes the operation metadata described above. Note that the operation metadata is not included in the moving image data as the content, and may be added. The operation metadata is, for example, operation metadata D300. Note that when the streaming distribution of the requested moving image data is completed, the process of step S144A ends, and the process of step S144 is performed again.

  In video display device 600, when the process of step S125 ends, the process proceeds to step S125A.

  In step S125A, when n is “2”, control unit 610 receives period number 2 data. It should be noted that the moving image data included in the period number 2 data that is distributed by streaming is continuously received by the control unit 610 even after the process of step S125A ends. Thereafter, the process proceeds to step S125B.

  In step S125B, since operation panel data is not included in the received period number 2 data, control unit 610 does not perform processing for transmitting operation panel data to communication terminal device 500. Thereafter, the process of step S125B ends, and the process proceeds to step S126.

In step S126, the above-described content processing of FIG. 20 is performed.
In the content processing, first, in step S220, the control unit 610 executes content display processing. As described above, the content display process is a process performed independently of the content process and other processes. Thereafter, the process of step S220 ends.

  When n is “2”, in the content display processing, the control unit 610 uses the VDP 632 to receive an image based on the moving image data while receiving the moving image data included in the period number 2 data from the service server 800A. Then, a streaming playback display process to be displayed on the display unit 630 is performed. Note that when the reception of the moving image data included in the period number 2 data is completed and the reproduction of the image based on the moving image data is completed, the content display processing is ended.

  In step S222, the above-described processing is performed. When n is “2”, the operation panel data is not included in the received period number 2 data, and the process proceeds to step S226.

  In step S226, control unit 610 determines whether or not reception of moving image data included in period number 2 data has been completed in the content display process. As described above, even after the process of step S226 is completed, the content display process is continued until the reproduction of an image based on the received moving image data is completed. As described above, in the content display process, when n is “2”, when the reception of the moving image data included in the period number 2 data is completed and the reproduction of the image based on the moving image data is completed, The content display process ends. Here, assuming that the reception of the moving image data included in the period number 2 data is completed, the process returns to the processing of the video display device 600 of FIG. 10 and proceeds to step S127 subsequent to step S126.

  By repeating the processes of steps S125, S125A, S125B, and S126 described above until YES is determined in step S127, the moving image as the acquisition request content having undergone the content acquisition operation is displayed on display unit 630. Playback is displayed.

  Next, processing when the video display device 600 receives operation panel data different from the already received operation panel data from the service server 800A will be described.

First, in the video display device 600, the process of step S125 is performed.
In step S125, a process for receiving period number n data (period number 5 data) corresponding to period number “5” of time table data D210 from service server 800A is performed. More specifically, control unit 610 transmits a period number n data acquisition request for acquiring period number 5 data to service server 800A. Thereafter, the process of step S125 ends.

  When n is “5”, the period number 5 data is specified by the CM table data D220 in FIG. 16, and the “CM number” corresponds to “5555” and the file name is “CM5555.mpg”. The data includes the operation panel generation data A whose file name is “cont1234bb.html” and operation panel generation part data A corresponding to the operation panel generation data A.

  The operation panel image generated by the operation panel generation data A having the file name “cont1234bb.html” is assumed to be the following operation panel image PG100A.

  FIG. 21 is a diagram showing an operation panel image PG100A as an example. Referring to FIG. 21, operation panel image PG100A is compared with operation panel image PG100 in FIG. 17, pause button image PBG112, stop button image PBG120, rewind button image PBG132, and fast forward button image PBG134. The recording button image PBG140 is not arranged, and the hyperlink character string PCG180 “movie notice” is arranged.

  The hyperlink character string PCG 180 is a character string for displaying information on the Web page of the associated URL when clicked by the interface operation M. Other than that, it is similar to operation panel image PG100A, and therefore detailed description will not be repeated. That is, when the operation panel image PG100A is displayed on the display unit 530, fast-forward playback of the content displayed on the display unit 630, recording processing, and the like cannot be performed.

  Referring to FIG. 10 again, in service server 800A, after the end of step S144A, the process of step S144 is performed.

  In step S144, the processing described above is performed. Here, assuming that the period number n data acquisition request is received, the process proceeds to step S144A.

  In step S144A, control unit 810 transmits period number n data requested by the period number n data acquisition request to video display device 600. As described above, when n is “5”, the period number 5 data corresponds to the “CM number” of “5555”, the file name is “CM5555.mpg”, and the file name is “cont1234bb”. Data including operation panel generation data A and operation panel generation part data A which are “.html”. Hereinafter, data including the operation panel generation data A and the operation panel generation part data A is also referred to as operation panel data A.

  The moving image data whose file name is “CM5555.mpg” includes operation metadata D300A described later. Note that the operation metadata is not included in the moving image data as the content, and may be added. The moving image data included in the period number 5 data has a large data capacity. Therefore, the control unit 810 distributes the moving image data to the video display device 600 in a streaming manner. Note that when the streaming distribution of the requested moving image data is completed, the process of step S144A ends, and the process of step S144 is performed again.

  FIG. 22 is a diagram showing operation metadata D300A as an example. Referring to FIG. 22, operation metadata D300A is different from operation metadata D300 in FIG. 18 in that “genre” is “CM” instead of “movie”, “pause”, “stop”. ”,“ Rewind ”,“ fast forward ”, and“ recording ”, if there is no control information, the“ control ”item includes the control of Web access and the“ URL ”item. Different. Other than that, it is the same as the operation metadata D300, and the detailed description will not be repeated.

  When the hyperlink character string “movie preview” is clicked by the interface operation M, the video display device 600 accesses the URL “http://www.bb.ne.jp/1234bb01.html” on the Web. That is, when the hyperlink character string PCG180 “movie preview” displayed on the operation panel image PG100A is clicked by the interface operation M, the video display device 600 displays “http://www.bb.ne.jp/1234bb01”. Web access to the URL of “.html”. The server that is accessed via the Web is, for example, the service server 800A.

  In video display device 600, when the process of step S125 ends, the process proceeds to step S125A.

  In step S125A, when n is “5”, the control unit 610 receives the period number 5 data. Thereby, when n is “5”, the control unit 610 receives the operation panel data A included in the period number 5 data. The operation panel data A included in the period number 5 data is data for generating the operation panel image PG100A. It should be noted that the moving image data included in the period number 5 data that is distributed by streaming is continuously received by the control unit 610 even after the process of step S125A ends.

  The moving image data included in the period number 5 data includes the aforementioned operation metadata D300A. Note that the operation metadata is not included in the moving image data as the content, and may be added. The control unit 610 stores the received operation metadata D300A in the temporary storage unit 622. Thereafter, the process proceeds to step S125B.

  The operation metadata D300A is data corresponding to the operation panel data A including the operation panel generation data A whose file name is “cont1234bb.html”. That is, the operation metadata D300A is data corresponding to the operation panel image PG100A generated from the operation panel data A.

  In step S125B, control unit 610 transmits operation panel data A included in the received period number 5 data to communication terminal apparatus 500. Thereafter, the process of step S125B ends.

  In communication terminal device 500, in step S114, control unit 510 determines whether first operation panel data or different operation panel data has been received. Here, assuming that operation panel data A different from the already received operation panel data is received, the process proceeds to step S115. The received operation panel data A includes operation panel generation data A and operation panel generation part data A.

  In step S115, an operation panel image display process is performed as described above. In the operation panel image display processing, the control unit 510 uses the VDP 532 to generate an operation panel image based on the operation panel generation data A that is HTML data, using the operation panel generation part data A, and generate the operation panel image. The displayed operation panel image is displayed on the display unit 530. Thereafter, the process of step S115 ends. Note that the generated operation panel image is, for example, the operation panel image PG100A of FIG.

When the process of step S115 ends, the process proceeds to step S116.
In step S116, the processing described above is performed. Since the operation determination process has already been executed, the control unit 510 ends the operation determination process being executed, and executes a new operation determination process. The operation determination process newly executed is a process performed independently of other processes. When the process of step S116 ends, the process of step S114 is performed again.

  In video display device 600, when the process of step S125B ends, the process proceeds to step S126.

In step S126, the above-described content processing of FIG. 20 is performed.
In the content processing, first, in step S220, the control unit 610 executes content display processing. As described above, the content display process is a process performed independently of the content process and other processes. Thereafter, the process of step S220 ends.

  When n is “5”, in the content display process, the control unit 610 uses the VDP 632 to receive the moving image data included in the period number 5 data from the service server 800A while displaying an image based on the moving image data. Then, a streaming playback display process to be displayed on the display unit 630 is performed. In addition, when the reception of the moving image data included in the period number 5 data is completed and the reproduction of the image based on the moving image data is ended, the content display processing is ended.

  In the newly executed operation determination process, the process of step S210 described above is performed, and thus detailed description will not be repeated. In step S210, control unit 510 determines whether or not there is a display control operation. In this case, it is assumed that the display control operation is an interface operation M for pressing or clicking a button image and a hyperlink character string in the operation panel image displayed on the display unit 530. If YES in step S210, the process proceeds to step S212. On the other hand, if NO at step S210, the process at step S210 is performed again.

  When the operation panel image displayed on the display unit 530 is the operation panel image PG100A, it is not possible to perform a display control operation for fast-forward playback of a moving image as content, recording processing, or the like.

  Accordingly, fast-forward playback of a moving image is not possible during a period in which a moving image of a CM whose file name is “CM5555.mpg” is displayed on the display unit 630. As a result, the user looking at the display unit 630 sees the CM moving image. Therefore, it is possible to prevent the CM moving image from being viewed by fast-forward playback. That is, it is possible to prevent the CM provider company from suffering a disadvantage.

  In addition, if the above means are utilized, it is possible to apply an application such as advertising on the operation panel side without displaying any CM on the display device side, and an image in accordance with the intention of the content creator (creator). It is also effective as a delivery means such as distribution.

  It is assumed that when the process of step S210 is performed, there is a display control operation that is an interface operation M in which the hyperlink character string PCG180 in the operation panel image PG100A is clicked. Accordingly, the process proceeds to step S212.

  In step S212, processing similar to that described above is performed, and therefore detailed description will not be repeated. By this processing, a control remote control signal is transmitted to the video display device 600. Here, it is assumed that the display control operation is an interface operation M in which the hyperlink character string PCG180 in the operation panel image PG100A is clicked. In this case, the control remote control signal is a remote control signal including information on “movie notice” which is a character string of hyperlink character string PCG180 in operation panel image PG100A. When the process of step S212 is completed, the process of step S210 is performed again.

  In the content process, when the process of step S220 is completed, the process proceeds to step S222.

  In step S222, the above-described processing is performed. When n is “5”, control unit 610 determines that operation panel data different from the already received operation panel data has been received, and proceeds to step S224.

  In step S224, the processing described above is performed. In this case, since the control signal handling process has already been performed, the control unit 510 ends the control signal handling process being executed, and executes a new control signal handling process. The newly executed control signal handling process is a process performed independently of other processes. When the process of step S224 ends, the process proceeds to step S226.

  In the newly executed control signal handling process, first, the process of step S230 is performed.

  In step S230, the above-described processing is performed, and thus detailed description will not be repeated. If YES at step S230, the process proceeds to step S232. On the other hand, if NO at step S230, the process at step S230 is performed again. Here, as an example, assuming that a control remote control signal including information of “movie notice” which is a character string of hyperlink character string PCG180 is received, the process proceeds to step S232.

  In step S232, control remote control signal response processing is performed. In the control remote control signal corresponding processing, as described above, processing according to the received control remote control signal is performed. Here, since control remote control signal including information of “movie notice” which is a character string of hyperlink character string PCG 180 is received, control unit 610 performs the following processing.

  The control unit 610 refers to the operation metadata D300A of FIG. 22 and performs control corresponding to “movie notice” which is a character string of the hyperlink character string PCG180. That is, the control unit 610 accesses the URL of “http://www.bb.ne.jp/1234bb01.html” and the URL of “http://www.bb.ne.jp/1234bb01.html”. The information on the web page is displayed on the display unit 630.

  Therefore, it is possible to refer to the information of interest of the user during the period when the moving image of the CM whose file name is “CM5555.mpg” is displayed on the display unit 630. Therefore, a content provider company that provides a moving image of a CM whose file name is “CM5555.mpg” can allow the user to see information corresponding to the content, and can perform efficient advertisement.

  Thereafter, the process of step S232 ends, and the process of step S230 is performed again.

  In the content process, when the process of step S224 ends, the process proceeds to step S226.

  In step S226, control unit 610 determines whether or not reception of moving image data included in period number 5 data has been completed in the content display process. As described above, even after the process of step S226 is completed, the content display process is continued until the reproduction of an image based on the received moving image data is completed. As described above, in the content display process, when n is “5”, when the reception of the moving image data included in the period number 5 data is completed and the reproduction of the image based on the moving image data is completed, The content display process ends. Here, assuming that the reception of the moving image data included in the period number 5 data is completed, the processing returns to the processing of the video display device 600 of FIG. 10 and proceeds to step S127 subsequent to step S126.

  Next, processing when the video display apparatus 600 receives interactive content will be described. The interactive content is a program that a user can participate in, for example, counting a questionnaire. Interactive content is a program that a user can participate in, such as a quiz program.

  Since the processing up to the processing in step S111 is the same as described above, detailed description will not be repeated.

  First, in step S112, it is determined by the interface operation M that there has been a content acquisition operation for acquiring interactive content, and the process proceeds to step S113. Since the same processing as described above is performed in step S113, detailed description will not be repeated.

  In video display device 600, the same processing as described above is performed in steps S122 and S123, and therefore detailed description will not be repeated.

  In service server 800A, the same processing as described above is performed in steps S142 and S143, and therefore detailed description will not be repeated.

  In video display device 600, the same processing as described above is performed in step S124, and therefore detailed description will not be repeated. As a result, it is assumed that the video display device 600 has received the content reproduction necessary data including the content basic data D200, the time table data D210, and the CM table data D220.

  In step S125, the same processing as described above is performed. Here, assuming that n is “1”, control unit 610 transmits a period number n data acquisition request for acquiring period number 1 data to service server 800A.

  In service server 800A, the same processing as described above is performed in steps S144 and S144A, and therefore detailed description will not be repeated. Thus, control unit 810 transmits period number 1 data requested by the period number n data acquisition request to video display device 600.

  In video display device 600, the same processing as described above is performed in step S125A, and therefore detailed description will not be repeated. By this processing, the control unit 610 receives the period number 1 data. The period number 1 data includes moving image data having a file name “1234-1.mpg”, operation panel generation data having a file name “cont1234aa.html”, and operation panel generation part data corresponding to the operation panel generation data. It is data including. It is assumed that the operation panel image generated by the operation panel data including the operation panel generation data having the file name “cont1234aa.html” and the operation panel generation part data is the following operation panel image PG200.

  Note that moving image data as content included in the period number 1 data includes operation metadata. Note that the operation metadata is not included in the moving image data as the content, and may be added. The control unit 610 stores the received operation metadata in the temporary storage unit 622. Here, the operation metadata is, for example, operation metadata D310 described below.

  The operation metadata D310 is data corresponding to operation panel data including operation panel generation data whose file name is “cont1234aa.html”. That is, the operation metadata D310 is data corresponding to the operation panel image PG200 generated by the operation panel data.

  FIG. 23 is a diagram showing an operation panel image PG200 as an example. Referring to FIG. 23, operation panel image PG200 is different from operation panel image PG100 of FIG. 17 in that numeric button images PBG211, PBG212, PBG213, and PBG214 are further arranged. Other than that, it is the same as operation panel image PG100, and therefore detailed description will not be repeated.

  Each of the numeric button images PBG 211, PBG 212, PBG 213, and PBG 214 is a button image for performing a process described in the corresponding operation metadata when pressed by the interface operation M. The button image names of the numeric button images PBG211, PBG212, PBG213, and PBG214 are “number 1”, “number 2”, “number 3”, and “number 4”, respectively.

  FIG. 24 is a diagram illustrating operation metadata D310 as an example. Referring to FIG. 24, operation metadata D310 is different from operation metadata D300 in FIG. 18 in that “content type” is “interactive moving image” instead of “moving image”, and “genre”. Is different from “movie” in that it is “parity”, “control” includes Web access control, and “URL” includes an item “URL”.

  With reference to the operation metadata D310, for example, when the number button image PBG211 arranged on the operation panel image PG200 of FIG. 600 accesses the URL “http://www.bb.ne.jp/1234aa01.html”.

  Referring to FIG. 10 again, in video display device 600, in step S125B, control unit 610 transmits operation panel data included in the received period number 1 data to communication terminal device 500.

  In communication terminal device 500, the same processing as described above is performed in step S114, step S115, and step S116, and therefore detailed description will not be repeated. By these processes, the operation panel image PG200 is displayed on the display unit 530. Moreover, the operation determination process of FIG. 20 is performed.

In video display device 600, the process of step S126 is performed based on FIG.
In step S220, processing similar to that described above is performed, and therefore detailed description will not be repeated.

  In the operation determination process, a process similar to that described above is performed in step S210, and therefore detailed description will not be repeated. Here, assuming that there is a display control operation, the process proceeds to step S212. In this case, the display control operation is an interface operation M for pressing the numeric button image PBG211 whose button image name is “number 1” in the operation panel image PG200 displayed on the display unit 530. .

  In step S212, processing similar to that described above is performed, and therefore detailed description will not be repeated. By this processing, a control remote control signal is transmitted to the video display device 600. As described above, here, it is assumed that the display control operation is the interface operation M for pressing the numeric button image PBG211 having the button image name “number 1”. In this case, the control remote control signal is a remote control signal including information of “number 1” which is the name of the button image PBG211.

  In the content processing, since the same processing as described above is performed in step S222 and step S224, detailed description will not be repeated. By these processes, a control signal handling process is executed.

  In the control signal handling process, the process of step S230 is performed. In step S230, the above-described processing is performed, and thus detailed description will not be repeated. Here, as an example, assuming that a remote control signal including information of “number 1” which is the name of the button image PBG 211 is received, the process proceeds to step S232.

  In step S232, control remote control signal response processing is performed. In the control remote control signal corresponding processing, as described above, processing according to the received control remote control signal is performed. Here, since the control remote control signal including the information of “number 1” which is the name of button image PBG 211 is received, control unit 610 performs the following processing.

  The control unit 610 refers to the operation metadata D310 in FIG. 24 and performs control corresponding to “number 1” which is the name of the button image PBG211. That is, the control unit 610 accesses the URL “http://www.bb.ne.jp/1234aa01.html” via the Web. The server that is accessed via the Web is, for example, the service server 800A.

  By performing the above processing, the service server 800A accessed via the Web can count the number of accesses, for example, to count questionnaires. That is, by using an operation panel image corresponding to interactive content, a user can participate in a plan such as a questionnaire conducted in a program.

  The content received by the video display apparatus 600 may be 3D (three dimensions) content. The 3D content is, for example, a three-dimensionally modeled object.

FIG. 25 is a diagram illustrating 3D content 3DG as an example.
Next, processing when the video display device 600 receives 3D content 3DG will be described.

  Since the processing up to the processing in step S111 is the same as described above, detailed description will not be repeated.

  First, in step S112, it is determined by the interface operation M that there has been a content acquisition operation for acquiring the 3D content 3DG, and the process proceeds to step S113. Since the same processing as described above is performed in step S113, detailed description will not be repeated.

  In video display device 600, the same processing as described above is performed in steps S122 and S123, and therefore detailed description will not be repeated.

  In service server 800A, the same processing as described above is performed in step S142, and therefore detailed description will not be repeated. Here, assuming that the content acquisition request A is received, the process proceeds to step S143.

  In step S143, as described above, control unit 810 transmits content reproduction necessary data to video display device 600. Thereafter, the process of step S143 ends. The content reproduction necessary data includes content basic data D200A and time table data D210A described below.

  FIG. 26 is a diagram showing content basic data D200A and time table data D210A as an example. FIG. 26A shows content basic data D200A as an example. Referring to FIG. 26A, content basic data D200A has a point that “CM insertion count” is “0” and there is no CM table URL, as compared with content basic data D200 of FIG. The difference is that there is no URL for the contents 2, 3 and 4 and there is no operation panel bbURL and no operation panel ccURL. Other than that, since it is the same as the content basic data D200, detailed description will not be repeated.

  FIG. 26B is a diagram showing time table data D210A as an example. Referring to FIG. 26B, time table data D210A is data in which only information corresponding to “period number” “1” is described as compared with time table data D210 in FIG. Different. Other than that, it is the same as time table data D210, and therefore detailed description will not be repeated.

  Referring to FIG. 10 again, in video display device 600, the same processing as described above is performed in step S124, and therefore detailed description will not be repeated. Thereby, it is assumed that video display device 600 has received content reproduction necessary data including content basic data D200A and time table data D210A.

  In step S125, the same processing as described above is performed. Here, assuming that n is “1”, control unit 610 transmits a period number n data acquisition request for acquiring period number 1 data to service server 800A.

  In service server 800A, the same processing as described above is performed in steps S144 and S144A, and therefore detailed description will not be repeated. Thus, control unit 810 transmits period number 1 data requested by the period number n data acquisition request to video display device 600.

  In video display device 600, the same processing as described above is performed in step S125A, and therefore detailed description will not be repeated. By this processing, the control unit 610 receives the period number 1 data. The period number 1 data includes 3D content data whose file name is “1234.dt”, operation panel generation data whose file name is “cont1234dd.html”, and operation panel generation part data corresponding to the operation panel generation data. It is data. The operation panel image generated by the operation panel data including the operation panel generation data having the file name “cont1234dd.html” and the operation panel generation part data is assumed to be the following operation panel image PG300.

  The 3D content data included in the period number 1 data includes operation metadata. Note that the operation metadata is not included in the 3D content data, and may be added. The control unit 610 stores the received operation metadata in the temporary storage unit 622. Here, the operation metadata is, for example, operation metadata D320 described below.

  The operation metadata D320 is data corresponding to operation panel data including operation panel generation data whose file name is “cont1234dd.html”. That is, the operation metadata D320 is data corresponding to the operation panel image PG300 generated from the operation panel data.

  FIG. 27 is a diagram showing an operation panel image PG300 as an example. Referring to FIG. 27, button images PBG 312, PBG 314, PBG 316, PBG 318, PBG 332, and PBG 334 are arranged in operation panel image PG 300.

  The button image PBG 312 is a button image for rotating the 3D content 3DG upward, for example, 10 degrees with respect to the vertical direction by being pressed once by the interface operation M. The button image PBG 314 is a button image for rotating the 3D content 3DG downward, for example, 10 degrees with respect to the vertical direction by being pressed once by the interface operation M. The button image PBG 316 is a button image for rotating the 3D content 3DG leftward with respect to the horizontal direction, for example, 10 degrees by being pressed once by the interface operation M. The button image PBG 318 is a button image for rotating the 3D content 3DG rightward with respect to the horizontal direction, for example, 10 degrees by being pressed once by the interface operation M.

  The button image PBG 332 is a button image for enlarging the 3D content 3DG by, for example, 50% by being pressed once by the interface operation M. The button image PBG 334 is a button image for reducing the size of the 3D content 3DG by, for example, 50% by being pressed once by the interface operation M.

  The button image names of the button images PBG 312, PBG 314, PBG 316, PBG 318, PBG 332, and PBG 334 are “upper rotation”, “lower rotation”, “left rotation”, “right rotation”, “enlargement”, and “reduction”, respectively. .

  FIG. 28 is a diagram showing operation metadata D320 as an example. Referring to FIG. 28, the description of each item of operation metadata D320 is the same as that described with reference to FIG. 18, and thus detailed description will not be repeated. “Content type” is “interactive 3D content”.

  With reference to the operation metadata D320, for example, when the button image PBG 312 arranged in the operation panel image PG300 corresponding to “upward rotation” is pressed by the interface operation M, the video display device 600 is 3D. The content 3DG is rotated upward, for example, 10 degrees with respect to the vertical direction.

  Referring to FIG. 10 again, in video display device 600, in step S125B, control unit 610 transmits operation panel data included in the received period number 1 data to communication terminal device 500.

  In communication terminal device 500, the same processing as described above is performed in step S114, step S115, and step S116, and therefore detailed description will not be repeated. By these processes, the operation panel image PG300 is displayed on the display unit 530. Moreover, the operation determination process of FIG. 20 is performed.

In video display device 600, the process of step S126 is performed based on FIG.
In step S220, control unit 610 executes content display processing. The content display process is a process performed independently of the content process and other processes. Thereafter, the process of step S220 ends.

  In the content display process, the control unit 610 displays the 3D content 3DG of FIG. 25 included in the period number n data on the display unit 630 using the VDP 632. And this content display process is complete | finished.

  In the operation determination process, a process similar to that described above is performed in step S210, and therefore detailed description will not be repeated. Here, assuming that there is a display control operation, the process proceeds to step S212. In this case, it is assumed that the display control operation is an interface operation M for pressing the button image PBG 316 whose button image name is “left rotation” in the operation panel image PG 300 displayed on the display unit 530.

  In step S212, processing similar to that described above is performed, and therefore detailed description will not be repeated. By this processing, a control remote control signal is transmitted to the video display device 600. As described above, here, it is assumed that the display control operation is the interface operation M for pressing the button image PBG 316 whose button image name is “left rotation”. In this case, the control remote control signal is a remote control signal including information of “left rotation” that is the name of the button image PBG 316.

  In the content processing, since the same processing as described above is performed in step S222 and step S224, detailed description will not be repeated. By these processes, a control signal handling process is executed.

  In the control signal handling process, the process of step S230 is performed. In step S230, the above-described processing is performed, and thus detailed description will not be repeated. Here, as an example, assuming that a remote control signal including information of “left rotation” that is the name of the button image PBG 316 is received, the process proceeds to step S232.

  In step S232, control remote control signal response processing is performed. In the control remote control signal corresponding processing, as described above, processing according to the received control remote control signal is performed. Here, since the control remote control signal including the information of “left rotation” which is the name of button image PBG 316 is received, control unit 610 performs the following processing.

  The control unit 610 refers to the operation metadata D320 in FIG. 28 and performs control corresponding to “left rotation” that is the name of the button image PBG316. That is, the control unit 610 performs a process of rotating the 3D content 3DG of FIG. 25 displayed on the display unit 630 by 10 degrees toward the left with respect to the horizontal direction.

  By performing the above processing, 3D content can be rotated, enlarged, and reduced. That is, 3D content can be displayed in various states by user operation.

  For example, when the above processing is applied to a field such as television shopping, it is possible to confirm a product as if the user is actually in front of him. In addition to television shopping, the above processing can be applied in various fields such as games, medical care, online shopping, and virtual experiences.

  The operation panel image used in the present embodiment may be as shown below.

  FIG. 29 is a diagram showing an operation panel image PG400 as an example. Referring to FIG. 29, button images PBG411, PBG412, PBG413, PBG414, PBG415, PBG416, PBG417, PBG418, and PBG419 are arranged in operation panel image PG400. Each of the button images PBG411, PBG412, PBG413, PBG414, PBG415, PBG416, PBG417, PBG418, and PBG419 is pressed by the interface operation M, and the processing based on the following operation metadata D340 is performed. The button image names of the button images PBG411, PBG412, PBG413, PBG414, PBG415, PBG416, PBG417, PBG418, and PBG419 are "number 1," "number 2," "number 3," "number 4," "number 5," respectively. ”,“ No. 6 ”,“ No. 7 ”,“ No. 8 ”, and“ No. 9 ”.

  FIG. 30 is a diagram illustrating operation metadata D340 as an example. Referring to FIG. 30, the description of each item of operation metadata D340 is the same as that described in FIG. 18, and therefore detailed description will not be repeated.

  With reference to the operation metadata D340, for example, when the button image PBG411 arranged in the operation panel image PG400 corresponding to “number 1” is pressed by the interface operation M, the video display device 600 displays “http Web access is made to the URL "http://www.bb.ne.jp/1234aa01.mpg". The server that is accessed via the Web is, for example, the service server 800A. Here, it is assumed that a moving image is displayed on the display unit 630. In this case, moving image data whose file name is “1234aa01.mpg” is downloaded from the service server 800A. Then, control unit 610 performs processing for displaying an image based on the downloaded moving image data instead of the image displayed on display unit 630.

  Note that the operation panel image to be used may display an equalizer that can freely change the sound quality of music when the received content is music. The operation panel image is not limited to the one described above.

  As described above, in the present embodiment, video display device 600 receives content from service server 800A and also receives operation panel data for generating an operation panel image for operating the content. The video display device 600 transmits the received operation panel data to the communication terminal device 500. Communication terminal device 500 displays an operation panel image based on the received operation panel data. The communication terminal device 500 controls the content displayed on the display unit 630 of the video display device 600 using an operation panel image corresponding to the received content.

  Therefore, the content can be controlled using an operation panel image suitable for controlling the content. As a result, it is possible to obtain an operation system with a high degree of freedom according to the type of content.

  In the present embodiment, the operation panel image is also changed according to the content displayed on display unit 630. For example, when a CM moving image is displayed on the display unit 630, the operation panel image cannot be fast-forwarded. Thereby, it is possible to prevent the CM moving image from being viewed by fast-forward playback. That is, it is possible to prevent the CM provider company from suffering a disadvantage.

  In the present embodiment, an operation panel image displaying a hyperlink character string for acquiring information related to content displayed on display unit 630 is used. As a result, a content providing company or the like that provides a moving image as content can allow the user to view information corresponding to the content, and can perform efficient advertisement.

  In the present embodiment, when the content displayed on display unit 630 is interactive content, an operation panel image corresponding to the interactive content is used. Thereby, the user can participate in a plan such as a questionnaire performed in the program.

  In the present embodiment, when the content displayed on display unit 630 is 3D content, an operation panel image corresponding to 3D content is used. Thereby, the user can see various states of the 3D content.

  In such conventional products, specifications of an operation panel in advance are formulated and contents are distributed according to the specifications. However, in the above-described embodiment, the possibility of producing all contents is expanded.

  As described above, according to the present embodiment, content can be controlled using an operation panel image suitable for controlling content. As a result, it is possible to obtain an operation system with a high degree of freedom according to the type of content.

  Further, according to the present embodiment, the content creator (creator) can provide even the user's operation panel, and the content distribution can be freely provided to the creator.

<Second Embodiment>
In the first embodiment, the service server 800A transmits all data for generating an operation panel image to the video display device 600. Therefore, the service server 800A needs to store data for generating many operation panel images. In the present embodiment, a process in which service server 800A transmits only operation metadata necessary for operation using an operation panel image to video display device 600 will be described.

  In the present embodiment, the storage unit 620 of the video display device 600 stores a plurality of types of operation panel generation part data necessary for generating an operation panel image. The operation panel generation part data is, for example, button image data included in each of the operation panel image PG100 in FIG. 17, the operation panel image PG200 in FIG. 23, the operation panel image PG300 in FIG. 27, and the operation panel image PG400 in FIG. . The button image data is stored in the storage unit 620 as template data.

  A name is set in the button image data. For example, the playback button image PBG110, the pause button image PBG112, the stop button image PBG120, the rewind button image PBG132, the fast forward button image PBG134, and the record button image PBG140 in the operation panel image PG100 are respectively “play”, The names “pause”, “stop”, “rewind”, “fast forward” and “record” are set.

  Since the network system in the present embodiment is similar to network system 1000 in the first embodiment, detailed description will not be repeated. Since the configuration of each of communication terminal device 500, video display device 600, service server 800A, search server 800S, and Web server 800W is the same as that described in the first embodiment, detailed description thereof will not be repeated.

  Next, in the present embodiment, a process (hereinafter also referred to as a content handling process A) for the video display apparatus 600 to receive content from the service server 800A will be described. It is assumed that remote control image MG100 in FIG. 9 is displayed on display unit 530 of communication terminal device 500. In this case, it is assumed that communication terminal apparatus 500 is set to the remote control mode.

  FIG. 31 is a flowchart of the content handling process A. FIG. 31 shows processing performed in each of communication terminal device 500, video display device 600, and service server 800A.

In communication terminal device 500, first, the process of step S310 is performed.
In step S310, the same processing as in step S110 is performed, and thus detailed description will not be repeated. If YES in step S310, the process proceeds to step S311. On the other hand, if NO at step S310, the process at step S310 is performed again. Here, assuming that there is a list acquisition operation, the process proceeds to step S311.

  In step S311, a list acquisition process is performed in the same manner as in step S111, and thus detailed description will not be repeated.

  In video display device 600, first, the process of step S320 is performed. In step S320, control unit 610 determines whether a list acquisition remote control signal as a list acquisition request has been received or not. If YES in step S320, the process proceeds to step S321. On the other hand, if NO at step S320, the process at step S320 is performed again.

  In step S321, list acquisition processing A is performed in the same manner as in step S121, and thus detailed description will not be repeated. With this process, the list acquisition request A is transmitted to the service server 800A.

In service server 800A, first, the process of step S340 is performed.
In step S340, control unit 810 determines whether or not list acquisition request A has been received. If YES in step S340, the process proceeds to step S341. On the other hand, if NO at step S340, the process at step S340 is performed again.

  In step S341, the control unit 810 transmits the list data D100 of FIG. 11, which is data of a list of distributable contents, to the device that transmitted the list acquisition request A. Thereafter, the process of step S341 ends.

  In the video display device 600, in the list acquisition process A in step S321, the control unit 610 receives the list data D100. When receiving the list data D100, the control unit 610 stores the list data D100 in the storage unit 620. Then, the control unit 610 generates the list image TG200 of FIG. 12 using the VDP 632 based on the list data D100, and causes the display unit 630 to display the generated list image TG200.

  In the list acquisition process A in step S321, the control unit 610 further transmits (transfers) the received list data D100 to the communication terminal device 500 using the communication unit 660. Thereafter, the process of step S321 ends.

  In communication terminal device 500, in list acquisition processing in step S311, control unit 510 further receives list data D100. When receiving the list data D100, the control unit 510 stores the list data D100 in the storage unit 520. Then, control unit 510 generates list image MG200 of FIG. 13 using VDP 632 based on list data D100, and causes display unit 630 to display the generated list image MG200. Then, the process of step S311 ends, and the process proceeds to step S312.

  In step S312, the same processing as in step S112 is performed, and thus detailed description will not be repeated. If YES in step S312, the process proceeds to step S313. On the other hand, if NO at step S312, the process at step S312 is performed again. Here, assuming that there is a content acquisition operation for pressing the button image MBG211 that displays the title “B movie” by the interface operation M, the process proceeds to step S313.

  In step S313, the same processing as in step S113 is performed, and thus detailed description will not be repeated. By this processing, a content acquisition remote control signal as a content acquisition request is transmitted to the video display device 600. Then, the process of step S113 ends.

  In video display device 600, when the process of step S321 ends, the process proceeds to step S322.

  In step S322, processing similar to that in step S122 is performed, and thus detailed description will not be repeated. If YES in step S322, the process proceeds to step S323. On the other hand, if NO at step S322, the process at step S322 is performed again.

  In step S323, the same processing as in step S123 is performed, and thus detailed description will not be repeated. Through this process, control unit 610 transmits content acquisition request A for acquiring the content specified by the received content acquisition remote control signal to service server 800A. Thereafter, the process of step S323 ends. The content acquisition request A includes an ID number for specifying the acquisition request content. Here, it is assumed that the content acquisition request A includes an ID number “1234” for specifying the acquisition request content whose title is “B movie”.

  In service server 800A, when the process of step S341 ends, the process proceeds to step S342.

  In step S342, control unit 810 determines whether or not content acquisition request A has been received. If YES in step S342, the process proceeds to step S343. On the other hand, if NO at step S342, the process of step S342 is performed again.

  In step S343, control unit 810 transmits content reproduction necessary data necessary for content reproduction to video display apparatus 600. Thereafter, the process of step S343 ends. The content reproduction necessary data includes CM table data D220, content basic data D260 and time table data D270 described below.

  The content basic data corresponding to the ID number for specifying the content included in the content acquisition request A is stored in advance in the storage unit 820 of the service server 800A. Therefore, the content basic data D260 is also stored in the storage unit 820 of the service server 800A in advance.

  FIG. 32 is a diagram showing content basic data D260 as an example. Referring to FIG. 32, content basic data D260 has no information on whether or not “operation panel” is “variable” as compared with content basic data D200 of FIG. 14, and “operation panel xxURL”. Is different from that in that there is an item of “operation metadata xxURL”. Other than that, since it is the same as the content basic data D200, detailed description will not be repeated.

  In the content basic data D260, the “time table URL” is a URL of the following time table data D270 necessary for reproducing the acquisition request content. The time table data D270 is stored in the storage unit 820.

  “Operation metadata xxURL” is a URL of operation metadata. In the present embodiment, three operation metadata are used as an example during the reproduction period of the acquisition request content.

  FIG. 33 is a diagram showing time table data D270 as an example. Referring to FIG. 33, time table data D270 corresponds to “period number” instead of the operation panel used corresponding to “period number”, as compared with time table data D210 of FIG. The difference is that the operation metadata used is described. Other than that, it is the same as time table data D210, and therefore detailed description will not be repeated.

  For example, the time table data D270 indicates that operation metadata having a file name “cont1234aa.meta” is used in a period in which the “period number” is “1” to “4”.

  Referring to FIG. 31 again, in video display device 600, when the process of step S323 ends, the process proceeds to step S324.

  In step S324, control unit 610 receives the content reproduction necessary data, and stores the received content reproduction necessary data in storage unit 620. Thereafter, the process proceeds to step S325.

  In step S325, the same processing as in step S125 is performed, and thus detailed description will not be repeated. By this processing, control unit 610 performs processing for receiving period number n data corresponding to period number n (natural number) of time table data D270 from service server 800A. Note that the initial value of n is “1”. Specifically, a period number n data acquisition request for acquiring period number n data is transmitted to service server 800A. Thereafter, the process of step S325 ends. When n is “1”, the period number n data is also referred to as period number 1 data. When n is “1”, the period number 1 data is data including moving image data whose file name is “1234-1.mpg”.

  In service server 800A, when the process of step S343 ends, the process proceeds to step S344.

  In step S344, processing similar to that in step S144 is performed, and thus detailed description will not be repeated. If YES in step S344, the process proceeds to step S344A. On the other hand, if NO at step S344, the process at step S344 is performed again.

  In step S344A, control unit 810 transmits period number n data requested by the period number n data acquisition request to video display device 600. As described above, when n is “1”, the period number n data (period number 1 data) is data including moving image data whose file name is “1234-1.mpg”. The moving image data included in the period number n data has a large data capacity. Therefore, the control unit 810 distributes the moving image data to the video display device 600 in a streaming manner. Note that when the streaming distribution of the requested moving image data is completed, the process of step S344A ends, and the process of step S344 is performed again.

  In video display device 600, when the process of step S325 ends, the process proceeds to step S325A.

  In step S325A, control unit 610 receives period number n data. As a result, the moving image data included in the period number n data that is distributed by streaming is sequentially received by the control unit 610. That is, even when the process of step S325A ends, the moving image data continues to be received by the control unit 610. Note that the moving image data as the content includes operation metadata for performing processing such as reproduction control of the content (moving image data). Note that the operation metadata is not included in the moving image data as the content, and may be added. Here, it is assumed that the operation metadata is the following operation metadata D400 whose file name is “cont1234aa.meta” when n is “1”.

  FIG. 34 is a diagram showing operation metadata D400 as an example. Referring to FIG. 34, operation metadata D400 differs from operation metadata D300 in FIG. 18 in that there is no “button image name” item. Other than that, it is the same as the operation metadata D300, and the detailed description will not be repeated.

  Referring to FIG. 31 again, control unit 610 stores the received operation metadata in temporary storage unit 622. Thereafter, the process proceeds to step S325B.

  In step S325B, control unit 610 generates operation panel generation data for generating an operation panel image suitable for the operation panel data included in the received period number n data. Control unit 610 communicates with communication terminal device 500 in advance and acquires interface information of communication terminal device 500 before generating operation panel generation data.

  FIG. 35 is a diagram illustrating interface information as an example of the communication terminal device 500. Referring to FIG. 35, the column of “hard button name” shows the names of buttons provided in communication terminal device 500. “UP”, “DOWN”, “LEFT”, “RIGHT”, and “ENTER” in the “Hard Button Name” column are names of the direction buttons 541A, 541B, 541C, 541D and the decision button 541E, respectively. “No. 1”, “No. 2”, “No. 3”, and “No. 4” in the column of “Hard Button Name” are names of function buttons 542A, 542B, 543A, and 543B, respectively.

  “Screen size” is the resolution of the display unit 530. “Yes” in the “touch panel” column indicates that the display unit 530 of the communication terminal device 500 has a touch panel function. The “touch panel recognition interval” is an interval for detecting a touched position, and is 10 dots as an example here.

  The control unit 610 is operation panel generation data for generating an operation panel image based on at least one of content type, genre, link character string, and control in the interface information and operation metadata of the communication terminal device 500. Is generated.

  First, control unit 610 refers to the screen size information included in the interface information of communication terminal apparatus 500 to determine the size of the operation panel image. In this case, the size of the operation panel image is smaller than the screen size. When the received operation metadata is, for example, the operation metadata D400, the control unit 610 performs operation panel generation part data (button image) corresponding to each control in the “control” column in the operation metadata D400. Data) is read from the storage unit 620, and an operation panel image is generated by arranging a button image in the operation panel image.

  For example, when “control” is “reproduction”, the data of the reproduction button image PBG110 of FIG. 17 having the name “reproduction” is read from the storage unit 620, and the button image is arranged in the operation panel image. Similarly, the button image data corresponding to other controls is read out, and the button image is arranged in the operation panel image. As described above, the operation panel image generated based on the operation metadata D400 is, for example, the operation panel image PG100 in FIG. Thereby, operation panel generation data for generating the operation panel image is generated. The operation panel generation data is HTML format data. The operation panel generation data is not limited to data in the HTML format, and may be data in other formats.

  Then, the control unit 610 performs processing for adding the name of the button image assigned to each control to the operation metadata in association with each control. When the operation metadata is the operation metadata D400, the operation metadata to which the name of the button image is added is the following operation metadata D400A.

  FIG. 36 is a diagram showing operation metadata D400A as an example. Referring to FIG. 36, operation metadata D400A is the same as operation metadata D300 in FIG. 18, and therefore detailed description will not be repeated.

  In addition, when the control unit 610 refers to the interface information of the communication terminal device 500 and recognizes that there is no touch panel function, the control unit 610 generates operation panel generation data in which each control in the operation metadata is assigned to each hard button. To do. Even when the touch panel function is provided, the control unit 610 may generate operation panel generation data in which each control in the operation metadata is assigned to the hard button.

  Then, control unit 610 generates operation panel data including the generated operation panel generation data and operation panel generation part data (button image data) necessary for the generated operation panel image. Then, control unit 610 transmits the generated operation panel data to communication terminal device 500.

  When control unit 610 receives the same operation metadata as the operation metadata that has already been received, control unit 610 performs the above-described processing for generating operation panel data and the processing for transmitting the generated operation panel data to communication terminal device 500. Absent. Thereafter, the process of step S325B ends.

In communication terminal device 500, after the process of step S313, the process proceeds to step S314.
In step S314, control unit 510 determines whether or not operation panel data that is different from the first operation panel data or the operation panel data that has already been received is received. If YES in step S314, the process proceeds to step S315. On the other hand, if NO at step S314, the process at step S314 is performed again. When the process of step S314 is performed for the first time, it is determined that the first operation panel data has been received, and the process proceeds to step S315. Here, assuming that operation panel data including operation panel generation data and operation panel generation part data has been received, the process proceeds to step S315.

  In step S315, an operation panel image display process is performed. In the operation panel image display process, the control unit 510 uses the VDP 532 to generate an operation panel image based on the operation panel generation data that is HTML data using the operation panel generation part data, and the generated operation A panel image is displayed on the display unit 530. Thereafter, the process of step S315 ends. Note that the generated operation panel image is, for example, the operation panel image PG100 of FIG.

  When the operation panel image is smaller than the displayable image size of the display unit 530 and an execution program image generated by executing another program is displayed on the display unit 530, the front of the execution program image is displayed. A composite image on which the operation panel image is displayed may be displayed on display unit 530. The composite image is, for example, a composite image MG300 in FIG. Only the generated operation panel image may be displayed on display unit 530.

When the process of step S315 ends, the process proceeds to step S316.
In step S316, control unit 510 executes operation determination processing A described later. The operation determination process A is a process performed independently of other processes. Note that, when the operation determination process A has already been executed, the control unit 510 ends the operation determination process A being executed and executes a new operation determination process A. When the process of step S316 ends, the process of step S314 is performed again.

  In video display device 600, when the process of step S325B ends, the process proceeds to step S326.

In step S126, content processing A is performed.
FIG. 37 is a flowchart of the operation determination process A and the content process A. Referring to FIG. 37, in content processing A, first, the processing of step S420 is performed.

  In step S420, control unit 610 executes content display processing. The content display process is a process performed independently of the content process A and other processes. Thereafter, the process of step S420 ends.

  In the content display processing, the control unit 610 uses the VDP 632 to perform streaming for displaying an image based on the moving image data on the display unit 630 while receiving the moving image data included in the period number n data from the service server 800A. Reproduction display processing is performed. In addition, when the reception of moving image data included in the period number n data (for example, period number 1 data) is completed and the reproduction of the image based on the moving image data is completed, the content display process ends.

In the operation determination process A, first, the process of step S410 is performed.
In step S410, control unit 510 determines whether or not there is a display control operation. The display control operation is an interface operation M for pressing the button image in the operation panel image displayed on the display unit 530. If YES in step S410, the process proceeds to step S412. On the other hand, if NO at step S410, the process at step S410 is performed again.

  For example, when the operation panel image displayed on the display unit 530 is the operation panel image PG100 of FIG. 17, the display control operation is, for example, an interface operation M for pressing the stop button image PBG120.

  In step S412, control unit 510 transmits a control remote control signal to video display device 600 using communication unit 560. For example, when the display control operation is the interface operation M for pressing down the stop button image PBG120, the control remote control signal is “stop” information that is the name of the stop button image PBG120 in the operation panel image PG100. Remote control signal including When the process of step S412 ends, the process of step S410 is performed again.

  In the content process A, when the process of step S420 ends, the process proceeds to step S422.

  In step S422, control unit 610 determines whether or not operation metadata different from the first operation metadata or operation metadata that has already been received is received. That is, the operation number is included in the period number n data received by the control unit 610 in step S325A, and the operation metadata is different from the first operation metadata or the operation metadata that has already been received. It is determined whether it is metadata. If YES in step S422, the process proceeds to step S424. On the other hand, if NO at step S422, the process proceeds to step S426. When the process of step S422 is performed for the first time, it is determined that the first operation metadata has been received, and the process proceeds to step S424.

  In step S424, control unit 610 executes control signal handling process A for handling the control remote control signal transmitted from communication terminal apparatus 500. The control signal corresponding process A is a process performed independently of other processes. If the control signal handling process A has already been executed, the control unit 610 terminates the control signal handling process A being executed and executes a new control signal handling process A. When the process of step S424 ends, the process proceeds to step S426.

In the control signal corresponding process A, first, the process of step S430 is performed.
In step S430, control unit 610 determines whether a control remote control signal has been received or not. If YES in step S430, the process proceeds to step S432. On the other hand, if NO at step S430, the process at step S430 is performed again. Here, as an example, it is assumed that a control remote control signal including information of “stop” which is the name of the stop button image PBG 120 is received.

  In step S432, control remote control signal handling processing is performed in the same manner as in step S232. In the control remote control signal corresponding processing, processing according to the received control remote control signal is performed. For example, when a control remote control signal including information “stop”, which is the name of the stop button image PBG120, is received while a moving image is displayed on the display unit 630, the control unit 610 displays the operation meta data shown in FIG. The control corresponding to the button image name “stop” is performed with reference to the data D400A. That is, the control unit 610 stops the reproduction of the moving image displayed on the display unit 630 and deletes the moving image displayed on the display unit 630. Thereafter, the process of step S432 ends, and the process of step S430 is performed again.

  In the content process A, when the process of step S424 ends, the process proceeds to step S426.

  In step S426, control unit 610 determines whether or not reception of moving image data included in period number n data (for example, period number 1 data) has been completed in the content display process. If YES in step S426, the content process ends, the process returns to the process of the video display device 600 in FIG. 31, and the process proceeds to step S327 subsequent to step S326. On the other hand, if NO at step S426, the process at step S426 is performed again. Even if the processing in step S426 is completed, the content display processing is continued until the reproduction of the image based on the moving image data that has been received is completed. As described above, in the content display process, when the reception of the moving image data included in the period number n data (period number 1 data) is completed and the reproduction of the image based on the moving image data is completed, the content display is performed. The process ends.

  Referring to FIG. 31 again, when the process of step S326 ends, the process proceeds to step S327.

  In step S327, the control unit 610 completes the reception of the moving image data as all contents corresponding to all the period numbers described in the time table data D270 in FIG. It is determined whether or not the reproduction of the moving image data has been completed. If YES in step S327, the process of step S322 is performed again. On the other hand, if NO at step S327, the process proceeds to step S327A.

  In step S327A, control unit 610 increments the value of n by 1. Thereafter, the process of step S325 is performed again. Here, the process performed in step S325 will be described assuming that the value of n becomes “2” after the process in step S327A.

  In step S325, since n is “2”, the control unit 610 receives period number n data (period number 2 data) corresponding to the period number “2” of the time table data D270 from the service server 800A. Perform the following process. More specifically, control unit 610 transmits a period number n data acquisition request for acquiring period number 2 data to service server 800A. Thereafter, the process of step S325 ends. When n is “2”, the period number 2 data is a file identified by the CM table data D220 in FIG. 16 and corresponding to “CM number” “0001”, “0007”, “0189”, respectively. The data includes a plurality of moving image data whose names are “CM0001.mpg”, “CM0007.mpg”, and “CM0189.mpg”.

  In service server 800A, after the end of step S344A, the process of step S344 is performed.

  In step S344, the above-described processing is performed. Here, assuming that the period number n data acquisition request is received, the process proceeds to step S344A.

  In step S344A, control unit 810 transmits period number n data requested by the period number n data acquisition request to video display device 600. As described above, when n is “2”, the period number 2 data has a “CM number” corresponding to “0001”, “0007”, “0189”, and file names “CM0001.mpg”, “ “CM0007.mpg” and “CM0189.mpg” are data including a plurality of moving image data. The moving image data included in the period number 2 data has a large data capacity. Therefore, the control unit 810 distributes the moving image data to the video display device 600 in a streaming manner. The moving image data as the content includes the operation metadata described above. When n is “2”, the operation metadata is operation metadata D400 from the time table data D270 of FIG. Note that when the streaming distribution of the requested moving image data is completed, the process of step S344A ends, and the process of step S344 is performed again.

  In video display device 600, when the process of step S325 ends, the process proceeds to step S325A.

  In step S325A, when n is “2”, control unit 610 receives period number 2 data. The moving image data included in the period number 2 data includes operation metadata D400 whose file name is “cont1234aa.meta”. Note that the operation metadata is not included in the moving image data as the content, and may be added. Note that the moving image data included in the period number 2 data that is distributed by streaming is continuously received by the control unit 610 even after the process of step S325A is completed. Thereafter, the process proceeds to step S325B.

  In step S325B, since the same operation metadata (operation metadata D400) as the operation metadata (operation metadata D400) already received is received, the control unit 610 generates the operation panel data and the generated operation panel data. Is not transmitted to communication terminal device 500. Thereafter, the process of step S325B ends, and the process proceeds to step S326.

In step S326, the above-described content processing A in FIG. 37 is performed.
In content processing A, first, in step S420, control unit 610 executes content display processing. As described above, the content display process is a process performed independently of the content process and other processes. Thereafter, the process of step S420 ends.

  When n is “2”, in the content display processing, the control unit 610 uses the VDP 632 to receive an image based on the moving image data while receiving the moving image data included in the period number 2 data from the service server 800A. Then, a streaming playback display process to be displayed on the display unit 630 is performed. Note that when the reception of the moving image data included in the period number 2 data is completed and the reproduction of the image based on the moving image data is completed, the content display processing is ended.

  In step S422, the above-described processing is performed. When n is “2”, it means that the same operation metadata as the operation metadata already received in the process of step S325A has been received, and the process proceeds to step S426.

  In step S426, control unit 610 determines whether or not reception of moving image data included in period number 2 data has been completed in the content display process. As described above, even after the process of step S426 is completed, the content display process is continued until the reproduction of the image based on the received moving image data is completed. As described above, in the content display process, when n is “2”, when the reception of the moving image data included in the period number 2 data is completed and the reproduction of the image based on the moving image data is completed, The content display process ends. Here, assuming that the reception of the moving image data included in the period number 2 data is completed, the process returns to the process of the video display device 600 of FIG. 31, and the process proceeds to step S327 following step S326.

  The processing in steps S325, S325A, S325B, and S326 described above is repeated until it is determined YES in step S327, so that the moving image as the acquisition request content having undergone the content acquisition operation is displayed on the display unit 630. Playback is displayed.

  Next, processing when the video display apparatus 600 receives operation metadata different from the operation metadata already received from the service server 800A will be described.

First, in the video display device 600, the process of step S325 is performed.
In step S325, a process for receiving period number n data (period number 5 data) corresponding to period number “5” of time table data D270 of FIG. 33 from service server 800A is performed. More specifically, control unit 610 transmits a period number n data acquisition request for acquiring period number 5 data to service server 800A. Thereafter, the process of step S325 ends.

  When n is “5”, the period number 5 data is specified by the CM table data D220 in FIG. 16, and the “CM number” corresponds to “5555” and the file name is “CM5555.mpg”. It is data including data.

  In service server 800A, after the end of step S344A, the process of step S344 is performed.

  In step S344, the above-described processing is performed. Here, assuming that the period number n data acquisition request is received, the process proceeds to step S344A.

  In step S344A, control unit 810 transmits period number n data requested by the period number n data acquisition request to video display device 600. As described above, when n is “5”, the period number 5 data is data including moving image data whose file name is “CM5555.mpg” corresponding to “CMnumber” of “5555”.

  The moving image data whose file name is “CM5555.mpg” includes the following operation metadata D410 whose file name is “cont1234bb.meta”. The moving image data included in the period number 5 data has a large data capacity. Therefore, the control unit 810 distributes the moving image data to the video display device 600 in a streaming manner. Note that when the streaming distribution of the requested moving image data is completed, the process of step S344A ends, and the process of step S344 is performed again.

  FIG. 38 is a diagram illustrating operation metadata D410 as an example. Referring to FIG. 38, operation metadata D410 differs from operation metadata D300A in FIG. 22 in that there is no “button image name” item. Other than that, it is the same as the operation metadata D300, and the detailed description will not be repeated.

  Referring to FIG. 31 again, in video display device 600, when the process of step S325 ends, the process proceeds to step S325A.

  In step S325A, when n is “5”, control unit 610 receives period number 5 data. Thereby, the control unit 610 receives moving image data included in the period number 5 data. The moving image data included in the period number 5 data includes operation metadata D410. Note that the operation metadata D410 is not included in the moving image data as the content, and may be added. Note that the moving image data included in the period number 5 data distributed by streaming is continuously received by the control unit 610 even after the process of step S325A is completed.

  The moving image data included in the period number 5 data includes the operation metadata D410 described above. The control unit 610 stores the received operation metadata D410 in the temporary storage unit 622. Thereafter, the process proceeds to step S325B.

  In step S325B, processing similar to that described above is performed, and therefore detailed description will not be repeated. When the received operation metadata is the operation metadata D410, the control unit 610 generates operation panel generation part data (button image data) corresponding to “play” in the “control” column in the operation metadata D410. The operation panel image is generated by reading from the storage unit 620 and arranging the button image in the operation panel image. Further, control unit 610 generates an operation panel image by arranging a hyperlink character string “movie notice” in operation metadata D410 in the operation panel image. As described above, the operation panel image generated based on the operation metadata 410 is, for example, the operation panel image PG100A of FIG. Thereby, operation panel generation data A for generating the operation panel image is generated.

  Then, the control unit 610 performs processing for adding the name of the button image assigned to each control to the operation metadata in association with each control. When the operation metadata is the operation metadata D410, the operation metadata to which the name of the button image is added becomes the following operation metadata D410A.

  FIG. 39 is a diagram illustrating operation metadata D410A as an example. Referring to FIG. 39, operation metadata D410A is the same as operation metadata D300A of FIG. 22, and therefore detailed description will not be repeated.

  Referring to FIG. 31 again, control unit 610 obtains operation panel data A including generated operation panel generation data A and operation panel generation part data A (button image data) necessary for the generated operation panel image. Generate. Then, control unit 610 transmits generated operation panel data A to communication terminal device 500. Thereafter, the process of step S325B ends.

  In communication terminal device 500, in step S314, control unit 510 determines whether the first operation panel data or operation panel data different from the already received operation panel data has been received. Here, assuming that operation panel data A different from the already received operation panel data is received, the process proceeds to step S315. The received operation panel data A includes operation panel generation data A and operation panel generation part data A.

  In step S315, operation panel image display processing is performed in the same manner as described above. In the operation panel image display processing, the control unit 510 uses the VDP 532 to generate an operation panel image based on the operation panel generation data A that is HTML data, using the operation panel generation part data A, and generate the operation panel image. The displayed operation panel image is displayed on the display unit 530. Thereafter, the process of step S315 ends. Note that the generated operation panel image is, for example, the operation panel image PG100A of FIG.

When the process of step S315 ends, the process proceeds to step S316.
In step S316, the processing described above is performed. Since the operation determination process A has already been executed, the control unit 510 ends the operation determination process A being executed, and executes a new operation determination process A. The newly executed operation determination process A is a process performed independently of the other processes. When the process of step S316 ends, the process of step S314 is performed again.

  In video display device 600, when the process of step S325B ends, the process proceeds to step S326.

In step S326, the above-described content processing A in FIG. 37 is performed.
In content processing A, first, in step S420, control unit 610 executes content display processing. As described above, the content display process is a process performed independently from the content process A and other processes. Thereafter, the process of step S420 ends.

  When n is “5”, in the content display process, the control unit 610 uses the VDP 632 to receive the moving image data included in the period number 5 data from the service server 800A while displaying an image based on the moving image data. Then, a streaming playback display process to be displayed on the display unit 630 is performed. In addition, when the reception of the moving image data included in the period number 5 data is completed and the reproduction of the image based on the moving image data is ended, the content display processing is ended.

  In the newly executed operation determination process A, since the process of step S410 described above is performed, detailed description will not be repeated.

  In step S410, control unit 510 determines whether or not there is a display control operation. In this case, it is assumed that the display control operation is an interface operation M for pressing or clicking a button image and a hyperlink character string in the operation panel image displayed on the display unit 530. If YES in step S410, the process proceeds to step S412. On the other hand, if NO at step S410, the process at step S410 is performed again.

  When the operation panel image displayed on the display unit 530 is the operation panel image PG100A, it is not possible to perform a display control operation for fast-forward playback of a moving image as content, recording processing, or the like.

  Accordingly, fast-forward playback of a moving image is not possible during a period in which a moving image of a CM whose file name is “CM5555.mpg” is displayed on the display unit 630. As a result, the user looking at the display unit 630 sees the CM moving image. Therefore, it is possible to prevent the CM moving image from being viewed by fast-forward playback. That is, it is possible to prevent the CM provider company from suffering a disadvantage.

  It is assumed that when the process of step S410 is performed, there is a display control operation that is an interface operation M in which the hyperlink character string PCG180 in the operation panel image PG100A is clicked. Accordingly, the process proceeds to step S412.

  In step S412, the same processing as described above is performed, and thus detailed description will not be repeated. By this processing, a control remote control signal is transmitted to the video display device 600. Here, it is assumed that the display control operation is an interface operation M in which the hyperlink character string PCG180 in the operation panel image PG100A is clicked. In this case, the control remote control signal is a remote control signal including information on “movie notice” which is a character string of hyperlink character string PCG180 in operation panel image PG100A. When the process of step S412 ends, the process of step S410 is performed again.

  In the content process A, when the process of step S420 ends, the process proceeds to step S422.

  In step S422, the above-described processing is performed. When n is “5”, the control unit 610 determines that the operation metadata different from the already received operation metadata has been received, and proceeds to step S424.

  In step S424, the processing described above is performed. Since the control signal corresponding process A has already been executed, the control unit 510 ends the control signal corresponding process A being executed and executes a new control signal corresponding process A. The newly executed control signal handling process A is a process performed independently of other processes. When the process of step S424 ends, the process proceeds to step S426.

  In the control signal corresponding process A that is newly executed, first, the process of step S430 is performed.

  In step S430, the above-described processing is performed, and thus detailed description will not be repeated. If YES in step S430, the process proceeds to step S432. On the other hand, if NO at step S430, the process at step S430 is performed again. Here, as an example, assuming that a control remote control signal including information of “movie notice” which is a character string of hyperlink character string PCG180 is received, the process proceeds to step S432.

  In step S432, control remote control signal response processing is performed. In the control remote control signal corresponding processing, as described above, processing according to the received control remote control signal is performed. Here, since control remote control signal including information of “movie notice” which is a character string of hyperlink character string PCG 180 is received, control unit 610 performs the following processing.

  The control unit 610 refers to the operation metadata D410A of FIG. 39 and performs control corresponding to “movie notice” which is the character string of the hyperlink character string PCG180. That is, the control unit 610 accesses the URL of “http://www.bb.ne.jp/1234bb01.html” and the URL of “http://www.bb.ne.jp/1234bb01.html”. The information on the web page is displayed on the display unit 630.

  Therefore, it is possible to refer to the information of interest of the user during the period when the moving image of the CM whose file name is “CM5555.mpg” is displayed on the display unit 630. Therefore, a content provider company that provides a moving image of a CM whose file name is “CM5555.mpg” can allow the user to see information corresponding to the content, and can perform efficient advertisement.

  Thereafter, the process of step S432 ends, and the process of step S430 is performed again.

  In the content process A, when the process of step S424 ends, the process proceeds to step S426.

  In step S426, control unit 610 determines whether or not reception of moving image data included in period number 5 data has been completed in the content display process. As described above, even after the process of step S426 is completed, the content display process is continued until the reproduction of the image based on the received moving image data is completed. As described above, in the content display process, when n is “5”, when the reception of the moving image data included in the period number 5 data is completed and the reproduction of the image based on the moving image data is completed, The content display process ends. Here, assuming that the reception of the moving image data included in the period number 5 data is completed, the process returns to the processing of the video display device 600 of FIG. 31 and proceeds to step S327 subsequent to step S326.

  Next, processing when the video display apparatus 600 receives interactive content will be described. The interactive content is a program that a user can participate in, for example, counting a questionnaire. Interactive content is a program that a user can participate in, such as a quiz program.

  The processing up to the processing in step S311 is the same as described above, and thus detailed description will not be repeated.

  First, in step S312, it is determined by the interface operation M that there has been a content acquisition operation for acquiring interactive content, and the process proceeds to step S313. Since the same processing as described above is performed in step S313, detailed description will not be repeated.

  In video display device 600, the same processing as described above is performed in steps S322 and S323, and therefore detailed description will not be repeated.

  In service server 800A, the same processing as described above is performed in steps S342 and S343, and therefore detailed description will not be repeated.

  In video display device 600, the same processing as described above is performed in step S324, and therefore detailed description will not be repeated. Thereby, it is assumed that the video display apparatus 600 receives the content basic data D260, the CM table data D220, and the time table data D270.

  In step S325, the same processing as described above is performed. Here, assuming that n is “1”, control unit 610 transmits a period number n data acquisition request for acquiring period number 1 data to service server 800A.

  In service server 800A, the same processing as described above is performed in steps S344 and S344A, and therefore detailed description will not be repeated. Thus, control unit 810 transmits period number 1 data requested by the period number n data acquisition request to video display device 600.

  In video display device 600, the same processing as described above is performed in step S325A, and therefore detailed description will not be repeated. By this processing, the control unit 610 receives the period number 1 data. The period number 1 data is data including moving image data whose file name is “1234-1.mpg”. Note that moving image data as content included in the period number 1 data includes operation metadata. Note that the operation metadata is not included in the moving image data as the content, and may be added. The control unit 610 stores the received operation metadata in the temporary storage unit 622. Here, the operation metadata is, for example, operation metadata D420 described below. Thereafter, the process proceeds to step S325B.

  FIG. 40 is a diagram illustrating operation metadata D420 as an example. Referring to FIG. 40, operation metadata D420 is different from operation metadata D310 in FIG. 24 in that there is no “button image name” item. Other than that, it is the same as the operation metadata D310, and the detailed description will not be repeated.

  Referring to FIG. 31 again, in video display device 600, the process of step S325B is performed. In step S325B, processing similar to that described above is performed, and therefore detailed description will not be repeated. When the received operation metadata is operation metadata D420, control unit 610 stores operation panel generation part data (button image data) corresponding to each control in the column “control” in operation metadata D420. The operation panel image is generated by reading out from the unit 620 and arranging the button image in the operation panel image. As described above, the operation panel image generated based on the operation metadata 420 is, for example, the operation panel image PG200 of FIG. Thereby, operation panel generation data for generating the operation panel image is generated.

  Then, the control unit 610 performs processing for adding the name of the button image assigned to each control to the operation metadata in association with each control. When the operation metadata is the operation metadata D420, the operation metadata to which the name of the button image is added is the following operation metadata D420A.

  FIG. 41 is a diagram illustrating operation metadata D420A as an example. Referring to FIG. 41, operation metadata D420A is the same as operation metadata D310 in FIG. 24, and thus detailed description will not be repeated.

  Referring to FIG. 31 again, control unit 610 generates operation panel data including the generated operation panel generation data and operation panel generation part data (button image data) necessary for the generated operation panel image. Then, control unit 610 transmits the generated operation panel data to communication terminal device 500. Thereafter, the process of step S325B ends.

  In communication terminal device 500, the same processing as described above is performed in steps S314, S315, and S316, and therefore detailed description will not be repeated. By these processes, the operation panel image PG200 is displayed on the display unit 530. Also, the operation determination process A in FIG. 37 is executed.

In video display device 600, the process of step S326 is performed based on FIG.
In step S420, the same processing as described above is performed, and therefore detailed description will not be repeated.

  In the operation determination process A, since the same process as described above is performed in step S410, detailed description will not be repeated. Here, assuming that there is a display control operation, the process proceeds to step S412. In this case, the display control operation is an interface operation M for pressing the numeric button image PBG211 whose button image name is “number 1” in the operation panel image PG200 displayed on the display unit 530. .

  In step S412, the same processing as described above is performed, and thus detailed description will not be repeated. By this processing, a control remote control signal is transmitted to the video display device 600. As described above, here, it is assumed that the display control operation is the interface operation M for pressing the numeric button image PBG211 having the button image name “number 1”. In this case, the control remote control signal is a remote control signal including information of “number 1” which is the name of the button image PBG211.

  In the content processing A, since the same processing as described above is performed in steps S422 and S424, detailed description will not be repeated. By these processes, the control signal corresponding process A is executed.

  In the control signal corresponding process A, the process of step S430 is performed. In step S430, the above-described processing is performed, and thus detailed description will not be repeated. Here, as an example, assuming that a remote control signal including information of “number 1” which is the name of the button image PBG 211 is received, the process proceeds to step S432.

  In step S432, control remote control signal response processing is performed. In the control remote control signal corresponding processing, as described above, processing according to the received control remote control signal is performed. Here, since the control remote control signal including the information of “number 1” which is the name of button image PBG 211 is received, control unit 610 performs the following processing.

  The control unit 610 refers to the operation metadata D420A of FIG. 41 and performs control corresponding to “number 1” which is the name of the button image PBG211. That is, the control unit 610 accesses the URL “http://www.bb.ne.jp/1234aa01.html” via the Web. The server that is accessed via the Web is, for example, the service server 800A.

  By performing the above processing, the service server 800A accessed via the Web can count the number of accesses, for example, to count questionnaires. That is, by using an operation panel image corresponding to interactive content, a user can participate in a plan such as a questionnaire conducted in a program.

  Note that the content received by the video display device 600 may be 3D content. As an example, the 3D content is assumed to be the 3D content 3DG of FIG.

  Next, processing when the video display device 600 receives 3D content 3DG will be described.

  The processing up to the processing in step S311 is the same as described above, and thus detailed description will not be repeated.

  First, in step S312, it is determined by the interface operation M that there has been a content acquisition operation for acquiring 3D content 3DG, and the process proceeds to step S313. Since the same processing as described above is performed in step S313, detailed description will not be repeated.

  In video display device 600, the same processing as described above is performed in steps S322 and S323, and therefore detailed description will not be repeated.

  In service server 800A, the same processing as described above is performed in step S342, and therefore detailed description will not be repeated. Here, assuming that the content acquisition request A is received, the process proceeds to step S343.

  In step S343, as described above, control unit 810 transmits content reproduction necessary data to video display device 600. Thereafter, the process of step S343 ends. The content reproduction necessary data includes content basic data D260A and time table data D270A described below.

  FIG. 42 is a diagram showing content basic data D260A and time table data D270A as an example. FIG. 42A shows content basic data D260A as an example. Referring to FIG. 42A, content basic data D260A is different from content basic data D260 in FIG. 32 in that “CM insertion count” is “0” and that there is no CM table URL. The difference is that there is no URL for the contents 2, 3, and 4 and no operation metadata bbURL and operation metadata ccURL. Other than that, since it is the same as the content basic data D260, detailed description will not be repeated.

  FIG. 42B is a diagram showing time table data D270A as an example. Referring to FIG. 42B, time table data D270A is data in which only information corresponding to “period number” of “1” is described as compared with time table data D270 of FIG. Different. Other than that, it is the same as time table data D270, and therefore detailed description will not be repeated.

  Referring to FIG. 31 again, in video display device 600, the same processing as described above is performed in step S324, and therefore detailed description will not be repeated. Thereby, it is assumed that video display device 600 has received content reproduction necessary data including content basic data D260A and time table data D270A.

  In step S325, the same processing as described above is performed. Here, assuming that n is “1”, control unit 610 transmits a period number n data acquisition request for acquiring period number 1 data to service server 800A.

  In service server 800A, the same processing as described above is performed in steps S344 and S344A, and therefore detailed description will not be repeated. Thus, control unit 810 transmits period number 1 data requested by the period number n data acquisition request to video display device 600.

  In video display device 600, the same processing as described above is performed in step S325A, and therefore detailed description will not be repeated. By this processing, the control unit 610 receives the period number 1 data. The period number 1 data is data including 3D content data whose file name is “1234.dt”. The 3D content data included in the period number 1 data includes operation metadata whose file name is “cont1234dd.meta”. Note that the operation metadata is not included in the 3D content data, and may be added. The control unit 610 stores the received operation metadata in the temporary storage unit 622. Here, the operation metadata is, for example, operation metadata D430 described below.

  FIG. 43 is a diagram illustrating operation metadata D430 as an example. Referring to FIG. 43, operation metadata D430 is different from operation metadata D320 in FIG. 28 in that there is no “button image name” item. Other than that, it is the same as the operation metadata D320, and the detailed description will not be repeated.

  Referring to FIG. 31 again, in video display device 600, the process of step S325B is performed. In step S325B, processing similar to that described above is performed, and therefore detailed description will not be repeated. When the received operation panel data is the operation metadata D430, the control unit 610 stores operation panel generation part data (button image data) corresponding to each control in the “control” column in the operation metadata D430. The operation panel image is generated by reading out from the unit 620 and arranging the button image in the operation panel image. As described above, the operation panel image generated based on the operation metadata 430 is, for example, the operation panel image PG300 of FIG. Thereby, operation panel generation data for generating the operation panel image is generated.

  Then, the control unit 610 performs processing for adding the name of the button image assigned to each control to the operation metadata in association with each control. When the operation metadata is the operation metadata D430, the operation metadata to which the name of the button image is added is the following operation metadata D430A.

  FIG. 44 is a diagram illustrating operation metadata D430A as an example. Referring to FIG. 44, operation metadata D430A is the same as operation metadata D320 in FIG. 28, and therefore detailed description will not be repeated.

  Referring to FIG. 31 again, control unit 610 generates operation panel data including the generated operation panel generation data and operation panel generation part data (button image data) necessary for the generated operation panel image. Then, control unit 610 transmits the generated operation panel data to communication terminal device 500. Thereafter, the process of step S325B ends.

  In communication terminal device 500, the same processing as described above is performed in steps S314, S315, and S316, and therefore detailed description will not be repeated. Through these processes, the operation panel image PG300 of FIG. 27 is displayed on the display unit 530. Also, the operation determination process A in FIG. 37 is executed.

In video display device 600, the process of step S326 is performed based on FIG.
In step S420, control unit 610 executes content display processing. The content display process is a process performed independently of the content process A and other processes. Thereafter, the process of step S420 ends.

  In the content display process, the control unit 610 displays the 3D content 3DG of FIG. 25 included in the period number n data on the display unit 630 using the VDP 632. And this content display process is complete | finished.

  In the operation determination process A, since the same process as described above is performed in step S410, detailed description will not be repeated. Here, assuming that there is a display control operation, the process proceeds to step S412. In this case, it is assumed that the display control operation is an interface operation M for pressing the button image PBG 316 whose button image name is “left rotation” in the operation panel image PG 300 displayed on the display unit 530.

  In step S412, the same processing as described above is performed, and thus detailed description will not be repeated. By this processing, a control remote control signal is transmitted to the video display device 600. As described above, here, it is assumed that the display control operation is the interface operation M for pressing the button image PBG 316 whose button image name is “left rotation”. In this case, the control remote control signal is a remote control signal including information of “left rotation” that is the name of the button image PBG 316.

  In the content processing A, since the same processing as described above is performed in steps S422 and S424, detailed description will not be repeated. By these processes, the control signal corresponding process A is executed.

  In the control signal corresponding process A, the process of step S430 is performed. In step S430, the above-described processing is performed, and thus detailed description will not be repeated. Here, as an example, assuming that a remote control signal including information of “left rotation” that is the name of the button image PBG 316 is received, the process proceeds to step S432.

  In step S432, control remote control signal response processing is performed. In the control remote control signal corresponding processing, as described above, processing according to the received control remote control signal is performed. Here, since the control remote control signal including the information of “left rotation” which is the name of button image PBG 316 is received, control unit 610 performs the following processing.

  The control unit 610 refers to the operation metadata D430A of FIG. 44 and performs control corresponding to “left rotation” which is the name of the button image PBG316. That is, the control unit 610 performs a process of rotating the 3D content 3DG of FIG. 25 displayed on the display unit 630 by 10 degrees toward the left with respect to the horizontal direction.

  By performing the above processing, 3D content can be rotated, enlarged, and reduced. That is, 3D content can be displayed in various states by user operation.

  Note that the operation panel image used in the present embodiment may be an operation panel image PG400 of FIG. Further, the operation panel image used in the present embodiment may display an equalizer that can freely change the sound quality of music when the received content is music. The operation panel image is not limited to the one described above.

  As described above, in the present embodiment, video display device 600 receives content from service server 800A, and transmits operation metadata for operating the content to video display device 600. The video display device 600 uses the operation panel generation part data (button image data) as template data based on the received operation metadata to generate an operation panel image and generate the operation panel image. Generate operation panel generation data.

  Then, the control unit 610 generates operation panel data including the generated operation panel generation data and operation panel generation part data (button image data) necessary for the generated operation panel image, and the generated operation panel data is It transmits to the communication terminal device 500. Communication terminal device 500 displays an operation panel image based on the received operation panel data. The communication terminal device 500 controls the content displayed on the display unit 630 of the video display device 600 using an operation panel image corresponding to the received content.

  Therefore, also in the present embodiment in which the video display device 600 generates an operation panel image, the same effects as in the first embodiment can be achieved. That is, according to the present embodiment, it is possible to control content using an operation panel image suitable for controlling the content. As a result, it is possible to obtain an operation system with a high degree of freedom according to the type of content.

<Third Embodiment>
In the present embodiment, processing in which communication terminal apparatus 500 generates an operation panel image will be described.

  In the present embodiment, storage unit 520 of communication terminal device 500 stores a plurality of types of operation panel generation part data necessary for generating an operation panel image. The operation panel generation part data is, for example, button image data included in each of the operation panel image PG100 in FIG. 17, the operation panel image PG200 in FIG. 23, the operation panel image PG300 in FIG. 27, and the operation panel image PG400 in FIG. . This button image data is stored in the storage unit 520 as template data.

  A name is set in the button image data. For example, the playback button image PBG110, the pause button image PBG112, the stop button image PBG120, the rewind button image PBG132, the fast forward button image PBG134, and the record button image PBG140 in the operation panel image PG100 are respectively “play”, The names “pause”, “stop”, “rewind”, “fast forward” and “record” are set.

  Since the network system in the present embodiment is similar to network system 1000 in the first embodiment, detailed description will not be repeated. Since the configuration of each of communication terminal device 500, video display device 600, service server 800A, search server 800S, and Web server 800W is the same as that described in the first embodiment, detailed description thereof will not be repeated.

  Next, in the present embodiment, a process for the video display apparatus 600 to receive content from the service server 800A (hereinafter also referred to as content handling process B) will be described. It is assumed that remote control image MG100 is displayed on display unit 530 of communication terminal device 500. In this case, it is assumed that communication terminal apparatus 500 is set to the remote control mode.

  FIG. 45 is a flowchart of the content handling process B. FIG. 45 shows processing performed in each of communication terminal device 500, video display device 600, and service server 800A.

In communication terminal device 500, first, the process of step S510 is performed.
In step S510, processing similar to that in step S110 is performed, and thus detailed description will not be repeated. If YES in step S510, the process proceeds to step S511. On the other hand, if NO at step S510, the process at step S510 is performed again. Here, assuming that there is a list acquisition operation, the process proceeds to step S511.

  In step S511, a list acquisition process is performed in the same manner as in step S111, and thus detailed description will not be repeated.

  In video display device 600, first, the process of step S520 is performed. In step S520, control unit 610 determines whether a list acquisition remote control signal as a list acquisition request has been received or not. If YES in step S520, the process proceeds to step S521. On the other hand, if NO at step S520, the process at step S520 is performed again.

  In step S521, list acquisition processing A is performed in the same manner as in step S121, and thus detailed description will not be repeated. With this process, the list acquisition request A is transmitted to the service server 800A.

In service server 800A, first, the process of step S540 is performed.
In step S540, control unit 810 determines whether or not list acquisition request A has been received. If YES in step S540, the process proceeds to step S541. On the other hand, if NO at step S540, the process at step S540 is performed again.

  In step S541, the control unit 810 transmits the list data D100 of FIG. 11, which is data of a list of distributable contents, to the device that transmitted the list acquisition request A. Thereafter, the process of step S541 ends.

  In video display device 600, control unit 610 receives list data D100. When receiving the list data D100, the control unit 610 stores the list data D100 in the storage unit 620. Then, the control unit 610 generates the list image TG200 of FIG. 12 using the VDP 632 based on the list data D100, and causes the display unit 630 to display the generated list image TG200.

  In the list acquisition process A of step S521, the control unit 610 further transmits (transfers) the received list data D100 to the communication terminal device 500 using the communication unit 660. Thereafter, the process of step S521 ends.

  In communication terminal device 500, in the list acquisition process of step S511, control unit 510 further receives list data D100. When receiving the list data D100, the control unit 510 stores the list data D100 in the storage unit 520. Then, control unit 510 generates list image MG200 of FIG. 13 using VDP 632 based on list data D100, and causes display unit 630 to display the generated list image MG200. Then, the process of step S511 ends, and the process proceeds to step S312.

  In step S512, processing similar to that in step S112 is performed, and thus detailed description will not be repeated. If YES in step S512, the process proceeds to step S513. On the other hand, if NO at step S512, the process at step S512 is performed again. Here, assuming that there is a content acquisition operation for pressing the button image MBG211 that displays the title “B movie” by the interface operation M, the process proceeds to step S513.

  In step S513, the same processing as in step S113 is performed, and thus detailed description will not be repeated. By this processing, a content acquisition remote control signal as a content acquisition request is transmitted to the video display device 600. Then, the process of step S113 ends.

  In video display device 600, when the process of step S521 ends, the process proceeds to step S522.

  In step S522, a process similar to that in step S122 is performed, and thus detailed description will not be repeated. If YES in step S522, the process proceeds to step S523. On the other hand, if NO at step S522, the process at step S522 is performed again.

  In step S523, processing similar to that in step S123 is performed, and thus detailed description will not be repeated. Through this process, control unit 610 transmits content acquisition request A for acquiring the content specified by the received content acquisition remote control signal to service server 800A. Thereafter, the process of step S523 ends. The content acquisition request A includes an ID number for specifying the acquisition request content. Here, it is assumed that the content acquisition request A includes an ID number “1234” for specifying the acquisition request content whose title is “B movie”.

  In service server 800A, when the process of step S541 ends, the process proceeds to step S542.

  In step S542, control unit 810 determines whether content acquisition request A has been received or not. If YES at step S542, the process proceeds to step S543. On the other hand, if NO at step S542, the process at step S542 is performed again.

  In step S <b> 543, control unit 810 transmits content reproduction necessary data necessary for content reproduction to video display device 600. Thereafter, the process of step S543 ends. The content reproduction necessary data includes CM table data D220 in FIG. 16, content basic data D260 in FIG. 32, and time table data D270 in FIG.

  The content basic data corresponding to the ID number for specifying the content included in the content acquisition request A is stored in advance in the storage unit 820 of the service server 800A. Therefore, the content basic data D260 is also stored in the storage unit 820 of the service server 800A in advance.

  In video display device 600, when the process of step S523 ends, the process proceeds to step S524.

  In step S524, control unit 610 receives the content reproduction necessary data, and stores the received content reproduction necessary data in storage unit 620. Thereafter, the process proceeds to step S525.

  In step S525, the same processing as in step S125 is performed, and thus detailed description will not be repeated. By this processing, control unit 610 performs processing for receiving period number n data corresponding to period number n (natural number) of time table data D270 from service server 800A. Note that the initial value of n is “1”. Specifically, a period number n data acquisition request for acquiring period number n data is transmitted to service server 800A. Thereafter, the process of step S525 ends. When n is “1”, the period number n data is also referred to as period number 1 data. When n is “1”, the period number 1 data is data including moving image data whose file name is “1234-1.mpg”.

  In service server 800A, when the process of step S543 ends, the process proceeds to step S544.

  In step S544, the same processing as in step S144 is performed, and thus detailed description will not be repeated. If YES in step S544, the process proceeds to step S544A. On the other hand, if NO at step S544, the process at step S544 is performed again.

  In step S544A, control unit 810 transmits period number n data requested by the period number n data acquisition request to video display device 600. As described above, when n is “1”, the period number n data (period number 1 data) is data including moving image data whose file name is “1234-1.mpg”. The moving image data included in the period number n data has a large data capacity. Therefore, the control unit 810 distributes the moving image data to the video display device 600 in a streaming manner. Note that when the streaming distribution of the requested moving image data is completed, the process of step S544A is terminated, and the process of step S544 is performed again.

  In video display device 600, when the process of step S525 ends, the process proceeds to step S525A.

  In step S525A, control unit 610 receives period number n data. As a result, the moving image data included in the period number n data that is distributed by streaming is sequentially received by the control unit 610. In other words, the moving image data continues to be received by the control unit 610 even after the process of step S525A is completed. Note that the moving image data as the content includes operation metadata for performing processing such as reproduction control of the content (moving image data). Note that the operation metadata is not included in the moving image data as the content, and may be added. Here, it is assumed that the operation metadata is the operation metadata D400 in FIG. 34 having a file name “cont1234aa.meta” when n is “1”.

  The control unit 610 stores the received operation metadata in the temporary storage unit 622. Thereafter, the process proceeds to step S525B.

  In step S525B, control unit 610 transmits operation metadata included in the received period number n data to communication terminal device 500. Control unit 610 does not perform the process of transmitting the operation metadata to communication terminal device 500 when the same operation metadata as the operation metadata already received is received. Thereafter, the process of step S525B ends.

In communication terminal device 500, after the process of step S513, the process proceeds to step S514.
In step S514, control unit 510 determines whether or not operation metadata different from the first operation metadata or operation metadata already received is received. If YES at step S514, the process proceeds to step S514A. On the other hand, if NO at step S514, the process at step S514 is performed again. When the process of step S514 is performed for the first time, it is determined that the first operation metadata has been received, and the process proceeds to step S514A.

  In step S514A, control unit 510 generates an operation panel image suitable for the operation panel data. Specifically, the control unit 510 is based on the interface information (see FIG. 35) of the communication terminal device 500, the content type in the operation metadata, and at least one information of genre, link character string, and control. An operation panel image is generated by a process similar to the process of step S325B. Note that the interface information of the communication terminal device 500 is stored in the storage unit 520.

  Control unit 510 refers to the screen size information included in the interface information of communication terminal device 500 to determine the size of the operation panel image. In this case, the size of the operation panel image is smaller than the screen size. When the received operation metadata is, for example, the operation metadata D400 of FIG. 34, the control unit 610 controls the operation panel generation part data corresponding to each control in the column “control” in the operation metadata D400. (Button image data) is read from the storage unit 620, and a button image is arranged in the operation panel image to generate an operation panel image.

  For example, when “control” is “reproduction”, the data of the reproduction button image PBG110 of FIG. 17 having the name “reproduction” is read from the storage unit 620, and the button image is arranged in the operation panel image. Similarly, the button image data corresponding to other controls is read out, and the button image is arranged in the operation panel image. As described above, the operation panel image generated based on the operation metadata D400 is, for example, the operation panel image PG100 in FIG.

  Then, the control unit 610 performs processing for adding the name of the button image assigned to each control to the operation metadata in association with each control. When the operation metadata is the operation metadata D400, the operation metadata to which the name of the button image is added becomes the operation metadata D400A in FIG. Thereafter, the process proceeds to step S514B.

  In step S514B, control unit 510 transmits changed operation metadata (hereinafter also referred to as updated operation metadata) to communication terminal apparatus 500. Here, the post-update operation metadata is operation metadata D400A.

  In video display device 600, when the process of step S525B ends, the process proceeds to step S525C.

  In step S525C, control unit 610 receives the updated operation metadata, and stores the received updated operation metadata in temporary storage unit 622. Here, the post-update operation metadata is operation metadata D400A. Thereafter, the process of step S525C ends. In step S525C, when the process of transmitting the operation metadata is not performed in the process of step S525B, control unit 610 ends the process of step S525C without receiving the updated operation metadata.

  In communication terminal device 500, when the process of step S514B ends, the process proceeds to step S515.

  In step S515, operation panel image display processing is performed as in step S315, and thus detailed description will not be repeated. By this processing, the generated operation panel image is displayed on the display unit 530. Thereafter, the process of step S515 ends. Note that the generated operation panel image is, for example, the operation panel image PG100 of FIG.

When the process of step S515 ends, the process proceeds to step S516.
In step S516, control unit 510 executes operation determination processing B described later. The operation determination process B is a process performed independently of other processes. If the operation determination process B has already been executed, the control unit 510 ends the operation determination process B that is being executed, and executes a new operation determination process B. When the process of step S516 ends, the process of step S514 is performed again.

  In video display device 600, when the process of step S525C ends, the process proceeds to step S526.

In step S526, content processing B is performed.
FIG. 46 is a flowchart of the operation determination process B and the content process B. Referring to FIG. 46, in the content process B, first, the process of step S620 is performed.

  In step S620, control unit 610 executes content display processing. The content display process is a process performed independently of the content process B and other processes. Thereafter, the process of step S620 ends.

  In the content display processing, the control unit 610 uses the VDP 632 to perform streaming for displaying an image based on the moving image data on the display unit 630 while receiving the moving image data included in the period number n data from the service server 800A. Reproduction display processing is performed. In addition, when the reception of moving image data included in the period number n data (for example, period number 1 data) is completed and the reproduction of the image based on the moving image data is completed, the content display process ends.

In the operation determination process B, first, the process of step S610 is performed.
In step S610, control unit 510 determines whether or not there is a display control operation. The display control operation is an interface operation M for pressing the button image in the operation panel image displayed on the display unit 530. If YES in step S610, the process proceeds to step S612. On the other hand, if NO at step S610, the process at step S610 is performed again.

  For example, when the operation panel image displayed on the display unit 530 is the operation panel image PG100 of FIG. 17, the display control operation is, for example, an interface operation M for pressing the stop button image PBG120.

  In step S612, control unit 510 transmits a control remote control signal to video display device 600 using communication unit 560. For example, when the display control operation is the interface operation M for pressing down the stop button image PBG120, the control remote control signal is “stop” information that is the name of the stop button image PBG120 in the operation panel image PG100. Remote control signal including When the process of step S612 ends, the process of step S610 is performed again.

  In the content process B, when the process of step S620 ends, the process proceeds to step S622.

  In step S622, control unit 610 determines whether or not operation metadata different from the first operation metadata or the operation metadata already received is received. That is, the operation number is included in the period number n data received by the control unit 610 in the process of step S525A, and the operation metadata is different from the first operation metadata or the operation metadata already received. It is determined whether or not metadata has been received. If YES in step S622, the process proceeds to step S624. On the other hand, if NO at step S622, the process proceeds to step S626. When the process of step S622 is performed for the first time, it is determined that the first operation metadata has been received, and the process proceeds to step S624.

  In step S624, control unit 610 executes control signal handling process B for handling the control remote control signal transmitted from communication terminal apparatus 500. The control signal corresponding process B is a process performed independently of other processes. When the control signal handling process B has already been executed, the control unit 610 terminates the control signal handling process B being executed and executes a new control signal handling process B. When the process of step S624 ends, the process proceeds to step S626.

In the control signal handling process B, first, the process of step S630 is performed.
In step S630, control unit 610 determines whether a control remote control signal has been received or not. If YES at step S630, the process proceeds to step S632. On the other hand, if NO at step S630, the process at step S630 is performed again. Here, as an example, it is assumed that a control remote control signal including information of “stop” which is the name of the stop button image PBG 120 is received.

  In step S632, control remote control signal handling processing is performed in the same manner as in step S232. In the control remote control signal corresponding processing, processing according to the received control remote control signal is performed. For example, when a control remote control signal including information “stop” that is the name of the stop button image PBG 120 is received while a moving image is displayed on the display unit 630, the control unit 610 displays the updated operation metadata. Referring to the operation metadata D400A in FIG. 36, control corresponding to the button image name “stop” is performed. That is, the control unit 610 stops the reproduction of the moving image displayed on the display unit 630 and deletes the moving image displayed on the display unit 630. Thereafter, the process of step S632 ends, and the process of step S630 is performed again.

  In the content process B, when the process of step S624 ends, the process proceeds to step S626.

  In step S626, control unit 610 determines whether or not reception of moving image data included in period number n data (for example, period number 1 data) has been completed in the content display process. If YES in step S626, the content process ends, the process returns to the process of the video display device 600 in FIG. 45, and the process proceeds to step S527 following step S526. On the other hand, if NO at step S626, the process at step S626 is performed again. Even if the process of step S626 is completed, the content display process is continued until the reproduction of the image based on the moving image data that has been received is completed. As described above, in the content display process, when the reception of the moving image data included in the period number n data (period number 1 data) is completed and the reproduction of the image based on the moving image data is completed, the content display is performed. The process ends.

  Referring to FIG. 31 again, when the process of step S526 ends, the process proceeds to step S527.

  In step S527, the control unit 610 completes the reception of the moving image data as all the contents corresponding to all the period numbers described in the time table data D270 in FIG. It is determined whether or not the reproduction of the moving image data is finished. If YES in step S527, the process of step S522 is performed again. On the other hand, if NO at step S327, the process proceeds to step S527A.

  In step S527A, control unit 610 increments the value of n by 1. Thereafter, the process of step S525 is performed again. Here, the process performed in step S525 will be described assuming that the value of n becomes “2” after the process in step S527A.

  In step S525, since n is “2”, control unit 610 receives period number n data (period number 2 data) corresponding to period number “2” of time table data D270 from service server 800A. Perform the following process. More specifically, control unit 610 transmits a period number n data acquisition request for acquiring period number 2 data to service server 800A. Thereafter, the process of step S325 ends. When n is “2”, the period number 2 data is a file identified by the CM table data D220 in FIG. 16 and corresponding to “CM number” “0001”, “0007”, “0189”, respectively. The data includes a plurality of moving image data whose names are “CM0001.mpg”, “CM0007.mpg”, and “CM0189.mpg”.

  In service server 800A, after step S544A ends, the process of step S544 is performed.

  In step S544, the above-described processing is performed. Here, assuming that the period number n data acquisition request is received, the process proceeds to step S544A.

  In step S544A, control unit 810 transmits period number n data requested by the period number n data acquisition request to video display device 600. As described above, when n is “2”, the period number 2 data has a “CM number” corresponding to “0001”, “0007”, “0189”, and file names “CM0001.mpg”, “ “CM0007.mpg” and “CM0189.mpg” are data including a plurality of moving image data. The moving image data included in the period number 2 data has a large data capacity. Therefore, the control unit 810 distributes the moving image data to the video display device 600 in a streaming manner. The moving image data as the content includes the operation metadata described above. The operation metadata is, for example, the operation metadata D400 in FIG. Note that when the streaming distribution of the requested moving image data is completed, the process of step S544A is terminated, and the process of step S544 is performed again.

  In video display device 600, when the process of step S525 ends, the process proceeds to step S525A.

  In step S525A, when n is “2”, control unit 610 receives period number 2 data. The moving image data included in the period number 2 data includes operation metadata D400 whose file name is “cont1234aa.meta”. Note that the operation metadata D400 is not included in the moving image data as the content, and may be added. Note that the moving image data included in the period number 2 data distributed by streaming is continuously received by the control unit 610 even after the process of step S525A is completed. Thereafter, the process proceeds to step S525B.

  In step S525B, since the same operation metadata (operation metadata D400) as the operation metadata (operation metadata D400) that has already been received is received, the control unit 610 transmits the operation metadata to the communication terminal device 500. Don't do it. Thereafter, the process of step S525B ends, and the process proceeds to step S525C.

  In step S525C, when the process of transmitting operation metadata is not performed in the process of step S525B, the control unit 610 ends the process of step S525C without receiving the updated operation metadata, and proceeds to step S526. move on.

In step S526, the above-described content processing B of FIG. 46 is performed.
In the content process B, first, in step S620, the control unit 610 executes a content display process. As described above, the content display process is a process performed independently of the content process and other processes. Thereafter, the process of step S620 ends.

  When n is “2”, in the content display processing, the control unit 610 uses the VDP 632 to receive an image based on the moving image data while receiving the moving image data included in the period number 2 data from the service server 800A. Then, a streaming playback display process to be displayed on the display unit 630 is performed. Note that when the reception of the moving image data included in the period number 2 data is completed and the reproduction of the image based on the moving image data is completed, the content display processing is ended.

  In step S622, the above-described processing is performed. If n is “2”, it means that the same operation metadata as the already received operation metadata has been received, and the process proceeds to step S626.

  In step S626, control unit 610 determines whether or not reception of moving image data included in period number 2 data has been completed in the content display process. As described above, even after the process of step S626 is completed, the content display process is continued until the reproduction of the image based on the received moving image data is completed. As described above, in the content display process, when n is “2”, when the reception of the moving image data included in the period number 2 data is completed and the reproduction of the image based on the moving image data is completed, The content display process ends. Here, assuming that the reception of the moving image data included in the period number 2 data has been completed, the processing returns to the processing of the video display device 600 in FIG. 45, and proceeds to step S527 following step S526.

  The processing in steps S525, S525A, S525B, S525C, and S526 described above is repeated until it is determined YES in step S527, so that the display unit 630 has a moving image as an acquisition request content for which a content acquisition operation has been performed. The image is replayed and displayed.

  Next, processing when the video display apparatus 600 receives operation metadata different from the operation metadata already received from the service server 800A will be described.

First, in the video display device 600, the process of step S525 is performed.
In step S525, a process for receiving period number n data (period number 5 data) corresponding to period number “5” of time table data D270 of FIG. 33 from service server 800A is performed. More specifically, control unit 610 transmits a period number n data acquisition request for acquiring period number 5 data to service server 800A. Thereafter, the process of step S525 ends.

  When n is “5”, the period number 5 data is specified by the CM table data D220 in FIG. 16, and the “CM number” corresponds to “5555” and the file name is “CM5555.mpg”. It is data including data.

  In service server 800A, after step S544A ends, the process of step S544 is performed.

  In step S544, the above-described processing is performed. Here, assuming that the period number n data acquisition request is received, the process proceeds to step S544A.

  In step S544A, control unit 810 transmits period number n data requested by the period number n data acquisition request to video display device 600. As described above, when n is “5”, the period number 5 data is data including moving image data whose file name is “CM5555.mpg” corresponding to “CMnumber” of “5555”.

  The moving image data whose file name is “CM5555.mpg” includes the operation metadata D410 of FIG. 38 whose file name is “cont1234bb.meta”. The moving image data included in the period number 5 data has a large data capacity. Therefore, the control unit 810 distributes the moving image data to the video display device 600 in a streaming manner. Note that when the streaming distribution of the requested moving image data is completed, the process of step S544A is terminated, and the process of step S544 is performed again.

  In video display device 600, when the process of step S525 ends, the process proceeds to step S525A.

  In step S525A, when n is “5”, control unit 610 receives period number 5 data. Thereby, the control unit 610 receives moving image data included in the period number 5 data. The moving image data included in the period number 5 data includes the operation metadata D410 of FIG. Note that the moving image data included in the period number 5 data distributed by streaming is continuously received by the control unit 610 even after the process of step S325A is completed.

  The moving image data included in the period number 5 data includes the operation metadata D410 described above. Note that the operation metadata D410 is not included in the moving image data as the content, and may be added. The control unit 610 stores the received operation metadata D410 in the temporary storage unit 622. Thereafter, the process proceeds to step S525B.

  In step S525B, processing similar to that described above is performed, and therefore detailed description will not be repeated. By this processing, the operation metadata D410 included in the received period number n data is transmitted to the communication terminal device 500. Thereafter, the process of step S525B ends.

  In communication terminal device 500, in step S514, control unit 510 determines whether or not operation metadata different from the first operation metadata or operation metadata that has already been received is received. Here, it is assumed that operation metadata (operation metadata D410) different from the operation metadata (operation metadata D400) that has already been received is received, and the process proceeds to step S514A.

  In step S514A, processing similar to that described above is performed, and therefore detailed description will not be repeated. When the received operation metadata is operation metadata D410, control unit 510 uses operation panel generation part data (button image data) corresponding to “play” in the “control” column in operation metadata D410. An operation panel image is generated by reading from the storage unit 520 and arranging a button image in the operation panel image. Further, control unit 510 generates an operation panel image by arranging a hyperlink character string “movie notice” in operation metadata D410 in the operation panel image. As described above, the operation panel image generated based on the operation metadata 410 is, for example, the operation panel image PG100A of FIG.

  Then, the control unit 610 performs processing for adding the name of the button image assigned to each control to the operation metadata in association with each control. When the operation metadata is the operation metadata D410, the operation metadata with the name of the button image added is the operation metadata D410A in FIG. Thereafter, the process proceeds to step S514B.

  In step S514B, control unit 510 transmits operation metadata D410A as updated operation metadata to communication terminal apparatus 500.

  In video display device 600, when the process of step S525B ends, the process proceeds to step S525C.

  In step S525C, control unit 610 receives operation metadata D410A as post-update operation metadata, and stores received operation metadata D410A in temporary storage unit 622. Thereafter, the process proceeds to step S526.

  In communication terminal device 500, when the process of step S514B ends, the process proceeds to step S515.

  In step S515, operation panel image display processing is performed in the same manner as described above, and therefore detailed description will not be repeated. By this processing, the generated operation panel image PG100A is displayed on the display unit 530. Thereafter, the process of step S515 ends.

When the process of step S515 ends, the process proceeds to step S516.
In step S516, the processing described above is performed. Since the operation determination process B has already been executed, the control unit 510 ends the operation determination process B being executed, and executes a new operation determination process B. The newly executed operation determination process B is a process performed independently of the other processes. When the process of step S516 ends, the process of step S514 is performed again.

  In video display device 600, when the process of step S525C ends, the process proceeds to step S526.

In step S526, the above-described content processing B of FIG. 46 is performed.
In the content process B, first, in step S620, the control unit 610 executes a content display process. As described above, the content display process is a process performed independently of the content process and other processes. Thereafter, the process of step S620 ends.

  When n is “5”, in the content display process, the control unit 610 uses the VDP 632 to receive the moving image data included in the period number 5 data from the service server 800A while displaying an image based on the moving image data. Then, a streaming playback display process to be displayed on the display unit 630 is performed. In addition, when the reception of the moving image data included in the period number 5 data is completed and the reproduction of the image based on the moving image data is ended, the content display processing is ended.

  In the newly executed operation determination process B, the process in step S610 described above is performed, and thus detailed description will not be repeated.

  In step S610, control unit 510 determines whether or not there is a display control operation. In this case, it is assumed that the display control operation is an interface operation M for pressing or clicking a button image and a hyperlink character string in the operation panel image displayed on the display unit 530. If YES in step S610, the process proceeds to step S612. On the other hand, if NO at step S610, the process at step S610 is performed again.

  When the operation panel image displayed on the display unit 530 is the operation panel image PG100A, it is not possible to perform a display control operation for fast-forward playback of a moving image as content, recording processing, or the like.

  Accordingly, fast-forward playback of a moving image is not possible during a period in which a moving image of a CM whose file name is “CM5555.mpg” is displayed on the display unit 630. As a result, the user looking at the display unit 630 sees the CM moving image. Therefore, it is possible to prevent the CM moving image from being viewed by fast-forward playback. That is, it is possible to prevent the CM provider company from suffering a disadvantage.

  It is assumed that there is a display control operation that is an interface operation M in which the hyperlink character string PCG180 in the operation panel image PG100A is clicked when the process of step S610 is performed. Accordingly, the process proceeds to step S612.

  In step S612, the same processing as described above is performed, and thus detailed description will not be repeated. By this processing, a control remote control signal is transmitted to the video display device 600. Here, it is assumed that the display control operation is an interface operation M in which the hyperlink character string PCG180 in the operation panel image PG100A is clicked. In this case, the control remote control signal is a remote control signal including information on “movie notice” which is a character string of hyperlink character string PCG180 in operation panel image PG100A. When the process of step S612 ends, the process of step S610 is performed again.

  In the content process A, when the process of step S620 ends, the process proceeds to step S622.

  In step S622, the above-described processing is performed. When n is “5”, the control unit 610 determines that the operation metadata different from the already received operation metadata has been received, and proceeds to step S624.

  In step S624, the above-described processing is performed. Since the control signal corresponding process B has already been executed, the control unit 510 ends the control signal corresponding process B being executed and executes a new control signal corresponding process B. The newly executed control signal corresponding process B is a process performed independently of other processes. When the process of step S624 ends, the process proceeds to step S626.

  In the control signal corresponding process B to be newly executed, first, the process of step S630 is performed.

  In step S630, the above-described processing is performed, and thus detailed description will not be repeated. If YES at step S630, the process proceeds to step S632. On the other hand, if NO at step S630, the process at step S630 is performed again. Here, as an example, assuming that a control remote control signal including information of “movie notice” which is a character string of hyperlink character string PCG180 is received, the process proceeds to step S632.

  In step S632, control remote control signal response processing is performed. In the control remote control signal corresponding processing, as described above, processing according to the received control remote control signal is performed. Here, since control remote control signal including information of “movie notice” which is a character string of hyperlink character string PCG 180 is received, control unit 610 performs the following processing.

  The control unit 610 refers to the operation metadata D410A of FIG. 39 and performs control corresponding to “movie notice” which is the character string of the hyperlink character string PCG180. That is, the control unit 610 accesses the URL of “http://www.bb.ne.jp/1234bb01.html” and the URL of “http://www.bb.ne.jp/1234bb01.html”. The information on the web page is displayed on the display unit 630.

  Therefore, it is possible to refer to the information of interest of the user during the period when the moving image of the CM whose file name is “CM5555.mpg” is displayed on the display unit 630. Therefore, a content provider company that provides a moving image of a CM whose file name is “CM5555.mpg” can allow the user to see information corresponding to the content, and can perform efficient advertisement.

  Thereafter, the process of step S632 ends, and the process of step S630 is performed again.

  In the content process B, when the process of step S624 ends, the process proceeds to step S626.

  In step S626, control unit 610 determines whether or not reception of moving image data included in period number 5 data has been completed in the content display process. As described above, even after the process of step S626 is completed, the content display process is continued until the reproduction of the image based on the received moving image data is completed. As described above, in the content display process, when n is “5”, when the reception of the moving image data included in the period number 5 data is completed and the reproduction of the image based on the moving image data is completed, The content display process ends. Here, assuming that the reception of the moving image data included in the period number 5 data is completed, the processing returns to the processing of the video display device 600 of FIG. 45, and proceeds to step S527 following step S526.

  Next, processing when the video display apparatus 600 receives interactive content will be described. The interactive content is a program that a user can participate in, for example, counting a questionnaire. Interactive content is a program that a user can participate in, such as a quiz program.

  Since the processing up to the processing in step S511 is the same as described above, detailed description will not be repeated.

  First, in step S512, it is determined by the interface operation M that there has been a content acquisition operation for acquiring interactive content, and the process proceeds to step S513. Since the same processing as described above is performed in step S513, detailed description will not be repeated.

  In video display device 600, the same processing as described above is performed in steps S522 and S523, and therefore detailed description will not be repeated.

  In service server 800A, the same processing as described above is performed in steps S542 and S543, and therefore detailed description will not be repeated.

  In video display device 600, the same processing as described above is performed in step S524, and therefore detailed description will not be repeated. Thereby, it is assumed that the video display apparatus 600 receives the content basic data D260, the CM table data D220, and the time table data D270.

  In step S525, the same processing as described above is performed. Here, assuming that n is “1”, control unit 610 transmits a period number n data acquisition request for acquiring period number 1 data to service server 800A.

  In service server 800A, the same processing as described above is performed in steps S544 and S544A, and therefore detailed description will not be repeated. Thus, control unit 810 transmits period number 1 data requested by the period number n data acquisition request to video display device 600.

  In video display device 600, the same processing as described above is performed in step S525A, and therefore detailed description will not be repeated. By this processing, the control unit 610 receives the period number 1 data. The period number 1 data is data including moving image data whose file name is “1234-1.mpg”. Note that moving image data as content included in the period number 1 data includes operation metadata. Note that the operation metadata is not included in the moving image data as the content, and may be added. The control unit 610 stores the received operation metadata in the temporary storage unit 622. Here, the operation metadata is, for example, the operation metadata D420 of FIG. Thereafter, the process proceeds to step S525B.

  In video display device 600, the process of step S525B is performed. In step S525B, processing similar to that described above is performed, and therefore detailed description will not be repeated. Control unit 610 transmits operation metadata D420 included in the received period number 1 data to communication terminal device 500. Thereafter, the process of step S525B ends.

  In communication terminal device 500, assuming that the first operation metadata is received in step S514, the process proceeds to step S514A.

  In step S514A, control unit 510 performs the same processing as described above, and thus detailed description will not be repeated. When the received operation metadata is operation metadata D420, control unit 610 stores operation panel generation part data (button image data) corresponding to each control in the column “control” in operation metadata D420. The operation panel image is generated by reading out from the unit 620 and arranging the button image in the operation panel image. As described above, the operation panel image generated based on the operation metadata 420 is, for example, the operation panel image PG200 of FIG.

  Then, the control unit 610 performs processing for adding the name of the button image assigned to each control to the operation metadata in association with each control. When the operation metadata is the operation metadata D420, the operation metadata to which the name of the button image is added is the following operation metadata D420A. Thereafter, the process proceeds to step S514B.

  In step S514B, control unit 510 transmits operation metadata D420A as updated operation metadata to video display device 600.

  In video display device 600, when the process of step S525B ends, the process proceeds to step S525C.

  In step S525C, control unit 610 receives operation metadata D420A as updated operation metadata, and stores received operation metadata D420A in temporary storage unit 622. Thereafter, the process proceeds to step S526.

  In communication terminal device 500, when the process of step S514B ends, the process proceeds to step S515. In steps S515 and S516, the same processing as described above is performed, and thus detailed description will not be repeated. By these processes, the operation panel image PG200 is displayed on the display unit 530. Also, the operation determination process B of FIG. 46 is executed.

In video display device 600, the process of step S526 is performed based on FIG.
In step S620, processing similar to that described above is performed, and thus detailed description will not be repeated.

  In operation determination process B, the same process as described above is performed in step S610, and thus detailed description will not be repeated. Here, assuming that there is a display control operation, the process proceeds to step S612. In this case, the display control operation is an interface operation M for pressing the numeric button image PBG211 whose button image name is “number 1” in the operation panel image PG200 displayed on the display unit 530. .

  In step S612, the same processing as described above is performed, and thus detailed description will not be repeated. By this processing, a control remote control signal is transmitted to the video display device 600. As described above, here, it is assumed that the display control operation is the interface operation M for pressing the numeric button image PBG211 having the button image name “number 1”. In this case, the control remote control signal is a remote control signal including information of “number 1” which is the name of the button image PBG211.

  In content processing B, the same processing as described above is performed in steps S622 and S624, and therefore detailed description will not be repeated. By these processes, the control signal corresponding process B is executed.

  In the control signal corresponding process B, the process of step S630 is performed. In step S630, the above-described processing is performed, and thus detailed description will not be repeated. Here, as an example, assuming that a remote control signal including information of “number 1” which is the name of the button image PBG 211 is received, the process proceeds to step S632.

  In step S632, control remote control signal response processing is performed. In the control remote control signal corresponding processing, as described above, processing according to the received control remote control signal is performed. Here, since the control remote control signal including the information of “number 1” which is the name of button image PBG 211 is received, control unit 610 performs the following processing.

  The control unit 610 refers to the operation metadata D420A of FIG. 41 and performs control corresponding to “number 1” which is the name of the button image PBG211. That is, the control unit 610 accesses the URL “http://www.bb.ne.jp/1234aa01.html” via the Web. The server that is accessed via the Web is, for example, the service server 800A.

  By performing the above processing, the service server 800A accessed via the Web can count the number of accesses, for example, to count questionnaires. That is, by using an operation panel image corresponding to interactive content, a user can participate in a plan such as a questionnaire conducted in a program.

  Note that the content received by the video display device 600 may be 3D content. As an example, the 3D content is assumed to be the 3D content 3DG of FIG.

  Next, processing when the video display device 600 receives 3D content 3DG will be described.

  Since the processing up to the processing in step S511 is the same as described above, detailed description will not be repeated.

  First, in step S512, it is determined by the interface operation M that there has been a content acquisition operation for acquiring 3D content 3DG, and the process proceeds to step S513. Since the same processing as described above is performed in step S513, detailed description will not be repeated.

  In video display device 600, the same processing as described above is performed in steps S522 and S523, and therefore detailed description will not be repeated.

  In service server 800A, the same processing as described above is performed in step S542, and therefore detailed description will not be repeated. Here, assuming that the content acquisition request A is received, the process proceeds to step S543.

  In step S543, as described above, control unit 810 transmits content reproduction necessary data to video display device 600. Thereafter, the process of step S543 ends. The content reproduction necessary data includes content basic data D260A in FIG. 42 (A) and time table data D270A in FIG. 42 (B).

  In video display device 600, the same processing as described above is performed in step S524, and therefore detailed description will not be repeated. Thereby, it is assumed that video display device 600 has received content reproduction necessary data including content basic data D260A and time table data D270A.

  In step S525, the same processing as described above is performed. Here, assuming that n is “1”, control unit 610 transmits a period number n data acquisition request for acquiring period number 1 data to service server 800A.

  In service server 800A, the same processing as described above is performed in steps S544 and S544A, and therefore detailed description will not be repeated. Thus, control unit 810 transmits period number 1 data requested by the period number n data acquisition request to video display device 600.

  In video display device 600, the same processing as described above is performed in step S525A, and therefore detailed description will not be repeated. By this processing, the control unit 610 receives the period number 1 data. The period number 1 data is data including 3D content data whose file name is “1234.dt”. The 3D content data included in the period number 1 data includes operation metadata whose file name is “cont1234dd.meta”. Note that the operation metadata is not included in the 3D content data, and may be added. The control unit 610 stores the received operation metadata in the temporary storage unit 622. Here, the operation metadata is, for example, the operation metadata D430 in FIG.

  In video display device 600, the process of step S525B is performed. In step S525B, processing similar to that described above is performed, and therefore detailed description will not be repeated. By this processing, the operation metadata D430 included in the received period number 1 data is transmitted to the communication terminal device 500. Thereafter, the process of step S525B ends.

  In communication terminal device 500, assuming that the first operation metadata is received in step S514, the process proceeds to step S514A.

  In step S514A, processing similar to that described above is performed, and therefore detailed description will not be repeated. When the received operation panel data is operation metadata D430, control unit 510 stores operation panel generation part data (button image data) corresponding to each control in the column “control” in operation metadata D430. The operation panel image is generated by reading out from the unit 620 and arranging the button image in the operation panel image. As described above, the operation panel image generated based on the operation metadata 430 is, for example, the operation panel image PG300 of FIG. Thereby, operation panel generation data for generating the operation panel image is generated.

  Then, control unit 510 performs processing for adding the name of the button image assigned to each control to the operation metadata in association with each control. When the operation metadata is the operation metadata D430, the operation metadata to which the name of the button image is added is the operation metadata D430A in FIG. Thereafter, the process proceeds to step S514B.

  In step S514B, control unit 510 transmits operation metadata D430A as updated operation metadata to video display device 600.

  In video display device 600, when the process of step S525B ends, the process proceeds to step S525C.

  In step S525C, control unit 610 receives operation metadata D430A as updated operation metadata, and stores received operation metadata D430A in temporary storage unit 622. Thereafter, the process proceeds to step S526.

  In communication terminal device 500, when the process of step S514B ends, the process proceeds to step S515. In steps S515 and S516, the same processing as described above is performed, and thus detailed description will not be repeated. By these processes, the operation panel image PG300 is displayed on the display unit 530. Also, the operation determination process B of FIG. 46 is executed.

In video display device 600, the process of step S526 is performed based on FIG.
In step S620, control unit 610 executes content display processing. The content display process is a process performed independently of the content process B and other processes. Thereafter, the process of step S620 ends.

  In the content display process, the control unit 610 displays the 3D content 3DG of FIG. 25 included in the period number n data on the display unit 630 using the VDP 632. And this content display process is complete | finished.

  In operation determination process B, the same process as described above is performed in step S610, and thus detailed description will not be repeated. Here, assuming that there is a display control operation, the process proceeds to step S612. In this case, it is assumed that the display control operation is an interface operation M for pressing the button image PBG 316 whose button image name is “left rotation” in the operation panel image PG 300 displayed on the display unit 530.

  In step S612, the same processing as described above is performed, and thus detailed description will not be repeated. By this processing, a control remote control signal is transmitted to the video display device 600. As described above, here, it is assumed that the display control operation is the interface operation M for pressing the button image PBG 316 whose button image name is “left rotation”. In this case, the control remote control signal is a remote control signal including information of “left rotation” that is the name of the button image PBG 316.

  In content processing B, the same processing as described above is performed in steps S622 and S624, and therefore detailed description will not be repeated. By these processes, the control signal corresponding process B is executed.

  In the control signal corresponding process B, the process of step S630 is performed. In step S630, the above-described processing is performed, and thus detailed description will not be repeated. Here, as an example, assuming that a remote control signal including information of “left rotation” that is the name of the button image PBG 316 is received, the process proceeds to step S632.

  In step S632, control remote control signal response processing is performed. In the control remote control signal corresponding processing, as described above, processing according to the received control remote control signal is performed. Here, since the control remote control signal including the information of “left rotation” which is the name of button image PBG 316 is received, control unit 610 performs the following processing.

  The control unit 610 refers to the operation metadata D430A of FIG. 44 and performs control corresponding to “left rotation” which is the name of the button image PBG316. That is, the control unit 610 performs a process of rotating the 3D content 3DG of FIG. 25 displayed on the display unit 630 by 10 degrees toward the left with respect to the horizontal direction.

  By performing the above processing, 3D content can be rotated, enlarged, and reduced. That is, 3D content can be displayed in various states by user operation.

  Note that the operation panel image used in the present embodiment may be an operation panel image PG400 of FIG. Further, the operation panel image used in the present embodiment may display an equalizer that can freely change the sound quality of music when the received content is music. The operation panel image is not limited to the one described above.

  As described above, in the present embodiment, video display apparatus 600 receives content from service server 800A and also receives operation metadata for operating the content. The video display device 600 transmits the received operation metadata to the communication terminal device 500. Based on the received operation metadata, communication terminal device 500 uses operation panel generation part data (button image data) as template data to generate an operation panel image, and displays the operation panel image on display unit 530. To display. The communication terminal device 500 controls the content displayed on the display unit 630 of the video display device 600 using an operation panel image corresponding to the received content.

  Therefore, also in the present embodiment in which communication terminal device 500 generates an operation panel image, the same effects as in the first embodiment can be achieved. That is, according to the present embodiment, it is possible to control content using an operation panel image suitable for controlling the content. As a result, it is possible to obtain an operation system with a high degree of freedom according to the type of content.

  The embodiment disclosed this time should be considered as illustrative in all points and not restrictive. The scope of the present invention is defined by the terms of the claims, rather than the description above, and is intended to include any modifications within the scope and meaning equivalent to the terms of the claims.

It is a figure which shows the structure of the network system in this Embodiment. It is the figure which showed the external appearance of the communication terminal device from the front. It is the figure which showed the external appearance of the communication terminal device from the left side surface. It is the figure which showed the external appearance of the communication terminal device from the back surface. It is the block diagram which showed the internal structure of the communication terminal device. It is the figure which showed the external appearance of the video display apparatus from the front. It is the block diagram which showed the internal structure of the video display apparatus. It is the block diagram which showed the internal structure of the service server. It is a figure which shows the remote control image as an example. It is a flowchart of a content handling process. It is a figure which shows the list data as an example. It is a figure which shows the list image as an example. It is a figure which shows the list image as an example. It is a figure which shows the content basic data as an example It is a figure which shows the time table data as an example. It is a figure which shows CM table data as an example. It is a figure which shows the operation panel image as an example. It is a figure which shows the operation metadata as an example. It is a figure which shows the synthesized image as an example. It is a flowchart of an operation determination process and a content process. It is a figure which shows the operation panel image as an example. It is a figure which shows the operation metadata as an example. It is a figure which shows the operation panel image as an example. It is a figure which shows the operation metadata as an example. It is a figure which shows the 3D content as an example. It is a figure which shows content basic data and time table data as an example. It is a figure which shows the operation panel image as an example. It is a figure which shows the operation metadata as an example. It is a figure which shows the operation panel image as an example. It is a figure which shows the operation metadata as an example. It is a flowchart of the content handling process A. It is a figure which shows the content basic data as an example. It is a figure which shows the time table data as an example. It is a figure which shows the operation metadata as an example. It is a figure which shows the interface information as an example of a communication terminal device. It is a figure which shows the operation metadata as an example. 5 is a flowchart of an operation determination process A and a content process A. It is a figure which shows the operation metadata as an example. It is a figure which shows the operation metadata as an example. It is a figure which shows the operation metadata as an example. It is a figure which shows the operation metadata as an example. It is a figure which shows content basic data and time table data as an example. It is a figure which shows the operation metadata as an example. It is a figure which shows the operation metadata as an example. It is a flowchart of the content handling process B. 5 is a flowchart of an operation determination process B and a content process B.

Explanation of symbols

  50 communication unit, 70 network, 180, 180A program, 300 remote control, 500 communication terminal device, 510, 610, 810 control unit, 520, 620, 820 storage unit, 530, 630 display unit, 540 input unit, 555, 555A recording Medium, 600 video display device, 800A service server, 800S search server, 800W Web server, 1000 network system.

Claims (8)

A video display system composed of a communication terminal device and a video display device capable of data communication with each other,
The video display device is capable of data communication with a server that distributes content,
The server transmits the content and operation panel data for controlling the content to the video display device,
The video display device
First receiving means for receiving the content and the operation panel data;
First display means for displaying the received content;
First operation means for transmitting the operation panel data corresponding to the content displayed on the first display means to the communication terminal device;
The communication terminal device
Second receiving means for receiving the operation panel data;
Second display means for displaying an operation panel image for controlling the content displayed on the first display means using the operation panel data;
A second transmission means for transmitting a control signal for controlling the content to the video display device by an instruction input to the operation panel image;
The first receiving means receives the control signal;
The video display device
A video display system further comprising control means for controlling the content according to the received control signal. A video display system composed of a communication terminal device and a video display device capable of data communication with each other,
The video display device is capable of data communication with a server that distributes content,
The server transmits the content and operation metadata for controlling the content to the video display device,
The video display device
First receiving means for receiving the content and the operation metadata;
First display means for displaying the received content;
Storage means for storing a plurality of types of operation panel generation part data for generating an operation panel image for controlling the content displayed on the first display means;
Generating means for generating the operation panel image using the operation metadata and one or more operation panel generation part data related to the operation metadata;
First operation means for transmitting operation panel image data to the communication terminal device;
The communication terminal device
Second receiving means for receiving data of the operation panel image;
Second display means for displaying the operation panel image using data of the operation panel image;
A second transmission means for transmitting a control signal for controlling the content to the video display device by an instruction input to the operation panel image;
The first receiving means receives the control signal;
The video display device
A video display system further comprising control means for controlling the content according to the received control signal. A video display device capable of data communication with a communication terminal device provided with a display unit and a server that distributes content and operation metadata for controlling the content,
The video display device
Receiving means for receiving the content and the operation metadata;
Display means for displaying the received content;
Storage means for storing a plurality of types of operation panel generation part data for generating an operation panel image for controlling the content displayed on the display means;
Generating means for generating the operation panel image using the operation metadata and one or more operation panel generation part data related to the operation metadata;
Transmission means for transmitting the operation panel image data to the communication terminal device;
The receiving means receives a control signal for controlling the content by an instruction input to the operation panel image displayed on the display unit of the communication terminal device,
The video display device
A video display device further comprising control means for controlling the content according to the received control signal. A video display system composed of a communication terminal device and a video display device capable of data communication with each other,
The video display device is capable of data communication with a server that distributes content,
The server transmits the content and operation metadata for controlling the content to the video display device,
The video display device
First receiving means for receiving the content and the operation metadata;
First display means for displaying the received content;
First operation means for transmitting the received operation metadata to the communication terminal device;
The communication terminal device
Second receiving means for receiving the operation metadata;
Storage means for storing a plurality of types of operation panel generation part data for generating an operation panel image for controlling the content displayed on the first display means;
Generating means for generating the operation panel image using the operation metadata and one or more operation panel generation part data related to the operation metadata;
Second display means for displaying the operation panel image;
A second transmission means for transmitting a control signal for controlling the content to the video display device by an instruction input to the operation panel image;
The first receiving means receives the control signal;
The video display device
A video display system further comprising control means for controlling the content according to the received control signal. An image display provided with a display unit for transmitting the content and operation metadata for controlling the content received from a server, and controlling the content by receiving a control signal for controlling the content A communication terminal device capable of data communication with the device,
The communication terminal device
Receiving means for receiving operation metadata for controlling the content displayed on the display unit of the video display device;
Storage means for storing a plurality of types of operation panel generation part data for generating an operation panel image for controlling the content displayed on the display unit;
Generating means for generating the operation panel image using the operation metadata and one or more operation panel generation part data related to the operation metadata;
Display means for displaying the operation panel image;
A communication terminal device comprising: a transmission unit configured to transmit a control signal for controlling the content to the video display device by an instruction input to the operation panel image. A video display system composed of a communication terminal device and a video display device capable of data communication with each other,
The video display device is capable of data communication with a server that distributes content,
The server transmits the content and operation data for controlling the content to the video display device,
The video display device
First receiving means for receiving the content and the operation data;
First display means for displaying the received content;
First operation means for transmitting the received operation data to the communication terminal device;
The communication terminal device
Second receiving means for receiving the operation data;
Second display means for displaying an operation panel image for controlling the content displayed on the first display means using the operation data;
A second transmission means for transmitting a control signal for controlling the content to the video display device by an instruction input to the operation panel image;
The first receiving means receives the control signal;
The video display device
A video display system further comprising control means for controlling the content according to the received control signal. Device control including a first control method and a second control method for causing a video display device provided with a first display unit and a communication terminal device provided with a second display unit to perform data communication with each other, respectively. A method,
The video display device is capable of data communication with a server that distributes content,
The server transmits the content and operation data for controlling the content to the video display device,
The first control method includes:
A first receiving step of receiving the content and the operation data;
A first display step of displaying the received content on the first display unit;
A first transmission step of transmitting the received operation data to the communication terminal device;
The second control method includes:
A second receiving step for receiving the operation data;
A second display step of displaying, on the second display unit, an operation panel image for controlling the content displayed on the first display unit using the operation data;
A second transmission step of transmitting a control signal for controlling the content to the video display device by an instruction input to the operation panel image;
The first receiving step receives the control signal,
The first control method includes:
An apparatus control method further comprising a control step of controlling the content in accordance with the received control signal. Receiving a content and operation data for controlling the content; and
A first display step for displaying the received content;
A content control method comprising: a second display step of displaying an operation panel image for controlling the content displayed in the first display step using the operation data.

Images