JP2008072468A - Video display system and communication terminal device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a video display system and a communication terminal device that can materialize speedy selection of desired information. <P>SOLUTION: A video display device displays a first menu for selecting one of a plurality of kinds of first information. The video display device has a display control means for causing a first display means to display a second menu, corresponding to the selected first information, for selecting one of a plurality of kinds of second information instead of the first menu. The communication terminal device displays the first menu. <P>COPYRIGHT: (C)2008,JPO&INPIT

Description

  The present invention relates to a video display system and a communication terminal device, and more particularly to a video display system and a communication terminal device that perform menu display control.

  In recent years, devices conforming to a standard (hereinafter also referred to as inter-device communication standard) for enabling data communication with each other among a plurality of types of devices in a home are becoming widespread. The inter-device communication standard is, for example, a DLNA (Digital Living Network Alliance) standard. Devices conforming to the inter-device communication standard are, for example, a television receiver, an HDD (Hard disk drive) recorder, an audio device, and the like. In addition, a device compliant with the inter-device communication standard is generally connectable to a network such as the Internet via a network device such as a router.

  In addition, home appliances using the infrastructure such as the Internet are emerging. According to the situation, communication line operators have started a service (triple play service) that provides the Internet, telephone, and multi-channel broadcasting in a lump. For example, in a service using FTTH (Fiber To The Home), a monthly fee for a subscriber telephone (metal line) is not required, and multi-channel broadcasting and VOD (Video On Demand) can be used.

  Furthermore, a service (quadruple play service) that collectively provides a mobile communication service to a triple play service is being realized. With the addition of the mobile communication service, the user can connect to a network such as the Internet with a single telephone number / email address anytime and anywhere by carrying a mobile terminal such as a mobile phone. In addition, it is expected that a mobile phone can be easily used as a remote control in the home or accessed from the outside to the home.

  In general, a device that conforms to a communication standard between different devices that can be connected to a network is a device that can be operated by a remote controller. Therefore, it is required to operate a plurality of types of devices that can be operated with a remote controller and can be connected to a network with a single device.

  In JP 2002-135810 A (Patent Document 1), a communication terminal device such as a mobile phone that can be connected to a network such as the Internet and has a very high penetration rate operates a device that can be connected to the network. A technology used as a remote controller for the above (hereinafter also referred to as a first prior art) is disclosed.

  Japanese Patent Laid-Open No. 2001-275173 (Patent Document 2) displays an operation screen corresponding to the type of device to be operated (hereinafter also referred to as an operated device) on the operation side device, A technique for using a device as a remote controller for operating an operated device (hereinafter also referred to as a second prior art) is disclosed.

Japanese Patent Laid-Open No. 2001-136585 (Patent Document 3) discloses a technique (hereinafter referred to as “No. 1”) that transmits information on the arrangement positions of a plurality of hyperlink character strings in a Web page displayed on a television receiver to a remote controller. 3) is also disclosed.
JP 2002-135810 A JP 2001-275173 A JP 2001-136585 A

  Recently, as in the first to third prior arts, a scene in which a communication terminal device such as a mobile phone and a video display device such as a television are used in cooperation is increasing. And the scene which enjoys various services from a content site is also increasing by using said two apparatuses in cooperation. The service is, for example, a service in which a video display device receives content from a content site. In this case, the video display device displays the received content.

  In recent years, the number of contents provided by content sites is becoming enormous. For this reason, for example, content sites have come to provide menus of a plurality of levels so that users can easily search for desired content. The multi-level menu includes, for example, an upper-level menu that displays a list of content genres and a lower-level menu that displays a list of content corresponding to the genre selected in the upper-level menu. Is done.

  When searching for desired content (information) using a menu of a plurality of layers as described above, a genre is selected from a menu of a higher layer and a menu of a lower layer is displayed on one device. If the desired content (information) is not found, the user is again required to perform an operation for displaying a higher-level menu. Therefore, there is a problem that it is difficult to quickly select and display desired content (information). In the first to third prior arts, a technique for solving the above problem is not disclosed.

  The present invention has been made to solve the above-described problems, and an object of the present invention is to provide a video display system capable of quickly selecting desired information.

  Another object of the present invention is to provide a communication terminal device capable of quickly selecting desired information.

  In order to solve the above-described problem, according to one aspect of the present invention, a video display system including a communication terminal device and a video display device capable of data communication with the communication terminal device, the video display device includes: First communication means is provided for displaying a first menu for selecting any one of a plurality of types of first information, and the communication terminal device can select any one of the plurality of types of first information in response to an external instruction input. A first transmission means for transmitting a selection signal for selecting the video signal to the video display device, wherein the video display device includes a first reception means for receiving the selection signal transmitted by the first transmission means, and a received selection signal. Display control means for displaying, on the first display means, a second menu for selecting any one of a plurality of types of second information corresponding to the selected first information, and the first menu Through And a second transmission means for transmitting to the terminal device, wherein the communication terminal apparatus receives a first menu transmitted by the second transmission means, and a second display for displaying the received first menu. Means.

  According to another aspect of the present invention, there is provided a communication terminal device capable of data communication with a video display device provided with a display unit for displaying information, the communication terminal device comprising: a display means for displaying information; First input receiving means for receiving instruction input, second input receiving means for receiving instruction input from the outside, and a first menu for selecting one of a plurality of types of first information on the display unit of the video display device Is displayed, a first process for transmitting a selection signal for selecting one of a plurality of types of first information to the video display device in response to an instruction input received by the first input receiving means, and a selection A second menu for selecting one of a plurality of types of second information corresponding to the first information selected by the signal is displayed on the display unit of the video display device, and the first menu is displayed on the display means. If In accordance with an instruction input by the second input receiving unit received, and transmitting means for performing a second process of transmitting a selection signal for selecting either the first information of a plurality of types to the video display device.

  Preferably, the display unit also operates as a second input receiving unit.

  The video display system according to the present invention includes a communication terminal device and a video display device. The video display device includes first display means for displaying a first menu for selecting any one of a plurality of types of first information. The video display device displays a second menu for selecting any one of a plurality of types of second information corresponding to the selected first information on the first display unit instead of the first menu. Is further provided. The communication terminal device further includes second display means for displaying the first menu.

  Therefore, a first menu for selecting one of the plurality of types of first information and a second menu for selecting any of the plurality of types of second information corresponding to the selected first information. Since the images are displayed by a plurality of different devices, the desired information can be quickly selected.

  In the communication terminal device according to the present invention, when a first menu for selecting any one of a plurality of types of first information is displayed on the display unit of the video display device, the instruction received by the first input receiving unit In response to the input, a first process for transmitting a selection signal for selecting one of a plurality of types of first information to the video display device, and a plurality of types of second information corresponding to the selected first information When the second menu for selecting one is displayed on the display unit of the video display device and the first menu is displayed on the display means, according to the instruction input received by the second input receiving means, Transmitting means for performing a second process of transmitting a selection signal for selecting any one of the plurality of types of first information to the video display device.

  Therefore, the first menu for selecting any one of the plurality of types of first information and the second menu for selecting any one of the plurality of types of second information are displayed on different devices. In addition, operations for the first menu and the second menu can be performed by a plurality of different input receiving means. As a result, there is an effect that desired information can be quickly selected.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings. In the following description, the same parts are denoted by the same reference numerals. Their names and functions are also the same. Therefore, detailed description thereof will not be repeated.

  The content handled in the present invention intends digital data such as video, audio, and images and related information related thereto. As a matter of course, the content is not limited to digital data as long as it is handled in the same manner as the above content. In addition, if the content is provided via a network such as a television broadcast, an Internet broadcast, or a mobile phone network, one content can be provided from a plurality of networks.

<First Embodiment>
(System configuration)
FIG. 1 is a diagram illustrating a configuration of a network system 1000 according to the present embodiment. With reference to FIG. 1, a network system 1000 includes a home network 501.

  Home network 501 is, for example, a network provided in a home. The home is, for example, a user's home, a company, or the like. Home network 501 includes communication terminal device 500, video display device 600, and communication unit 50.

  Communication terminal device 500 is a PDA (Personal Digital Assistance). Communication terminal device 500 has a telephone function. Communication terminal device 500 may not have a telephone function. Communication terminal device 500 is not limited to a PDA, and may be any device (for example, a PC (Personal Computer) or a mobile phone) as long as it has a communication function and is portable.

  The communication terminal device 500 can perform data communication with the telephone network 60 by radio. The telephone network 60 is a telephone network for mobile phones, for example. Note that when the communication terminal device 500 performs data communication with the telephone network 60, a packet fee corresponding to the amount of data used at the time of data communication is generated.

  The video display device 600 is a liquid crystal television. The video display device 600 is not limited to a liquid crystal television, and may be any device that can display an image. Video display device 600 may be, for example, a plasma television. The video display device 600 may be a device that includes a display device for displaying an image and an image data transmission device that transmits image data to be displayed on the display device. The image data transmitting device is, for example, an STB (Set Top Box), HDD recorder, DVD (Digital Versatile Disc) recorder, or the like.

  Communication terminal device 500 and video display device 600 perform data communication wirelessly or by wire. That is, the communication terminal device 500 and the video display device 600 constitute a video display system.

  The communication unit 50 has a function of performing data communication with each of the communication terminal device 500, the video display device 600, and the network 70. The network 70 is an external network such as the Internet.

  The communication unit 50 has a function of performing data communication simultaneously with a plurality of devices by using a wireless technology based on any one of IEEE802.11a, IEEE802.11b, and IEEE802.11g, which are wireless LAN standards. Note that the radio technology is not limited to a technology based on any of IEEE 802.11a, IEEE 802.11b, and IEEE 802.11g, and may be other radio technologies. Therefore, communication unit 50 can perform data communication with each of communication terminal device 500, video display device 600, and network 70 wirelessly.

  The communication unit 50 further has a communication interface using Ethernet (registered trademark). When a device in the home network 501 issues a connection request to the network 70, the address of the device is set in the network 70. It has a router function including a NAT (Network Address Translation) function for converting addresses. Therefore, the communication unit 50 can perform data communication with each of the communication terminal device 500, the video display device 600, and the network 70, for example, via a LAN cable. That is, the communication unit 50 can perform data communication with each of the communication terminal device 500, the video display device 600, and the network 70 by wire.

  The network 70 can perform data communication with the telephone network 60 by radio or wire. Therefore, the communication terminal device 500 can perform data communication with the network 70 via the telephone network 60.

  Network system 1000 further includes service server 800A, search server 800S, and Web server 800W.

  The service server 800A is a server that provides content, information related to the content, and the like. The content is, for example, a moving image or music data. For example, when the content is a moving image of a program, the information related to the content is, for example, program information. Service server 800A is a PC. The service server 800A is not limited to a PC, and any device can be used as long as it has a function of providing content such as moving images, content such as music data, information related to the content, and the like. May be.

  The service server 800A records all the programs of all the channels in the period from the current date and time to the date and time before a predetermined period (for example, 24 hours), and stores recorded data obtained by recording the program. Service server 800A automatically deletes recorded data after a predetermined period (for example, 24 hours) from the current date and time. Therefore, the service server 800A stores the recording data of all the programs of all the channels in the period from the current date and time to the date and time before the predetermined period. The service server 800A stores video content such as a movie to be distributed in response to a distribution request from the apparatus, separately from the recording data of the broadcast program. If there is a recording data distribution request, the service server 800A transmits or performs streaming distribution of the recording data requested to be distributed to the apparatus that has requested the recording data distribution.

  Further, the service server 800A stores in advance a program currently being broadcast and moving image data scheduled to be broadcast for a predetermined period (for example, 24 hours). If there is a distribution request for moving image data of a program that is currently being broadcast, the distribution-requested moving image data is streamed to the apparatus that has requested the distribution of moving image data.

  When receiving a keyword as search information from a terminal device connected to the network 70, the search server 800S searches a URL (Uniform Resource Locator) of a Web page for information related to the received keyword. The search server 800S is a PC. The search server 800S is not limited to a PC, and when receiving a keyword from a terminal device connected to the network 70, the search server 800S searches for a URL (Uniform Resource Locator) of a Web page of information related to the received keyword. Any device having a function may be used.

  Web server 800W is a server that provides data of a plurality of Web pages corresponding to each of a plurality of types of information. Web server 800W provides data of a plurality of Web pages corresponding to information related to a movie, for example. Web server 800W is a PC. Web server 800W is not limited to a PC, and may be any device that has a function of providing data of a plurality of Web pages corresponding to each of a plurality of types of information.

  Each of service server 800A, search server 800S, and Web server 800W performs data communication with network 70 in a wireless or wired manner.

  In the present embodiment, it is assumed that communication unit 50 can perform high-speed data communication with each of communication terminal device 500, video display device 600, and network 70. The communication unit 50 is assumed to be capable of data communication with each of the communication terminal device 500, the video display device 600, and the network 70, for example, at a maximum speed of 100 Mbps (Mega bit per second).

  In addition, it is assumed that the network 70 can perform high-speed data communication with each of the communication unit 50, the telephone network 60, the service server 800A, the search server 800S, and the Web server 800W. It is assumed that the network 70 can perform data communication with each of the communication unit 50, the telephone network 60, the service server 800A, the search server 800S, and the Web server 800W, for example, at a maximum speed of 100 Mbps. Therefore, for example, it is assumed that the maximum speed of data communication between the video display device 600 and the network 70 is 100 Mbps. For example, it is assumed that the maximum speed of data communication between the communication terminal device 500 and the network 70 is 100 Mbps.

  It is assumed that the data communication speed between communication terminal device 500 and telephone network 60 is slower than the data communication speed between communication terminal device 500 and network 70. Assume that the maximum speed of data communication between communication terminal device 500 and telephone network 60 is, for example, 256 kbps.

Further, it is assumed that the data communication speed between the communication terminal device 500 and the video display device 600 is sufficiently higher than the data communication speed between the communication terminal device 500 and the telephone network 60. It is assumed that the maximum speed of data communication between the communication terminal device 500 and the video display device 600 is 4 Mbps, for example.
(Communication terminal device)
Next, the communication terminal device 500 will be described in detail.

  FIG. 2 is a diagram showing the external appearance of the communication terminal device 500 from the front. Referring to FIG. 2, communication terminal device 500 includes a display unit 530, an audio output unit 570, an LED 576, and an input unit 540.

  The display unit 530 has a function of displaying characters, images, and the like. The display unit 530 is a device using any one of an LCD panel (Liquid Crystal Display Panel), an FED panel (Field Emission Display Panel), and an organic EL display panel (Organic Electroluminescence Display Panel). Note that the display unit 530 may be a device using a panel of a display method other than the above.

  The resolution of the display unit 530 is horizontal 480 (dots) × vertical 640 (dots). The resolution of the display unit 530 is not limited to horizontal 480 (dots) × vertical 640 (dots), and may be another resolution (for example, horizontal 240 (dots) × vertical 320 (dots)). .

  The display unit 530 has a touch panel function that allows the user to input information by directly touching the screen. Display unit 530 transmits the position information of the user touching the screen to control unit 510 described later. Control unit 510 performs predetermined processing based on the received position information.

  The voice output unit 570 has a function of outputting the voice of the telephone. Audio output unit 570 includes a speaker that outputs audio. The audio output unit 570 outputs audio based on audio data received from the control unit 510 described later from the speaker.

  The LED 576 performs light notification according to processing performed in the communication terminal device 500. For example, the LED 576 blinks light when an incoming call is received.

  The input unit 540 includes a button group 541. The button group 541 includes direction buttons 541A, 541B, 541C, 541D, and an enter button 541E. The direction buttons 541A, 541B, 541C, and 541D are displayed when the image is displayed on the display unit 530 by a short time (for example, less than 1 second) pressing operation (hereinafter also referred to as a short pressing operation) by the user. This is a button for moving an object to be moved (for example, a cursor) vertically and horizontally. Specifically, the direction buttons 541A, 541B, 541C, and 541D in which a short press operation has been performed are buttons for moving the cursor up, down, left, and right, respectively, for example. In addition, the direction buttons 541A, 541B, 541C, and 541D can be operated by pressing the user for a long time (for example, one second or longer) (hereinafter, also referred to as a long press operation), for example, to move the screen up, down, left, or right, respectively. It is also possible to scroll the screen.

  The determination button 541E is a button for determining an item or the like selected by a short press operation of the direction buttons 541A, 541B, 541C, 541D, for example.

  Input unit 540 further includes function buttons 542A, 542B, 543A, and 543B. Each of the function buttons 542A and 542B is a button for starting a program or the like preset by the user, for example, by a short press operation.

  The function button 543A is a button for starting a call by a short press operation when a call is made to the communication terminal device 500. The function button 543B is a button for ending the call by a short press operation when the communication terminal device 500 is in a call. The function button 543B is a button for switching the power of the communication terminal device 500 on and off by a user's long-time (for example, 1 second or longer) pressing operation (hereinafter also referred to as a long pressing operation). is there.

  The input unit 540 transmits a button signal corresponding to a short-pressed or long-pressed button among a plurality of buttons included in the input unit 540 to the control unit 510 described later. That is, the input unit 540 is an interface for the user to operate the communication terminal device 500. Hereinafter, an operation of the input unit 540 or a touch operation on the display unit 530 by the user is also referred to as an interface operation M.

  Communication terminal device 500 further includes a voice input unit 574. The voice input unit 574 has a function of inputting voice during a call. The voice input unit 574 includes a microphone for inputting voice. The voice input unit 574 converts voice acquired by the microphone into voice data, and transmits the voice data to the control unit 510 described later in the communication terminal device 500.

  FIG. 3 is a diagram showing an appearance of the communication terminal device 500 from the left side. Referring to FIG. 3, communication terminal apparatus 500 includes a recording medium insertion unit 550A. The recording medium insertion unit 550A is a part that inserts a recording medium, which will be described later, into the communication terminal device 500.

  FIG. 4 is a diagram showing the appearance of the communication terminal device 500 from the back. With reference to FIG. 4, communication terminal apparatus 500 further includes an audio output unit 572 and an imaging unit 578. The audio output unit 572 has a function of outputting audio corresponding to processing performed by the control unit 510 described later. The sound output unit 572 includes a speaker that outputs sound. The audio output unit 572 outputs audio based on audio data received from the control unit 510 described later from the speaker.

  The imaging unit 578 has a function of performing an imaging process for imaging a subject to be imaged. The imaging unit 578 includes an imaging lens, a light receiving unit, and a color filter unit (not shown). The light receiving unit has a function of converting input light into an electrical signal. The light receiving unit is composed of a plurality of light receiving elements. The light receiving element is an element using, for example, a CCD (Charge Coupled Device) image sensor or a CMOS (Complementary Metal Oxide Semiconductor) image sensor.

  The color filter unit is composed of a plurality of color filters. The color filter is a filter corresponding to each of R, G, and B. The plurality of color filters are provided corresponding to the plurality of light receiving elements, respectively.

  The following processing is performed in the imaging processing. First, the imaging unit 578 inputs light reflected by the subject to be imaged and incident on the imaging lens to the light receiving unit via the color filter unit. The light receiving unit converts the input light into an electrical signal. The imaging unit 578 converts the converted electrical signal into digital data (hereinafter also referred to as captured image data).

  FIG. 5 is a block diagram showing an internal configuration of communication terminal apparatus 500. FIG. 5 also shows a recording medium 555 for explanation. A recording medium 555 stores a program 180 described later. That is, the program 180 is recorded on a medium or the like and distributed as a program product. The recording medium 555 is also distributed as a program product.

  Referring to FIG. 5, communication terminal apparatus 500 further includes a control unit 510, a temporary storage unit 522, and a storage unit 520.

  The storage unit 520 has a function of storing data in a nonvolatile manner. The storage unit 520 is accessed by the control unit 510. The storage unit 520 is a medium (for example, a flash memory) that can hold data in a nonvolatile manner even when power is not supplied. The storage unit 520 stores a program 180, recording data to be described later, various other data, and the like. The program 180 includes a remote control program described later.

  Control unit 510 has a function of performing various types of processing, arithmetic processing, and the like for each unit in communication terminal device 500 in accordance with program 180 stored in storage unit 520. The controller 510 may be any of a microprocessor, a field programmable gate array (FPGA), an application specific integrated circuit (ASIC), a digital signal processor (DSP), and other circuits having arithmetic functions.

  Temporary storage unit 522 is accessed as data by control unit 510 and used as a work memory for temporarily storing data. The temporary storage unit 522 includes a RAM (Random Access Memory), an SRAM (Static Random Access Memory), a DRAM (Dynamic Random Access Memory), an SDRAM (Synchronous DRAM), a DDR-SDRAM (Double Data Rate SDRAM), and an RDRAM (Rambus Dynamic Random). (Access Memory (registered trademark)), Direct-RDRAM (Direct Rambus Dynamic Random Access Memory (registered trademark)), or any other circuit having a configuration capable of storing and storing data in a volatile manner.

  Communication terminal device 500 further includes an antenna 502, a tuner 505, and a data processing unit 507.

  The antenna 502 is connected to the tuner 505. The tuner 505 receives a broadcast signal having a frequency instructed by the control unit 510 via the antenna 502. The tuner 505 has a function of receiving broadcast signals based on digital broadcasting and analog broadcasting.

  The broadcast signal includes image data, audio data, text data, and EPG (Electric Program Guide) data. When the broadcast signal is a signal based on digital broadcasting, the broadcast signal further includes BML (Broadcast Markup Language) data and the like. The EPG data is data indicating a plurality of program information. BML data is data for controlling the arrangement position and operation of each of image data, audio data, and text data. The tuner 505 transmits the received broadcast signal to the data processing unit 507.

  The data processing unit 507 demodulates the received broadcast signal to obtain demodulated data. When the received broadcast signal is a signal based on analog broadcast, the data processing unit 507 performs the following processing. First, the data processing unit 507 decodes the demodulated data to obtain image data and audio data, and obtains text data and EPG data from a vertical blanking interval (VBI) of the broadcast signal.

  When the data processing unit 507 receives a display instruction for causing the display unit 530 to display an image from the control unit 510, the data processing unit 507 transmits the image data to a VDP (Video Display Processor) 532 described later. When receiving the image data, the VDP 532 displays an image (moving image or still image) based on the image data on the display unit 530.

  In addition, when the data processing unit 507 receives a recording instruction for performing a recording process from the control unit 510, the data processing unit 507 compresses the image data and the audio data and stores the compressed image data and the audio data in the storage unit 520. The recorded data in this case is also referred to as content below. The recorded data is data compressed in MPEG (Moving Picture Experts Group) 4 format. The recorded data is not limited to data compressed in the MPEG4 format, and may be data compressed in another format. Here, other formats include, for example, MPEG1, MPEG2, H.264. H.264 or the like.

  When the received broadcast signal is a signal based on digital broadcast, the data processing unit 507 performs the following processing. First, the data processing unit 507 decodes the demodulated data based on a digital broadcast protocol to obtain decoded data. The decoded data includes image data, audio data, text data, EPG data, and BML data. Image data and audio data included in the decoded data are data compressed in the MPEG4 format. The image data and audio data included in the decoded data are not limited to data compressed in the MPEG4 format, and may be data compressed in other formats. Here, other formats include, for example, MPEG1, MPEG2, H.264. H.264 or the like.

  When the data processing unit 507 receives a display instruction for displaying an image on the display unit 530 from the control unit 510, the data processing unit 507 transmits the image data included in the decoded data of the channel specified by the display instruction to the VDP 532 described later. Send. When receiving the image data, the VDP 532 displays an image (moving image or still image) based on the image data on the display unit 530.

  Further, when receiving a recording instruction for performing a recording process from the control unit 510, the data processing unit 507 stores the decoded data of the channel designated by the recording instruction in the storage unit 520 as the recording data. The recorded data in this case is also referred to as content below. In this case, the recorded data includes image data, audio data, text data, and BML data.

  Communication terminal apparatus 500 further includes VDP 532 and VRAM (Video Random Access Memory) 536.

The VRAM 536 has a function of temporarily storing image data.
Control unit 510 issues a drawing instruction to VDP 532 according to program 180 stored in storage unit 520. The drawing instruction is an instruction for generating an image and causing the display unit 530 to display the image.

  The VDP 532 is connected to the display unit 530. The VDP 532 reads font data, graphic data, and the like from a program 180 (to be described later) in the storage unit 520 in response to a drawing instruction from the control unit 510 and generates an image using the VRAM 536. The VDP 532 reads out the image data stored in the VRAM 536 and causes the display unit 530 to display an image based on the image data.

  Communication terminal device 500 further includes an input unit 540 and a recording medium access unit 550.

  Control unit 510 receives, from input unit 540, a button signal corresponding to a button that has been subjected to a short press operation or a long press operation among the plurality of buttons included in input unit 540. Control unit 510 performs processing according to the received button signal.

  The recording medium access unit 550 can access the recording medium 555 when the recording medium 555 is inserted (attached) to the communication terminal device 500 from the recording medium insertion unit 550A. As a result, the recording medium access unit 550 can read the program 180 from the recording medium 555 on which the program 180 is recorded.

  The program 180 stored in the recording medium 555 is read by the recording medium access unit 550 by the installation process of the control unit 510, and the control unit 510 stores the program 180 in the storage unit 520. The installation processing program is stored in advance in the storage unit 520, and the installation processing is performed by the control unit 510 based on the installation processing program.

  Note that the program 180 may not be installed in the storage unit 520. In this case, control unit 510 reads program 180 stored in recording medium 555 via recording medium access unit 550, and performs predetermined processing based on program 180. The recording medium 555 further records content data and the like. The content data is, for example, music data, moving image data, and the like.

  The recording medium 555 includes a floppy (registered trademark) disk, a CF (Compact Flash (registered trademark)) card, SM (Smart Media (registered trademark)), MMC (Multi Media Card (registered trademark)), and SD (Secure Digital (registered trademark)). (Trademark)) Memory Card, Memory Stick (Registered Trademark), xD Picture Card (Registered Trademark), and non-volatile memory other than the above.

Communication terminal device 500 further includes a communication unit 560 and a communication unit 562.
Communication unit 560 exchanges data with control unit 510. The communication unit 560 has a function of transmitting and receiving data to and from the video display device 600 in a wired or wireless manner.

  The communication unit 560 has a function of a communication interface that performs serial transfer based on the USB (Universal Serial Bus) 1.1 or USB 2.0 standard. Note that the standard of the communication interface for performing serial transfer is not limited to USB 1.1 or USB 2.0, but may be another standard.

  Note that the communication unit 560 may have a function of a communication interface that performs parallel transfer. The communication interface that performs parallel transfer is, for example, an interface that conforms to a Centronics standard or an IEEE 1284 (Institute of Electrical and Electronic Engineers 1284) standard. Further, the communication unit 560 may have a communication interface function based on the IEEE 1394 or SCSI standard.

  Communication unit 560 further has a wireless data communication function. The wireless data communication function has a function of performing data communication wirelessly using Bluetooth (registered trademark). Note that the wireless data communication is not limited to a method using Bluetooth (registered trademark), and may be another communication method using infrared light, for example. Communication unit 560 performs data communication with video display device 600 wirelessly in response to a control instruction from control unit 510.

  Communication unit 562 exchanges data with control unit 510. The communication unit 562 has a function of performing data communication using a wireless technology based on any one of IEEE802.11a, IEEE802.11b, and IEEE802.11g, which are wireless LAN standards. Note that the radio technology is not limited to a technology based on any of IEEE 802.11a, IEEE 802.11b, and IEEE 802.11g, and may be other radio technologies. Therefore, communication unit 562 can perform data communication with communication unit 50 wirelessly.

  The communication unit 562 further has a communication interface function using Ethernet (registered trademark). Therefore, the communication unit 562 can perform data communication with the communication unit 50 via, for example, a LAN cable.

  Therefore, communication terminal device 500 according to the present embodiment can also download a program from network 70 via communication unit 50 and communication unit 562 and store the program in storage unit 520. In this case, the downloaded program is the program 180.

  Control unit 510 performs predetermined processing in accordance with a program (program 180) downloaded from network 70. The download program is stored in advance in the storage unit 520, and the download process is performed by the control unit 510 based on the download program.

Communication terminal device 500 further includes an antenna 564 and a communication unit 566.
The antenna 564 is connected to the communication unit 566. The communication unit 566 has a function of transmitting and receiving a wireless communication signal using the antenna 564. The communication unit 566 receives a wireless communication signal having a frequency designated by the control unit 510 via the antenna 564. The wireless communication signal is a signal including voice data, character data, image data, and the like.

  Communication unit 566 uses antenna 564 to communicate with the nearest base station (not shown) using a wireless communication signal. The nearest base station can communicate with the telephone network 60. Therefore, the communication unit 566 uses the antenna 564 to communicate with the telephone network 60 via the nearest base station using a wireless communication signal. When receiving the wireless communication signal, the communication unit 566 demodulates the wireless communication signal and transmits data based on the demodulated wireless communication signal to the control unit 510. Further, when transmitting a wireless communication signal, the communication unit 566 receives data (for example, audio data) from the control unit 510 and converts the data into a wireless communication signal based on a predetermined protocol. Communication unit 566 then uses antenna 564 to transmit the converted wireless communication signal to telephone network 60 via the nearest base station (not shown).

  The communication unit 566 can also acquire information indicating the position of the base station (hereinafter also referred to as base station position information) by communicating with the nearest base station. The communication unit 566 transmits the acquired base station position information to the control unit 510 in response to a control instruction from the control unit 510. Control unit 510 can roughly grasp the position of communication terminal apparatus 500 based on the received base station position information.

  The communication unit 566 has a GPS (Global Positioning System) function. The GPS function is a function of communicating with the artificial satellite and acquiring information (hereinafter also referred to as GPS position information) of the position (position based on latitude, longitude, altitude, etc.) of the communication terminal device 500. The communication unit 566 acquires GPS position information in response to a control instruction from the control unit 510 and transmits it to the control unit 510.

  Control unit 510 performs data communication with voice output units 570 and 572 and voice input unit 574 described above.

  When control unit 510 transmits audio data to audio output unit 570, audio output unit 570 outputs audio based on the audio data received from control unit 510 from the speaker. When control unit 510 transmits audio data to audio output unit 572, audio output unit 572 outputs audio based on the audio data received from control unit 510 from the speaker.

  When the user utters voice to the microphone included in the voice input unit 574, the voice input unit 574 converts voice acquired by the microphone into voice data, and transmits the voice data to the control unit 510.

  The control unit 510 performs data communication with the LED 576 and the imaging unit 578 described above. The LED 576 emits light based on a control instruction from the control unit 510.

  The imaging unit 578 performs the above-described imaging processing based on a control instruction from the control unit 510 and transmits captured image data to the control unit 510. Upon receiving the captured image data, control unit 510 stores the captured image data in any of temporary storage unit 522, storage unit 520, and recording medium 555.

  Communication terminal device 500 further includes a vibration unit 579. The vibration unit 579 has a function of vibrating the communication terminal device 500 based on a control instruction from the control unit 510. The vibration unit 579 vibrates the communication terminal device 500 based on a control instruction from the control unit 510 when, for example, an incoming call or an e-mail is received.

Communication terminal device 500 further includes RFID 580. The RFID 580 is an integrated circuit based on RFID (Radio Frequency Identification) having a security function such as FeliCa (registered trademark), and communicates with a reading terminal (not shown) in a non-contact manner. The RFID 580 outputs data such as a terminal ID based on a control instruction from the control unit 510.
(Video display device)
Next, the video display device 600 will be described in detail.

  FIG. 6 is a diagram showing the external appearance of the video display device 600 from the front. Referring to FIG. 6, video display device 600 includes a display unit 630 and an audio output unit 670.

  The display unit 630 has a function of displaying characters, images, and the like. The display unit 630 is a device using any one of an LCD panel, a CRT (Cathode Ray Tube), an FED panel, a PDP (Plasma Display Panel), and an organic EL display panel. Note that the display unit 630 may be a device using a panel with a display method other than the above. The size of the image that can be displayed by the display unit 630 is larger than the size of the image that can be displayed by the display unit 530. Further, the resolution of the display unit 630 is larger than the resolution of the display unit 530. For example, the resolution of the display unit 630 is a resolution of horizontal 1366 (dots) × vertical 768 (dots) at which a PC image can be displayed. The resolution of the display unit 630 is not limited to horizontal 1366 (dots) × vertical 768 (dots), but may be other resolutions (for example, 1024 × 768). The aspect ratio of the display unit 630 displaying the video is 16: 9. The aspect ratio is not limited to 16: 9, and may be 4: 3, for example.

  The audio output unit 670 has a function of outputting audio corresponding to processing performed by the control unit 610 described later. Audio output unit 670 includes a speaker that outputs audio. The audio output unit 670 outputs audio based on audio data received from the control unit 610 described later from the speaker.

  FIG. 7 is a block diagram showing an internal configuration of the video display device 600. FIG. 7 also shows a recording medium 555A for explanation. A recording medium 555A records a program 180A described later. That is, the program 180A is recorded on a medium or the like and distributed as a program product. The recording medium 555A is also distributed as a program product.

  Referring to FIG. 7, video display device 600 further includes a control unit 610, a temporary storage unit 622, and a storage unit 620.

  The storage unit 620 has a function of storing data in a nonvolatile manner. The storage unit 620 is accessed by the control unit 610. The storage unit 620 is a hard disk capable of storing a large amount of data. Note that the storage unit 620 is not limited to a hard disk, and may be any medium (for example, a flash memory) that can hold data in a nonvolatile manner even when power is not supplied. The storage unit 620 stores a program 180A, recording data to be described later, a device ID for identifying the video display device 600, other various data, and the like.

  Control unit 610 has a function of performing various types of processing, arithmetic processing, and the like for each unit in video display device 600 in accordance with program 180A stored in storage unit 620. Since control unit 610 is similar to control unit 510 described above, detailed description will not be repeated.

  The temporary storage unit 622 is used as a work memory that is accessed by the control unit 610 and temporarily stores data. Since temporary storage unit 622 is similar to temporary storage unit 522 described above, detailed description thereof will not be repeated.

  The video display device 600 further includes an antenna 602, a tuner 605, and a data processing unit 607.

  The antenna 602 is connected to the tuner 605. The tuner 605 receives a broadcast signal having a frequency instructed by the control unit 610 via the antenna 602. The tuner 605 has a function of receiving broadcast signals based on digital broadcasting and analog broadcasting.

  The broadcast signal includes image data, audio data, text data, and EPG data. When the broadcast signal is a signal based on digital broadcasting, the broadcast signal further includes the BML data described above. The tuner 605 transmits the received broadcast signal to the data processing unit 607.

  The data processing unit 607 demodulates the received broadcast signal to obtain demodulated data. When the received broadcast signal is a signal based on analog broadcast, the data processing unit 607 performs the following processing. First, the data processing unit 607 decodes the demodulated data, acquires image data and audio data, and acquires text data and EPG data from the vertical blanking interval of the broadcast signal.

  When the data processing unit 607 receives a display instruction for displaying an image on the display unit 630 from the control unit 610, the data processing unit 607 transmits the image data to the VDP 632 described later. When receiving the image data, the VDP 632 displays an image (moving image or still image) based on the image data on the display unit 630.

  In addition, when the data processing unit 607 receives a recording instruction for performing a recording process from the control unit 610, the data processing unit 607 compresses the image data and the audio data, and stores them in the storage unit 620 as recorded data. The recorded data is data compressed in the MPEG2 format. The recorded data is not limited to data compressed in the MPEG2 format, and may be data compressed in another format. Here, other formats include, for example, MPEG1, H.264, and the like. H.264 or the like.

  When the received broadcast signal is a signal based on digital broadcast, the data processing unit 607 performs the following processing. First, the data processing unit 607 decodes the demodulated data based on the digital broadcasting standard to obtain decoded data. The decoded data includes image data, audio data, text data, EPG data, and BML data. Image data and audio data included in the decoded data are data compressed in the MPEG2 format. The image data and audio data included in the decoded data are not limited to data compressed in the MPEG2 format, and may be data compressed in other formats. Here, other formats include, for example, MPEG1, H.264, and the like. H.264 or the like.

  When the data processing unit 607 receives a display instruction for causing the display unit 630 to display the image data from the control unit 610, the data processing unit 607 converts the image data included in the decoded data of the channel designated by the display instruction into a VDP 632 described later. Send to. When receiving the image data, the VDP 632 displays an image (moving image or still image) based on the image data on the display unit 630.

  Hereinafter, an image based on a broadcast signal received by the tuner 605 and displayed on the display unit 630 is also referred to as a TV image. Note that the number of types of TV image channels that can be directly selected by pressing the numeric buttons “1” to “12” provided on the remote controller 300 to be described later for operating the video display device 600 is as follows. Assume that the maximum is 12. As a matter of course, the more number buttons provided on the remote controller 300, the larger the number of TV image channel types that can be directly selected.

  Remote control channel numbers “1” to “12” are set in the numeric buttons “1” to “12” of the remote control 300, respectively. For example, the remote control channel number “3” is set to the numeric button “3”. One TV image channel can be registered in one remote control channel number. For example, it is assumed that the TV image channel number “8” is registered for the remote control channel number “1”. In this case, the numeric button “1” of the remote controller 300 is pressed by the user, so that a remote control signal for selecting a TV image of the channel number “8” is transmitted from the remote controller 300 to the video display device 600. Sent.

  Note that the video display device 600 has a function of simultaneously displaying a plurality of types of TV images on the display unit 630. In addition, the video display device 600 has a function of simultaneously displaying a TV image and other types of images on the display unit 630.

  In addition, when the data processing unit 607 receives a recording instruction for performing a recording process from the control unit 610, the data processing unit 607 causes the storage unit 620 to store the decoded data of the channel designated by the recording instruction as the recording data. The recorded data in this case is also referred to as content below. In this case, the recorded data includes image data, audio data, text data, and BML data.

The video display device 600 further includes a VDP 632 and a VRAM 636.
The VRAM 636 has a function of temporarily storing image data.

  The control unit 610 issues a drawing instruction to the VDP 632 according to the program 180A stored in the storage unit 620. The drawing instruction is an instruction for generating an image and causing the display unit 630 to display the image.

  The VDP 632 is connected to the display unit 630. In response to a drawing instruction from the control unit 610, the VDP 632 reads font data, graphic data, and the like from a program 180A described later in the storage unit 620, and generates an image using the VRAM 636. The VDP 632 reads out the image data stored in the VRAM 636 and causes the display unit 630 to display an image based on the image data.

  The video display device 600 further includes an input unit 640 and a recording medium access unit 650.

  Input unit 640 includes a plurality of buttons (not shown). The plurality of buttons are provided outside the video display device 600. When any one of the buttons is pressed by the user, the input unit 640 transmits a button signal corresponding to the pressed button to the control unit 610. Control unit 610 performs predetermined processing based on the received button signal. Hereinafter, the button operation of the input unit 640 by the user is also referred to as an interface operation T.

  The recording medium access unit 650 has a function of reading the program 180A from the recording medium 555A on which the program 180A is recorded. The program 180A stored in the recording medium 555A is read by the recording medium access unit 650 by the installation process of the control unit 610, and the control unit 610 stores the program 180A in the storage unit 620. The installation processing program is stored in advance in the storage unit 620, and the installation processing is performed by the control unit 610 based on the installation processing program.

  Note that the program 180A may not be installed in the storage unit 620. In this case, control unit 610 reads program 180A stored in recording medium 555A via recording medium access unit 650, and performs predetermined processing based on program 180A. Content data and the like are also recorded on recording medium 555A. The content data is, for example, music data, moving image data, and the like.

  The recording medium 555A includes Blu-ray Disc (registered trademark), HD-DVD (High-Definition Digital Versatile Disc) (registered trademark), DVD-ROM (Digital Versatile Disk Read Only Memory), DVD-R (Digital Versatile Disk Recordable). ), DVD-RAM (Digital Versatile Disk Random Access Memory), DVD + RW (Digital Versatile Disk Re-Writable), DVD-RW, CD-ROM (Compact Disk Read Only Memory), MO (Magneto Optical Disk), floppy (registered trademark) ) Disk, CF card (registered trademark), SM (Smart Media (registered trademark)), MMC (registered trademark), SD memory card (registered trademark), Memory Stick (registered trademark), xD picture card, USB memory, magnetic tape and Any non-volatile memory other than those described above may be used.

Video display device 600 further includes a communication unit 660 and a communication unit 662.
Communication unit 660 exchanges data with control unit 610. The communication unit 660 has a function of transmitting / receiving data to / from the communication terminal device 500 in a wired or wireless manner. Communication unit 660 has the same configuration and function as communication unit 560 described above, and therefore detailed description will not be repeated.

  Communication unit 662 transmits / receives data to / from control unit 610. Since communication unit 662 has the same configuration and function as communication unit 562 described above, detailed description will not be repeated. Therefore, communication unit 662 can perform data communication with communication unit 50 wirelessly. Communication unit 662 can perform data communication with communication unit 50 via, for example, a LAN cable.

  Therefore, video display apparatus 600 according to the present embodiment can also download a program from network 70 via communication unit 50 and communication unit 662 and store the program in storage unit 620. In this case, the downloaded program is the program 180A.

  Control unit 610 performs predetermined processing in accordance with a program (program 180A) downloaded from network 70. The download program is stored in advance in the storage unit 620, and the download process is performed by the control unit 610 based on the download program.

  Video display device 600 further includes a remote control signal receiver 680. The remote control signal receiving unit 680 has a function of receiving a remote control signal for operating the video display device 600 output from the remote control (remote controller) 300. Remote control signal receiving unit 680 transmits the received remote control signal to control unit 610. Control unit 610 performs corresponding processing in accordance with the received remote control signal. As described above, the remote controller 300 is provided with numeric buttons “1” to “12” for selecting a TV image. Hereinafter, the operation of the remote controller 300 by the user is also referred to as an interface operation T.

  In addition, it can be assumed that the above-described communication terminal device 500 has the function of the remote controller 300, and there can be assumed a case where there are two communication terminal devices 500 and a remote controller 300 and a case where only one of them exists.

The control unit 610 performs data communication with the voice output unit 670 described above. When control unit 610 transmits audio data to audio output unit 670, audio output unit 670 outputs audio based on the audio data received from control unit 610 from the speaker.
(Service server, search server and Web server)
FIG. 8 is a block diagram showing the internal configuration of the service server 800A. Referring to FIG. 8, service server 800A includes a display unit 830, a control unit 810, a temporary storage unit 822, and a storage unit 820.

  The display unit 830 has a function of displaying characters, images, and the like. Since display unit 830 is similar to display unit 630 described above, detailed description will not be repeated.

  The storage unit 820 has a function of storing data in a nonvolatile manner. The storage unit 820 is accessed by the control unit 810. The storage unit 820 is a hard disk capable of storing a large amount of data. Note that the storage unit 820 is not limited to a hard disk, and may be any medium (for example, a flash memory) that can hold data in a nonvolatile manner even when power is not supplied. The storage unit 820 stores a program 180B, recording data, content data, various other data, and the like.

  Control unit 810 has a function of performing various types of processing, arithmetic processing, and the like for each unit in service server 800A in accordance with program 180B stored in storage unit 820. Since control unit 810 is similar to control unit 510 described above, detailed description will not be repeated.

  The temporary storage unit 822 is accessed as data by the control unit 810, and is used as a work memory that temporarily stores data. Since temporary storage unit 822 is similar to temporary storage unit 522 described above, detailed description thereof will not be repeated.

Service server 800A further includes a VDP 832 and a VRAM 836.
The VRAM 836 has a function of temporarily storing image data.

  The control unit 810 issues a drawing instruction to the VDP 832 in accordance with the program 180B stored in the storage unit 820. The drawing instruction is an instruction for generating an image and causing the display unit 830 to display the image.

  The VDP 832 is connected to the display unit 830. In response to a drawing instruction from the control unit 810, the VDP 832 reads font data, graphic data, and the like from a program 180B described later in the storage unit 520, and generates an image using the VRAM 836. The VDP 832 reads out the image data stored in the VRAM 836 and causes the display unit 830 to display an image based on the image data.

Service server 800A further includes an input unit 840.
A mouse 842 and a keyboard 844 are connected to the input unit 840. The user uses the mouse 842 or the keyboard 844 to give an instruction to the service server 800A. An input instruction from the mouse 842 or the keyboard 844 is transmitted to the control unit 810 via the input unit 840. Control unit 810 performs predetermined processing based on an input instruction from input unit 840.

The service server 800A further includes a communication unit 860 and a communication unit 862.
The communication unit 860 performs data transmission / reception with the control unit 810. The communication unit 860 has a function of transmitting and receiving data to and from other devices not shown in a wired or wireless manner. Communication unit 860 has the same configuration and function as communication unit 560 described above, and therefore detailed description will not be repeated.

  Communication unit 862 transmits and receives data to and from control unit 810. Since communication unit 862 has the same configuration and function as communication unit 562 described above, detailed description will not be repeated. Accordingly, the communication unit 862 can perform data communication with the network 70 wirelessly. The communication unit 862 can perform data communication with the network 70 via, for example, a LAN cable.

  Each of search server 800S and Web server 800W has the same configuration as that of service server 800A described above, and thus detailed description will not be repeated.

Next, processing for using communication terminal device 500 as a remote controller for operating video display device 600 (hereinafter also referred to as a display device remote controller) will be described. When control unit 510 executes a remote control program of program 180 by interface operation M, communication terminal device 500 can be used as a display device remote control. In this case, the following remote control image MG100 is displayed on display unit 530.
(Remote controller)
FIG. 9 is a diagram showing a remote control image MG100 as an example. Referring to FIG. 9, button images MBG110, MBG120, and MBG130 are arranged in remote control image MG100.

  Each of the button images MBG110, MBG120, and MBG130 is pressed by the interface operation M, so that the control unit 510 transmits a corresponding remote control signal described later to the video display device 600 using the communication unit 560. It is a button image for doing.

  The button image MBG110 is a button image for transmitting a power supply remote control signal to the video display device 600 by being pressed by the interface operation M. Here, the video display device 600 has a standby mode. The standby mode is a state in which the display unit 630 cannot display an image because the power for displaying an image on the display unit 630 is off, and the main power is not off. That is, the standby mode is a state in which no image is displayed on the display unit 630 and the main power supply is not turned off. Hereinafter, a power source for displaying an image on the display unit 630 is also referred to as an image display power source.

  Therefore, when the video display device 600 is in the standby mode, an image can be displayed on the display unit 630 by receiving the power remote control signal and turning on the image display power. In the following, the video display device 600 in which the image display power is on is also referred to as a normal mode. That is, the power supply remote control signal is a remote control signal for switching between the standby mode and the normal mode in the video display device 600.

  The button image MBG 120 is a button image for transmitting a program guide display remote control signal to the video display device 600 by being pressed by the interface operation M. The program guide display remote control signal is a remote control signal for causing the display unit 630 of the video display device 600 to display a program guide image to be described later.

  The button image MBG 130 is a button image for transmitting a menu display remote control signal to the video display device 600 by being pressed by the interface operation M. The menu display remote control signal is a remote control signal for causing a display unit 630 of the video display device 600 to display a menu image to be described later.

  In remote control image MG100, button images MBG142, MBG144, MBG152, and MBG154 are further arranged. Each of the button images MBG142, MBG144, MBG152, and MBG154 is pressed by the interface operation M, so that the control unit 510 uses a communication unit 560 to transmit a corresponding remote control signal to be described later to the video display device 600. It is a button image for transmitting to.

  The button image MBG 142 is a button image for transmitting a volume up remote control signal to the video display device 600 by being pressed by the interface operation M. The volume up remote control signal is a remote control signal for increasing the sound output from the audio output unit 670 of the video display device 600. The button image MBG 144 is a button image for transmitting a volume down remote control signal to the video display device 600 by being pressed by the interface operation M. The volume down remote control signal is a remote control signal for reducing the sound output from the audio output unit 670 of the video display device 600.

  The button image MBG 152 is a button image for transmitting a channel plus remote control signal to the video display device 600 by being pressed by the interface operation M. The channel plus remote control signal is a remote control signal for incrementing the remote control channel number by 1 when a TV image is displayed on the display unit 630 of the video display device 600. When the remote control channel number is “12” and the above-described process of incrementing by 1 is performed, the remote control channel number is “1”.

  The button image MBG154 is a button image for transmitting a channel minus remote control signal to the video display device 600 by being pressed by the interface operation M. The channel minus remote control signal is a remote control signal for decrementing the remote control channel number by 1 when a TV image is displayed on the display unit 630 of the video display device 600. When the remote control channel number is “1” and the above decrementing process is performed, the remote control channel number is “12”.

  In remote control image MG100, button images MBG170 and MBG180 are further arranged. Each of the button images MBG 170 and MBG 180 is pressed by the interface operation M so that the control unit 510 transmits a corresponding remote control signal to be described later to the video display device 600 using the communication unit 560. It is a button image.

  The button image MBG 170 is a button image for transmitting a set image display remote control signal to the video display device 600 by being pressed by the interface operation M. The setting image display remote control signal is a remote control signal for causing the display unit 630 of the video display device 600 to display a setting image to be described later. Button image MBG 180 is a button image for transmitting a detailed remote control image display remote control signal to video display device 600 by being pressed by interface operation M. The detailed remote control image display remote control signal is a remote control signal for causing the display unit 630 of the video display device 600 to display a detailed remote control image. The detailed remote control image is an image for transmitting a remote control signal other than a remote control signal frequently used for the video display device 600 to the video display device 600.

Hereinafter, the operation mode of the communication terminal device 500 when the communication terminal device 500 can operate the video display device 600 by transmitting a remote control signal to the video display device 600 is also referred to as a remote control mode.
(Content processing)
Next, processing for displaying content by the video display device 600 (hereinafter also referred to as content handling processing) will be described. Note that the video display device 600 is in a standby mode. As described above, the standby mode is a state in which no image is displayed on the display unit 630 and the main power supply is not turned off. The video display device 600 performs data communication with the communication unit 50 even in the standby mode, and performs the following processing.

  FIG. 10 is a flowchart of the content handling process. FIG. 10 shows processing performed in each of communication terminal device 500 and video display device 600. Before the content handling process is performed, in communication terminal device 500, control unit 510 causes tuner 505 and data processing unit 507 to display an image based on a broadcast signal (hereinafter also referred to as a TV image) on display unit 530. It is assumed that control is performed to display on the screen. Therefore, a TV image is displayed on the display unit 530. The TV image displayed on the display unit 530 is assumed to be a 3-channel TV image as an example. Further, it is assumed that the audio of the TV image displayed on the display unit 530 is output from the audio output unit 572 of the communication terminal device 500.

  The image displayed on display unit 530 is not limited to a TV image, but may be an image based on content received by communication terminal device 500 from service server 800A (hereinafter also referred to as a content image). . In this case, the sound of the content image displayed on the display unit 530 is output from the sound output unit 572 of the communication terminal device 500.

  Referring to FIG. 10, in video display device 600, first, the process of step S120 is performed.

  In step S120, connection signal transmission processing is performed. In the connection signal transmission process, control unit 610 transmits a connection signal using the wireless data communication function. As an example, the wireless data communication function is assumed to be a communication function using Bluetooth (registered trademark). The connection signal includes the device ID of the video display device 600. Here, the device ID is information for identifying a device (hereinafter also referred to as device identification information). As an example, it is assumed that the device ID of the video display device 600 is “11TA”. As an example, the connection signal transmitted by the above processing is assumed to reach a radius of 10 meters from the installation position of the video display device 600. That is, by the above processing, it is assumed that, for example, a device within a radius of 10 meters (hereinafter also referred to as a connection signal receivable range) from the installation position of the video display device 600 can receive a connection signal. Here, communication terminal apparatus 500 is assumed to be in a power-on state and within a connection signal receivable range. Thereafter, the process of step S120 ends.

In communication terminal device 500, first, the process of step S110 is performed.
In step S110, control unit 510 determines whether or not data communication with video display device 600 is possible. That is, control unit 510 determines whether or not data communication is possible with video display device 600 arranged at a position where communication terminal device 500 and video display device 600 are at or below a predetermined distance. Specifically, control unit 510 determines whether or not a connection signal has been received. If YES in step S110, the process proceeds to step S111. On the other hand, if NO at step S110, the process at step S110 is performed again. Here, assuming that a connection signal has been received, the process proceeds to step S111. If YES is determined in step S <b> 110, control unit 510 determines that data communication with video display device 600 is possible.

  In step S111, device recognition processing is performed. In device recognition processing, control unit 510 performs processing with reference to the following device specifying data D100. The device specifying data D100 is data for specifying a device based on the received device ID. The device specifying data D100 is stored in the storage unit 520 in advance.

  FIG. 11 is a diagram showing device specifying data D100 as an example. Referring to FIG. 11, device specifying data D100 includes a plurality of device specifying information. In the device identification data D100, the “number” is a number for managing each of the plurality of device identification information. “Device ID” is an ID for specifying (identifying) the device. “Device Name” is the name of the device specified by “Device ID”. For example, the device ID is “11HDR”. The device name is “HDD recorder”.

  Referring to FIG. 10 again, in the device recognition process in step S111, control unit 510 refers to device specifying data D100 stored in storage unit 520, and connects using the device ID included in the received connection signal. Recognize the device name of the device that sent the signal. Here, since the device ID included in the connection signal is “11TA”, control unit 510 recognizes that the device name of the device that transmitted the connection signal is “TV”.

  Then, the control unit 510 uses the VDP 532 to generate the following device recognition image MG200 in which an icon displaying the recognized device name is displayed on the TV image, and displays the generated device recognition image MG200 on the display unit. 530.

  Then, control unit 510 causes LED 576 to emit blue light, for example. For example, blue light indicates a state in which data communication with the video display device 600 is possible. Thereafter, the process of step S111 ends.

  In the present embodiment, the communication state is expressed by the LED, but the expression of the communication state is not limited to the LED. For example, the communication state may be expressed by displaying the communication state in a part of the image displayed on the display unit 530 of the communication terminal device 500.

  FIG. 12 is a diagram showing an apparatus recognition image MG200 as an example. Referring to FIG. 12, device recognition image MG200 is an image in which button image MBG210 as an icon is arranged in a TV image.

  In the button image MBG210, the device name recognized by the control unit 510 is displayed. The button image MBG210 is a button image for transmitting a control start signal as a control signal to the device having the device ID corresponding to the device name by being pressed by the interface operation M. The control start signal is a signal for setting the apparatus in the standby mode to the normal mode. Here, since the device name displayed on the button image MBG210 is “TV”, the corresponding device ID is “11TA”, and the control start signal is transmitted to the video display device 600 by pressing the button image MBG210. The

Referring to FIG. 11 again, after the process of step S111, the process proceeds to step S112.
In step S112, control unit 510 determines whether or not there is a control start operation. The control start operation is an interface operation M for pressing the button image MBG210. If YES in step S112, the process proceeds to step S113. On the other hand, if NO at step S112, the process at step S112 is performed again. Here, assuming that there is a control start operation, the process proceeds to step S113.

  In step S113, control unit 510 transmits a control start signal as a control signal to the device that transmitted the connection signal. Here, since the device that transmitted the connection signal is video display device 600, control unit 510 transmits a control start signal as a control signal to video display device 600. The transmitted control start signal includes content information.

  The content information includes content specifying information and content volume information. The content specifying information is information for specifying the content displayed on the display unit 530. The content volume information is information indicating the sound volume of the content displayed on the display unit 530. It is assumed that the sound volume value of the content displayed on the display unit 530 is expressed by a numerical value of “0” to “20”, for example. When the volume value is “0”, it indicates that the volume of the sound of the content displayed on the display unit 530 is zero.

  Here, it is assumed that a three-channel TV image based on a broadcast signal is displayed on display unit 530. In this case, the content displayed on the display unit 530 is a 3-channel TV image. Therefore, the content specifying information is information indicating three channels. Further, it is assumed that the sound volume value of the TV image displayed on the display unit 530 is “10” as an example. Therefore, the content volume information is information indicating the volume value “10”.

  When a content image based on the content received from service server 800A is displayed on display unit 530, the identification information for specifying the received content is the content specifying information. Further, the sound volume value of the content image becomes the content sound volume information.

  Further, the transmitted control start signal further includes a device ID (“11TA”) included in the received connection signal and a device ID of communication terminal device 500. The device ID of the communication terminal device 500 is assumed to be “11MA” as an example. And the process of step S113 is complete | finished.

In the video display device 600, the process proceeds to step S121 after the process of step S120.
In step S121, control unit 610 determines whether a control start signal including the device ID of the device itself has been received or not. If YES in step S121, the process proceeds to step S122. On the other hand, if NO in step S121, the process of step S120 is performed again after stopping the process for a predetermined time (for example, 10 seconds). That is, control unit 610 transmits a connection signal to devices within the connection signal receivable range at predetermined time intervals until a control start signal is received. Here, assuming that a control start signal including the device ID (“11TA”) of the device itself and the device ID (“11MA”) of communication terminal device 500 has been received, the process proceeds to step S122.

  In step S122, control unit 610 determines whether or not video display device 600 as its own device is in a standby mode. If YES in step S122, the process proceeds to step S123. On the other hand, if NO at step S122, the process proceeds to step S124. Here, assuming that video display device 600 is in the standby mode, the process proceeds to step S123. In addition, when it determines with NO in step S122, it is a case where the video display apparatus 600 is set to normal mode.

  In step S123, control unit 610 turns on the image display power supply described above, and sets video display device 600 to the normal mode. Thereby, an image can be displayed on the display unit 630. Then, the process proceeds to step S124.

  In step S124, content display processing is performed. In the content display process, the control unit 610 causes the display unit 630 to display content based on the content specifying information included in the content information included in the received control start signal using the VDP 632. In addition, the control unit 610 outputs the audio of the content displayed on the display unit 630 from the audio output unit 670 at a volume based on the volume value indicated by the content volume information included in the content information included in the received control start signal. Let

  Here, the content based on the content specifying information displayed on the display unit 630 is a 3-channel TV image based on a broadcast signal. In this case, the control unit 610 also uses the data processing unit 607 to cause the display unit 630 to display a 3-channel TV image based on the broadcast signal. Note that if a three-channel TV image is displayed on the display unit 630 before the process of step S124 is performed, the image displayed on the display unit 630 is not changed.

  The volume value indicated by the content volume information is “10”. Therefore, the sound volume of the content displayed on the display unit 630 and output from the sound output unit 670 is a volume based on the volume value “10” indicated by the content volume information.

  Note that the volume value of the sound of the content displayed on the display unit 630 may not be the same as the volume value “10” indicated by the content volume information. In this case, the sound volume output from the sound output unit 670 of the video display device 600 is k (a natural number equal to or greater than 1 (for example, 2) with respect to the sound volume output from the sound output unit 572 of the communication terminal device 500. )) The volume output from the audio output unit 670 of the video display device 600 is set by the control unit 610 based on the volume value indicated by the content volume information so as to be doubled.

  When the content specifying information is information for identifying the content received from service server 800A, control unit 610 receives the content specified by the content specifying information from service server 800A, and displays it on display unit 630. Display received content. Further, in this case, the control unit 610 causes the audio output unit 670 to output the audio of the content displayed on the display unit 630 at the volume indicated by the content volume information. Then, the process of step S124 ends.

  Through the above processing, the content displayed on the display unit 530 of the communication terminal device 500 can be displayed on the display unit 630 of the video display device 600 with a simple operation. Since the size of the image that can be displayed on the display unit 630 is larger than the size of the image that can be displayed on the display unit 530, the user can comfortably view the content displayed on the display unit 630.

  Further, the volume value of the content displayed on the communication terminal device 500 can be taken over by the content displayed on the video display device 600. For this reason, an effect of eliminating the trouble of adjusting the volume value is obtained.

  Here, it has been described that the sound volume value is taken over, but in addition to this, it can be assumed that information such as channel preset information, audio mode, and screen display mode is taken over.

It progresses to step S125 after the process of step S124.
In step S125, a program transmission process is performed. In the program transmission process, control unit 610 transmits a program corresponding to the device ID of its own device to communication terminal device 500 based on the following program selection data D200. Note that the device ID (“11MA”) of the communication terminal device 500 that is the transmission destination device is added to the transmitted program. Thereafter, the process of step S125 ends.

  FIG. 13 is a diagram showing program selection data D200 as an example. Referring to FIG. 13, program selection data D200 includes a plurality of program selection information. The “number” is a number for managing each of the plurality of program selection information. “Device ID” is an ID for identifying (identifying) a device. “Program name” is the name of a program. A plurality of programs respectively corresponding to a plurality of program names displayed in the program selection data D200 are stored in the storage unit 620 in advance.

  Therefore, when the device ID of the own device is “11TA”, in the program transmission process, control unit 610 transmits the TV operation program to communication terminal device 500. When the TV operation program is executed in communication terminal device 500, operation image MG100A described below is displayed on display unit 530.

  FIG. 14 is a diagram showing an operation image MG100A as an example. Referring to FIG. 14, operation image MG100A is different from remote control image MG100 in FIG. 9 in that button images MBG120, MBG130, MBG170, and MBG180 are not arranged. Other than that, since it is similar to remote control image MG100, detailed description will not be repeated.

  The TV operation program includes data of button images MBG110, MBG142, MBG144, MBG152, and MBG154, information on a plurality of relative coordinate values for arranging the button images MBG110, MBG142, MBG144, MBG152, and MBG154 in the operation image MG100A, Information on the name of the button image is included.

  The button image names of the button images MBG110, MBG142, MBG144, MBG152, and MBG154 are “power”, “volume up”, “volume down”, “channel plus”, and “channel minus”, respectively.

  In the TV operation program, remote control data for generating each of a plurality of remote control signals corresponding to the button images MBG110, MBG142, MBG144, MBG152, and MBG154 and a remote control for generating a remote control signal corresponding to an external button are provided. Data is also included. When any of the button images MBG110, MBG142, MBG144, MBG152, and MBG154 is pressed by the interface operation M when the TV operation program is executed in the communication terminal device 500, the control unit 510 performs the pressing operation. The remote control data corresponding to the button image thus generated is used to generate a remote control signal, and the generated remote control signal is transmitted to the video display device 600.

  The plurality of remote control data corresponding to the button images MBG110, MBG142, MBG144, MBG152, and MBG154 respectively include the power supply remote control signal, the volume up remote control signal, the volume down remote control signal, the channel plus remote control signal, and the channel minus remote control signal. Data to generate.

  Referring to FIG. 10 again, in video display device 600, the process proceeds to step S126 after the process of step S125.

  In step S126, an operation guidance display process is performed. In the operation guidance display process, the control unit 610 uses the VDP 632 to display the following operation guidance display image G100 in which an operation guidance image is displayed in content (for example, a TV image) displayed on the display unit 630. The operation guidance display image G100 is generated and displayed on the display unit 630. Then, the process of step S126 ends.

  Here, it is assumed that the above-described recording process is simultaneously performed on the TV image as the content displayed on the display unit 630. Therefore, the TV image displayed on the display unit 630 can be temporarily stopped to display a still image. When the TV image is paused, the TV image from the location where the TV image is paused (hereinafter also referred to as the pause location) to the current time is recorded, so the TV image up to the current time is recorded. In order to display an image, fast-forward playback from the pause position of the TV image to the location of the TV image at the current time is also possible.

  Further, the TV image may be stopped and the TV image may not be displayed on the display unit 630. When the TV image is stopped and no TV image is displayed on the display unit 630, if a playback operation is performed, playback display is performed from the location of the TV image for which the stop operation has been performed. Moreover, the display location of the TV image currently displayed on the display part 630 can also be made into the location before a predetermined period (for example, 15 seconds) by rewinding operation.

  FIG. 15 is a diagram illustrating an operation guidance display image G100 as an example. Referring to FIG. 15, operation guidance display image G100 is an image in which operation guidance image G170 is arranged in a TV image. Operation guidance information for operating the video display device 600 by the communication terminal device 500 is displayed on the operation guidance image G170.

  The operation guidance information is, for example, information such as “left button (rewind), right button (fast forward), up button (pause), down button (stop), and enter button (play)”. The left button, the right button, the up button, the down button, and the enter button are names of the direction buttons 541C, 541D, 541A, 541B, and 541E of the communication terminal device 500, respectively.

  Therefore, according to the operation guidance information shown in the operation guidance image G170, for example, it is understood that the currently displayed content can be temporarily stopped by pressing the direction button 541A that is the up direction button. That is, by referring to the operation guidance information shown in the operation guidance image G170, the user who operates the communication terminal device 500 can easily recognize what processing is performed when which button is operated. In the operation guidance information shown in the operation guidance image G170, for example, it is shown that a rewind process, a fast-forward process, a pause process, a stop process, a reproduction process, and the like can be performed on the displayed content.

  Referring to FIG. 10 again, communication terminal apparatus 500 proceeds to step S114 after the process of step S113.

  In step S114, control unit 510 determines whether or not a program to which the device ID (“11MA”) of its own device is added has been received. If YES in step S114, the process proceeds to step S115. On the other hand, if NO at step S114, the process at step S114 is performed again. Here, assuming that the TV operation program to which the device ID (“11MA”) of the own device is added is received, the process proceeds to step S115.

  In step S115, an operation image display process is performed. In the operation image display process, control unit 510 executes the received program. Here, it is assumed that the received program is a TV operation program. Control unit 510 executes TV operation program to generate operation image MG100A in FIG. 14 using VDP 532, and causes operation unit MG100A to be displayed on display unit 530.

  Control unit 510 sets communication terminal apparatus 500 to the remote control mode. Then, control unit 510 causes LED 576 to emit red light, for example. For example, the red light indicates that the communication terminal device 500 is in a state where the video display device 600 can be operated. And the process of step S115 is complete | finished.

  Therefore, the user can easily recognize whether or not the video display device 600 can be operated by operating the communication terminal device 500 based on the color of the LED 576.

It progresses to step S118 after the process of step S115.
In step S118, control unit 510 executes an operation determination process M described later. The operation determination process M is a process performed independently of other processes. Then, the process of step S118 ends, and the process of communication terminal apparatus 500 in the content handling process ends.

In the video display device 600, the process proceeds to step S128 after the process of step S126.
In step S128, control unit 610 executes control signal corresponding processing T for performing processing corresponding to the remote control signal transmitted from communication terminal apparatus 500. The control signal handling process T is a process performed independently of other processes. Then, the process of step S128 ends, and the process of the video display device 600 in the content handling process ends.

  FIG. 16 is a flowchart of the operation determination process M and the control signal handling process T. Referring to FIG. 16, in operation determination process M performed by communication terminal apparatus 500, first, the process of step S210 is performed.

  In step S210, control unit 510 determines whether or not there is a button operation. The button operation is an interface operation M for pressing one of a plurality of button images arranged in the operation image MG100A of FIG. 14 displayed on the display unit 530, or outside the communication terminal device 500. This is a pressing operation of any of the plurality of external buttons provided. The plurality of external buttons are direction buttons 541A, 541B, 541C, and 541D, an enter button 541E, and function buttons 542A, 542B, 543A, and 543B. If YES in step S210, the process proceeds to step S212. On the other hand, if NO at step S210, the process at step S210 is performed again.

  In step S212, control unit 510 uses communication unit 560 to transmit a remote control signal as a control signal corresponding to the pressed button image or external button to video display device 600. When the button operation is, for example, an operation of pressing the direction button 541A, the remote control signal to be transmitted is a remote control signal including information on the “upward button” that is the name of the direction button 541A. When the process of step S212 is completed, the process of step S210 is performed again.

  In the control signal corresponding process T performed by the video display device 600, first, the process of step S220 is performed.

  In step S220, control unit 610 determines whether or not a remote control signal as a control signal has been received. If YES in step S220, the process proceeds to step S222. On the other hand, if NO at step S220, the process at step S220 is performed again. Here, as an example, it is assumed that a remote control signal including information of “upward button” which is the name of the direction button 541A is received.

  In step S222, control signal handling processing is performed. In the control signal handling process, control unit 610 performs a process according to the received remote control signal. For example, when the operation guidance display image G100 of FIG. 15 is displayed on the display unit 630 and the remote control signal including the information of the “upward button” is received, the control unit 610 uses the VDP 532 to The TV image as the content is paused and a still image is displayed on the display unit 630. When the process of step S222 ends, the process of step S220 is performed again.

  Here, for example, it is assumed that the button operation determined in step S210 is an interface operation M for pressing the button image MBG110 arranged in the operation image MG100A. In this case, a power remote control signal as a control signal is transmitted to the video display device 600 in the process of step S212. Then, control unit 610 sets video display device 600 to a standby mode by receiving a power supply remote control signal.

  Further, for example, it is assumed that the button operation determined in step S210 is an interface operation M for pressing the button image MBG142 arranged in the operation image MG100A. In this case, a volume up remote control signal as a control signal is transmitted to the video display device 600 in the process of step S212. Then, the control unit 610 receives the volume up remote control signal, thereby increasing the volume of the audio of the TV image as the content displayed on the display unit 630 and output from the audio output unit 670. Do.

  Through the above processing, communication terminal device 500 can control another device by executing a program transmitted from the other device. Here, the other device is a video display device 600 as an example.

  In the present embodiment, when communication terminal apparatus 500 is capable of data communication with video display apparatus 600, button image MBG210 as an icon for operating video display apparatus 600 is displayed on display unit 530. .

Therefore, the user simply presses the displayed button image MBG210 as a display element as an instruction input, and even if the video display device 600 is in the standby mode, the video display device 600 is set in the normal mode. The video display device 600 can be operated. As a result, there is an effect that it is possible to realize operation of another device without much effort.
(Process when the video display device 600 shifts to the standby mode)
Next, a power remote control signal as a control signal is transmitted to the video display device 600 by a button operation in the communication terminal device 500, and the video display device 600 in the normal mode receives the power remote control signal to enter the standby mode. Processing in the case of transition (hereinafter also referred to as standby mode transition processing) will be described.

  FIG. 17 is a flowchart of the standby mode transition process. FIG. 17 shows processing performed in each of communication terminal device 500 and video display device 600. In the standby mode transition processing, processing performed in each of communication terminal device 500 and video display device 600 is processing performed independently of other processing.

  Referring to FIG. 17, in video display device 600, first, the process of step S320 is performed.

  In step S320, control unit 610 determines whether or not a power supply remote control signal as a control signal has been received from communication terminal apparatus 500. If YES in step S320, the process proceeds to step S321. On the other hand, if NO at step S320, the process at step S320 is performed again. Here, assuming that a power supply remote control signal has been received, the process proceeds to step S321.

  In step S321, control unit 610 transmits content information T to the device that transmitted the power remote control signal. Here, the device that has transmitted the power remote control signal is communication terminal device 500. Therefore, control unit 610 transmits content information T to communication terminal device 500.

  The content information T includes content specifying information T and content volume information T. The content specifying information T is information for specifying the content displayed on the display unit 630. The content volume information T is information indicating the audio volume value of the content displayed on the display unit 630. It is assumed that the sound volume value of the content displayed on the display unit 630 is expressed by a numerical value of “0” to “20”, for example. When the volume value is “0”, it indicates that the volume of the sound of the content displayed on the display unit 630 is zero.

  Here, it is assumed that a three-channel TV image based on a broadcast signal is displayed on display unit 630. In this case, the content displayed on the display unit 630 is a 3-channel TV image. Therefore, the content specifying information T is information indicating three channels. Further, it is assumed that the sound volume value of the TV image displayed on the display unit 630 is “10” as an example. Therefore, the content volume information T is information indicating the volume value “10”.

  Note that when the content image based on the content received from the service server 800A is displayed on the display unit 630, the identification information for specifying the received content is the content specifying information T. The volume value of the sound of the content image is the content volume information T.

  Further, the content information T to be transmitted further includes the device ID of the transmission destination device and the device ID of the own device. When the device ID of the own device is “11TA” and the device ID of the transmission destination is “11MA”, the content information T to be transmitted includes the device ID “11TA” of the own device and the device ID “of the transmission destination”. 11MA ". Thereafter, the process of step S321 ends.

In communication terminal device 500, first, the process of step S310 is performed.
In step S310, control unit 510 determines whether or not content information T including the device ID of the device itself has been received. If YES in step S310, the process proceeds to step S311. On the other hand, if NO at step S310, the process at step S310 is performed again. Here, assuming that the content information T including the device ID (“11MA”) of the device itself and the device ID (“11TA”) of the video display device 600 has been received, the process proceeds to step S311.

  In step S311, control unit 510 stores received content information T in association with the device ID (“11TA”) of the device (video display device 600) that transmitted content information T, included in content information T. 520 stores it. Thereafter, the process proceeds to step S312.

  In step S312, content display continuation confirmation processing is performed. In the content display continuation confirmation process, control unit 510 generates the following display continuation confirmation image MG300 using VDP 532, and causes display 530 to display display continuation confirmation image MG300. The display continuation confirmation image MG300 is an image for confirming whether the content displayed on the display unit 630 of the video display device 600 is to be continuously displayed on the display unit 630. Then, the process of step S312 ends.

  FIG. 18 is a diagram showing a display continuation confirmation image MG300 as an example. Referring to FIG. 18, display continuation confirmation image MG300 displays a message for confirming whether the content displayed on video display device 600 is to be displayed on its own device. The message is, for example, “Do you want to display the content displayed on the video display device on your own device?”.

A button image MG350 is further arranged in the display continuation confirmation image MG300.
The button image MG350 is an image for performing a process of displaying the content displayed on the video display device 600 on the own device when pressed by the interface operation M.

Referring to FIG. 17 again, after the process of step S312, the process proceeds to step S313.
In step S313, control unit 510 determines whether or not there is a continuous display operation. The continuous display operation is an interface operation M for pressing the button image MG350. If YES in step S313, the process proceeds to step S314. On the other hand, if NO at step S313, the process at step S313 is performed again. Here, assuming that there is a continuous display operation, the process proceeds to step S314.

  In step S314, content display processing M is performed. In the content display process M, the control unit 510 causes the display unit 530 to display content based on the content specifying information T included in the received content information T using the VDP 532. In addition, control unit 510 causes audio output unit 572 to output the audio of the content displayed on display unit 530 at a volume based on the volume value indicated by content volume information T included in received content information T.

  Here, the content based on the content specifying information T displayed on the display unit 530 is a 3-channel TV image based on a broadcast signal.

  The volume value indicated by the content volume information T is “10”. Therefore, the sound volume of the content displayed on the display unit 530 and output from the sound output unit 572 is a volume based on the volume value “10” indicated by the content volume information T.

  Note that the volume value of the sound of the content displayed on the display unit 530 may not be the same as the volume value “10” indicated by the content volume information T. In this case, the volume of the audio output from the audio output unit 572 of the communication terminal device 500 is L (greater than 0 and less than 1) with respect to the audio volume output from the audio output unit 670 of the video display device 600. Based on the volume value indicated by the content volume information T, the volume output from the audio output unit 572 of the communication terminal device 500 is set by the control unit 510 so as to be an integer (for example, 0.5)) times. .

  When the content specifying information T is information for identifying the content received from the service server 800A, the control unit 510 receives the content specified by the content specifying information T from the service server 800A, and displays the content. The received content is displayed at 630. In this case, the control unit 510 causes the audio output unit 572 to output the audio of the content displayed on the display unit 530 at a volume based on the volume value “10” indicated by the content volume information T. And the process of step S314 is complete | finished and the process of the communication terminal device 500 in this standby mode transfer process is complete | finished.

  After that, when processing is performed so that the device recognition image MG200 of FIG. 12 is displayed on the display unit 530 of the communication terminal device 500, the image display power supply of the video display device 600 is turned on again with a simple operation. The video display device 600 can be controlled by the communication terminal device 500.

In the video display device 600, the process proceeds to step S322 after the process of step S321.
In step S322, standby mode setting processing is performed. In the standby mode setting process, the control unit 610 turns off the above-described image display power source and puts the video display device 600 into the standby mode. As a result, no image is displayed on the display unit 630. Then, the processing of the video display device 600 in this standby mode transition processing ends.

  With the above processing, the content displayed on the display unit 630 of the video display device 600 can be displayed on the display unit 530 of the communication terminal device 500 with a simple operation. Therefore, it is possible to easily view the continuation of the content that was viewed on the video display device 600 while away from home.

Further, the volume value of the content displayed on the video display device 600 can be taken over by the content displayed on the communication terminal device 500. For this reason, an effect of eliminating the trouble of adjusting the volume value is obtained.
(When connection signals are received from multiple types of devices)
As described above, communication terminal device 500 may receive connection signals from a plurality of types of devices instead of receiving connection signals only from video display device 600 in the process of step S110 of FIG. For example, when a connection signal is received from each of video display device 600 and HDD recorder, the following device recognition image MG200A is displayed on display unit 530 by the device recognition processing in step S111 in FIG. It is assumed that the HDD recorder transmits a connection signal including the device ID “11HDR” of its own device to communication terminal device 500 in the same manner as video display device 600.

  FIG. 19 is a diagram showing an apparatus recognition image MG200A as an example. Referring to FIG. 19, device recognition image MG200A is different from device recognition image MG200 in FIG. 12 in that button image MBG220 as an icon is further arranged in the TV image. Other than that, since it is the same as the device recognition image MG200, detailed description will not be repeated.

  In the button image MBG220, the device name recognized by the control unit 510 is displayed. The button image MBG220 is a button image for transmitting a control start signal as a control signal to the device having the device ID corresponding to the device name by being pressed by the interface operation M. The control start signal is a signal for setting the apparatus in the standby mode to the normal mode. Here, since the device name displayed on the button image MBG220 is “HDD recorder”, the device ID corresponding to the device identification data D100 in FIG. 11 is “11HDR”, and the control start signal is a press of the button image MBG220. By processing, it is transmitted to the HDD recorder.

  Then, the HDD recorder performs the same process as the process after step S121 in FIG. 10 described above, and communication terminal device 500 receives the HDD recorder operation program and performs the same process as step S115 described above. The communication terminal device 500 is ready to operate the HDD recorder.

With the above processing, it is possible to quickly operate a user-desired device among a plurality of types of devices with one device.
(Function block diagram)
FIG. 20 is a functional block diagram of control unit 510 in the present embodiment. Referring to FIG. 20, control unit 510 includes a communication determination unit 511 and a transmission unit 512. The communication determination unit 511 performs the process of step S110 in FIG. That is, the communication determination unit 511 determines whether data communication with the video display device 600 is possible. The determination result of the communication determination unit 511 is transmitted to the transmission unit 512.

  When receiving an instruction input to the display element displayed on display unit 530, transmission unit 512 transmits a control signal for operating video display device 600 to video display device 600.

  Note that all or part of the communication determination unit 511 and the transmission unit 512 included in the control unit 510 may be configured by hardware.

  FIG. 21 is a functional block diagram of control unit 610 in the present embodiment. Referring to FIG. 21, control unit 610 includes a transmission unit 612, a reception unit 613, and an execution unit 614.

  The transmission unit 612 transmits a connection signal for enabling data communication with the video display device 600 that is the device itself to the communication terminal device 500. The receiving unit 613 receives a control signal for operating the video display device 600 transmitted from the communication terminal device 500. The execution unit 614 executes processing corresponding to the received control signal.

  Note that all or part of the transmission unit 612, the reception unit 613, and the execution unit 614 included in the control unit 610 may be configured by hardware.

<Second Embodiment>
In the present embodiment, processing for displaying different menus in each of communication terminal device 500 and video display device 600 will be described.

Since the network system in the present embodiment is similar to network system 1000 in the first embodiment, detailed description will not be repeated. The configuration of each of communication terminal device 500, video display device 600, and service server 800A is the same as that described in the first embodiment, and therefore detailed description thereof will not be repeated.
(Menu display)
Next, processing for displaying a menu (hereinafter also referred to as menu display processing) by each of communication terminal device 500 and video display device 600 will be described. It is assumed that remote control image MG100 in FIG. 9 is displayed on display unit 530 of communication terminal device 500. In this case, it is assumed that communication terminal apparatus 500 is set to the remote control mode.

  FIG. 22 is a flowchart of the menu display process. FIG. 22 shows processing performed in each of communication terminal device 500, video display device 600, and service server 800A. Referring to FIG. 22, in communication terminal device 500, first, the process of step S410 is performed.

  In step S410, control unit 510 determines whether or not there is a menu acquisition operation. The menu acquisition operation is an operation for causing the display unit 530 to display a list menu of contents that can be acquired from the service server 800A. Specifically, the menu acquisition operation is an interface operation M for pressing the button image MBG130 in FIG. If YES in step S410, the process proceeds to step S411. On the other hand, if NO at step S410, the process at step S410 is performed again.

  In step S411, menu acquisition processing is performed. In the menu acquisition process, first, control unit 510 transmits a menu acquisition remote control signal as a menu acquisition request to video display device 600 using communication unit 560. The menu acquisition remote control signal is a remote control signal for causing the video display device 600 to acquire a list menu of contents that can be acquired from the service server 800A. Thereafter, the process of step S411 ends.

In video display device 600, first, the process of step S420 is performed.
In step S420, control unit 610 determines whether a menu acquisition remote control signal as a menu acquisition request has been received or not. If YES in step S420, the process proceeds to step S421. On the other hand, if NO at step S420, the process at step S420 is performed again.

  In step S421, a menu acquisition process T is performed. In the menu acquisition process T, first, the control unit 610 uses the communication unit 662 to transmit a menu acquisition request T for acquiring a list menu of contents that can be acquired from the service server 800A to the service server 800A.

In service server 800A, first, the process of step S440 is performed.
In step S440, control unit 810 determines whether or not menu acquisition request T has been received. If YES in step S440, the process proceeds to step S441. On the other hand, if NO at step S440, the process at step S440 is performed again.

  In step S441, the control unit 810 transmits the following menu data D300, which is a list menu data of genres of contents that can be distributed, to the device that transmitted the menu acquisition request T. Thereafter, the process of step S441 ends, and the process of step S440 is performed again.

  FIG. 23 is a diagram showing menu data D300 as an example. Referring to FIG. 23, menu data D300 includes a plurality of genre information. The “number” is a number for managing each of a plurality of genre information, and corresponds to a remote control number. “Genre ID” is an ID for specifying the genre of content. “Genre name” indicates the genre name of the corresponding content.

  Referring to FIG. 22 again, in video display device 600, in menu acquisition process T in step S421, control unit 610 receives menu data D300. Upon receiving the menu data D300, the control unit 610 stores the menu data D300 in the storage unit 620. Then, the control unit 610 generates the following menu image G200 using the VDP 632 based on the menu data D300, and causes the display unit 630 to display the generated menu image G200. Thereafter, the process of step S421 ends.

  In the following, the image generated based on the menu data D300 is also referred to as an upper layer menu image. Therefore, menu image G200 is an upper layer menu image. Menu image G200 is an image for selecting one of a plurality of genres as information.

  FIG. 24 is a diagram showing a menu image G200 as an example. Referring to FIG. 24, button images BG211, BG212, BG213, BG214, BG215, BG216, BG217, BG218, BG219, BG220, BG221, and BG222 are arranged in menu image G200. Each of the button images BG211, BG212, BG213, BG214, BG215, BG216, BG217, BG218, BG219, BG220, BG221, and BG222 displays the genre of the content.

  Each of the button images BG211, BG212, BG213, BG214, BG215, BG216, BG217, BG218, BG219, BG220, BG221, and BG222 is a button image for acquiring a submenu of the corresponding genre from the service server 800A.

  In addition, in the menu image G200, as an example, a selection frame SR250 is arranged so as to surround the button image BG215. The button image surrounded by the selection frame SR250 is a selected button image. The arrangement position of the selection frame SR250 in the initial state is not limited to the position surrounding the button image BG215, and may be a position surrounding other button images.

  In addition, an operation guidance image G270 is arranged in the menu image G200. In the operation guidance image G270, operation guidance information for operating the video display device 600 by the communication terminal device 500 is displayed. The operation guidance information is, for example, message information “A genre can be selected by pressing the direction button. A submenu of the selected genre is displayed by pressing the enter button.”

  Here, the direction buttons are the direction buttons 541A, 541B, 541C, and 541D of the communication terminal device 500. The determination button is the determination button 541E of the communication terminal device 500. The character strings “direction button” and “decision button” included in the operation guidance information may be images such as icons. For example, the direction buttons 541A, 541B, 541C, and 541D may be indicated by arrow mark icons indicating the upward, downward, left, and right directions, respectively.

Referring to FIG. 22 again, after the process of step S421, the process proceeds to step S428.
In step S428, control unit 610 executes a control signal corresponding process TA to be described later for performing a process corresponding to the remote control signal transmitted from communication terminal apparatus 500. The control signal corresponding process TA is a process performed independently of other processes. Then, the process of step S428 ends, and the process of the video display device 600 in the menu display process ends.

In communication terminal device 500, after the process of step S411, the process proceeds to step S418.
In step S418, control unit 510 executes operation determination process MA. The operation determination process MA is a process performed independently of other processes. And the process of step S418 is complete | finished and the process of the communication terminal device 500 in a menu display process is complete | finished.

  FIG. 25 is a flowchart of the operation determination process MA and the control signal corresponding process TA. Referring to FIG. 25, in operation determination process MA performed by communication terminal device 500, first, the process of step S510 is performed.

  In step S510, control unit 510 determines whether there is a touch operation on display unit 530 or not. The touch operation is an interface operation M for pressing the hyperlink character string or the button image in the image displayed on the display unit 530. If YES in step S510, the process proceeds to step S511. On the other hand, if NO at step S510, the process proceeds to step S514.

  In step S511, a touch operation handling process M is performed. In the touch operation handling process M, a process based on the touch operation is performed. Detailed processing in the touch operation handling processing M will be described later. When the touch operation handling process M ends, the process proceeds to step S514.

  In step S514, control unit 510 determines whether there is a button operation. The button operation is an operation of pressing any one of a plurality of external buttons provided outside the communication terminal device 500. The plurality of external buttons are direction buttons 541A, 541B, 541C, and 541D, an enter button 541E, and function buttons 542A, 542B, 543A, and 543B. If YES in step S514, the process proceeds to step S515. On the other hand, if NO at step S514, the process of step S510 is performed again.

  In step S515, control unit 510 uses communication unit 560 to transmit a remote control signal as a control signal corresponding to the pressed external button to video display device 600. When the button operation is, for example, an operation of pressing the direction button 541B, the remote control signal to be transmitted is a remote control signal including information of “downward button” that is the name of the direction button 541B. When the process of step S515 ends, the process of step S510 is performed again.

  In the control signal corresponding process TA performed by the video display device 600, first, the process of step S520 is performed.

  In step S520, control unit 610 determines whether or not a remote control signal as a control signal has been received. If YES in step S520, the process proceeds to step S521. On the other hand, if NO at step S520, the process at step S520 is performed again. Here, as an example, assuming that a remote control signal including information of “down button” which is the name of the direction button 541B is received, the process proceeds to step S521.

  In step S521, control signal handling processing is performed. In the control signal handling process, control unit 610 performs a process according to the received remote control signal. For example, when the menu image G200 of FIG. 24 is displayed on the display unit 630 and the selection frame SR250 is arranged at a position surrounding the button image BG215, the control unit 610 displays the selection frame SR250 as the button image BG218. An image moved to a position surrounding the image is displayed on the display unit 630. That is, the button image BG218 is selected. When the control signal handling process ends, the process of step S520 is performed again.

Therefore, the button image in the selected state is changed by the operation of the direction buttons 541A, 541B, 541C, and 541D of the communication terminal device 500 by the operation determination process MA and the control signal corresponding process TA. Specifically, when the direction buttons 541A, 541B, 541C, and 541D of the communication terminal device 500 are operated, a corresponding remote control signal is transmitted to the video display device 600 through the processing in step S515 described above. The control unit 610 of the video display device 600 uses the VDP 632 to generate an image in a state in which the selection frame SR250 is moved to any one of up, down, left, and right based on the received remote control signal. In this case, the remote control signal received by control unit 610 is a control signal for operating video display device 600.
(Sub menu display)
Next, processing when the communication terminal device 500 performs a submenu acquisition operation when the menu image G200 of FIG. 24 is displayed on the display unit 630 of the video display device 600 will be described.

  The submenu acquisition operation is a button image selected from the button images BG211, BG212, BG213, BG214, BG215, BG216, BG217, BG218, BG219, BG220, BG221 and BG222 displayed on the menu image G200 of FIG. This is an operation of pressing the enter button 541E in the communication terminal device 500 when it is in the state.

  Here, as an example, it is assumed that there is a submenu acquisition operation when the button image BG215 is in a selected state. In this case, YES is determined in step S514 of the operation determination process MA of FIG. 25, and the process of step S515 is performed.

  In step S515, the above-described processing is performed, and thus detailed description will not be repeated. With this process, control unit 510 transmits a remote control signal (hereinafter also referred to as a determination remote control signal) including information on “determination button” which is the name of determination button 541E to video display device 600.

  In the video display device 600, YES is determined in step S520 of the control signal corresponding process TA, and the process of step S521 is performed.

  In step S521, control signal handling processing is performed. Here, control unit 610 receives the determined remote control signal when button image BG215 is in the selected state. That is, the determined remote control signal transmitted from communication terminal device 500 to video display device 600 is a selection signal for selecting button image BG215 for displaying genre information called sports. That is, the determined remote control signal is a selection signal for selecting genre information.

  In this case, in the control signal handling process, control unit 610 performs a submenu obtaining process T for obtaining a genre submenu corresponding to the selected button image from service server 800A. Here, it is assumed that the button image in the selected state is the button image BG215.

  FIG. 26 is a diagram illustrating a flowchart of processing performed by communication terminal device 500, submenu acquisition processing T, and processing performed by service server 800A. The processing performed by communication terminal device 500 and service server 800A in FIG. 26 is performed independently of other processing.

  Referring to FIG. 26, in submenu acquisition process T performed by video display device 600, first, the process of step S620 is performed.

  In step S620, control unit 610 transmits submenu acquisition request T to service server 800A. The submenu acquisition request T is a request for acquiring a genre submenu corresponding to the selected button image from the service server 800A. The submenu acquisition request T includes a genre ID for specifying the genre corresponding to the selected button image. Here, the button image in the selected state is the button image BG215, and the corresponding genre is “sports”. Therefore, from the menu data D300 of FIG. 23, the genre ID included in the submenu acquisition request T is “PG1238”. Thereafter, the process of step S620 ends.

  In the process performed by service server 800A, first, the process of step S640 is performed.

  In step S640, control unit 810 determines whether or not submenu acquisition request T has been received. If YES in step S640, the process of step S641 is performed. On the other hand, if NO at step S640, the process at step S640 is performed again. Here, assuming that a submenu acquisition request T including the genre ID “PG1238” is received, the process proceeds to step S641.

  In step S641, control unit 810 transmits submenu data corresponding to the genre ID included in submenu acquisition request T to the device that transmitted submenu acquisition request T. The sub menu data is data of a list menu of contents that can be distributed by the service server 800A. The genre ID included in the submenu acquisition request T is “PG1238”, and the corresponding genre is “sports”. Therefore, the sub menu data to be transmitted is the following sub menu data D300SB. Thereafter, the process of step S641 ends, and the process of step S640 is performed again.

  FIG. 27 is a diagram showing submenu data D300SB as an example. Referring to FIG. 27, submenu data D300SB is composed of a plurality of pieces of content information. The “number” is a number for managing each of a plurality of pieces of content information. The “program ID” is an ID for specifying content. “Title” indicates the title of the corresponding content.

  Referring to FIG. 26 again, in video display device 600, the process proceeds to step S621 after the process of step S620.

  In step S621, a submenu display process T is performed. In submenu display process T, control unit 610 receives submenu data. Here, it is assumed that the received submenu data is submenu data D300SB. Upon receiving the sub menu data D300SB, the control unit 610 stores the sub menu data D300SB in the storage unit 620. Then, the control unit 610 generates the following submenu image G300 using the VDP 632 based on the submenu data D300SB, and causes the display unit 630 to display the generated submenu image G300. That is, the display unit 630 displays the sub menu image G300 instead of the menu image G200. Thereafter, the process of step S621 ends.

  In the following, an image generated based on the sub menu data D300SB is also referred to as a lower layer menu image. Therefore, the submenu image G300 is a lower layer menu image. The lower hierarchy menu image selects one of a plurality of types of information (for example, content titles) corresponding to the selected information among the plurality of information (for example, genre) displayed on the upper hierarchy menu image. It is an image for.

  FIG. 28 is a diagram showing a submenu image G300 as an example. Referring to FIG. 28, button images BG311, BG312, BG313, BG314, BG315, BG316, BG317, BG318, BG319, BG320, BG321, and BG322 are arranged in submenu image G300. Each of the button images BG311, BG312, BG313, BG314, BG315, BG316, BG317, BG318, BG319, BG320, BG321, and BG322 has a content title based on a plurality of pieces of content information of the submenu data D300SB of FIG. Is displayed.

  Each of the button images BG311, BG312, BG313, BG314, BG315, BG316, BG317, BG318, BG319, BG320, BG321, and BG322 is a button image for acquiring the corresponding content from the service server 800A.

  In addition, in the submenu image G300, for example, a selection frame SR350 is arranged so as to surround the button image BG315. The button image surrounded by the selection frame SR350 is a selected button image. The arrangement position of the selection frame SR350 in the initial state is not limited to the position surrounding the button image BG315, and may be a position surrounding other button images.

  In addition, an operation guidance image G370 is arranged in the submenu image G300. In the operation guidance image G370, operation guidance information for operating the video display device 600 by the communication terminal device 500 is displayed. The operation guidance information is, for example, message information that “content to be played can be selected by pressing the direction button. The selected content is played by pressing the enter button”.

  Here, the direction buttons are the direction buttons 541A, 541B, 541C, and 541D of the communication terminal device 500. The determination button is the determination button 541E of the communication terminal device 500. The character strings “direction button” and “decision button” included in the operation guidance information may be images such as icons. For example, the direction buttons 541A, 541B, 541C, and 541D may be indicated by arrow mark icons indicating the upward, downward, left, and right directions, respectively.

  The submenu image G300 may be an image on which an electronic program guide generated based on EPG data is displayed. In this case, each of the button images BG311, BG312, BG313, BG314, BG315, BG316, BG317, BG318, BG319, BG320, BG321, and BG322 is a button image for acquiring a moving image of a program as content. In this case, the button images BG311 to BG322 are button images for acquiring, for example, broadcast programs of 1 to 12 channels.

  When the submenu image G300 is displayed on the display unit 630, the button image in the selected state is displayed as the direction button 541A of the communication terminal device 500 by the operation determination process MA and the control signal corresponding process TA in FIG. It changes by the operation of 541B, 541C, 541D. Specifically, when the direction buttons 541A, 541B, 541C, and 541D of the communication terminal device 500 are operated, a corresponding remote control signal is transmitted to the video display device 600 through the process of step S515 described above. The control unit 610 of the video display device 600 uses the VDP 632 to generate an image in a state where the selection frame SR350 is moved to any one of up, down, left, and right based on the received remote control signal. In this case, the remote control signal received by control unit 610 is a control signal for operating video display device 600.

Referring to FIG. 26 again, after the process of step S621, the process proceeds to step S622.
In step S622, menu operation program generation processing is performed. In the menu operation program generation process, control unit 610 generates a menu operation program using a plurality of genre information of menu data D300 in FIG. 23 stored in storage unit 630. The menu operation program is a program for displaying the following operation image MG400 on the display unit 530 by being executed in the communication terminal device 500. Thereafter, the process of step S622 ends.

  As described above, the image generated based on the menu data D300 is also referred to as an upper layer menu image, and therefore the operation image MG400 is an upper layer menu image.

  FIG. 29 is a diagram showing an operation image MG400 as an example. Referring to FIG. 29, button images MBG411, MBG412, MBG413, MBG414, MBG415, MBG416, MBG417, MBG418, MBG419, MBG420, MBG421, MBG422 are arranged in operation image MG400. Each of the button images MBG411, MBG412, MBG413, MBG414, MBG415, MBG416, MBG417, MBG418, MBG419, MBG420, MBG421, MBG422 displays the genre of the content based on the plurality of genre information of the menu data D300.

  Each of the button images MBG411, MBG412, MBG413, MBG414, MBG415, MBG416, MBG417, MBG418, MBG419, MBG420, MBG421, MBG422 is a button image for acquiring a submenu of the corresponding genre from the service server 800A.

  The menu operation program includes button images MBG411, MBG412, MBG413, MBG414, MBG415, MBG416, MBG417, MBG418, MBG419, MBG420, MBG421, MBG422 and button image MBG411, MBG412, MBG413, MBG414. , MBG 415, MBG 416, MBG 417, MBG 418, MBG 419, MBG 420, MBG 421, and information on a plurality of relative coordinate values for MBG 422 are included.

  The menu operation program includes remote control data for generating each of a plurality of remote control signals corresponding to the button images MBG411, MBG412, MBG413, MBG414, MBG415, MBG416, MBG417, MBG418, MBG419, MBG420, MBG421, MBG422. Is also included.

  When the menu operation program is executed in the communication terminal device 500, any one of the button images MBG411, MBG412, MBG413, MBG414, MBG415, MBG416, MBG417, MBG418, MBG419, MBG420, MBG421, MBG422 is determined by the interface operation M. When pressed, control unit 510 generates a remote control signal using the remote control data corresponding to the pressed button image, and transmits the generated remote control signal to video display device 600. .

  The plurality of remote control data corresponding to the button images MBG411, MBG412, MBG413, MBG414, MBG415, MBG416, MBG417, MBG418, MBG419, MBG420, MBG421, MBG422 respectively include the genre IDs of the plurality of genre information in the menu data D300. This is data for generating a remote control signal. For example, the remote control signal corresponding to the button image MBG414 is generated by remote control data including the genre ID “PG1237” indicated by the genre information of the number “4” in the menu data D300. In this case, the generated remote control signal is a remote control signal including the genre ID “PG1237”.

Referring to FIG. 26 again, after the process of step S622, the process proceeds to step S623.
In step S623, control unit 610 transmits the generated menu operation program to communication terminal device 500. Thereafter, the process of step S623 ends, and the submenu acquisition process T also ends.

In communication terminal device 500, first, the process of step S614 is performed.
In step S614, control unit 510 determines whether or not a menu operation program has been received. If YES in step S614, the process proceeds to step S615. On the other hand, if NO at step S614, the process at step S614 is performed again. Here, assuming that the menu operation program has been received, the process proceeds to step S615.

  In step S615, an operation image display process M is performed. In operation image display process M, control unit 510 executes the received program. Here, it is assumed that the received program is a menu operation program. The control unit 510 executes the menu operation program, generates the operation image MG400 of FIG. 29 using the VDP 532, and causes the display unit 530 to display the operation image MG400. Thereafter, the process of step S615 ends, and the process of step S614 is performed again.

As a result of the above processing, the display unit 630 of the video display device 600 displays the submenu image G300 as the lower layer menu image corresponding to the menu image G200 as the upper layer menu image. In addition, on display unit 530 of communication terminal device 500, operation image MG400 as an upper layer menu image corresponding to submenu image G300 as a lower layer menu image is displayed.
(Menu switching display)
Next, when submenu image G300 as a lower layer menu image is displayed on display unit 630 of video display device 600, and operation image MG400 as an upper layer menu image is displayed on display unit 530 of communication terminal device 500. The process will be described.

  Here, a process when there is a submenu acquisition operation M in the communication terminal device 500 will be described.

  The submenu acquisition operation M is any one of the button images MBG411, MBG412, MBG413, MBG414, MBG415, MBG416, MBG417, MBG418, MBG419, MBG420, MBG421, MBG422 displayed on the operation image MG400 as the upper layer menu image. This is a button image touch operation. Here, as an example, it is assumed that there is a touch operation on the button image MBG411. In this case, YES is determined in step S510 of the operation determination process MA of FIG. 25, and the process of step S511 is performed.

  In step S511, as described above, the touch operation handling process M is performed. In this case, in the touch operation handling process M, a submenu acquisition process M is performed for the video display device 600 to obtain a submenu of the genre corresponding to the touched button image from the service server 800A.

  FIG. 30 is a diagram illustrating a flowchart of the submenu acquisition process M, the process performed by the video display device 600, and the process performed by the service server 800A. Note that the processing performed by video display device 600 and service server 800A in FIG. 30 is performed independently of other processing.

  Referring to FIG. 30, in submenu acquisition process M performed by communication terminal device 500, first, the process of step S710 is performed.

  In step S710, a submenu acquisition request transmission process is performed. In the submenu acquisition request transmission process, first, control unit 510 uses the remote control data corresponding to the touch-operated button image to generate a submenu acquisition remote control signal. The submenu acquisition remote control signal is a remote control signal for the video display device 600 to acquire the submenu of the genre corresponding to the touch-operated button image from the service server 800A.

  When the button image that has been touched is the button image MBG411, the corresponding remote control data is data including the genre ID “PG1234” indicated by the genre information of the number “1” in the menu data D300 of FIG. is there. In this case, the generated submenu acquisition remote control signal is a remote control signal including the genre ID “PG1234”.

  Then, control unit 510 transmits the generated submenu acquisition remote control signal to video display device 600 as a submenu acquisition request.

In video display device 600, first, the process of step S720 is performed.
In step S720, control unit 610 determines whether a submenu acquisition remote control signal as a submenu acquisition request has been received or not. If YES in step S720, the process proceeds to step S721. On the other hand, if NO at step S720, the process at step S720 is performed again. Here, assuming that a submenu acquisition remote control signal including the genre ID “PG1234” has been received, the process proceeds to step S721.

  In step S721, control unit 610 transmits submenu acquisition request TM to service server 800A. The submenu acquisition request TM is a request for acquiring a submenu of the genre selected in the communication terminal device 500 from the service server 800A. The submenu acquisition request TM includes a genre ID “PG1234” for specifying a genre included in the submenu acquisition remote control signal. Here, the genre selected in communication terminal device 500 is “movie” from menu data D300 in FIG. Thereafter, the process of step S721 ends.

In service server 800A, first, the process of step S640 is performed.
In step S740, it is determined whether a submenu acquisition request TM has been received. If YES in step S740, the process of step S741 is performed. On the other hand, if NO at step S740, the process at step S740 is performed again. Here, assuming that the submenu acquisition request TM including the genre ID “PG1234” is received, the process proceeds to step S741.

  In step S741, control unit 810 transmits submenu data corresponding to the genre ID included in submenu acquisition request TM to the device that transmitted submenu acquisition request TM. The sub menu data is data of a list menu of contents that can be distributed by the service server 800A. The genre ID included in the submenu acquisition request TM is “PG1234”, and the corresponding genre is “movie”. Therefore, the sub menu data to be transmitted is the following sub menu data D304SB. Thereafter, the process of step S741 ends, and the process of step S740 is performed again.

  FIG. 31 is a diagram showing submenu data D304SB as an example. Referring to FIG. 31, sub menu data D304SB is composed of a plurality of pieces of content information, similarly to sub menu data D300SB of FIG. 27, and therefore detailed description will not be repeated. In each of the plurality of pieces of content information indicated by the submenu data D304SB, the plurality of titles shown are titles related to the movie. The “program ID” is an ID for specifying the content of the corresponding movie.

  Referring to FIG. 30 again, in video display device 600, the process proceeds to step S722 after the process of step S721.

  In step S722, a submenu display process T is performed. In submenu display process T, control unit 610 receives submenu data. Here, it is assumed that the received submenu data is submenu data D304SB. Upon receiving the sub menu data D304SB, the control unit 610 stores the sub menu data D304SB in the storage unit 620.

  Then, the control unit 610 generates the following submenu image G304 using the VDP 632 based on the submenu data D304SB, and causes the display unit 630 to display the generated submenu image G304. In this case, the sub menu image G304 is a lower layer menu image. Thereafter, the process of step S722 ends, and the process of step S720 is performed again.

  FIG. 32 is a diagram showing a submenu image G304 as an example. Referring to FIG. 32, the submenu image G304 is compared with the submenu image G300 of FIG. 28. Button images BG311, BG312, BG313, BG314, BG315, BG316, BG317, BG318, BG319, BG320, BG321, BG322 The button images BG311A, BG312A, BG313A, BG314A, BG315A, BG316A, BG317A, BG318A, BG319A, BG320A, BG321A, and BG322A are different from each other. Other than that, it is the same as the submenu image G300, and therefore, detailed description will not be repeated.

  In addition, the button images BG311A, BG312A, BG313A, BG314A, BG315A, BG316A, BG317A, BG318A, BG319A, BG320A, BG321A, BG322A are the button images BG311, BG312, BG313, BG316, BG315, , BG321 and BG322 are different in that movie-related titles are displayed. Other than that, the button images BG311, BG312, BG313, BG314, BG315, BG316, BG317, BG318, BG319, BG320, BG321, and BG322 are not repeated in detail.

With the above processing, the lower layer menu image displayed on the display unit 630 of the video display device 600 is displayed while the operation image MG400 as the upper layer menu image displayed on the display unit 530 of the communication terminal device 500 is displayed. It is possible to switch to a lower hierarchy menu image of another genre.
(Content playback)
Next, when submenu image G300 as a lower layer menu image is displayed on display unit 630 of video display device 600, and operation image MG400 as an upper layer menu image is displayed on display unit 530 of communication terminal device 500. Next, a process for reproducing the content will be described.

  Here, processing when the content acquisition operation M is performed in the communication terminal device 500 will be described.

  The content acquisition operation M is an operation for the video display device 600 to receive content from the service server 800A. Specifically, the content acquisition operation M is one of the button images BG311, BG312, BG313, BG314, BG315, BG316, BG317, BG318, BG319, BG320, BG321, and BG322 displayed in the submenu image G300 of FIG. The operation of pressing the enter button 541E in the communication terminal device 500 when the button image is in the selected state.

  Here, as an example, it is assumed that there is a sub-content acquisition operation M when the button image BG315 is in a selected state. In this case, YES is determined in step S514 of the operation determination process MA of FIG. 25, and the process of step S515 is performed.

  In step S515, the above-described processing is performed, and thus detailed description will not be repeated. As a result of this processing, control unit 510 transmits a determination remote control signal including information on “decision button”, which is the name of decision button 541E, to video display device 600.

  In the video display device 600, YES is determined in step S520 of the control signal corresponding process TA, and the process of step S521 is performed.

  In step S521, control signal handling processing is performed. Here, control unit 610 receives the determined remote control signal when button image BG315 is in the selected state. In this case, in the control signal handling process, control unit 610 performs a content acquisition process T for acquiring content corresponding to the button image in the selected state from service server 800A. Here, it is assumed that the button image in the selected state is the button image BG315.

  FIG. 33 is a diagram illustrating a flowchart of processing performed by communication terminal device 500, content acquisition processing T, and processing performed by service server 800A. Note that the processing performed by communication terminal device 500 and service server 800A in FIG. 33 is performed independently of other processing.

  Referring to FIG. 33, in content acquisition process T performed by video display device 600, first, the process of step S820 is performed.

  In step S820, control unit 610 transmits content acquisition request T to service server 800A. The content acquisition request T is a request for acquiring the content corresponding to the selected button image from the service server 800A.

  The content acquisition request T includes a program ID for specifying the content corresponding to the selected button image. Here, the button image in the selected state is the button image BG315, and the title of the content is “F golf”. Therefore, the program ID included in the content acquisition request T is “P1238” from the submenu data D300SB of FIG. Thereafter, the process of step S820 ends. Hereinafter, the content requested to the service server 800A by the content acquisition request T is also referred to as an acquisition request content.

  In the process performed by service server 800A, first, the process of step S840 is performed.

  In step S840, control unit 810 determines whether or not content acquisition request T has been received. If YES in step S840, the process of step S841 is performed. On the other hand, if NO at step S840, the process at step S840 is performed again. Here, it is assumed that the content acquisition request T including the program ID “P1238” is received, and the process proceeds to step S841.

  In step S841, content distribution processing is performed. In the content distribution processing, the control unit 810 starts processing for streaming distribution of the acquisition request content to the video display device 600 that has transmitted the content acquisition request T. Here, the acquisition request content is content specified by the program ID “P1238”. The acquisition request content may be sent to the video display device 600 as a broadcast radio wave.

  Here, it is assumed that the acquisition request content is moving image data compressed in the MPEG2-TS (Transport Stream) format. The compression format of the moving image data is not limited to the MPEG2-TS format, and may be data compressed in another format. Here, other formats include, for example, MPEG2, H.264, and the like. H.264 or the like. In addition, it is assumed that the acquisition request content is moving image data whose title is “F golf”. The acquisition request content may be transmitted so that the video display device 600 can download the acquisition request content instead of streaming distribution.

  When the distribution of the acquisition request content ends, the process of step S841 ends, and the process of step S840 is performed again.

In the video display device 600, the process proceeds to step S821 after the process of step S820.
In step S821, the control unit 610 executes the content display process T. The content display process T is a process performed independently of other processes. Thereafter, the process of step S821 ends.

  In the content display process T, the control unit 610 uses the VDP 632 to reproduce (decrypt) the acquisition request content while receiving the acquisition request content from the service server 800A, and to obtain an image based on the acquisition request content (hereinafter, referred to as “content acquisition request content”). Streaming reproduction display processing for displaying the content image) on the display unit 630 is performed. In this case, the following content display image G400 is displayed on the display unit 630.

  FIG. 34 is a diagram showing a content display image G400 as an example. Referring to FIG. 34, a content image based on the acquisition request content is displayed in content display image G400. In addition, an operation guidance image G470 is arranged in the content display image G400. In the operation guidance image G470, operation guidance information for operating the video display device 600 by the communication terminal device 500 is displayed.

  The operation guidance information displayed on the operation guidance image G470 is the same as the operation guidance information displayed on the operation guidance image G170 arranged on the operation guidance display image G100 of FIG. 15, and thus detailed description will not be repeated. That is, for example, the operation guidance information displayed on the operation guidance image G470 is to perform a rewind process, a fast forward process, a pause process, a stop process, a reproduction process, and the like on the content being displayed and reproduced on the display unit 630. Show that you can.

  If, for example, the direction button 541D is pressed in the communication terminal device 500 while the content display image G400 is displayed on the display unit 630, the processing is being performed by the processing in steps S515 and S521 in FIG. The content is fast forwarded.

Referring again to FIG. 33, after the process of step S821, the process proceeds to step S822.
In step S822, menu operation program C generation processing is performed. In the menu operation program C generation process, the control unit 610 generates the menu operation program C using a plurality of pieces of content information of the submenu data D300SB of FIG. 27 stored in the storage unit 630. The menu operation program C is a program for displaying the following operation image MG500 on the display unit 530 by being executed in the communication terminal device 500. Thereafter, the process of step S822 ends.

  As described above, since the image generated based on the sub menu data D300SB is also referred to as a lower layer menu image, the operation image MG500 is a lower layer menu image.

  FIG. 35 is a diagram showing an operation image MG500 as an example. Referring to FIG. 35, button images MBG511, MBG512, MBG513, MBG514, MBG515, MBG516, MBG517, MBG518, MBG519, MBG520, MBG521, and MBG522 are arranged in operation image MG500. Each of the button images MBG511, MBG512, MBG513, MBG514, MBG515, MBG516, MBG517, MBG518, MBG519, MBG520, MBG521, MBG522 has a content title based on a plurality of content information of the submenu data D300SB of FIG. Is displayed.

  Button images MBG511, MBG512, MBG513, MBG514, MBG515, MBG516, MBG517, MBG518, MBG519, MBG520, MBG521, and MBG522 are button images for acquiring the corresponding content from service server 800A.

  The menu operation program C includes button images MBG511, MBG512, MBG513, MBG514, MBG515, MBG516, MBG517, MBG518, MBG519, MBG520, MBG521, MBG522, and button image MBG511, MBG512, MBG513, in the operation image MG500. Information of a plurality of relative coordinate values for arranging MBG 514, MBG 515, MBG 516, MBG 517, MBG 518, MBG 519, MBG 520, MBG 521, MBG 522, respectively, is included.

  The menu operation program C includes a remote controller for generating each of a plurality of remote control signals respectively corresponding to the button images MBG511, MBG512, MBG513, MBG514, MBG515, MBG516, MBG517, MBG518, MBG519, MBG520, MBG521, MBG522. Data is also included.

  When the menu operation program C is executed in the communication terminal device 500, any of the button images MBG511, MBG512, MBG513, MBG514, MBG515, MBG516, MBG517, MBG518, MBG519, MBG520, MBG521, MBG522 is the interface operation M Thus, when pressed, control unit 510 uses the remote control data corresponding to the pressed button image to generate a remote control signal, and transmits the generated remote control signal to video display device 600. It is.

  A plurality of remote control data respectively corresponding to the button images MBG511, MBG512, MBG513, MBG514, MBG515, MBG516, MBG517, MBG518, MBG519, MBG520, MBG521, MBG522 are respectively a plurality of content information in the submenu data D300SB of FIG. This is data for generating a remote control signal including a program ID. For example, the remote control signal corresponding to button image MBG514 is generated by remote control data including program ID “P1237” indicated by the content information of number “4” in submenu data D300SB. In this case, the generated remote control signal is a remote control signal including the program ID “P1237”.

Referring to FIG. 33 again, after the process of step S822, the process proceeds to step S823.
In step S823, control unit 610 transmits generated menu operation program C to communication terminal device 500. Thereafter, the process of step S813 ends, and the content acquisition process T also ends.

In communication terminal device 500, first, the process of step S814 is performed.
In step S814, control unit 510 determines whether or not menu operation program C has been received. In step S814, control unit 510 determines whether or not menu operation program C has been received. If YES in step S814, the process proceeds to step S815. On the other hand, if NO at step S814, the process at step S814 is performed again. Here, assuming that the menu operation program C is received, the process proceeds to step S815.

  In step S815, an operation image display process M is performed. In operation image display process M, control unit 510 executes the received program. Here, it is assumed that the received program is the menu operation program C. The control unit 510 executes the menu operation program C to generate the operation image MG500 of FIG. 35 using the VDP 532, and causes the display unit 530 to display the operation image MG500. Thereafter, the process of step S815 ends, and the process of step S814 is performed again.

With the above processing, in the state where the content is reproduced and displayed on the display unit 630 of the video display device 600, the operation image MG500 as a lower-layer menu image is displayed on the display unit 530 of the communication terminal device 500.
(Change playback content)
Next, when the content is reproduced and displayed on the display unit 630 of the video display device 600 and the operation image MG500 as a lower layer menu image is displayed on the display unit 530 of the communication terminal device 500, the content is reproduced and displayed. Processing for changing content will be described.

  Here, processing when the content acquisition operation M is performed in the communication terminal device 500 will be described.

  The content acquisition operation M is any one of the button images MBG511, MBG512, MBG513, MBG514, MBG515, MBG516, MBG517, MBG518, MBG519, MBG520, MBG521, and MBG522 displayed on the operation image MG500 as the lower layer menu image. This is a button image touch operation. Here, as an example, it is assumed that there is a touch operation on the button image MBG511. In this case, YES is determined in step S510 of the operation determination process MA of FIG. 25, and the process of step S511 is performed.

  In step S511, as described above, the touch operation handling process M is performed. In this case, in the touch operation handling process M, the content acquisition process M for the video display apparatus 600 to acquire the content corresponding to the touch-operated button image from the service server 800A is performed.

  FIG. 36 is a diagram showing a flowchart of content acquisition processing M, processing performed by video display device 600, and processing performed by service server 800A. The processing performed by video display device 600 and service server 800A in FIG. 36 is performed independently of other processing.

  Referring to FIG. 36, in content acquisition process M performed by communication terminal apparatus 500, first, the process of step S910 is performed.

  In step S910, a content acquisition request transmission process is performed. In the content acquisition request transmission process, first, control unit 510 uses the remote control data corresponding to the touch-operated button image to generate a content acquisition remote control signal. The content acquisition remote control signal is a remote control signal for the video display apparatus 600 to acquire content corresponding to the touch-operated button image from the service server 800A.

  Here, if the button image that has been touched is the button image MBG511, the corresponding remote control data is data including the program ID “P1234” indicated by the genre information of the number “1” in the submenu data D300SB of FIG. It is. In this case, the generated content acquisition remote control signal is a remote control signal including the program ID “P1234”. Further, the content corresponding to the touch-operated button image MBG511 is the content whose title is “B baseball”.

  Then, control unit 510 transmits the generated content acquisition remote control signal to video display device 600 as a content acquisition request.

In video display device 600, first, the process of step S920 is performed.
In step S920, control unit 610 determines whether or not a content acquisition remote control signal as a content acquisition request has been received. If YES in step S920, the process proceeds to step S921. On the other hand, if NO at step S920, the process at step S920 is performed again. Here, assuming that a content acquisition remote control signal including program ID “P1234” has been received, the process proceeds to step S921.

  In step S921, control unit 610 transmits content acquisition request TM to service server 800A. The content acquisition request TM is a request for acquiring the content selected by the communication terminal device 500 from the service server 800A. The content acquisition request TM includes a program ID “P1234” for specifying the content included in the content acquisition remote control signal. Here, the content selected in communication terminal device 500 is the content whose title is “B baseball” from submenu data D300SB of FIG. Thereafter, the process of step S921 ends. Hereinafter, the content requested to the service server 800A by the content acquisition request TM is also referred to as an acquisition request content.

  In the process performed by service server 800A, first, the process of step S940 is performed.

  In step S940, control unit 810 determines whether or not content acquisition request TM has been received. If YES in step S940, the process of step S941 is performed. On the other hand, if NO at step S940, the process at step S940 is performed again. Here, assuming that the content acquisition request TM including the program ID “P1234” has been received, the process proceeds to step S941.

  In step S941, content distribution processing is performed as in step S841 of FIG. In the content distribution processing, the control unit 810 starts processing for streaming distribution of the acquisition request content to the video display device 600 that has transmitted the content acquisition request TM. Here, the acquisition request content is content specified by the program ID “P1234”. The acquisition request content may be sent to the video display device 600 as a broadcast radio wave. The acquisition request content is assumed to be moving image data whose title is “B baseball”.

  When the distribution of the acquisition request content ends, the process of step S941 ends, and the process of step S940 is performed again.

In the video display device 600, the process proceeds to step S922 after the process of step S921.
In step S922, control unit 610 executes content display processing T. The content display process T is a process performed independently of other processes. Thereafter, the process of step S922 ends, and the process of step S920 is performed again.

  Since the content display process T is the same as the content display process T in step S821 of FIG. 33, detailed description will not be repeated. By this processing, a content image based on the acquisition request content whose title is “B baseball” is reproduced and displayed on the display unit 630.

  With the above processing, even when the content is reproduced and displayed on the display unit 630 of the video display device 600, the operation image MG500 as the lower-level menu image is displayed on the display unit 530 of the communication terminal device 500. The content displayed on the display unit 630 of the video display device 600 can be easily changed.

  As described above, in the present embodiment, processing for displaying the upper layer menu image and the lower layer menu image related to the upper layer menu image on communication terminal device 500 and video display device 600, respectively, is performed. That is, a plurality of menus respectively corresponding to a plurality of layers are displayed on a plurality of devices. Then, an operation for the upper layer menu image and an operation for the lower layer menu image are performed by a plurality of different operation units (display unit 530 and external buttons) of communication terminal device 500, respectively.

  In addition, content display and content menu display are performed on video display device 600 and communication terminal device 500, respectively. Then, the reproduction control of the content displayed and displayed and the operation of changing the content displayed and displayed are performed by a plurality of different operation units (external buttons and display unit 530) of communication terminal device 500, respectively.

Therefore, there is an effect that desired information (content) can be quickly selected. As a result, there is an effect that desired information (content) can be displayed quickly.
(Function block diagram)
FIG. 37 is a functional block diagram of control unit 510 and control unit 610 in the present embodiment. Referring to FIG. 37, control unit 510 includes a first transmission unit 515 and a second reception unit 517. Control unit 610 includes a first reception unit 615, a display control unit 616, and a second transmission unit 617.

  The first transmission unit 515 transmits a selection signal for selecting one of a plurality of types of first information to the video display device 600 in response to an instruction input from the outside.

  The first reception unit 615 receives the selection signal transmitted by the first transmission unit 515. The display control unit 616 replaces the second menu for selecting any of the plurality of types of second information corresponding to the first information selected by the received selection signal with the display unit 630 instead of the first menu. Display. Second transmission unit 617 transmits the first menu to communication terminal device 500.

The second reception unit 517 receives the first menu transmitted by the second transmission unit 617.
Note that all or part of the first transmission unit 515 and the second reception unit 517 included in the control unit 510 may be configured by hardware. In addition, all or part of the first reception unit 615, the display control unit 616, and the second transmission unit 617 included in the control unit 610 may be configured by hardware.

  FIG. 38 is another example of a functional block diagram of control unit 510 in the present embodiment. Referring to FIG. 38, control unit 510 includes a first input receiving unit 511A, a second input receiving unit 512A, and a transmission unit 513A.

  The first input receiving unit 511A receives an instruction input from the outside. Second input accepting unit 512A accepts an instruction input from the outside.

  When the first menu for selecting any one of a plurality of types of first information is displayed on the display unit 630 of the video display device 600, the transmission unit 513A receives the instruction input received by the first input reception unit 511A. Accordingly, a first process of transmitting a selection signal for selecting any one of a plurality of types of first information to the video display device 600 is performed. In addition, the transmission unit 513A displays a second menu for selecting one of a plurality of types of second information corresponding to the first information selected by the selection signal on the display unit 630 of the video display device 600, When the first menu is displayed on the display unit 530, the selection signal for selecting any one of the plurality of types of first information is displayed in accordance with the instruction input received by the second input receiving unit 512A. A second process of transmitting to device 600 is performed.

Note that all or part of the first input reception unit 511A, the second input reception unit 512A, and the transmission unit 513A included in the control unit 510 may be configured by hardware.
(Development of invention)
In the present embodiment, the process of displaying the upper layer menu image and the lower layer menu image on communication terminal device 500 and video display device 600 has been described. However, the present invention can also be implemented by displaying the upper layer menu image and the lower layer menu image on the video display device 600 and the communication terminal device 500, respectively.

  Further, in the present embodiment, the process of performing content reproduction display and content menu display in video display device 600 and communication terminal device 500 has been described. However, the present invention can also be implemented by performing content reproduction display and content menu display in communication terminal device 500 and video display device 600, respectively.

  Further, in the present embodiment, the description has been given of the process in which the reproduction control of the content displayed and displayed and the operation of changing the content displayed and reproduced are performed using the external button and display unit 530 of communication terminal device 500, respectively. However, the present invention can also be implemented by performing playback control of the content being played back and changing operation of the content being played back using the display unit 530 and the external button of the communication terminal device 500, respectively.

  Further, in the present embodiment, a case has been described in which the plurality of menus corresponding to the plurality of hierarchies are a genre menu and a content menu, respectively. However, the plurality of menus corresponding to the plurality of hierarchies are not limited to the above menus. The plurality of menus respectively corresponding to the plurality of hierarchies may be a plurality of WEB pages linked to each other by, for example, hyperlink character strings.

  In this case, for example, the video display device 600 may display a top page of a WEB site, and the communication terminal device 500 may display a lower layer WEB page linked from the top page. Further, for example, the video display device 600 may display a WEB page of a certain site, and the communication terminal device 500 may display a WEB page of another site linked from the WEB page of the site. .

  Conversely, when the video display device 600 displays the top page of the WEB site and the video display device 600 displays the link destination of the top page, the communication terminal device 500 displays the top page. Can be considered. In this case, when another link destination of the top page is to be displayed on the video display device 600, the communication terminal device 500 can easily select again without returning the display of the video display device 600.

  Further, there may be a usage form in which a product on an EC (Electronic Commerce) site is browsed with the video display device 600 and the purchase operation is operated and processed with the communication terminal device 500 at hand.

  The embodiment disclosed this time should be considered as illustrative in all points and not restrictive. The scope of the present invention is defined by the terms of the claims, rather than the description above, and is intended to include any modifications within the scope and meaning equivalent to the terms of the claims.

It is a figure which shows the structure of the network system in this Embodiment. It is the figure which showed the external appearance of the communication terminal device from the front. It is the figure which showed the external appearance of the communication terminal device from the left side surface. It is the figure which showed the external appearance of the communication terminal device from the back surface. It is the block diagram which showed the internal structure of the communication terminal device. It is the figure which showed the external appearance of the video display apparatus from the front. It is the block diagram which showed the internal structure of the video display apparatus. It is the block diagram which showed the internal structure of the service server. It is a figure which shows the remote control image as an example. It is a flowchart of a content handling process. It is a figure which shows the apparatus specific data as an example. It is a figure which shows the apparatus recognition image as an example. It is a figure which shows the program selection data as an example. It is a figure which shows the operation image as an example. It is a figure which shows the operation guidance display image as an example. It is a flowchart of the operation determination process M and the control signal corresponding process T. It is a flowchart of the process at the time of standby mode transfer. It is a figure which shows the display continuation confirmation image as an example. It is a figure which shows the apparatus recognition image as an example. It is a functional block diagram of the control part in this Embodiment. It is a functional block diagram of the control part in this Embodiment. It is a flowchart of a menu display process. It is a figure which shows the menu data as an example. It is a figure which shows the menu image as an example. It is a flowchart of the operation determination process MA and the control signal corresponding process TA. It is a figure which shows the flowchart of the process which a communication terminal device performs, the submenu acquisition process T, and the process which a service server performs. It is a figure which shows the submenu data as an example. It is a figure which shows the submenu image as an example. It is a figure which shows the operation image as an example. It is a figure which shows the flowchart of the submenu acquisition process M, the process which a video display apparatus performs, and the process which a service server performs. It is a figure which shows the submenu data as an example. It is a figure which shows the submenu image as an example. It is a figure which shows the flowchart of the process which a communication terminal device performs, the content acquisition process T, and the process which a service server performs. It is a figure which shows the content display image as an example. It is a figure which shows the operation image as an example. It is a figure which shows the flowchart of the content acquisition process M, the process which a video display apparatus performs, and the process which a service server performs. It is a functional block diagram of two different control parts in the present embodiment. It is another example of the functional block diagram of the control part in this Embodiment.

Explanation of symbols

  50 communication unit, 70 network, 180, 180A, 180B program, 300 remote control, 500 communication terminal device, 510, 610, 810 control unit, 520, 620, 820 storage unit, 530, 630 display unit, 540 input unit, 555 555A recording medium, 600 video display device, 800A service server, 800S search server, 800W Web server, 1000 network system.

Claims (3)

A video display system comprising a communication terminal device and a video display device capable of data communication with the communication terminal device,
The video display device
First display means for displaying a first menu for selecting any one of a plurality of types of first information;
The communication terminal device
In accordance with an instruction input from the outside, comprising a first transmission means for transmitting a selection signal for selecting any one of the plurality of types of first information to the video display device,
The video display device
First receiving means for receiving the selection signal transmitted by the first transmitting means;
A second menu for selecting any one of a plurality of types of second information corresponding to the first information selected by the received selection signal is displayed on the first display means instead of the first menu. Display control means;
A second transmission means for transmitting the first menu to the communication terminal device;
The communication terminal device
Second receiving means for receiving the first menu transmitted by the second transmitting means;
A video display system further comprising second display means for displaying the received first menu. A communication terminal device capable of data communication with a video display device provided with a display unit for displaying information,
The communication terminal device
Display means for displaying information;
First input receiving means for receiving an instruction input from the outside;
A second input receiving means for receiving an instruction input from the outside;
When a first menu for selecting any one of a plurality of types of first information is displayed on the display unit of the video display device, the first input accepting unit accepts the instruction according to the instruction input. A first process for transmitting a selection signal for selecting one of a plurality of types of first information to the video display device; and a plurality of types of second information corresponding to the first information selected by the selection signal. When a second menu for selecting one is displayed on the display unit of the video display device and the first menu is displayed on the display unit, the instruction received by the second input receiving unit A communication terminal device comprising: a transmission unit configured to perform a second process of transmitting a selection signal for selecting any one of the plurality of types of first information to the video display device according to an input.   The communication terminal apparatus according to claim 2, wherein the display unit also operates as the second input receiving unit.

Images