JP4767083B2 - VIDEO DISPLAY SYSTEM, COMMUNICATION TERMINAL DEVICE, VIDEO DISPLAY DEVICE, AND DEVICE CONTROL METHOD - Google Patents

Description

  The present invention relates to a video display system, a communication terminal device, a video display device, and a device control method, and more particularly to a video display system, a communication terminal device, a video display device, and a device control method that display information related to content.

  In recent years, devices conforming to a standard (hereinafter also referred to as inter-device communication standard) for enabling data communication with each other among a plurality of types of devices in a home are becoming widespread. The inter-device communication standard is, for example, a DLNA (Digital Living Network Alliance) standard. Devices conforming to the inter-device communication standard are, for example, a television receiver, an HDD (Hard disk drive) recorder, an audio device, and the like. In addition, a device compliant with the inter-device communication standard is generally connectable to a network such as the Internet via a network device such as a router.

  In general, a device that conforms to a communication standard between different devices that can be connected to a network is a device that can be operated by a remote controller. Therefore, it is required to operate a plurality of types of devices that can be operated with a remote controller and can be connected to a network with a single device.

  In JP 2002-135810 A (Patent Document 1), a communication terminal device such as a mobile phone that can be connected to a network such as the Internet and has a very high penetration rate operates a device that can be connected to the network. A technique for use as a remote controller is disclosed.

  In addition, with the spread of video display devices (hereinafter also referred to as network compatible display devices) such as television receivers that can be connected to a network, information related to the program while viewing the program displayed on the network compatible display device. At the same time, it is also required to refer to them.

Japanese Patent No. 3167109 (Patent Document 2) discloses a technique for simultaneously displaying a program displayed on a network-compatible display device and information related to the program. Also, Japanese Patent Application Publication No. 2001-518762 (Patent Document 3) discloses a technique for notifying the display device of the fact that information related to the content displayed on the display device can be accessed. Yes.
JP 2002-135810 A Japanese Patent No. 3167109 JP-T-2001-518762

  However, in the technology disclosed in Japanese Patent No. 3167109 (Patent Document 2), information related to a program as content (hereinafter also referred to as displayed content) displayed on a network-compatible display device is not necessarily limited. In some cases, the information is not desired by the user.

  Therefore, in order to display information desired by the user on the network-compatible display device, for example, a selection image in which a plurality of titles respectively corresponding to a plurality of pieces of information related to the displayed content is displayed on the network-compatible display device. The user needs time and effort to select the title corresponding to the desired information from the plurality of titles.

  In addition, when the selected image is displayed on the display unit of the network-compatible display device during the period in which the above processing is performed, the displayed content needs to be displayed in a reduced size so as not to prevent viewing of the displayed content. is there. In this case, there is a problem that the visibility of the displayed content that the user is viewing is reduced. In this case, in addition to displaying the displayed content in a reduced size, the selected image also needs to be displayed in a reduced size, and the number of titles that can be displayed is limited in the reduced-selected image. Therefore, there arises a problem that the user cannot quickly select a title corresponding to desired information.

  The present invention has been made to solve the above-described problems, and its purpose is to quickly obtain desired information without deteriorating the visibility of the content being displayed in the period for selecting information. It is an object to provide a video display system that can refer to the video.

  Another object of the present invention is to provide a communication terminal device capable of quickly referring to desired information without deteriorating the visibility of content being displayed in a period for selecting information. .

  Still another object of the present invention is to provide a video display device capable of quickly referring to desired information without deteriorating the visibility of content being displayed in a period for selecting information. is there.

  Still another object of the present invention is to provide a device control method capable of quickly referring to desired information without deteriorating the visibility of content being displayed in a period for selecting information. is there.

  In order to solve the above-described problem, according to an aspect of the present invention, a video display system including a communication terminal device and a video display device, which are capable of data communication with each other, the communication terminal device receives search information. The video display device is capable of data communication with a search server that searches a database as a key, and the video display device transmits a display unit that displays content and content-related information related to the content displayed on the display unit to the communication terminal device. The communication terminal device includes first receiving means for receiving the content related information, and second transmitting means for transmitting the content related information to the search server as search information. The search server receives the search information. Then, the database is searched using the search information as a key, and the search result data including a plurality of network addresses is sent to the communication terminal device The first receiving means receives the search result data, and the communication terminal device selects one of a plurality of network addresses included in the received search result data in accordance with the input instruction, and selects the selected network address. The video display device further includes a selection transmission unit that transmits to the video display device, the video display device receiving a network address transmitted by the selection transmission unit, and information corresponding to the network address received by the second reception unit. The image processing apparatus further includes acquisition means for acquiring from the network, and display control means for causing the display means to display information acquired from the network.

  Preferably, the communication terminal device further includes information display means for displaying a plurality of selection information for selecting a plurality of network addresses, and an instruction input means for receiving an instruction from the outside, wherein the selection transmission means is In response to a selection instruction for selecting one of the plurality of selection information received by the instruction input means, one of the plurality of selection information is selected, and a network address corresponding to the selected selection information is sent to the video display device. Send.

  According to another aspect of the present invention, a display unit for displaying information is provided, a video display device that displays information corresponding to the received network address on the display unit, and a search server that searches a database using search information as a key. A communication terminal device capable of data communication with each of the communication terminal devices, wherein the communication terminal device receives content-related information related to the content displayed on the display unit of the video display device, the content-related information, and the search information Transmission means for transmitting to the search server, the receiving means receives search result data including a plurality of network addresses from the search server, and the communication terminal device is included in the search result data received in response to the input instruction Select one of multiple network addresses and send the selected network address to the video display device Further comprising a selected transmission means that.

  Preferably, the communication terminal device further includes information display means for displaying a plurality of selection information for selecting a plurality of network addresses, and an instruction input means for receiving an instruction from the outside, wherein the selection transmission means is Select one of the plurality of selection information according to the selection instruction for selecting one of the plurality of selection information received by the instruction input means, and transmit the network address corresponding to the selected selection information to the video display device To do.

According to still another aspect of the present invention, a video display device capable of data communication with a communication terminal device capable of data communication with a search server that searches a database using search information as a key, the video display device displaying a content And means for transmitting content related information related to the content displayed on the display means to the communication terminal device, and receiving the content related information received by the communication terminal device as search information to the search server. Receiving means for receiving a network address selected from a plurality of network addresses, acquisition means for obtaining information corresponding to the network address received by the receiving means from the network, and display control for displaying information obtained from the network on the display means And further means according to the present invention. According to the aspect, it is a video display system composed of a communication terminal device and a video display device capable of data communication with each other, and the video display device is capable of data communication with a search server that searches a database using search information as a key The video display device includes display means for displaying content, and transmission means for transmitting content-related information related to the content displayed on the display means to the search server as search information. The search server receives the search information. Then, a database search is performed using the search information as a key, and search result data including a plurality of network addresses is transmitted to the video display device. The video display device further includes first receiving means for receiving the search result data. The received search result data is transmitted to the communication terminal device, and the communication terminal device receives the search result data. A receiving unit; and a selection transmitting unit that selects any one of a plurality of network addresses included in the received search result data and transmits the selected network address to the video display device in response to an input instruction. The means receives the network address transmitted by the selective transmission means, and the video display device further includes an acquisition means for acquiring information corresponding to the network address received by the first reception means from the network, and the transmission means includes the acquisition means The acquired information is transmitted to the communication terminal apparatus, the second receiving means receives the information transmitted by the transmitting means, and the communication terminal apparatus further includes information display means for displaying the information received by the second receiving means.

  According to still another aspect of the present invention, a first control method and a second control method for causing a video display device and a communication terminal device, each of which is capable of data communication and provided with a display unit for displaying information, to be executed, respectively. The communication terminal device is capable of data communication with a search server that searches a database using search information as a key. The first control method includes a display step of displaying content on a display unit, and a display unit A first transmission step of transmitting content-related information related to the displayed content to the communication terminal device; a second control method: a first reception step of receiving content-related information; and searching for content-related information as search information A second transmission step for transmitting to the server, and when the search server receives the search information, A search result data including a plurality of network addresses is transmitted to the communication terminal device, the first reception step includes a step of receiving the search result data, and the second control method receives the response according to the input instruction. And a selection transmission step of selecting any one of a plurality of network addresses included in the retrieved search result data and transmitting the selected network address to the video display device. The first control method includes the network transmitted in the selection transmission step. A second receiving step for receiving the address; an obtaining step for obtaining information corresponding to the network address received by the second receiving step from the network; and a display control step for causing the display unit to display the information obtained from the network. .

  The video display system according to the present invention includes a communication terminal device and a video display device. The video display device transmits content related information related to the content displayed on the display means to the communication terminal device, and the communication terminal device transmits the received content related information to the search server as search information. Upon receiving the search information, the search server searches the database using the search information as a key, and transmits search result data including a plurality of network addresses to the communication terminal device. In response to the input instruction, the communication terminal device selects any one of a plurality of network addresses included in the received search result data, and transmits the selected network address to the video display device. The video display device receives information corresponding to the received network address. Is acquired from the network and displayed on the display means.

  Therefore, it is possible to search for information related to the content related information without reducing the content displayed on the display means. In addition, a communication terminal device, which is a device different from the device displaying the content, receives search result data including a plurality of network addresses from the search server that performed the search.

  Then, the communication terminal device selects one of a plurality of network addresses in response to the input instruction, and transmits the selected network address to the video display device. The video display device acquires information corresponding to the received network address from the network. And display it on the display means. As a result, there is an effect that desired information can be referred to quickly without reducing the visibility of the content being displayed in the period for selecting information.

  The communication terminal device according to the present invention is provided with a display unit, and is capable of data communication with a video display device that displays information corresponding to the received network address on the display unit. The communication terminal device receives the content related information related to the content displayed on the display unit of the video display device, and transmits it as search information to the search server. Then, the communication terminal device receives the search result data including a plurality of network addresses from the search server, selects one of the plurality of network addresses included in the received search result data according to the input instruction, and displays the video Send to device. The video display device displays information corresponding to the received network address on the display unit.

  Therefore, it is possible to search for information related to the content related information without reducing the content displayed on the display unit. In addition, a communication terminal device, which is a device different from the device displaying the content, receives search result data including a plurality of network addresses from the search server that performed the search.

  Then, the communication terminal device selects any one of the plurality of network addresses according to the input instruction and transmits the selected network address to the video display device, and the video display device displays information corresponding to the received network address on the display unit. . As a result, there is an effect that desired information can be referred to quickly without reducing the visibility of the content being displayed in the period for selecting information.

  The video display device according to the present invention transmits content-related information related to the content displayed on the display means to the communication terminal device, and transmits the content-related information received by the communication terminal device to the search server as search information. A network address selected from the plurality of received network addresses is received. Then, information corresponding to the received network address is acquired from the network and displayed on the display means.

  Therefore, it is possible to search for information related to the content related information without reducing the content displayed on the display means. In addition, the video display device receives a network address selected from a plurality of network addresses received from a search server in which a communication terminal device, which is a device different from the device displaying the content, searches. The video display device acquires information related to the search information corresponding to the received network address from the network and causes the display unit to display the information. As a result, there is an effect that desired information can be referred to quickly without reducing the visibility of the content being displayed in the period for selecting information.

  The video display system according to the present invention includes a communication terminal device and a video display device. The video display device transmits content related information related to the content displayed on the display means to the search server as search information. Upon receiving the search information, the search server searches the database using the search information as a key, and transmits search result data including a plurality of network addresses to the video display device. The video display device transmits the received search result data to the communication terminal device, and the communication terminal device selects and selects one of a plurality of network addresses included in the received search result data according to the input instruction. The network address is sent to the video display device. The video display device acquires information corresponding to the received network address from the network, and transmits the information to the communication terminal device. The communication terminal device displays the received information on the information display means.

  Therefore, it is possible to search for information related to the content related information without reducing the content displayed on the display means. In addition, a communication terminal device, which is a device different from the device displaying the content, receives search result data including a plurality of network addresses from the search server that performed the search.

  Then, the communication terminal device selects one of a plurality of network addresses in response to the input instruction, and transmits the selected network address to the video display device. The video display device displays information related to the search information corresponding to the received network address. , Acquired from the network, and transmitted to the communication terminal device. The communication terminal device displays the received information on the information display means. As a result, there is an effect that desired information can be referred to quickly without reducing the visibility of the content being displayed in the period for selecting information.

  The device control method according to the present invention includes a first control method and a second control method for causing a video display device provided with a display unit and a communication terminal device to execute the respective methods. By executing the first control method and the second control method, the following processing is performed. The video display device transmits content-related information related to the content displayed on the display unit to the communication terminal device, and the communication terminal device transmits the received content-related information to the search server as search information. Upon receiving the search information, the search server searches the database using the search information as a key, and transmits search result data including a plurality of network addresses to the communication terminal device. In response to the input instruction, the communication terminal device selects any one of a plurality of network addresses included in the received search result data, and transmits the selected network address to the video display device. The video display device receives information corresponding to the received network address. Is acquired from the network and displayed on the display unit.

  Therefore, it is possible to search for information related to the content related information without reducing the content displayed on the display unit. In addition, a communication terminal device, which is a device different from the device displaying the content, obtains a plurality of network addresses for acquiring a plurality of pieces of information related to the content related information from the network from the search server that performed the search. Receive search result data.

  Then, the communication terminal device selects one of a plurality of network addresses in response to the input instruction, and transmits the selected network address to the video display device. The video display device acquires information corresponding to the received network address from the network. And display it on the display means. As a result, there is an effect that desired information can be referred to quickly without reducing the visibility of the content being displayed in the period for selecting information.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings. In the following description, the same parts are denoted by the same reference numerals. Their names and functions are also the same. Therefore, detailed description thereof will not be repeated.

<First Embodiment>
FIG. 1 is a diagram illustrating a configuration of a network system 1000 according to the present embodiment. With reference to FIG. 1, a network system 1000 includes a home network 501.

  Home network 501 is, for example, a network provided in a home. The home is, for example, a user's home, a company, or the like. Home network 501 includes communication terminal device 500, video display device 600, and communication unit 50.

  Communication terminal device 500 is a PDA (Personal Digital Assistance). Communication terminal device 500 has a telephone function. Communication terminal device 500 may not have a telephone function. Communication terminal device 500 is not limited to a PDA, and may be any device (for example, a PC (Personal Computer) or a mobile phone) as long as it has a communication function and is portable.

  The communication terminal device 500 can perform data communication with the telephone network 60 by radio. The telephone network 60 is a telephone network for mobile phones, for example. Note that when the communication terminal device 500 performs data communication with the telephone network 60, a packet fee corresponding to the amount of data used at the time of data communication is generated.

  The video display device 600 is a liquid crystal television. The video display device 600 is not limited to a liquid crystal television, and may be any device that can display an image. Video display device 600 may be, for example, a plasma television. The video display device 600 may be a device that includes a display device for displaying an image and an image data transmission device that transmits image data to be displayed on the display device. The image data transmitting device is, for example, an STB (Set Top Box), HDD recorder, DVD (Digital Versatile Disc) recorder, or the like.

  Communication terminal device 500 and video display device 600 perform data communication wirelessly or by wire. That is, the communication terminal device 500 and the video display device 600 constitute a video display system.

  The communication unit 50 has a function of performing data communication with each of the communication terminal device 500, the video display device 600, and the network 70. The network 70 is an external network such as the Internet.

  The communication unit 50 has a function of performing data communication simultaneously with a plurality of devices by using a wireless technology based on any one of IEEE802.11a, IEEE802.11b, and IEEE802.11g, which are wireless LAN standards. Note that the radio technology is not limited to a technology based on any of IEEE 802.11a, IEEE 802.11b, and IEEE 802.11g, and may be other radio technologies. Therefore, communication unit 50 can perform data communication with each of communication terminal device 500, video display device 600, and network 70 wirelessly.

The communication unit 50 further has a communication interface using Ethernet (registered trademark). When a device in the home network 501 issues a connection request to the network 70, the address of the device is set in the network 70. It has a router function including a NAT (Network Address Translation) function for converting addresses. Therefore, the communication unit 50 can perform data communication with each of the communication terminal device 500, the video display device 600, and the network 70, for example, via a LAN cable. That is, the communication unit 50 can perform data communication with each of the communication terminal device 500, the video display device 600, and the network 70 by wire.

The communication unit 50 further has a communication interface function (for example, a router function) using Ethernet (registered trademark). Therefore, the communication unit 50 can perform data communication with each of the communication terminal device 500, the video display device 600, and the network 70, for example, via a LAN cable. That is, the communication unit 50 can perform data communication with each of the communication terminal device 500, the video display device 600, and the network 70 by wire.

  The network 70 can perform data communication with the telephone network 60 by radio or wire. Therefore, the communication terminal device 500 can perform data communication with the network 70 via the telephone network 60.

  Network system 1000 further includes service server 800A, search server 800S, and Web server 800W.

  The service server 800A is a server that provides content, information related to the content, and the like. The content is, for example, a moving image or music data. For example, when the content is a moving image of a program, the information related to the content is, for example, program information. Service server 800A is a PC. The service server 800A is not limited to a PC, and any device can be used as long as it has a function of providing content such as moving images, content such as music data, information related to the content, and the like. May be.

  The service server 800A records all the programs of all the channels in the period from the current date and time to the date and time before a predetermined period (for example, 24 hours), and stores recorded data obtained by recording the program. Service server 800A automatically deletes recorded data after a predetermined period (for example, 24 hours) from the current date and time. Therefore, the service server 800A stores the recording data of all the programs of all the channels in the period from the current date and time to the date and time before the predetermined period. The service server 800A stores video content such as a movie to be distributed in response to a distribution request from the apparatus, separately from the recording data of the broadcast program. If there is a recording data distribution request, the service server 800A transmits or performs streaming distribution of the recording data requested to be distributed to the apparatus that has requested the recording data distribution.

  Further, the service server 800A stores in advance a program currently being broadcast and moving image data scheduled to be broadcast for a predetermined period (for example, 24 hours). If there is a distribution request for moving image data of a program that is currently being broadcast, the distribution-requested moving image data is streamed to the apparatus that has requested the distribution of moving image data.

  When a search server 800S receives a keyword as search information from a terminal device connected to the network 70, the search server 800S searches a URL (Uniform Resource Locator) of a Web page of information related to the received keyword. The search server 800S is a PC. The search server 800S is not limited to a PC, and when receiving a keyword from a terminal device connected to the network 70, the search server 800S searches for a URL (Uniform Resource Locator) of a Web page of information related to the received keyword. Any device having a function may be used.

  Web server 800W is a server that provides data of a plurality of Web pages corresponding to each of a plurality of types of information. Web server 800W provides data of a plurality of Web pages corresponding to information related to a movie, for example. Web server 800W is a PC. Web server 800W is not limited to a PC, and may be any device that has a function of providing data of a plurality of Web pages corresponding to each of a plurality of types of information.

  Each of service server 800A, search server 800S, and Web server 800W performs data communication with network 70 in a wireless or wired manner.

  In the present embodiment, it is assumed that communication unit 50 can perform high-speed data communication with each of communication terminal device 500, video display device 600, and network 70. It is assumed that the communication unit 50 can perform data communication with each of the communication terminal device 500, the video display device 600, and the network 70, for example, at a maximum speed of 100 Mbps.

  In addition, it is assumed that the network 70 can perform high-speed data communication with each of the communication unit 50, the telephone network 60, the service server 800A, the search server 800S, and the Web server 800W. It is assumed that the network 70 can perform data communication with each of the communication unit 50, the telephone network 60, the service server 800A, the search server 800S, and the Web server 800W, for example, at a maximum speed of 100 Mbps. Therefore, for example, it is assumed that the maximum speed of data communication between the video display device 600 and the network 70 is 100 Mbps. For example, it is assumed that the maximum speed of data communication between the communication terminal device 500 and the network 70 is 100 Mbps.

  It is assumed that the data communication speed between communication terminal device 500 and telephone network 60 is slower than the data communication speed between communication terminal device 500 and network 70. Assume that the maximum speed of data communication between communication terminal device 500 and telephone network 60 is, for example, 256 kbps.

  Further, it is assumed that the data communication speed between the communication terminal device 500 and the video display device 600 is sufficiently higher than the data communication speed between the communication terminal device 500 and the telephone network 60. It is assumed that the maximum speed of data communication between the communication terminal device 500 and the video display device 600 is 4 Mbps, for example.

Next, the communication terminal device 500 will be described in detail.
FIG. 2 is a diagram showing the external appearance of the communication terminal device 500 from the front. Referring to FIG. 2, communication terminal device 500 includes a display unit 530, an audio output unit 570, an LED 576, and an input unit 540.

  The display unit 530 has a function of displaying characters, images, and the like. The display unit 530 is a device that uses either an LCD panel (Liquid Crystal Display Panel) or an organic EL display panel (Organic Electroluminescence Display Panel). Note that the display unit 530 may be a device using a panel of a display method other than the above.

  The resolution of the display unit 530 is horizontal 480 (dots) × vertical 640 (dots). The resolution of the display unit 530 is not limited to horizontal 480 (dots) × vertical 640 (dots), and may be another resolution (for example, horizontal 240 (dots) × vertical 320 (dots)). .

  The display unit 530 has a touch panel function that allows the user to input information by directly touching the screen. Display unit 530 transmits the position information of the user touching the screen to control unit 510 described later. Control unit 510 performs predetermined processing based on the received position information.

  The voice output unit 570 has a function of outputting the voice of the telephone. Audio output unit 570 includes a speaker that outputs audio. The audio output unit 570 outputs audio based on audio data received from the control unit 510 described later from the speaker.

  The LED 576 performs light notification according to processing performed in the communication terminal device 500. For example, the LED 576 blinks light when an incoming call is received.

  The input unit 540 includes a button group 541. The button group 541 includes direction buttons 541A, 541B, 541C, 541D, and an enter button 541E. The direction buttons 541A, 541B, 541C, and 541D are displayed when the image is displayed on the display unit 530 by a short time (for example, less than 1 second) pressing operation (hereinafter also referred to as a short pressing operation) by the user. This is a button for moving an object to be moved (for example, a cursor) vertically and horizontally. Specifically, the direction buttons 541A, 541B, 541C, and 541D in which a short press operation has been performed are buttons for moving the cursor up, down, left, and right, respectively, for example.

  The determination button 541E is a button for determining an item or the like selected by a short press operation of the direction buttons 541A, 541B, 541C, 541D, for example.

  Input unit 540 further includes function buttons 542A, 542B, 543A, and 543B. Each of the function buttons 542A and 542B is a button for starting a program or the like preset by the user, for example, by a short press operation.

  The function button 543A is a button for starting a call by a short press operation when a call is made to the communication terminal device 500. The function button button 543B is a button for ending the call by a short press operation when the communication terminal device 500 is in a call. The function button button 543B is a button for switching the power supply of the communication terminal device 500 on and off in response to a pressing operation (hereinafter also referred to as a long pressing operation) for a long time (for example, 1 second or more) by the user. It is.

  The input unit 540 transmits a button signal corresponding to a short-pressed or long-pressed button among a plurality of buttons included in the input unit 540 to the control unit 510 described later. That is, the input unit 540 is an interface for the user to operate the communication terminal device 500. Hereinafter, an operation of the input unit 540 or a touch operation on the display unit 530 by the user is also referred to as an interface operation M.

  Communication terminal device 500 further includes a voice input unit 574. The voice input unit 574 has a function of inputting voice during a call. The voice input unit 574 includes a microphone for inputting voice. The voice input unit 574 converts voice acquired by the microphone into voice data, and transmits the voice data to the control unit 510 described later in the communication terminal device 500.

  FIG. 3 is a diagram showing an appearance of the communication terminal device 500 from the left side. Referring to FIG. 3, communication terminal apparatus 500 includes a recording medium insertion unit 550A. The recording medium insertion unit 550A is a part that inserts a recording medium, which will be described later, into the communication terminal device 500.

  FIG. 4 is a diagram showing the appearance of the communication terminal device 500 from the back. With reference to FIG. 4, communication terminal apparatus 500 further includes an audio output unit 572 and an imaging unit 578. The audio output unit 572 has a function of outputting audio corresponding to processing performed by the control unit 510 described later. The sound output unit 572 includes a speaker that outputs sound. The audio output unit 572 outputs audio based on audio data received from the control unit 510 described later from the speaker.

  The imaging unit 578 has a function of performing an imaging process for imaging a subject to be imaged. The imaging unit 578 includes an imaging lens, a light receiving unit, and a color filter unit (not shown). The light receiving unit has a function of converting input light into an electrical signal. The light receiving unit is composed of a plurality of light receiving elements. The light receiving element is an element using, for example, a CCD (Charge Coupled Device) image sensor or a CMOS (Complementary Metal Oxide Semiconductor) image sensor.

  The color filter unit is composed of a plurality of color filters. The color filter is a filter corresponding to each of R, G, and B. The plurality of color filters are provided corresponding to the plurality of light receiving elements, respectively.

  The following processing is performed in the imaging processing. First, the imaging unit 578 inputs light reflected by the subject to be imaged and incident on the imaging lens to the light receiving unit via the color filter unit. The light receiving unit converts the input light into an electrical signal. The imaging unit 578 converts the converted electrical signal into digital data (hereinafter also referred to as captured image data).

  FIG. 5 is a block diagram showing an internal configuration of communication terminal apparatus 500. FIG. 5 also shows a recording medium 555 for explanation. A recording medium 555 stores a program 180 described later. That is, the program 180 is recorded on a medium or the like and distributed as a program product. The recording medium 555 is also distributed as a program product.

  Referring to FIG. 5, communication terminal apparatus 500 further includes a control unit 510, a temporary storage unit 522, and a storage unit 520.

  The storage unit 520 has a function of storing data in a nonvolatile manner. The storage unit 520 is accessed by the control unit 510. The storage unit 520 is a medium (for example, a flash memory) that can hold data in a nonvolatile manner even when power is not supplied. The storage unit 520 stores a program 180, recording data to be described later, various other data, and the like. The program 180 includes a remote control program described later.

  Control unit 510 has a function of performing various types of processing, arithmetic processing, and the like for each unit in communication terminal device 500 in accordance with program 180 stored in storage unit 520. The control unit 510 may be any of a microprocessor, a field programmable gate array (FPGA), an application specific integrated circuit (ASIC), and other circuits having arithmetic functions.

  Temporary storage unit 522 is accessed as data by control unit 510 and used as a work memory for temporarily storing data. The temporary storage unit 522 includes a RAM (Random Access Memory), an SRAM (Static Random Access Memory), a DRAM (Dynamic Random Access Memory), an SDRAM (Synchronous DRAM), a DDR-SDRAM (Double Data Rate SDRAM), and an RDRAM (Rambus Dynamic Random). (Access Memory (registered trademark)), Direct-RDRAM (Direct Rambus Dynamic Random Access Memory (registered trademark)), or any other circuit having a configuration capable of storing and storing data in a volatile manner.

  Communication terminal device 500 further includes an antenna 502, a tuner 505, and a data processing unit 507.

  The antenna 502 is connected to the tuner 505. The tuner 505 receives a broadcast signal having a frequency instructed by the control unit 510 via the antenna 502. The tuner 505 has a function of receiving broadcast signals based on digital broadcasting and analog broadcasting.

  The broadcast signal includes image data, audio data, text data, and EPG (Electric Program Guide) data. When the broadcast signal is a signal based on digital broadcasting, the broadcast signal further includes BML (Broadcast Markup Language) data and the like. The EPG data is data indicating a plurality of program information. BML data is data for controlling the arrangement position and operation of each of image data, audio data, and text data. The tuner 505 transmits the received broadcast signal to the data processing unit 507.

  The data processing unit 507 demodulates the received broadcast signal to obtain demodulated data. When the received broadcast signal is a signal based on analog broadcast, the data processing unit 507 performs the following processing. First, the data processing unit 507 decodes the demodulated data to obtain image data and audio data, and obtains text data and EPG data from a vertical blanking interval (VBI) of the broadcast signal.

  When the data processing unit 507 receives a display instruction for causing the display unit 530 to display an image from the control unit 510, the data processing unit 507 transmits the image data to a VDP (Video Display Processor) 532 described later. When receiving the image data, the VDP 532 displays an image (moving image or still image) based on the image data on the display unit 530.

  In addition, when the data processing unit 507 receives a recording instruction for performing a recording process from the control unit 510, the data processing unit 507 compresses the image data and the audio data and stores the compressed image data and the audio data in the storage unit 520. The recorded data in this case is also referred to as content below. The recorded data is data compressed in MPEG (Moving Picture Experts Group) 4 format. The recorded data is not limited to data compressed in the MPEG4 format, and may be data compressed in another format. Here, other formats include, for example, MPEG1, MPEG2, H.264. H.264 or the like.

  When the received broadcast signal is a signal based on digital broadcast, the data processing unit 507 performs the following processing. First, the data processing unit 507 decodes the demodulated data based on the digital broadcasting standard to obtain decoded data. The decoded data includes image data, audio data, text data, EPG data, and BML data. Image data and audio data included in the decoded data are data compressed in the MPEG4 format. The image data and audio data included in the decoded data are not limited to data compressed in the MPEG4 format, and may be data compressed in other formats. Here, other formats include, for example, MPEG1, MPEG2, H.264. H.264 or the like.

  When the data processing unit 507 receives a display instruction for displaying an image on the display unit 530 from the control unit 510, the data processing unit 507 transmits the image data included in the decoded data of the channel specified by the display instruction to the VDP 532 described later. Send. When receiving the image data, the VDP 532 displays an image (moving image or still image) based on the image data on the display unit 530.

  Further, when receiving a recording instruction for performing a recording process from the control unit 510, the data processing unit 507 stores the decoded data of the channel designated by the recording instruction in the storage unit 520 as the recording data. The recorded data in this case is also referred to as content below. In this case, the recorded data includes image data, audio data, text data, and BML data.

  Communication terminal apparatus 500 further includes VDP 532 and VRAM (Video Random Access Memory) 536.

The VRAM 536 has a function of temporarily storing image data.
Control unit 510 issues a drawing instruction to VDP 532 according to program 180 stored in storage unit 520. The drawing instruction is an instruction for generating an image and causing the display unit 530 to display the image.

  The VDP 532 is connected to the display unit 530. The VDP 532 reads font data, graphic data, and the like from a program 180 (to be described later) in the storage unit 520 in response to a drawing instruction from the control unit 510 and generates an image using the VRAM 536. The VDP 532 reads out the image data stored in the VRAM 536 and causes the display unit 530 to display an image based on the image data.

  Communication terminal device 500 further includes an input unit 540 and a recording medium access unit 550.

  Control unit 510 receives, from input unit 540, a button signal corresponding to a button that has been subjected to a short press operation or a long press operation among the plurality of buttons included in input unit 540. Control unit 510 performs processing according to the received button signal.

  The recording medium access unit 550 can access the recording medium 555 when the recording medium 555 is inserted (attached) to the communication terminal device 500 from the recording medium insertion unit 550A. As a result, the recording medium access unit 550 can read the program 180 from the recording medium 555 on which the program 180 is recorded.

  The program 180 stored in the recording medium 555 is read by the recording medium access unit 550 by the installation process of the control unit 510, and the control unit 510 stores the program 180 in the storage unit 520. The installation processing program is stored in advance in the storage unit 520, and the installation processing is performed by the control unit 510 based on the installation processing program.

  Note that the program 180 may not be installed in the storage unit 520. In this case, control unit 510 reads program 180 stored in recording medium 555 via recording medium access unit 550, and performs predetermined processing based on program 180. The recording medium 555 further records content data and the like. The content data is, for example, music data, moving image data, and the like.

  The recording medium 555 includes a floppy (registered trademark) disk, a CF (Compact Flash (registered trademark)) card, SM (Smart Media (registered trademark)), MMC (Multi Media Card (registered trademark)), and SD (Secure Digital (registered trademark)). (Trademark)) Memory Card, Memory Stick (Registered Trademark), xD Picture Card (Registered Trademark), and non-volatile memory other than the above.

Communication terminal device 500 further includes a communication unit 560 and a communication unit 562.
Communication unit 560 exchanges data with control unit 510. The communication unit 560 has a function of transmitting and receiving data to and from the video display device 600 in a wired or wireless manner.

  The communication unit 560 has a function of a communication interface that performs serial transfer based on the USB (Universal Serial Bus) 1.1 or USB 2.0 standard. Note that the standard of the communication interface for performing serial transfer is not limited to USB 1.1 or USB 2.0, but may be another standard.

  Note that the communication unit 560 may have a function of a communication interface that performs parallel transfer. The communication interface that performs parallel transfer is, for example, an interface that conforms to a standard based on Centronics (registered trademark) or a standard of IEEE 1284 (Institute of Electrical and Electronic Engineers 1284). Further, the communication unit 560 may have a communication interface function based on the IEEE 1394 or SCSI standard.

  Communication unit 560 further has a wireless data communication function. The wireless data communication function has a function of performing data communication wirelessly using Bluetooth (Bluetooth (registered trademark)). Note that the wireless data communication is not limited to a method using Bluetooth (registered trademark), and may be another communication method using infrared light, for example. Communication unit 560 performs data communication with video display device 600 wirelessly in response to a control instruction from control unit 510.

  Communication unit 562 exchanges data with control unit 510. The communication unit 562 has a function of performing data communication using a wireless technology based on any one of IEEE802.11a, IEEE802.11b, and IEEE802.11g, which are wireless LAN standards. Note that the radio technology is not limited to a technology based on any of IEEE 802.11a, IEEE 802.11b, and IEEE 802.11g, and may be other radio technologies. Therefore, the communication unit 562 can perform data communication with the communication unit 50 wirelessly. For example, the communication unit 562 sends a recording data transmission request to the video display device 600 via the communication unit 50 and transmits the recorded recording. Data can be received and streaming playback can be performed.

  The communication unit 562 further has a communication interface function using Ethernet (registered trademark). Therefore, the communication unit 562 can perform data communication with the communication unit 50 via, for example, a LAN cable.

  Therefore, communication terminal device 500 according to the present embodiment can also download a program from network 70 via communication unit 50 and communication unit 562 and store the program in storage unit 520. In this case, the downloaded program is the program 180.

  Control unit 510 performs predetermined processing in accordance with a program (program 180) downloaded from network 70. The download program is stored in advance in the storage unit 520, and the download process is performed by the control unit 510 based on the download program.

Communication terminal device 500 further includes an antenna 564 and a communication unit 566.
The antenna 564 is connected to the communication unit 566. The communication unit 566 has a function of transmitting and receiving a wireless communication signal using the antenna 564. The communication unit 566 receives a wireless communication signal having a frequency designated by the control unit 510 via the antenna 564. The wireless communication signal is a signal including voice data, character data, image data, and the like.

  Communication unit 566 uses antenna 564 to communicate with the nearest base station (not shown) using a wireless communication signal. The nearest base station can communicate with the telephone network 60. Therefore, the communication unit 566 uses the antenna 564 to communicate with the telephone network 60 via the nearest base station using a wireless communication signal. When receiving the wireless communication signal, the communication unit 566 demodulates the wireless communication signal and transmits data based on the demodulated wireless communication signal to the control unit 510. Further, when transmitting a wireless communication signal, the communication unit 566 receives data (for example, audio data) from the control unit 510 and converts the data into a wireless communication signal based on a predetermined protocol. Communication unit 566 then uses antenna 564 to transmit the converted wireless communication signal to telephone network 60 via the nearest base station (not shown).

  The communication unit 566 can also acquire information indicating the position of the base station (hereinafter also referred to as base station position information) by communicating with the nearest base station. The communication unit 566 transmits the acquired base station position information to the control unit 510 in response to a control instruction from the control unit 510. Control unit 510 can roughly grasp the position of communication terminal apparatus 500 based on the received base station position information.

  The communication unit 566 has a GPS (Global Positioning System) function. The GPS function is a function of communicating with the artificial satellite and acquiring information (hereinafter also referred to as GPS position information) of the position (position based on latitude, longitude, altitude, etc.) of the communication terminal device 500. The communication unit 566 acquires GPS position information in response to a control instruction from the control unit 510 and transmits it to the control unit 510.

  Control unit 510 performs data communication with voice output units 570 and 572 and voice input unit 574 described above.

  When control unit 510 transmits audio data to audio output unit 570, audio output unit 570 outputs audio based on the audio data received from control unit 510 from the speaker. When control unit 510 transmits audio data to audio output unit 572, audio output unit 572 outputs audio based on the audio data received from control unit 510 from the speaker.

  When the user utters voice to the microphone included in the voice input unit 574, the voice input unit 574 converts voice acquired by the microphone into voice data, and transmits the voice data to the control unit 510.

  The control unit 510 performs data communication with the LED 576 and the imaging unit 578 described above. The LED 576 emits light based on a control instruction from the control unit 510.

  The imaging unit 578 performs the above-described imaging processing based on a control instruction from the control unit 510 and transmits captured image data to the control unit 510. Upon receiving the captured image data, control unit 510 stores the captured image data in any of temporary storage unit 522, storage unit 520, and recording medium 555.

  Communication terminal device 500 further includes a vibration unit 579. The vibration unit 579 has a function of vibrating the communication terminal device 500 based on a control instruction from the control unit 510. The vibration unit 579 vibrates the communication terminal device 500 based on a control instruction from the control unit 510 when, for example, an incoming call or an e-mail is received.

  Communication terminal device 500 further includes RFID 580. The RFID 580 is an integrated circuit based on RFID (Radio Frequency Identification) having a security function such as Felica (registered trademark), and communicates with a reading terminal (not shown) in a non-contact manner. The RFID 580 outputs data such as a terminal ID based on a control instruction from the control unit 510.

Next, the video display device 600 will be described in detail.
FIG. 6 is a diagram showing the external appearance of the video display device 600 from the front. Referring to FIG. 6, video display device 600 includes a display unit 630 and an audio output unit 670.

  The display unit 630 has a function of displaying characters, images, and the like. The display unit 630 is a device using any one of an LCD panel, a CRT (Cathode Ray Tube), an FED panel (Field Emission Display Panel), a PDP (Plasma Display Panel), and an organic EL display panel. Note that the display unit 630 may be a device using a panel with a display method other than the above. The resolution of the display unit 630 is larger than the resolution of the display unit 530. For example, the resolution of the display unit 630 is a resolution of horizontal 1366 (dots) × vertical 768 (dots) at which a PC image can be displayed. The resolution of the display unit 630 is not limited to horizontal 1366 (dots) × vertical 768 (dots), but may be other resolutions (for example, 1024 × 768). The aspect ratio of the display unit 630 displaying the video is 16: 9. The aspect ratio is not limited to 16: 9 and may be 4: 3.

  The audio output unit 670 has a function of outputting audio corresponding to processing performed by the control unit 610 described later. Audio output unit 670 includes a speaker that outputs audio. The audio output unit 670 outputs audio based on audio data received from the control unit 610 described later from the speaker.

  FIG. 7 is a block diagram showing an internal configuration of the video display device 600. FIG. 7 also shows a recording medium 555A for explanation. A recording medium 555A records a program 180A described later. That is, the program 180A is recorded on a medium or the like and distributed as a program product. The recording medium 555A is also distributed as a program product.

  Referring to FIG. 7, video display device 600 further includes a control unit 610, a temporary storage unit 622, and a storage unit 620.

  The storage unit 620 has a function of storing data in a nonvolatile manner. The storage unit 620 is accessed by the control unit 610. The storage unit 620 is a hard disk capable of storing a large amount of data. Note that the storage unit 620 is not limited to a hard disk, and may be any medium (for example, a flash memory) that can hold data in a nonvolatile manner even when power is not supplied. The storage unit 620 stores a program 180A, recording data to be described later, a device ID for identifying the video display device 600, various other data, and the like.

  Control unit 610 has a function of performing various types of processing, arithmetic processing, and the like for each unit in video display device 600 in accordance with program 180A stored in storage unit 620. Since control unit 610 is similar to control unit 510 described above, detailed description will not be repeated.

  The temporary storage unit 622 is used as a work memory that is accessed by the control unit 610 and temporarily stores data. Since temporary storage unit 622 is similar to temporary storage unit 522 described above, detailed description thereof will not be repeated.

  The video display device 600 further includes an antenna 602, a tuner 605, and a data processing unit 607.

  The antenna 602 is connected to the tuner 605. The tuner 605 receives a broadcast signal having a frequency instructed by the control unit 610 via the antenna 602. The tuner 605 has a function of receiving broadcast signals based on digital broadcasting and analog broadcasting.

  The broadcast signal includes image data, audio data, text data, and EPG data. When the broadcast signal is a signal based on digital broadcasting, the broadcast signal further includes the BML data described above. The tuner 605 transmits the received broadcast signal to the data processing unit 607.

  The data processing unit 607 demodulates the received broadcast signal to obtain demodulated data. When the received broadcast signal is a signal based on analog broadcast, the data processing unit 607 performs the following processing. First, the data processing unit 607 decodes the demodulated data, acquires image data and audio data, and acquires text data and EPG data from the vertical blanking interval of the broadcast signal.

  When the data processing unit 607 receives a display instruction for displaying an image on the display unit 630 from the control unit 610, the data processing unit 607 transmits the image data to the VDP 632 described later. When receiving the image data, the VDP 632 displays an image (moving image or still image) based on the image data on the display unit 630.

  In addition, when the data processing unit 607 receives a recording instruction for performing a recording process from the control unit 610, the data processing unit 607 compresses the image data and the audio data, and stores them in the storage unit 620 as recorded data. The recorded data is data compressed in the MPEG2 format. The recorded data is not limited to data compressed in the MPEG2 format, and may be data compressed in another format. Here, other formats include, for example, MPEG1, H.264, and the like. H.264 or the like.

  When the received broadcast signal is a signal based on digital broadcast, the data processing unit 607 performs the following processing. First, the data processing unit 607 decodes the demodulated data based on the digital broadcasting standard to obtain decoded data. The decoded data includes image data, audio data, text data, EPG data, and BML data. Image data and audio data included in the decoded data are data compressed in the MPEG2 format. The image data and audio data included in the decoded data are not limited to data compressed in the MPEG2 format, and may be data compressed in other formats. Here, other formats include, for example, MPEG1, H.264, and the like. H.264 or the like.

  When the data processing unit 607 receives a display instruction for causing the display unit 630 to display the image data from the control unit 610, the data processing unit 607 converts the image data included in the decoded data of the channel designated by the display instruction into a VDP 632 described later. Send to. When receiving the image data, the VDP 632 displays an image (moving image or still image) based on the image data on the display unit 630.

  Hereinafter, an image based on a broadcast signal received by the tuner 605 and displayed on the display unit 630 is also referred to as a TV image. Note that the number of types of TV image channels that can be directly selected by pressing the numeric buttons “1” to “12” provided on the remote controller 300 to be described later for operating the video display device 600 is as follows. Assume that the maximum is 12. As a matter of course, the more number buttons provided on the remote controller 300, the larger the number of TV image channel types that can be directly selected.

  Remote control channel numbers “1” to “12” are set in the numeric buttons “1” to “12” of the remote control 300, respectively. For example, the remote control channel number “3” is set to the numeric button “3”. One TV image channel can be registered in one remote control channel number. For example, it is assumed that the TV image channel number “8” is registered for the remote control channel number “1”. In this case, the numeric button “1” of the remote controller 300 is pressed by the user, so that a remote control signal for selecting a TV image of the channel number “8” is transmitted from the remote controller 300 to the video display device 600. Sent.

  Note that the video display device 600 has a function of simultaneously displaying a plurality of types of TV images on the display unit 630. In addition, the video display device 600 has a function of simultaneously displaying a TV image and other types of images on the display unit 630.

  In addition, when the data processing unit 607 receives a recording instruction for performing a recording process from the control unit 610, the data processing unit 607 causes the storage unit 620 to store the decoded data of the channel designated by the recording instruction as the recording data. The recorded data in this case is also referred to as content below. In this case, the recorded data includes image data, audio data, text data, and BML data.

The video display device 600 further includes a VDP 632 and a VRAM 636.
The VRAM 636 has a function of temporarily storing image data.

  The control unit 610 issues a drawing instruction to the VDP 632 according to the program 180A stored in the storage unit 620. The drawing instruction is an instruction for generating an image and causing the display unit 630 to display the image.

  The VDP 632 is connected to the display unit 630. In response to a drawing instruction from the control unit 610, the VDP 632 reads font data, graphic data, and the like from a program 180A described later in the storage unit 620, and generates an image using the VRAM 636. The VDP 632 reads out the image data stored in the VRAM 636 and causes the display unit 630 to display an image based on the image data.

  The video display device 600 further includes an input unit 640 and a recording medium access unit 650.

  Input unit 640 includes a plurality of buttons (not shown). The plurality of buttons are provided outside the video display device 600. When any one of the buttons is pressed by the user, the input unit 640 transmits a button signal corresponding to the pressed button to the control unit 610. Control unit 610 performs predetermined processing based on the received button signal. Hereinafter, the button operation of the input unit 640 by the user is also referred to as an interface operation T.

  The recording medium access unit 650 has a function of reading the program 180A from the recording medium 555A on which the program 180A is recorded. The program 180A stored in the recording medium 555A is read by the recording medium access unit 650 by the installation process of the control unit 610, and the control unit 610 stores the program 180A in the storage unit 620. The installation processing program is stored in advance in the storage unit 620, and the installation processing is performed by the control unit 610 based on the installation processing program.

  Note that the program 180A may not be installed in the storage unit 620. In this case, control unit 610 reads program 180A stored in recording medium 555A via recording medium access unit 650, and performs predetermined processing based on program 180A. Content data and the like are also recorded on recording medium 555A. The content data is, for example, music data, moving image data, and the like.

  The recording medium 555A includes a BD (Blu-ray Disc), an HD-DVD (High-Definition Digital Versatile Disc), a DVD-ROM (Digital Versatile Disk Read Only Memory), a DVD-R (Digital Versatile Disk Recordable), and a DVD-RAM. (Digital Versatile Disk Random Access Memory), DVD + RW (Digital Versatile Disk Re-Writable), DVD-RW, CD-ROM (Compact Disk Read Only Memory), MO (Magneto Optical Disk), floppy (registered trademark) disk, CF card (Registered trademark), SM (Smart Media (registered trademark)), MMC (registered trademark), SD memory card (registered trademark), Memory Stick (registered trademark), xD Picture Card (registered trademark), USB memory, magnetic tape, and the above Any other nonvolatile memory may be used.

Video display device 600 further includes a communication unit 660 and a communication unit 662.
Communication unit 660 exchanges data with control unit 610. The communication unit 660 has a function of transmitting / receiving data to / from the communication terminal device 500 in a wired or wireless manner. Communication unit 660 has the same configuration and function as communication unit 560 described above, and therefore detailed description will not be repeated.

  Communication unit 662 transmits / receives data to / from control unit 610. Since communication unit 662 has the same configuration and function as communication unit 562 described above, detailed description will not be repeated. Therefore, communication unit 662 can perform data communication with communication unit 50 wirelessly. Communication unit 662 can perform data communication with communication unit 50 via, for example, a LAN cable. Therefore, when there is a request for transmission of the recorded data stored in the storage unit 620 to the communication unit 662 via the communication unit 50, transmission or streaming distribution is performed to the device that requested the recorded data.

  Therefore, video display apparatus 600 according to the present embodiment can also download a program from network 70 via communication unit 50 and communication unit 662 and store the program in storage unit 620. In this case, the downloaded program is the program 180A.

  Control unit 610 performs predetermined processing according to a program (program 180A) downloaded from network 70. The download program is stored in advance in the storage unit 620, and the download process is performed by the control unit 610 based on the download program.

  Video display device 600 further includes a remote control signal receiver 680. The remote control signal receiving unit 680 has a function of receiving a remote control signal for operating the video display device 600 output from the remote control (remote controller) 300. Remote control signal receiving unit 680 transmits the received remote control signal to control unit 610. Control unit 610 performs corresponding processing in accordance with the received remote control signal. As described above, the remote controller 300 is provided with numeric buttons “1” to “12” for selecting a TV image. Hereinafter, the operation of the remote controller 300 by the user is also referred to as an interface operation T.

  The control unit 610 performs data communication with the voice output unit 670 described above. When control unit 610 transmits audio data to audio output unit 670, audio output unit 670 outputs audio based on the audio data received from control unit 610 from the speaker.

  Next, processing for using communication terminal device 500 as a remote controller for operating video display device 600 (hereinafter also referred to as a display device remote controller) will be described. When control unit 510 executes a remote control program of program 180 by interface operation M, communication terminal device 500 can be used as a display device remote control. In this case, the following remote control image MG100 is displayed on display unit 530.

  FIG. 8 is a diagram showing a remote control image MG100 as an example. Referring to FIG. 8, button images MBG110, MBG120, and MBG130 are arranged in remote control image MG100.

  Each of the button images MBG110, MBG120, and MBG130 is pressed by the interface operation M, so that the control unit 510 transmits a corresponding remote control signal described later to the video display device 600 using the communication unit 560. It is a button image for doing.

  The button image MBG110 is a button image for transmitting a power supply remote control signal to the video display device 600 by being pressed by the interface operation M. The power remote control signal is a remote control signal for switching between a state where the power of the video display device 600 is on and a state where the power of the video display device 600 is off.

  The button image MBG 120 is a button image for transmitting a program guide display remote control signal to the video display device 600 by being pressed by the interface operation M. The program guide display remote control signal is a remote control signal for causing the display unit 630 of the video display device 600 to display a program guide image to be described later.

  The button image MBG 130 is a button image for transmitting a menu display remote control signal to the video display device 600 by being pressed by the interface operation M. The menu display remote control signal is a remote control signal for causing a display unit 630 of the video display device 600 to display a menu image to be described later.

  In remote control image MG100, button images MBG142, MBG144, MBG152, and MBG154 are further arranged. Each of the button images MBG142, MBG144, MBG152, and MBG154 is pressed by the interface operation M, so that the control unit 510 uses a communication unit 560 to transmit a corresponding remote control signal to be described later to the video display device 600. It is a button image for transmitting to.

  The button image MBG 142 is a button image for transmitting a volume up remote control signal to the video display device 600 by being pressed by the interface operation M. The volume up remote control signal is a remote control signal for increasing the sound output from the audio output unit 670 of the video display device 600. The button image MBG 144 is a button image for transmitting a volume down remote control signal to the video display device 600 by being pressed by the interface operation M. The volume down remote control signal is a remote control signal for reducing the sound output from the audio output unit 670 of the video display device 600.

  The button image MBG 152 is a button image for transmitting a channel plus remote control signal to the video display device 600 by being pressed by the interface operation M. The channel plus remote control signal is a remote control signal for incrementing the remote control channel number by 1 when a TV image is displayed on the display unit 630 of the video display device 600. When the remote control channel number is “12” and the above-described process of incrementing by 1 is performed, the remote control channel number is “1”.

  The button image MBG154 is a button image for transmitting a channel minus remote control signal to the video display device 600 by being pressed by the interface operation M. The channel minus remote control signal is a remote control signal for decrementing the remote control channel number by 1 when a TV image is displayed on the display unit 630 of the video display device 600. When the remote control channel number is “1” and the above decrementing process is performed, the remote control channel number is “12”.

  In remote control image MG100, button images MBG170 and MBG180 are further arranged. Each of the button images MBG 170 and MBG 180 is pressed by the interface operation M so that the control unit 510 transmits a corresponding remote control signal to be described later to the video display device 600 using the communication unit 560. It is a button image.

  The button image MBG 170 is a button image for transmitting a set image display remote control signal to the video display device 600 by being pressed by the interface operation M. The setting image display remote control signal is a remote control signal for causing the display unit 630 of the video display device 600 to display a setting image to be described later. Button image MBG 180 is a button image for transmitting a detailed remote control image display remote control signal to video display device 600 by being pressed by interface operation M. The detailed remote control image display remote control signal is a remote control signal for causing the display unit 630 of the video display device 600 to display a detailed remote control image. The detailed remote control image is an image for transmitting a remote control signal other than a remote control signal frequently used for the video display device 600 to the video display device 600.

  Hereinafter, the operation mode of the communication terminal device 500 when the communication terminal device 500 can operate the video display device 600 by transmitting a remote control signal to the video display device 600 is also referred to as a remote control mode.

  Next, processing for displaying information related to content (hereinafter also referred to as content-related information display processing) will be described. It is assumed that remote control image MG100 is displayed on display unit 530 of communication terminal device 500. In this case, it is assumed that communication terminal apparatus 500 is set to the remote control mode.

  FIG. 9 is a flowchart of the content related information display process. FIG. 9 shows processing performed in each of communication terminal device 500, video display device 600, service server 800A, search server 800S, and Web server 800W.

  In video display device 600, when the power is turned on, the process of step S110 is automatically performed. Note that the process of step S110 is not automatically performed when the power is turned on, but may be executed by the interface operation T or the interface operation M in the communication terminal device 500 set in the remote control mode. .

  Also, when the power of the video display device 600 is turned on, the control unit 610 automatically performs a date and time management process for managing the current date and time independently of other processes. Therefore, the information on the current date and time managed by the date and time management process changes with the passage of time.

  In step S110, program data acquisition processing is performed. In the program data acquisition process, the control unit 610 uses the communication unit 662 to transmit a program data acquisition request to the service server 800A via the communication unit 50 and the network 70. The program data acquisition request is a request for acquiring EPG data as program data.

In service server 800A, first, the process of step S140 is performed.
In step S140, it is determined whether a program data acquisition request has been received. If YES in step S140, the process proceeds to step S141. On the other hand, if NO at step S140, the process at step S140 is performed again.

  In step S141, service server 800A transmits EPG data as program data to the apparatus that transmitted the program data acquisition request. Thereafter, the process of step S140 is performed again.

  Then, the control unit 610 of the video display device 600 receives EPG data described below. When the control unit 610 receives the EPG data, the control unit 610 stores the EPG data in the storage unit 620. The EPG data is data constituting the following program information data table T100. The program information data table T100 includes a plurality of program information data respectively indicating a plurality of program information. The program information data table T100 is composed of a plurality of program information data for one day, for example.

  FIG. 10 is a diagram showing a program information data table T100 as an example. Referring to FIG. 10, in the program information data table T100, “management number” is a number for managing each of a plurality of program information data. The “ID number” is a number for identifying a program. “Channel number” is a channel number assigned to a broadcasting station. “Broadcasting station code” is a code number assigned to a broadcasting station. “Broadcasting station name” is the name of the broadcasting station.

  “Title” indicates the title of the corresponding program. The “start date / time” indicates the broadcast start date / time of the corresponding program. “End date and time” indicates the broadcast end date and time of the corresponding program. “Genre” indicates the genre of the corresponding program. “Performers” are the main performers of the corresponding program. “Program content” indicates simple content of a corresponding program. The program information data table T100 may further include “audio information”. “Audio information” is information indicating whether the audio of the corresponding program is stereo or monaural.

  Referring to FIG. 9 again, communication terminal apparatus 500 first performs the process of step S120.

  In step S120, control unit 510 determines whether or not there is a program guide display control operation for displaying a program guide image to be described later. The program guide display control operation is an interface operation M for pressing the button image MBG120. If YES in step S120, the process proceeds to step S120A. On the other hand, if NO at step S120, the process at step S120 is performed again.

  In step S120A, control unit 510 transmits a program guide display remote control signal to video display device 600 using communication unit 560. The program guide display remote control signal is a remote control signal for causing the display unit 630 to display a program guide image to be described later.

In the video display device 600, the process proceeds to step S111 after the process of step S110.
In step S111, control unit 610 receives a program guide display remote control signal. Thereafter, the process proceeds to step S112.

  In step S112, a program guide image display process is performed. In the program guide image display process, the control unit 610 generates the following program guide image TG100 using the VDP 632 based on the EPG data, and causes the display unit 630 to display the generated program guide image TG100.

  FIG. 11 is a diagram showing a program guide image TG100 as an example. Referring to FIG. 11, program guide display image TG110 and detailed information image TG120 are arranged in program guide image TG100.

  The program guide display image TG110 is an image that displays program information based on the program information data table T100 constituting the EPG data. In the program guide display image TG110, the number in the column “CH” is a channel number. In the program guide display image TG110, 19:00, 20:00, and 21:00 indicate the time. In the program guide display image TG110, a character string other than the channel number and time indicates the title of the program. The program title is selected by the interface operation M when the communication terminal device 500 is in the remote control mode. As an example, the title in the selected state is displayed with a black background and a white character string. In the program guide display image TG110, as an example, a program whose title is “A sports” is in a selected state.

  The detailed information image TG120 is an image that displays detailed information regarding the selected program in the program guide display image TG110. In the detailed information image TG120, for example, the channel number assigned to the broadcasting station broadcasting the program “A Sports”, the program name “A Sports”, the broadcast time of the program, the performers, the program contents, etc. Is displayed.

  Referring to FIG. 9 again, when the process of step S112 ends, the process of step S113 is performed.

  In step S113, the simple program list data is transmitted. Specifically, first, control unit 610 generates simple program list data, which is a part of program information data table T100 constituting EPG data, and transmits the generated simple program list data to communication terminal device 500. Send. The simple program list data is data constituting the following simple program information data table MT100. The simple program information data table MT100 is composed of a plurality of simple program information data respectively indicating a plurality of simple program information.

  FIG. 12 is a diagram showing a simple program information data table MT100 as an example. Referring to FIG. 12, the simplified program information data table MT100 is compared with the program information data table T100 of FIG. 10, with “broadcasting station code”, “end date”, “genre”, “performer”, and “program”. The difference is that the “content” item is not included, and the simple program information corresponding to programs broadcast after the program broadcast on the current date and time is not included. For example, if the current date and time is 21:30, the simplified program information data table MT100 includes simplified program information corresponding to programs after the program that is currently being broadcast and whose title is “C sightseeing”. Is not included. Other than that, it is the same as program information data table T100, and therefore detailed description will not be repeated.

  Referring to FIG. 9 again, communication terminal apparatus 500 proceeds to step S121 after the process of step S120A.

  In step S121, control unit 510 receives the simplified program list data. Thereafter, the process proceeds to step S122.

  In step S122, a simple list display process is performed. In the simple list display process, control unit 510 generates the following simple list image MG200 using VDP 532 based on the received program simple list data, and causes display unit 530 to display the generated simple list image MG200. . Then, control unit 510 cancels the remote control mode of communication terminal device 500. As a result, the communication terminal device 500 cannot operate the video display device 600 by the interface operation M.

  FIG. 13 is a diagram showing a simple list image MG200 as an example. Referring to FIG. 13, list image MG210 is arranged in simple list image MG200. In list image MG210, a plurality of simplified program information corresponding to one broadcasting station is displayed in a list. The simple program information includes the start time of the program and the title name of the program.

  A frame SR212 is a frame for selecting simple program information. The frame SR212 can be moved upward in the list image MG210 by a short press operation of the direction button 541A. If the frame SR212 is arranged at a position for selecting the top simple program information in the list image MG210 and the direction button 541A is further pressed, the plural simple program information is displayed below. Scroll display. Then, the simple program information one level higher than the simple program information selected by the frame SR212 is selected by the frame SR212.

  The frame SR212 can be moved downward in the list image MG210 by a short press operation of the direction button 541B. In addition, when the frame SR212 is arranged at the position for selecting the simple program information at the bottom of the list image MG210 and the direction button 541B is further pressed, the plural simple program information is Scroll display. Then, the simple program information one level lower than the simple program information selected by the frame SR212 is selected by the frame SR212.

  In the list image MG210, button images MBG242, MBG244, MBG270, and MBG272 are further arranged.

  The button image MBG242 is a button image for scrolling up a plurality of pieces of program simple information displayed in the list image MG210 by being pressed by the interface operation M. The button image MBG244 is a button image for scrolling down a plurality of program simple information displayed in the list image MG210 by being pressed by the interface operation M.

  When the button image MBG 270 is pressed by the interface operation M, a plurality of programs corresponding to a broadcasting station (for example, KKK television) different from the broadcasting station (for example, NNN television) displayed in the list image MG210. It is a button image for displaying simple information as a list. A plurality of simple program information corresponding to the broadcast stations immediately preceding the current broadcast station in the order of the registered broadcast stations are displayed in a list.

  Similar to MBG 270, button image MBG 272 is pressed by interface operation M, whereby a plurality of simplified program information corresponding to a broadcast station (for example, SSS television) different from the broadcast station displayed in list image MG210. Is a button image for displaying a list. A plurality of simple program information corresponding to the broadcast stations immediately after the current broadcast station in the order of the registered broadcast stations are displayed in a list.

  Referring to FIG. 9 again, when the process of step S122 ends, the process of step S123 is performed.

  In step S123, a program selection process is performed. In the program selection process, first, control unit 510 determines whether or not there is a selection determination operation. Here, the selection determination operation is a state in which the simple list image MG200 is displayed on the display unit 530 and the simple program information in the list image MG210 is selected by the frame SR212, and the determination button 541E is pressed. This is an operation in which a short press operation is performed. When it is determined that the selection determination operation has been performed, the control unit 510 transmits the ID number corresponding to the simplified program information selected by the frame SR212 to the video display device 600 using the communication unit 560. In the present embodiment, it is assumed that the simple program information corresponding to the title “C sightseeing” is selected by the frame SR212 as an example in the selection determination operation.

  In this case, control unit 510 transmits ID number information to video display device 600 using communication unit 560 based on the simple program list data constituting simple program information data table MT100. In this case, the transmitted ID number information is information of the ID number (11236 (see FIG. 12)) whose title is “C sightseeing”.

  In video display device 600, step S114 is performed after step S113.

  In step S114, control unit 610 receives ID number information. Thereafter, the process proceeds to step S115.

  In step S115, content display processing is performed. In the content display process, control unit 610 performs a display process of displaying an image of a program as content corresponding to the ID number indicated by the received ID number information on display unit 630. In the following, a program as content corresponding to the ID number indicated by the received ID number information is also referred to as selected content.

  In the display process, first, the control unit 610 determines whether or not the selected content is a currently broadcast program. Specifically, when the current date and time managed by the date and time management process is a date and time after the broadcast start date and time of the selected content, the control unit 610 determines that the selected content is a program that is currently being broadcast. judge. When the current date and time managed by the date and time management process is a date and time before the broadcast start date and time of the selected content, the control unit 610 determines that the selected content is not a program currently being broadcast.

  When it is determined that the selected content is a currently broadcast program, the control unit 610 uses the tuner 605, the data processing unit 607, and the VDP 632 to display the TV image of the selected content on the display unit 630. Perform processing. When it is determined that the selected content is a program that is currently being broadcast, the control unit 610 may make a distribution request for the selected content to the service server 800A. In this case, the service server 800A performs streaming delivery of moving image data after the portion corresponding to the current date and time among the moving image data corresponding to the selected content to the video display device 600 that has requested distribution of the selected content. Then, the control unit 610 performs a process of causing the display unit 630 to display a moving image based on the moving image data distributed in a streaming manner from the video display device 600.

  On the other hand, when it is determined that the selected content is a broadcast-terminated program, control unit 610 makes a distribution request for the selected content to service server 800A. In this case, the service server 800A performs streaming delivery of the recording data corresponding to the selected content to the video display device 600 that has requested the delivery of the selected content. Then, the control unit 610 performs a process of causing the display unit 630 to display a moving image based on the recording data that has been streamed from the video display device 600. Thereafter, the process of step S116 is performed. In the present embodiment, it is assumed that the program corresponding to the selected content is a program whose title corresponds to “C sightseeing” as an example.

  In step S116, a content related information transmission process is performed. The content related information is information related to the program as the content displayed on the display unit 630. In the present embodiment, it is assumed that the content related information is a program title. The content-related information is not limited to the program title, and may be, for example, genre information, performer information, or the like.

  In the content related information transmission process, control unit 610 transmits program title information as content related information to communication terminal device 500. Here, as an example, it is assumed that the program title is “C sightseeing”.

  In the communication terminal device 500, when it is determined in the process of step S123 that there is a selection determination operation and the ID number information is transmitted to the video display device 600, the process proceeds to step S124.

  In step S124, control unit 510 uses communication unit 560 to receive content-related information (program title information). Thereafter, the process proceeds to step S125.

  In step S125, search information transmission processing for transmitting search information is performed. The search information is content related information (program title information). Here, it is assumed that the search information is program title information. That is, the search information is information “C sightseeing”.

  Control unit 510 uses communication unit 566 to transmit search information to search server 800S via telephone network 60 and network 70. Control unit 510 may transmit search information to search server 800S via communication unit 50 and network 70 using communication unit 562.

In search server 800S, first, the process of step S150 is performed.
In step S150, it is determined whether search information has been received. If YES in step S150, the process proceeds to step S151. On the other hand, if NO at step S151, the process at step S150 is performed again. Here, it is assumed that the search server 800S has received the search information (“C sightseeing”), the process proceeds to step S151.

  In step S151, a search process is performed. In the search process, the received search information (“C sightseeing”) is used as a keyword, and a URL of a Web page of information related to the keyword is searched from a database of information stored in the search server 800S. Note that a process of searching from a database of information held by another device connected to the search server 800S via a network may be performed. Since the search information is content-related information (program title information) as described above, in the search process, a process for searching the URL of the Web page for information related to the content-related information is performed. Thereafter, the process proceeds to step S152.

  In step S152, the search server 800S generates the following search result data D100 by a search process, and transmits the generated search result data D100 to the communication terminal device 500 via the network 70 and the telephone network 60. The search server 800S may transmit the following search result data D100 to the communication terminal device 500 via the network 70 and the communication unit 50. Thereafter, the process of step S150 is performed again.

  FIG. 14 is a diagram showing search result data D100 as an example. Referring to FIG. 14, search result data D100 is composed of a plurality of Web page data. In FIG. 14, “number” is a number for managing a plurality of Web page data. “Title” is the title of the Web page. “URL” is the URL of the corresponding Web page.

  Referring to FIG. 9 again, communication terminal apparatus 500 proceeds to step S126 after the process of step S125.

  In step S126, control unit 510 receives search result data D100 transmitted from search server 800S using communication unit 566 or communication unit 562. Then, the control unit 510 stores the search result data D100 in the temporary storage unit 522. Thereafter, the process proceeds to step S127.

  In step S127, search result display processing is performed. In the search result display process, the control unit 510 generates the following search result image MG300 using the VDP 532 based on the received search result data D100, and causes the display unit 530 to display the generated search result image MG300. .

  FIG. 15 is a diagram showing a search result image MG300 as an example. Referring to FIG. 15, list image MG310 is arranged in search result image MG300. List image MG310 displays a plurality of titles corresponding to some Web page data of the plurality of Web page data constituting search result data D100.

  A frame SR312 is a frame for selecting a title. The frame SR312 can be moved upward in the list image MG310 by a short press operation of the direction button 541A. In addition, when the frame SR312 is arranged at a position for selecting the uppermost title in the list image MG310 and when the direction button 541A is further pressed, the plurality of titles are scrolled down. . Then, the title immediately above the title selected by the frame SR312 is selected by the frame SR312.

  The frame SR312 can be moved downward in the list image MG310 by a short press operation of the direction button 541B. When the frame SR312 is arranged at the position for selecting the bottom title in the list image MG310 and when the direction button 541B is further pressed, the plurality of titles are scrolled up. . Then, the title immediately below the title selected by the frame SR312 is selected by the frame SR312.

  In search result image MG300, button images MBG342, MBG344, MBG380, and MBG390 are further arranged.

  The button image MBG342 is a button image for scrolling up a plurality of titles displayed in the list image MG310 when pressed by the interface operation M. The button image MBG344 is a button image for scrolling down a plurality of titles displayed in the list image MG310 when pressed by the interface operation M.

  The button image MBG380 is a button image for releasing the remote control mode of the communication terminal device 500 when the communication terminal device 500 is set to the remote control mode by being pressed by the interface operation M. The button image MBG390 is a button image for deleting the search result image MG300 from the display unit 530 by being pressed by the interface operation M.

  Referring to FIG. 9 again, when the process of step S127 ends, the process of step S128 is performed.

  In step S128, a title selection process is performed. In the title selection process, first, control unit 510 determines whether or not there is a selection determination operation T. Here, the selection determination operation T is a short of the determination button 541E when the search result image MG300 is displayed on the display unit 530 and the title in the list image MG310 is selected by the frame SR312. This is an operation in which a push operation is performed. When it is determined that the selection determination operation T has been performed, the control unit 510 transmits information on the URL corresponding to the title selected by the frame SR312 to the video display device 600 using the communication unit 560. In the present embodiment, in the selection determination operation T, as an example, it is assumed that the title “tourist guide” is selected by the frame SR312.

  In this case, control unit 510 refers to search result data D100 and transmits URL information to video display device 600 using communication unit 560. In this case, the transmitted URL information is information of a URL (http://www.bbb.com/) whose title corresponds to “tourist guide”. Thereafter, control unit 510 sets communication terminal apparatus 500 to the remote control mode. Thereby, the communication terminal device 500 can operate the video display device 600 by the interface operation M.

  In video display device 600, the process of step S117 is performed after the process of step S116.

  In step S117, control unit 610 receives URL information. Thereafter, the process proceeds to step S118. Here, it is assumed that the received URL information is information of a URL (http://www.bbb.com/) whose title corresponds to “tourist guide”.

  In step S118, control unit 610 uses communication unit 662 to transmit a Web page data request for acquiring Web page data of a URL based on the received URL information to Web server 800W. Here, the Web page data includes content data and HTML (HyperText Markup Language) data for controlling the arrangement position and operation of the content data. The content data includes moving image data, still image data, text data, and the like.

In Web server 800W, first, the process of step S160 is performed.
In step S160, it is determined whether a web page data request has been received. If YES in step S160, the process proceeds to step S161. On the other hand, if NO at step S160, the process at step S160 is performed again. Here, it is assumed that the Web server 800W has received a Web page data request for acquiring Web page data with a URL (http://www.bbb.com/) corresponding to the title “Tourist Guide”, step S161. Proceed to

  In step S161, the Web server 800W transmits the Web page data to the video display device 600. Thereafter, the process of step S160 is performed again. The transmitted web page data is assumed to be web page data having a URL (http://www.bbb.com/) whose title corresponds to “tourist guide”.

In the video display device 600, the process proceeds to step S118A after the process of step S118.
In step S118A, control unit 610 uses communication unit 662 to receive Web page data transmitted from Web server 800W. That is, control unit 610 uses communication unit 662 to receive Web page data via network 70 and communication unit 50 capable of high-speed data communication. Therefore, the control unit 610 can receive Web page data in a short time. Thereafter, the process proceeds to step S119.

  In step S119, Web page display processing is performed. In the Web page display process, the control unit 610 generates the following Web page image G200 using the VDP 632 based on the received Web page data, and causes the display unit 630 to display the generated Web page image G200.

  FIG. 16 is a diagram showing a web page image G200 as an example. Referring to FIG. 16, in Web page image G200, moving image display image G220, information display image G240, still image display image G250, and hyperlink character string display image G230 are arranged.

  A moving image is displayed on the moving image display image G220. The displayed moving image is, for example, a moving image obtained by photographing a sightseeing spot. The information display image G240 is an image on which text is displayed. The sentence is, for example, a description of a sightseeing spot. The still image display image G250 displays a still image. The still image is, for example, a still image obtained by photographing a sightseeing spot.

  In the hyperlink character string display image G230, a plurality of hyperlink character strings for displaying other Web pages are displayed. The plurality of hyperlink character strings are, for example, character strings “peripheral map” and “column”.

  In the Web page image G200, a URL display image BG210, button images BG281, BG282, and BG284 are further arranged as images displayed by the program 180A, not images displayed by Web page data.

  The URL display image BG210 displays the URL of Web page data for generating the Web page image G200.

  The button image BG281 is currently displayed on the display unit 630 when there is an interface operation M for transmitting a remote control signal for pressing the button image BG281 to the video display device 600 in the communication terminal device 500. When there is a web page image (hereinafter also referred to as an old web page image) displayed on the display unit 630 before the web page image being displayed, a button image for causing the display unit 630 to display the old web page image It is.

  When there is an interface operation M for transmitting a remote control signal for pressing the button image BG282 to the video display device 600 in the communication terminal device 500, the button image BG282 is other related to the Web page image G200. It is a button image for displaying a web page image on the display unit 630.

  When there is an interface operation M for transmitting a remote control signal for pressing the button image BG284 to the video display device 600 in the communication terminal device 500, the button image BG284 is displayed on the web page image G200 from the display unit 630. It is a button image for deleting.

  Referring to FIGS. 9 and 16, if interface operation M is performed while Web page image G200 is displayed on display unit 630, the following processing is performed.

  For example, when the character string “neighboring map” displayed in the hyperlink character string display image G230 in the web page image G200 is selected by the interface operation M of the communication terminal device 500, the enter button 541E is pressed briefly. When the operation is performed, the following process A is performed. In the process A, the control unit 610 causes the display unit 630 to display the web page image displaying the map associated with the “neighboring map” on the display unit 630 using the VDP 632 instead of the web page image G200.

  When the control unit 610 determines that the remote control signal for pressing the button image BG284 in the web page image G200 by the interface operation M is received from the communication terminal device 500, the control unit 610 uses the VDP 632. Then, the Web page image G200 is deleted from the display unit 630. Then, using the VDP 632, the control unit 610 causes the display unit 630 to display the image displayed by the process of step S115 before the Web page image G200 is displayed. Thereafter, the processing in the video display device 600 ends.

  When control unit 510 determines that remote control mode release operation has been performed while search result image MG300 is displayed on display unit 530 of communication terminal device 500, control unit 510 causes communication terminal device 500 to Cancel the remote control mode. Here, the remote control mode release operation is an operation in which the button image MBG380 is pressed by the interface operation M.

  When control unit 510 determines that an end operation has been performed while search result image MG300 is displayed on display unit 530 of communication terminal device 500, control unit 510 ends the process of step S128. Then, the processing of the communication terminal device 500 is terminated. Here, the end operation is an operation in which the button image MBG 390 is pressed by the interface operation M.

  As described above, in the present embodiment, the video display device 600 displays the content related information related to the image as the content currently displayed on the display unit 630 of the video display device 600, and the communication terminal device 500. Send to. Then, the communication terminal device 500 receives the content related information. Then, the communication terminal device 500 transmits the content related information as search information to the search server 800S. The search server 800S uses the received search information (content related information) to perform processing for searching for the URL of the Web page of information related to the content related information.

  Then, the search server 800S transmits search result data including a plurality of Web page data to the communication terminal device 500 which is a device different from the video display device 600 displaying the content. In communication terminal device 500, URL information as a network address corresponding to the title selected by the user in the received search result data is transmitted to video display device 600. Then, the video display device 600 displays a corresponding Web page image on the display unit 630 based on the received URL information. Note that the resolution of the display unit 630 is larger than the resolution of the display unit 530.

  By performing the above processing, it is possible to retrieve the URL of the Web page of information related to the content related information related to the content in a state where the content is displayed on the display unit 630 of the video display device 600. Therefore, it is possible to search for the URL of the Web page displaying information related to the content related information related to the content without reducing the visibility of the content being viewed by the user.

  Then, in a state in which content is displayed on the display unit 630 of the video display device 600, the communication terminal device 500 transmits URL information corresponding to the title selected by the user to the video display device 600 based on the search result. To do. In the video display device 600, the Web page image related to the title corresponding to the information desired by the user selected by the user is displayed on the display unit 630 having a higher resolution than the resolution of the display unit 530 of the communication terminal device 500. be able to. Therefore, the user can refer to the information on the Web page of the information related to the content related information with high viewability.

  As described above, there is an effect that desired information can be referred to quickly without reducing the visibility of the content being displayed in the period for selecting information.

<Second Embodiment>
In the first embodiment, the process performed when communication terminal apparatus 500 transmits search information to search server 800S has been described. In the present embodiment, a process performed when video display apparatus 600 transmits search information to search server 800S will be described.

  Since the network system in the present embodiment is similar to network system 1000 in the first embodiment, detailed description will not be repeated. Since the configurations of communication terminal device 500 and video display device 600 are the same as those described in the first embodiment, detailed description will not be repeated.

  Next, processing for displaying information related to content (hereinafter also referred to as content-related information display processing A) in the present embodiment will be described. It is assumed that remote control image MG100 is displayed on display unit 530 of communication terminal device 500. In this case, it is assumed that communication terminal apparatus 500 is set to the remote control mode.

  FIG. 17 is a flowchart of the content related information display processing A. FIG. 17 shows processing performed in each of communication terminal device 500, video display device 600, service server 800A, search server 800S, and Web server 800W.

  In video display device 600, the process of step S210 is automatically performed when the power is turned on. Note that the process of step S210 is not automatically performed when the power is turned on, but may be executed by the interface operation T or the interface operation M in the communication terminal device 500 set in the remote control mode. .

  Also, when the power of the video display device 600 is turned on, the control unit 610 automatically performs a date and time management process for managing the current date and time independently of other processes. Therefore, the information on the current date and time managed by the date and time management process changes with the passage of time.

  In step S210, processing similar to that in step S110 of FIG. 9 is performed, and thus detailed description will not be repeated. Thereby, control unit 610 transmits a program data acquisition request to service server 800 </ b> A via communication unit 50 and network 70 using communication unit 662.

In service server 800A, first, the process of step S240 is performed.
In step S240, processing similar to that in step S240 is performed, and thus detailed description will not be repeated. If YES in step S240, the process proceeds to step S241. On the other hand, if NO at step S240, the process at step S240 is performed again.

  In step S241, service server 800A transmits EPG data as program data to the apparatus that transmitted the program data acquisition request. Thereafter, the process of step S240 is performed again.

  Then, the control unit 610 of the video display device 600 receives the EPG data described in the first embodiment. When the control unit 610 receives the EPG data, the control unit 610 stores the EPG data in the storage unit 620.

In communication terminal device 500, first, the process of step S220 is performed.
In step S220, it is determined whether or not there is a program guide display control operation as in step S120. If YES in step S220, the process proceeds to step S220A. On the other hand, if NO at step S220, the process at step S220 is performed again.

  In step S220A, control unit 510 transmits the program guide display remote control signal described in the first embodiment to video display device 600 using communication unit 560.

In the video display device 600, the process proceeds to step S211 after the process of step S210.
In step S211, control unit 610 receives a program guide display remote control signal. Thereafter, the process proceeds to step S212.

  In step S212, a program guide image display process similar to that in step S112 is performed, and thus detailed description will not be repeated. By this processing, the program guide image TG100 of FIG. 11 is displayed on the display unit 630. Thereafter, the process proceeds to step S213.

  In step S213, the simple program list data is transmitted in the same manner as in step S113, and therefore detailed description will not be repeated. As described above, the simple program list data is data constituting the simple program information data table MT100 of FIG.

In communication terminal device 500, after the process of step S220A, the process proceeds to step S221.
In step S221, control unit 510 receives program simple list data. Thereafter, the process proceeds to step S222.

  In step S222, the simple list display process is performed in the same manner as in step S122, and thus detailed description will not be repeated. By this processing, the simple list image MG200 of FIG. 13 is displayed on the display unit 530. Then, control unit 510 cancels the remote control mode of communication terminal device 500. As a result, the communication terminal device 500 cannot operate the video display device 600 by the interface operation M. Thereafter, the process proceeds to step S223.

  In step S223, a program selection process is performed. In the program selection process, first, control unit 510 determines whether or not there is a selection determination operation. As described in the first embodiment, the selection determination operation is such that the simple list image MG200 is displayed on the display unit 530, and the simple program information in the list image MG210 is selected by the frame SR212. In this state, a short press operation of the enter button 541E is performed. When it is determined that the selection determination operation has been performed, the control unit 510 transmits the ID number corresponding to the simplified program information selected by the frame SR212 to the video display device 600 using the communication unit 560. In the present embodiment, it is assumed that the simple program information corresponding to the title “C sightseeing” is selected by the frame SR212 as an example in the selection determination operation.

  In this case, control unit 510 transmits ID number information from video simple list data constituting simple program information data table MT100 to video display device 600 using communication unit 560. In this case, the transmitted ID number information is ID number information whose title is “C sightseeing”.

  In video display device 600, the process of step S214 is performed after the process of step S213.

  In step S214, control unit 610 receives ID number information. Thereafter, the process proceeds to step S215.

  In step S215, content display processing is performed. In the content display process, control unit 610 performs a display process of displaying an image of a program as content corresponding to the ID number indicated by the received ID number information on display unit 630. In the following, a program as content corresponding to the ID number indicated by the received ID number information is also referred to as selected content.

  Since the display process is the same as the display process in step S115, detailed description will not be repeated. With this display process, a moving image corresponding to the selected content is displayed on the display unit 630. Thereafter, the process of step S216B is performed. In the present embodiment, it is assumed that the program corresponding to the selected content is a program whose title corresponds to “C sightseeing”.

  In step S216B, search information transmission processing for transmitting search information is performed. The search information is content related information corresponding to the program as the content displayed on the display unit 630. In the present embodiment, it is assumed that the content related information is a program title. Therefore, it is assumed that the search information is program title information. That is, the search information is information “C sightseeing”. The content-related information is not limited to the program title, and may be, for example, genre information, performer information, or the like.

  Control unit 610 uses search unit 662 to transmit search information to search server 800S via communication unit 50 and network 70.

In search server 800S, first, the process of step S250 is performed.
In step S250, it is determined whether search information has been received. If YES in step S250, the process proceeds to step S251. On the other hand, if NO at step S251, the process at step S250 is performed again. Here, assuming that the search server 800S has received the search information (“C sightseeing”), the process proceeds to step S251.

  In step S251, a search process is performed. In the search process, the received search information (“C sightseeing”) is used as a keyword, and a URL of a Web page of information related to the keyword is searched from a database of information stored in the search server 800S. Note that a process of searching from a database of information held by another device connected to the search server 800S via a network may be performed. Since the search information is content-related information (program title information) as described above, in the search process, a process for searching the URL of the Web page for information related to the content-related information is performed. Thereafter, the process proceeds to step S252.

  In step S252, the search server 800S generates the search result data D100 of FIG. 14 by the search process, and transmits the generated search result data D100 to the video display device 600 via the network 70 and the communication unit 50. Thereafter, the process of step S250 is performed again.

  In video display device 600, the process proceeds to step S216C after the process of step S216B.

  In step S216C, control unit 610 receives search result data D100 transmitted from search server 800S using communication unit 662. Then, using the communication unit 660, the control unit 610 transmits (transfers) the received search result data D100 to the communication terminal device 500.

  In the communication terminal device 500, when it is determined in the process of step S223 that there is a selection determination operation and the ID number information is transmitted to the video display device 600, the process proceeds to step S226.

  In step S226, control unit 510 uses communication unit 560 to receive search result data D100 transmitted from communication terminal device 500. Then, the control unit 510 stores the search result data D100 in the temporary storage unit 522. Thereafter, the process proceeds to step S227.

  In step S227, search result display processing is performed in the same manner as in step S127, and thus detailed description will not be repeated. By this processing, the search result image MG300 of FIG. 15 is displayed on the display unit 530. Thereafter, the process proceeds to step S228.

  In step S228, title selection processing is performed as in step S128. In the title selection process, first, control unit 510 determines whether or not there is a selection determination operation T. Here, the selection determination operation T is a state where the search result image MG300 is displayed on the display unit 530 and the title in the list image MG310 is selected by the frame SR312 as described above. This is an operation in which a short press operation of the enter button 541E is performed. When it is determined that the selection determination operation T has been performed, the control unit 510 transmits information on the URL corresponding to the title selected by the frame SR312 to the video display device 600 using the communication unit 560. In the present embodiment, in the selection determination operation T, as an example, it is assumed that the title “tourist guide” is selected by the frame SR312.

  In this case, control unit 510 refers to search result data D100 and transmits URL information to video display device 600 using communication unit 560. In this case, the transmitted URL information is information of a URL (http://www.bbb.com/) whose title corresponds to “tourist guide”. Here, the URL information is transmitted to the video display device 600 using the communication unit 560, but may be transmitted directly to the Web server 800W via the communication unit 50 and the network 70 using the communication unit 562. Good. Thereafter, control unit 510 sets communication terminal apparatus 500 to the remote control mode. Thereby, the communication terminal device 500 can operate the video display device 600 by the interface operation M.

  In video display device 600, the process of step S217 is performed after the process of step S216C. However, if the communication terminal device 500 directly transmits the URL information to the Web server 800W in step S228, the process does not proceed to step S217, but ends.

  In step S217, control unit 610 receives URL information. Thereafter, the process proceeds to step S218. Here, it is assumed that the received URL information is information of a URL (http://www.bbb.com/) whose title corresponds to “tourist guide”.

  In step S218, similarly to step S118, control unit 610 uses communication unit 662 to transmit a web page data request for acquiring web page data of a URL based on the received URL information to web server 800W. To do. Here, the Web page data includes content data and HTML data for controlling the arrangement position and operation of the content data, as described above. The content data includes moving image data, still image data, text data, and the like.

In Web server 800W, first, the process of step S260 is performed.
In step S260, it is determined whether a web page data request has been received. If YES in step S260, the process proceeds to step S261. On the other hand, if NO at step S260, the process at step S260 is performed again. Here, it is assumed that the Web server 800W receives a Web page data request for acquiring Web page data having a URL (http://www.bbb.com/) corresponding to the title “Tourist Guide”, step S261. Proceed to

  In step S261, the Web server 800W transmits Web page data to the video display device 600. Thereafter, the process of step S260 is performed again. The transmitted web page data is assumed to be web page data having a URL (http://www.bbb.com/) whose title corresponds to “tourist guide”. If the communication terminal device 500 transmits URL information directly to the Web server 800W in step S228, the Web server 800W transmits Web page data to the video display device 500.

In video display device 600, the process proceeds to step S218A after the process of step S218.
In step S218A, control unit 610 receives web page data transmitted from web server 800W using communication unit 662. That is, control unit 610 uses communication unit 662 to receive Web page data via network 70 and communication unit 50 capable of high-speed data communication. Therefore, the control unit 610 can receive Web page data in a short time. Then, the control unit 610 transmits (transfers) the received web page data to the communication terminal device 500 using the communication unit 660. Thereafter, the processing in the video display device 600 ends.

In communication terminal device 500, after the process of step S228, the process proceeds to step S228A.
In step S228A, control unit 510 uses communication unit 560 to receive Web page data transmitted from video display device 600. In step S228, when communication terminal apparatus 500 directly transmits URL information to Web server 800W, control unit 510 uses communication unit 562 to receive Web page data transmitted from Web server 800W. . That is, the communication terminal device 500 does not receive web page data via the telephone network 60. For this reason, a packet charge corresponding to the data amount of the received web page data does not occur. The data communication speed between the communication terminal device 500 and the video display device 600 is sufficiently faster than the data communication speed between the communication terminal device 500 and the telephone network 60. Therefore, when the communication terminal device 500 receives Web page data from the Web server 800W via the network 70, the communication unit 50, and the video display device 600, the Web terminal data is received via the network 70 and the telephone network 60. Web page data can be received in a shorter time than the case.

  Similarly, the data communication speed between the communication terminal device 500 and the communication unit 50 is sufficiently faster than the data communication speed between the communication terminal device 500 and the telephone network 60. Therefore, when the communication terminal device 500 receives Web page data from the Web server 800W via the network 70 and the communication unit 50, the communication terminal device 500 is shorter than when Web page data is received via the network 70 and the telephone network 60. Web page data can be received in time. Thereafter, the process proceeds to step S229.

  In step S229, Web page display processing is performed. In the Web page display process, control unit 510 generates the following Web page image MG400 using VDP 532 based on the received Web page data, and causes display unit 530 to display the generated Web page image MG400.

  FIG. 18 is a diagram showing a web page image MG400 as an example. Referring to FIG. 18, still image display image MG420, information display image MG440, and hyperlink character string display image MG430 are arranged in Web page image MG400.

  Still image display image MG420 displays a still image. The still image is, for example, a still image obtained by photographing a sightseeing spot. Information display image MG440 is an image on which a sentence is displayed. The sentence is, for example, a description of a sightseeing spot.

  In the hyperlink character string display image MG430, a plurality of hyperlink character strings for displaying other Web pages are displayed. The plurality of hyperlink character strings are, for example, character strings “peripheral map” and “column”.

  Web page image MG400 further includes URL display image BMG410 and button images MBG480, MBG481, MBG482, and MBG490 as images displayed by program 180, not images displayed by Web page data.

  URL display image BMG410 displays the URL of Web page data for generating Web page image MG400. The button image MBG480 is a button image for releasing the remote control mode of the communication terminal device 500 when the communication terminal device 500 is set to the remote control mode by being pressed by the interface operation M. When the button image MBG 481 is pressed by the interface operation M, the Web page image (hereinafter referred to as the old Web page) displayed on the display unit 530 before the Web page image currently displayed on the display unit 530 is displayed. A page image), the old Web page image is displayed on the display unit 530.

  The button image MBG482 is a button image for causing the display unit 530 to display another Web page image related to the Web page image MG400 by being pressed by the interface operation M. The button image MBG490 is a button image for deleting the Web page image MG400 from the display unit 530 by being pressed by the interface operation M.

  Referring to FIGS. 17 and 18, when interface operation M is performed in a state where Web page image MG400 is displayed on display unit 530, the following processing is performed.

  For example, when the character string “neighboring map” displayed in the hyperlink character string display image MG430 in the web page image MG400 is selected by the interface operation M of the communication terminal device 500, the enter button 541E is pressed briefly. When the operation is performed, the following process A is performed. In the process A, the control unit 510 causes the display unit 530 to display the web page image displaying the map, which is associated with the “neighboring map”, using the VDP 532 instead of the web page image MG400.

  If control unit 510 determines that an end operation has been performed, control unit 510 uses VDP 532 to delete web page image MG400 from display unit 530. Here, the end operation is an operation in which the button image MBG 490 is pressed by the interface operation M. Then, control unit 510 uses VDP 532 to cause display unit 530 to display the image that was displayed before Web page image MG400 was displayed. Then, control unit 510 ends the process of step S229 and ends the process of communication terminal device 500.

  When control unit 510 determines that remote control mode canceling operation has been performed, control unit 510 cancels remote control mode of communication terminal device 500. Here, the remote control mode release operation is an operation in which the button image MBG480 is pressed by the interface operation M.

  As described above, in the present embodiment, the content related information related to the image as the content currently displayed on the display unit 630 of the video display device 600 is transmitted to the search server 800S as search information. The search server 800S uses the received search information (content related information) to perform processing for searching for the URL of the Web page of information related to the content related information. Then, the search server 800S transmits search result data including a plurality of Web page data to the video display device 600. The video display device 600 transmits (transfers) the received search result data to the communication terminal device 500 which is a device different from the video display device 600 displaying the content.

  The communication terminal device 500 transmits the URL information corresponding to the title selected by the user in the received search result data to the video display device 600. Then, the video display device 600 receives the Web page data of the URL corresponding to the selected title. The video display device 600 transmits (transfers) the received Web page data to the communication terminal device 500. Communication terminal device 500 causes display unit 530 to display a Web page image based on the Web page data.

  By performing the above processing, it is possible to retrieve the URL of the Web page of information related to the content related information related to the content in a state where the content is displayed on the display unit 630 of the video display device 600. Therefore, it is possible to search for the URL of the Web page displaying information related to the content related information related to the content without reducing the visibility of the content being viewed by the user.

  Then, in a state in which content is displayed on the display unit 630 of the video display device 600, the communication terminal device 500 transmits URL information corresponding to the title selected by the user to the video display device 600 based on the search result. To do. The video display device 600 transmits (transfers) the Web page data of the Web page image related to the title corresponding to the information desired by the user selected by the user to the communication terminal device 500. Then, a web page image based on the web page data is displayed on display unit 530. Therefore, the user can refer to the information on the Web page desired by the user in a state where the content is displayed on the display unit 630.

  As described above, there is an effect that desired information can be referred to quickly without reducing the visibility of the content being displayed in the period for selecting information.

  The embodiment disclosed this time should be considered as illustrative in all points and not restrictive. The scope of the present invention is defined by the terms of the claims, rather than the description above, and is intended to include any modifications within the scope and meaning equivalent to the terms of the claims.

It is a figure which shows the structure of the network system in this Embodiment. It is the figure which showed the external appearance of the communication terminal device from the front. It is the figure which showed the external appearance of the communication terminal device from the left side surface. It is the figure which showed the external appearance of the communication terminal device from the back surface. It is the block diagram which showed the internal structure of the communication terminal device. It is the figure which showed the external appearance of the video display apparatus from the front. It is the block diagram which showed the internal structure of the video display apparatus. It is a figure which shows the remote control image as an example. It is a flowchart of a content related information display process. It is a figure which shows the program information data table as an example. It is a figure which shows the program schedule image as an example. It is a figure which shows the program simple information data table as an example. It is a figure which shows the simple list image as an example. It is a figure which shows the search result data as an example. It is a figure which shows the search result image as an example. It is a figure which shows the web page image as an example. It is a flowchart of the content related information display process A. It is a figure which shows the web page image as an example.

Explanation of symbols

  50 communication unit, 70 network, 180, 180A program, 300 remote control, 500 communication terminal device, 510, 610 control unit, 520, 620 storage unit, 530, 630 display unit, 540 input unit, 555, 555A recording medium, 600 video Display device, 800A service server, 800S search server, 800W Web server, 1000 network system.

Claims (7)

A video display system composed of a communication terminal device and a video display device capable of data communication with each other,
The communication terminal device is capable of data communication with a search server that searches a database using search information as a key,
The video display device
Display means for displaying content;
First transmission means for transmitting content-related information related to the content displayed on the display means to the communication terminal device;
The communication terminal device
First receiving means for receiving the content related information;
Second transmission means for transmitting the content related information as the search information to the search server,
Upon receiving the search information, the search server searches the database using the search information as a key, and transmits search result data including a plurality of network addresses to the communication terminal device,
The first receiving means receives the search result data;
The communication terminal device
In response to an input instruction, the system further comprises selection transmission means for selecting any of the plurality of network addresses included in the received search result data and transmitting the selected network address to the video display device,
The video display device
Second receiving means for receiving the network address transmitted by the selective transmitting means;
Obtaining means for obtaining information corresponding to the network address received by the second receiving means from the network;
A video display system further comprising display control means for causing the display means to display information acquired from the network. The communication terminal device
Information display means for displaying a plurality of selection information for respectively selecting the plurality of network addresses;
An instruction input means for receiving instructions from the outside,
The selection transmission unit selects one of the plurality of selection information in response to a selection instruction for selecting any of the plurality of selection information received by the instruction input unit, and corresponds to the selected selection information The video display system according to claim 1, wherein a network address to be transmitted is transmitted to the video display device. A communication terminal provided with a display unit for displaying information and capable of data communication with each of a video display device that displays information corresponding to the received network address on the display unit and a search server that searches a database using search information as a key A device,
The communication terminal device
Receiving means for receiving content-related information related to content displayed on the display unit of the video display device;
Transmission means for transmitting the content related information to the search server as the search information,
The receiving means receives search result data including a plurality of network addresses from the search server;
The communication terminal device
A communication terminal device further comprising selection transmission means for selecting any of the plurality of network addresses included in the search result data received in response to an input instruction and transmitting the selected network address to the video display device. The communication terminal device
Information display means for displaying a plurality of selection information for respectively selecting the plurality of network addresses;
An instruction input means for receiving instructions from the outside,
The selection transmission unit selects one of the plurality of selection information according to a selection instruction for selecting any of the plurality of selection information received by the instruction input unit, and corresponds to the selected selection information The communication terminal device according to claim 3, wherein a network address is transmitted to the video display device. A video display device capable of data communication with a communication terminal device capable of data communication with a search server that searches a database using search information as a key,
The video display device
Display means for displaying content;
Transmitting means for transmitting content-related information related to the content displayed on the display means to the communication terminal device;
Receiving means for receiving a network address selected from a plurality of network addresses received by transmitting the content related information received by the communication terminal device as the search information to the search server;
Obtaining means for obtaining information corresponding to the network address received by the receiving means from the network;
A video display device further comprising display control means for causing the display means to display information acquired from the network. A video display system composed of a communication terminal device and a video display device capable of data communication with each other,
The video display device is capable of data communication with a search server that searches a database using search information as a key,
The video display device
Display means for displaying content;
Transmission means for transmitting content-related information related to the content displayed on the display means to the search server as the search information,
When the search server receives the search information, the search server performs a database search using the search information as a key, and transmits search result data including a plurality of network addresses to the video display device,
The video display device
A first receiving means for receiving the search result data;
The transmission means transmits the received search result data to the communication terminal device,
The communication terminal device
Second receiving means for receiving the search result data;
In response to an input instruction, a selection transmission unit that selects any one of the plurality of network addresses included in the received search result data and transmits the selected network address to the video display device,
The first receiving means receives the network address transmitted by the selective transmission means,
The video display device
An acquisition means for acquiring information corresponding to the network address received by the first reception means from the network;
The transmitting unit transmits the information acquired by the acquiring unit to the communication terminal device;
The second receiving means receives the information transmitted by the transmitting means;
The communication terminal device
An image display system further comprising information display means for displaying information received by the second receiving means. A device control method including a first control method and a second control method for causing a video display device and a communication terminal device, each of which is capable of data communication with each other and provided with a display unit for displaying information,
The communication terminal device is capable of data communication with a search server that searches a database using search information as a key,
The first control method includes:
A display step of displaying content on the display unit;
A first transmission step of transmitting content-related information related to the content displayed on the display unit to the communication terminal device;
The second control method includes:
A first receiving step of receiving the content related information;
A second transmission step of transmitting the content related information as the search information to the search server,
Upon receiving the search information, the search server searches the database using the search information as a key, and transmits search result data including a plurality of network addresses to the communication terminal device,
The first receiving step includes receiving the search result data;
The second control method includes:
In response to an input instruction, further includes a selection transmission step of selecting any of the plurality of network addresses included in the received search result data and transmitting the selected network address to the video display device,
The first control method includes:
A second receiving step of receiving the network address transmitted by the selective transmission step;
An acquisition step of acquiring information corresponding to the network address received in the second reception step from the network;
And a display control step of displaying information acquired from the network on the display unit.

Images