JP4987568B2 - Communication terminal device and cooperative processing method - Google Patents

Description

  The present invention relates to a terminal device, a cooperation processing system, and a cooperation processing method, and particularly to a terminal device, a cooperation processing system, and a cooperation processing method that operate based on data for operating a plurality of devices.

  In recent years, devices conforming to a standard (hereinafter also referred to as inter-device communication standard) for enabling data communication with each other among a plurality of types of devices in a home are becoming widespread. The inter-device communication standard is, for example, a DLNA (Digital Living Network Alliance) standard. Devices conforming to the inter-device communication standard are, for example, a television receiver, an HDD (Hard disk drive) recorder, an audio device, and the like. In addition, a device compliant with the inter-device communication standard is generally connectable to a network such as the Internet via a network device such as a router.

  In general, a device that conforms to a communication standard between different devices that can be connected to a network is a device that can be operated by a remote controller. Therefore, it is required to operate a plurality of types of devices that can be operated with a remote controller and can be connected to a network with a single device.

Japanese Patent Laying-Open No. 2006-024137 (Patent Document 1) discloses a technique of using a mobile phone as a remote controller for operating a plurality of types of devices such as a TV and an HDD recorder. Japanese Patent Laid-Open No. 2006-024137 (Patent Document 1) discloses a technique (hereinafter also referred to as a first prior art) for easily generating UI (User Interface) content used in a mobile phone. It is disclosed.
JP 2006-024137 A

  A plurality of types of devices such as a mobile phone, a TV, an HDD recorder, and the like can realize various types of processing by operating in cooperation with each other. That is, in order to realize various kinds of processing, it is necessary that a plurality of types of devices operate in cooperation with each other. The first prior art does not disclose that the HDD recorder only performs an operation according to the instruction in response to an instruction from the mobile phone, and that the mobile phone and the HDD recorder operate in cooperation with each other.

  The present invention has been made to solve the above-described problems, and the object of the present invention is to allow each of a plurality of devices to perform operations in cooperation with each other by fully utilizing the characteristics of the device itself. It is to provide a possible terminal device, a cooperation processing system, and a cooperation processing method.

  In order to solve the above-described problem, according to one aspect of the present invention, a terminal device capable of data communication with another terminal device and a data generation device includes a storage unit that stores device information of the own device, and another terminal device. From the first acquisition means for acquiring the device information of the other terminal device, the device information of the own device, and the device information of the other terminal device to the data generation device, and the data generation device, Data generated based on the device information of the own device and the device information of other terminal devices, and is data for operating in cooperation with other terminal devices. A second acquisition unit configured to acquire processing data from the data generation device; and an execution unit configured to perform processing in order to operate in cooperation with other terminal devices by executing cooperative processing data corresponding to the own device. .

  Preferably, the execution unit performs processing for operating in cooperation with other terminal devices in response to acquisition of the cooperation processing data corresponding to the own device.

  Preferably, the second acquisition unit acquires information for operating in cooperation with another terminal device from another terminal device in response to the execution unit executing the cooperation processing data corresponding to the own device. To do.

  Preferably, the second acquisition unit further acquires cooperation processing data according to the other terminal device from the data generation device, and the transmission unit transmits the cooperation processing data according to the other terminal device to the other terminal device. Send.

  Preferably, the transmission unit transmits information for the other terminal device to operate in cooperation with the own device to the other terminal device in response to the execution unit executing the cooperation processing data according to the own device. To do.

  Preferably, the device information of the own device includes information on the function of the own device, and the device information of the other terminal device includes information of the function of the other terminal device.

  According to another aspect of the present invention, a cooperation processing system including a first terminal device capable of data communication with a data generation device and a second terminal device, wherein the first terminal device is device information of the first terminal device. First storage means for storing, first acquisition means for acquiring device information of the second terminal device from the second terminal device, device information of the first terminal device, and device information of the second terminal device, Data generated on the basis of the device information of the first terminal device and the device information of the second terminal device by the transmission means for transmitting to the data generating device and the data generating device, and cooperates with the second terminal device By executing the second acquisition means for acquiring the cooperation processing data corresponding to the first terminal device from the data generation device and the cooperation processing data corresponding to the first terminal device. , Connected to the second terminal device First execution means for performing processing to operate as the second terminal device generated by the data generation device based on the device information of the first terminal device and the device information of the second terminal device 3rd acquisition means which is data for operating in cooperation with each other with the first terminal device, and acquires cooperation processing data corresponding to the second terminal device from the data generation device, and the second terminal Second execution means for performing processing to operate in cooperation with the first terminal device by executing cooperative processing data corresponding to the device is provided.

  According to still another aspect of the present invention, the cooperative processing method executed by the second terminal device capable of data communication with the first terminal device and the data generation device is the device information of the first terminal device from the first terminal device. The step of acquiring, the device information of the second terminal device, and the device information of the first terminal device are transmitted to the data generating device, and the device information of the second terminal device and the first terminal are transmitted by the data generating device. Data generated on the basis of the device information of the device, and is data for the first terminal device and the second terminal device to operate in cooperation with each other, and the cooperation processing data according to the second terminal device Are obtained from the data generation device, and by executing cooperative processing data corresponding to the second terminal device, the processing is performed to operate in cooperation with the first terminal device.

  The terminal device according to the present invention acquires device information of another terminal device from another terminal device, transmits device information of the own device and device information of the other terminal device to the data generation device, and transmits data Data generated by the generation device based on the device information of the own device and the device information of the other terminal device, the data for operating in cooperation with the other terminal device, the own device Is obtained from the data generation device, and by executing the cooperation processing data according to its own device, processing is performed in order to operate in cooperation with other terminal devices.

  Accordingly, each of the plurality of devices can perform operations in cooperation with each other by fully utilizing the characteristics of the device itself. As a result, various kinds of processing can be realized.

  The cooperative processing system according to the present invention includes a first terminal device capable of data communication with a data generation device, and a second terminal device. The first terminal device acquires the device information of the second terminal device, transmits the device information of the first terminal device and the device information of the second terminal device to the data generation device, and the first data is generated by the data generation device. Data generated based on the device information of the terminal device and the device information of the second terminal device, and data for operating in cooperation with the second terminal device, depending on the first terminal device The cooperative processing data is acquired from the data generation device, and by executing the cooperative processing data according to the first terminal device, processing is performed to operate in cooperation with the second terminal device.

  The second terminal device is data generated by the data generation device based on the device information of the first terminal device and the device information of the second terminal device, and operates in cooperation with the first terminal device. Data for the second terminal device is acquired from the data generation device, and the cooperation processing data according to the second terminal device is executed to cooperate with the first terminal device. Process to operate.

  Accordingly, each of the plurality of devices can perform operations in cooperation with each other by fully utilizing the characteristics of the device itself. As a result, various kinds of processing can be realized.

  The cooperation processing method according to the present invention acquires device information of the first terminal device from the first terminal device, and transmits the device information of the second terminal device and the device information of the first terminal device to the data generation device. The data generation device generates data based on the device information of the second terminal device and the device information of the first terminal device, and the first terminal device and the second terminal device cooperate with each other. It is data for operation, and the cooperation processing data according to the second terminal device is acquired from the data generation device, and by executing the cooperation processing data according to the second terminal device, the first terminal device and each other Processes to work together.

  Accordingly, each of the plurality of devices can perform operations in cooperation with each other by fully utilizing the characteristics of the device itself. As a result, various kinds of processing can be realized.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings. In the following description, the same parts are denoted by the same reference numerals. Their names and functions are also the same. Therefore, detailed description thereof will not be repeated.

  The content handled in the present invention intends digital data such as video, audio, and images and related information related thereto. As a matter of course, the content is not limited to digital data as long as it is handled in the same manner as the above content. In addition, if the content is provided via a network such as a television broadcast, an Internet broadcast, or a mobile phone network, one content can be provided from a plurality of networks.

<First Embodiment>
(System configuration)
FIG. 1 is a diagram illustrating a configuration of a network system 1000 according to the present embodiment. Referring to FIG. 1, network system 1000 includes home networks 501.1, 501.2,. n is included. In the following, home networks 501.1, 501.2,. n (n: natural number) is also collectively referred to as a home network 501.

  Home network 501 is, for example, a network provided in a home. The home is, for example, a user's home, a company, or the like. Home network 501 includes communication terminal device 500, video display device 600, and communication unit 50.

  Communication terminal device 500 is a mobile phone. Communication terminal device 500 is not limited to a mobile phone, and any device (for example, a PDA (Personal Digital Assistance) or a PC (Personal Computer)) that has a communication function and is portable can be used. Good.

  The communication terminal device 500 can perform data communication with the telephone network 60 by radio. The telephone network 60 is a telephone network for mobile phones, for example. Note that when the communication terminal device 500 performs data communication with the telephone network 60, a packet fee corresponding to the amount of data used at the time of data communication is generated.

  The video display device 600 is a television receiver. The video display device 600 is a liquid crystal television as an example of a television receiver. The video display device 600 is not limited to a liquid crystal television, and may be any device that can display an image. Video display device 600 may be, for example, a plasma television. The video display device 600 may be a device that includes a display device for displaying an image and an image data transmission device that transmits image data to be displayed on the display device. The image data transmission device is, for example, a PC, an STB (Set Top Box), an HDD (Hard Disk Drive) recorder, a DVD (Digital Versatile Disc) recorder, or the like. In this case, the connection method between the image data transmission device and the display device is not particularly defined.

  Communication terminal device 500 and video display device 600 perform data communication wirelessly or by wire. That is, a video display system including the communication terminal device 500 and the video display device 600 is configured.

  The communication unit 50 has a function of performing data communication with each of the communication terminal device 500, the video display device 600, and the network 70. The network 70 is an external network such as the Internet.

  The communication unit 50 has a function of performing data communication simultaneously with a plurality of devices by using a wireless technology based on IEEE 802.11g, which is a wireless LAN standard. The wireless technology is not limited to the technology based on IEEE 802.11g, and may be other wireless technology. Therefore, communication unit 50 can perform data communication with each of communication terminal device 500, video display device 600, and network 70 wirelessly.

  The communication unit 50 further has a communication interface using Ethernet (registered trademark). When a device in the home network 501 issues a connection request to the network 70, the address of the device is set in the network 70. It has a router function including a NAT (Network Address Translation) function for converting addresses.

  Therefore, the communication unit 50 can perform data communication with each of the communication terminal device 500, the video display device 600, and the network 70, for example, via a LAN cable. That is, the communication unit 50 can perform data communication with each of the communication terminal device 500, the video display device 600, and the network 70 by wire.

  The network 70 can perform data communication with the telephone network 60 by radio or wire. Therefore, the communication terminal device 500 can perform data communication with the network 70 via the telephone network 60.

  Network system 1000 further includes service server 800A, search server 800S, and Web server 800W.

  The service server 800A is a server that provides content, information related to the content, and the like. The content is, for example, a moving image or music data. For example, when the content is a moving image of a program, the information related to the content is, for example, program information. Service server 800A is a PC. The service server 800A is not limited to a PC, and any device can be used as long as it has a function of providing content such as moving images, content such as music data, information related to the content, and the like. May be.

  The service server 800A records all the programs of all the channels in the period from the current date and time to the date and time before a predetermined period (for example, 24 hours), and stores recorded data obtained by recording the program. Service server 800A automatically deletes recorded data after a predetermined period (for example, 24 hours) from the current date and time. Therefore, the service server 800A stores the recording data of all the programs of all the channels in the period from the current date and time to the date and time before the predetermined period.

  The service server 800A stores video content such as a movie to be distributed in response to a distribution request from the apparatus, separately from the recording data of the broadcast program. If there is a recording data distribution request, the service server 800A transmits or performs streaming distribution of the recording data requested to be distributed to the apparatus that has requested the recording data distribution.

  Further, the service server 800A stores in advance a program currently being broadcast and moving image data scheduled to be broadcast for a predetermined period (for example, 24 hours). If there is a distribution request for moving image data of a program that is currently being broadcast, the distribution-requested moving image data is streamed to the apparatus that has requested the distribution of moving image data.

  When a search server 800S receives a keyword as search information from a terminal device connected to the network 70, the search server 800S searches a URL (Uniform Resource Locator) of a Web page of information related to the received keyword. The search server 800S is a PC. The search server 800S is not limited to a PC, and when receiving a keyword from a terminal device connected to the network 70, the search server 800S searches for a URL (Uniform Resource Locator) of a Web page of information related to the received keyword. Any device having a function may be used.

  Web server 800W is a server that provides data of a plurality of Web pages corresponding to each of a plurality of types of information. Web server 800W provides data of a plurality of Web pages corresponding to information related to a movie, for example. Web server 800W is a PC. Web server 800W is not limited to a PC, and may be any device that has a function of providing data of a plurality of Web pages corresponding to each of a plurality of types of information.

  Each of service server 800A, search server 800S, and Web server 800W performs data communication with network 70 in a wireless or wired manner.

  The service server 800A may be provided in the home network 501. In this case, the communication terminal device 500 and the video display device 600 are configured to be able to perform data communication with the service server 800A without going through the network 70.

  In the present embodiment, it is assumed that communication unit 50 can perform high-speed data communication with each of communication terminal device 500, video display device 600, and network 70. The communication unit 50 is assumed to be capable of data communication with each of the communication terminal device 500, the video display device 600, and the network 70, for example, at a maximum speed of 100 Mbps (Mega bit per second).

  In addition, it is assumed that the network 70 can perform high-speed data communication with each of the communication unit 50, the telephone network 60, the service server 800A, the search server 800S, and the Web server 800W. It is assumed that the network 70 can perform data communication with each of the communication unit 50, the telephone network 60, the service server 800A, the search server 800S, and the Web server 800W, for example, at a maximum speed of 100 Mbps. Therefore, for example, it is assumed that the maximum speed of data communication between the video display device 600 and the network 70 is 100 Mbps. For example, it is assumed that the maximum speed of data communication between the communication terminal device 500 and the network 70 is 100 Mbps.

  It is assumed that the data communication speed between communication terminal device 500 and telephone network 60 is slower than the data communication speed between communication terminal device 500 and network 70. Assume that the maximum speed of data communication between communication terminal device 500 and telephone network 60 is, for example, 256 kbps.

  Further, it is assumed that the data communication speed between the communication terminal device 500 and the video display device 600 is sufficiently higher than the data communication speed between the communication terminal device 500 and the telephone network 60. It is assumed that the maximum speed of data communication between the communication terminal device 500 and the video display device 600 is 4 Mbps, for example.

(Communication terminal device)
Next, the communication terminal device 500 will be described in detail.

  FIG. 2 is a diagram showing the external appearance of the communication terminal device 500 from the front. Referring to FIG. 2, communication terminal device 500 includes a display unit 530, an audio output unit 570, an LED 576, and an input unit 540.

  The display unit 530 has a function of displaying characters, images, and the like. The display unit 530 is a device using an LCD panel (Liquid Crystal Display Panel). Note that the display unit 530 may be a device using a panel of a display method other than the above.

  The resolution of the display unit 530 is 240 horizontal (dots) × 400 vertical (dots). Note that the resolution of the display unit 530 is not limited to horizontal 240 (dots) × longitudinal 400 (dots), but may be other resolutions.

  The display unit 530 has a touch panel function that allows the user to input information by directly touching the screen. Display unit 530 transmits the position information of the user touching the screen to control unit 510 described later. Control unit 510 performs predetermined processing based on the received position information.

  The voice output unit 570 has a function of outputting the voice of the telephone. Audio output unit 570 includes a speaker that outputs audio. The audio output unit 570 outputs audio based on audio data received from the control unit 510 described later from the speaker.

  The LED 576 performs light notification according to processing performed in the communication terminal device 500. For example, the LED 576 blinks light when an incoming call is received.

  The input unit 540 includes a button group 541. The button group 541 includes direction buttons 541A, 541B, 541C, 541D, and an enter button 541E. The direction buttons 541A, 541B, 541C, and 541D are displayed when the image is displayed on the display unit 530 by a short time (for example, less than 1 second) pressing operation (hereinafter also referred to as a short pressing operation) by the user. This is a button for moving an object to be moved (for example, a cursor) vertically and horizontally.

  Specifically, the direction buttons 541A, 541B, 541C, and 541D in which a short press operation has been performed are buttons for moving the cursor up, down, left, and right, respectively, for example. In addition, the direction buttons 541A, 541B, 541C, and 541D can be operated by pressing the user for a long time (for example, one second or longer) (hereinafter, also referred to as a long press operation), for example, to move the screen up, down, left, or right It is also possible to scroll the screen.

  The determination button 541E is a button for determining an item or the like selected by a short press operation of the direction buttons 541A, 541B, 541C, 541D, for example.

  Input unit 540 further includes function buttons 542A, 542B, 543A, and 543B. Each of the function buttons 542A and 542B is a button for starting a program or the like preset by the user, for example, by a short press operation.

  The function button 543A is a button for making a call. For example, the function button 543A is subjected to a process of making a call to the terminal device of the input telephone number by inputting the telephone number by a short press operation of a numerical button group 546 described later and then pressing the function button 543A. Function button 543A is a button for starting a call by a short press operation when a call is made to communication terminal device 500. The function button 543B is a button for ending the call by a short press operation when the communication terminal device 500 is in a call. The function button 543B is a button for switching the power of the communication terminal device 500 on and off by a user's long-time (for example, 1 second or longer) pressing operation (hereinafter also referred to as a long pressing operation). is there.

  Input unit 540 further includes a number button group 546. The number button group 546 includes 12 number buttons. The number of number buttons included in the number button group 546 is not limited to twelve. Each of the twelve number buttons is a button for inputting numbers, characters, symbols, or the like by a short press operation. The names of the 12 numeric buttons are referred to as 0 button, 1 button, 2 button, 3 button, 4 button, 5 button, 6 button, 7 button, 8 button, 9 button, symbol button 1 and symbol button 2, respectively.

  The input unit 540 transmits a button signal corresponding to a short-pressed or long-pressed button among a plurality of buttons included in the input unit 540 to the control unit 510 described later. That is, the input unit 540 is an interface for the user to operate the communication terminal device 500. Hereinafter, an operation of the input unit 540 or a touch operation on the display unit 530 by the user is also referred to as an interface operation M.

  Communication terminal device 500 further includes a voice input unit 574 and a biological information acquisition unit 577. The voice input unit 574 has a function of inputting voice during a call. The voice input unit 574 includes a microphone for inputting voice. The voice input unit 574 converts voice acquired by the microphone into voice data, and transmits the voice data to the control unit 510 described later in the communication terminal device 500.

  The biological information acquisition unit 577 has a function of acquiring human biological information. In the present embodiment, the biological information is information obtained by converting a fingerprint that is a part of a human body into data. In this case, the biometric information is fingerprint image data, data obtained by extracting a characteristic portion of the fingerprint, or the like. The biometric information is not limited to information obtained by converting fingerprints into data, but may be information obtained by converting veins, retinas, irises, faces, and the like into data. The biometric information may be a voiceprint based on a voice uttered by a human.

  When a part of the human body comes into contact, the biological information acquisition unit 577 transmits the biological information obtained by converting the part of the contacted body into data to the control unit 510 described later.

  The portable terminal device 500 further includes a recording medium insertion unit 550A. The recording medium insertion unit 550 </ b> A is a part for inserting a recording medium, which will be described later, into the mobile terminal device 500.

  FIG. 3 is a diagram showing the appearance of the communication terminal device 500 from the back. With reference to FIG. 3, communication terminal apparatus 500 further includes an audio output unit 572 and an imaging unit 578. The audio output unit 572 has a function of outputting audio corresponding to processing performed by the control unit 510 described later. The sound output unit 572 includes a speaker that outputs sound. The audio output unit 572 outputs audio based on audio data received from the control unit 510 described later from the speaker.

  The imaging unit 578 has a function of performing an imaging process for imaging a subject to be imaged. The imaging unit 578 includes an imaging lens, a light receiving unit, and a color filter unit (not shown). The light receiving unit has a function of converting input light into an electrical signal. The light receiving unit is composed of a plurality of light receiving elements. The light receiving element is an element using, for example, a CCD (Charge Coupled Device) image sensor or a CMOS (Complementary Metal Oxide Semiconductor) image sensor.

  The color filter unit is composed of a plurality of color filters. The color filter is a filter corresponding to each of R, G, and B. The plurality of color filters are provided corresponding to the plurality of light receiving elements, respectively.

  The following processing is performed in the imaging processing. First, the imaging unit 578 inputs light reflected by the subject to be imaged and incident on the imaging lens to the light receiving unit via the color filter unit. The light receiving unit converts the input light into an electrical signal. The imaging unit 578 converts the converted electrical signal into digital data (hereinafter also referred to as captured image data).

  FIG. 4 is a block diagram showing an internal configuration of communication terminal device 500. FIG. 4 also shows a recording medium 555 for explanation. A recording medium 555 stores a program 180 described later. That is, the program 180 is recorded on a medium or the like and distributed as a program product. The recording medium 555 is also distributed as a program product.

  Referring to FIG. 4, communication terminal apparatus 500 further includes a control unit 510, a temporary storage unit 522, and a storage unit 520.

  The storage unit 520 has a function of storing data in a nonvolatile manner. The storage unit 520 is accessed by the control unit 510. The storage unit 520 is a medium (for example, a flash memory) that can hold data in a nonvolatile manner even when power is not supplied. The storage unit 520 stores a program 180, recording data to be described later, various other data, and the like. The program 180 includes a remote control program described later.

  Control unit 510 has a function of performing various types of processing, arithmetic processing, and the like for each unit in communication terminal device 500 in accordance with program 180 stored in storage unit 520. Control unit 510 is a CPU (Central Processing Unit). Control unit 510 is not limited to a CPU, and may be another circuit having an arithmetic function.

  Temporary storage unit 522 is accessed as data by control unit 510 and used as a work memory for temporarily storing data. The temporary storage unit 522 is a DRAM (Dynamic Random Access Memory). Note that the temporary storage unit 522 is not limited to a DRAM, and may be another circuit capable of storing data in a volatile manner.

  Communication terminal device 500 further includes an antenna 502, a tuner 505, and a data processing unit 507.

  The antenna 502 is connected to the tuner 505. The tuner 505 receives a broadcast signal having a frequency instructed by the control unit 510 via the antenna 502. The tuner 505 has a function of receiving broadcast signals based on digital broadcasting and analog broadcasting.

  The broadcast signal includes image data, audio data, text data, and EPG (Electric Program Guide) (registered trademark) data. When the broadcast signal is a signal based on digital broadcasting, the broadcast signal further includes BML (Broadcast Markup Language) data and the like. EPG (registered trademark) data is data indicating a plurality of program information. BML data is data for controlling the arrangement position and operation of each of image data, audio data, and text data. The tuner 505 transmits the received broadcast signal to the data processing unit 507.

  The data processing unit 507 demodulates the received broadcast signal to obtain demodulated data. When the received broadcast signal is a signal based on analog broadcast, the data processing unit 507 performs the following processing. First, the data processing unit 507 decodes the demodulated data to obtain image data and audio data, and from the vertical blanking interval (VBI) of the broadcast signal, text data and EPG (registered trademark) data. Get.

  When the data processing unit 507 receives a display instruction for causing the display unit 530 to display an image from the control unit 510, the data processing unit 507 transmits the image data to a VDP (Video Display Processor) 532 described later. When receiving the image data, the VDP 532 displays an image (moving image or still image) based on the image data on the display unit 530.

  In addition, when the data processing unit 507 receives a recording instruction for performing a recording process from the control unit 510, the data processing unit 507 compresses the image data and the audio data and stores the compressed image data and the audio data in the storage unit 520. The recorded data in this case is also referred to as content below. The recorded data is H.264. The data is compressed in the H.264 format. The recorded data is H.264. The data is not limited to data compressed in the H.264 format, and may be data compressed in another format. Here, the other formats are, for example, MPEG (Moving Picture Experts Group) 1, MPEG2, and the like.

  When the received broadcast signal is a signal based on digital broadcast, the data processing unit 507 performs the following processing. First, the data processing unit 507 decodes the demodulated data based on a digital broadcast protocol to obtain decoded data. The decoded data includes image data, audio data, text data, EPG (registered trademark) data, and BML data. The image data and audio data included in the decoded data are H.264 data. The data is compressed in the H.264 format. Note that image data and audio data included in the decoded data are H.264 data. The data is not limited to data compressed in the H.264 format, and may be data compressed in another format. Here, the other formats are, for example, formats such as MPEG1 and MPEG2.

  When the data processing unit 507 receives a display instruction for displaying an image on the display unit 530 from the control unit 510, the data processing unit 507 transmits the image data included in the decoded data of the channel specified by the display instruction to the VDP 532 described later. Send. When receiving the image data, the VDP 532 displays an image (moving image or still image) based on the image data on the display unit 530.

  Further, when receiving a recording instruction for performing a recording process from the control unit 510, the data processing unit 507 stores the decoded data of the channel designated by the recording instruction in the storage unit 520 as the recording data. The recorded data in this case is also referred to as content below. In this case, the recorded data includes image data, audio data, text data, and BML data.

  Communication terminal apparatus 500 further includes VDP 532 and VRAM (Video Random Access Memory) 536.

The VRAM 536 has a function of temporarily storing image data.
Control unit 510 issues a drawing instruction to VDP 532 according to program 180 stored in storage unit 520. The drawing instruction is an instruction for generating an image and causing the display unit 530 to display the image.

  The VDP 532 is connected to the display unit 530. The VDP 532 reads font data, graphic data, and the like from a program 180 (to be described later) in the storage unit 520 in response to a drawing instruction from the control unit 510 and generates an image using the VRAM 536. The VDP 532 reads out the image data stored in the VRAM 536 and causes the display unit 530 to display an image based on the image data.

  Communication terminal device 500 further includes an input unit 540 and a recording medium access unit 550.

  Control unit 510 receives, from input unit 540, a button signal corresponding to a button that has been subjected to a short press operation or a long press operation among the plurality of buttons included in input unit 540. Control unit 510 performs processing according to the received button signal.

  The recording medium access unit 550 can access the recording medium 555 when the recording medium 555 is inserted (attached) to the communication terminal device 500 from the recording medium insertion unit 550A. As a result, the recording medium access unit 550 can read the program 180 from the recording medium 555 on which the program 180 is recorded.

  The program 180 stored in the recording medium 555 is read by the recording medium access unit 550 by the installation process of the control unit 510, and the control unit 510 stores the program 180 in the storage unit 520. The installation processing program is stored in advance in the storage unit 520, and the installation processing is performed by the control unit 510 based on the installation processing program.

  Note that the program 180 may not be installed in the storage unit 520. In this case, control unit 510 reads program 180 stored in recording medium 555 via recording medium access unit 550, and performs predetermined processing based on program 180. The recording medium 555 further records content data and the like. The content data is, for example, music data, moving image data, and the like.

  The recording medium 555 is an SD (Secure Digital (registered trademark)) memory card. The recording medium 555 is not limited to the SD memory card (registered trademark), and may be another medium capable of recording data in a nonvolatile manner.

Communication terminal device 500 further includes a communication unit 560 and a communication unit 562.
Communication unit 560 exchanges data with control unit 510. The communication unit 560 has a function of transmitting and receiving data to and from the video display device 600 in a wired or wireless manner.

  The communication unit 560 has a function of a communication interface that performs serial transfer based on the USB (registered trademark) (Universal Serial Bus) 2.0 standard. Note that the standard of the communication interface for performing serial transfer is not limited to USB (registered trademark) 2.0, and may be another standard.

  Note that the communication unit 560 may have a function of a communication interface that performs parallel transfer. The communication interface that performs parallel transfer is, for example, an interface that conforms to a Centronics-compliant standard. Further, the communication unit 560 may have a communication interface function based on the IEEE 1394 or SCSI standard.

  Communication unit 560 further has a wireless data communication function. The wireless data communication function has a function of performing data communication wirelessly using Bluetooth (registered trademark). Note that the wireless data communication is not limited to a method using Bluetooth (registered trademark), and may be another communication method using infrared light, for example. Communication unit 560 performs data communication with video display device 600 wirelessly in response to a control instruction from control unit 510.

  Communication unit 562 exchanges data with control unit 510. The communication unit 562 has a function of performing data communication using a wireless technology based on IEEE 802.11g, which is a wireless LAN standard. The wireless technology is not limited to the technology based on IEEE 802.11g, and may be other wireless technology. Therefore, communication unit 562 can perform data communication with communication unit 50 wirelessly.

  The communication unit 562 further has a communication interface function using Ethernet (registered trademark). Therefore, the communication unit 562 can perform data communication with the communication unit 50 via, for example, a LAN cable.

Communication terminal device 500 further includes an antenna 564 and a communication unit 566.
The antenna 564 is connected to the communication unit 566. The communication unit 566 has a function of transmitting and receiving a wireless communication signal using the antenna 564. The communication unit 566 receives a wireless communication signal having a frequency designated by the control unit 510 via the antenna 564. The wireless communication signal is a signal including voice data, character data, image data, and the like.

  Communication unit 566 uses antenna 564 to communicate with the nearest base station (not shown) using a wireless communication signal. The nearest base station can communicate with the telephone network 60. Therefore, the communication unit 566 uses the antenna 564 to communicate with the telephone network 60 via the nearest base station using a wireless communication signal. When receiving the wireless communication signal, the communication unit 566 demodulates the wireless communication signal and transmits data based on the demodulated wireless communication signal to the control unit 510. Further, when transmitting a wireless communication signal, the communication unit 566 receives data (for example, audio data) from the control unit 510 and converts the data into a wireless communication signal based on a predetermined protocol. Communication unit 566 then uses antenna 564 to transmit the converted wireless communication signal to telephone network 60 via the nearest base station (not shown).

  The communication unit 566 can also acquire information indicating the position of the base station (hereinafter also referred to as base station position information) by communicating with the nearest base station. The communication unit 566 transmits the acquired base station position information to the control unit 510 in response to a control instruction from the control unit 510. Control unit 510 can roughly grasp the position of communication terminal apparatus 500 based on the received base station position information.

  The communication unit 566 has a GPS (Global Positioning System) function. The GPS function is a function of communicating with the artificial satellite and acquiring information (hereinafter also referred to as GPS position information) of the position (position based on latitude, longitude, altitude, etc.) of the communication terminal device 500. The communication unit 566 acquires GPS position information in response to a control instruction from the control unit 510 and transmits it to the control unit 510.

  The portable terminal device 500 can also download a program from the network 70 via the telephone network 60 and store the program in the storage unit 520 through the processing of the control unit 510 and the communication unit 566. In this case, the downloaded program is the program 180.

  Control unit 510 performs predetermined processing in accordance with a program (program 180) downloaded from network 70. The download program is stored in advance in the storage unit 520, and the download process is performed by the control unit 510 based on the download program.

  Control unit 510 performs data communication with voice output units 570 and 572 and voice input unit 574 described above.

  When control unit 510 transmits audio data to audio output unit 570, audio output unit 570 outputs audio based on the audio data received from control unit 510 from the speaker. When control unit 510 transmits audio data to audio output unit 572, audio output unit 572 outputs audio based on the audio data received from control unit 510 from the speaker.

  When the user utters voice to the microphone included in the voice input unit 574, the voice input unit 574 converts voice acquired by the microphone into voice data, and transmits the voice data to the control unit 510.

  Control unit 510 performs data communication with each of LED 576, imaging unit 578, and biological information acquisition unit 577 described above. The LED 576 emits light based on a control instruction from the control unit 510.

  The imaging unit 578 performs the above-described imaging processing based on a control instruction from the control unit 510 and transmits captured image data to the control unit 510. Upon receiving the captured image data, control unit 510 stores the captured image data in any of temporary storage unit 522, storage unit 520, and recording medium 555.

  When the biometric information acquisition unit 577 acquires biometric information, the biometric information acquisition unit 577 transmits the acquired biometric information (for example, fingerprint information) to the control unit 510.

  Communication terminal device 500 further includes a vibration unit 579. The vibration unit 579 has a function of vibrating the communication terminal device 500 when the vibration unit 579 itself vibrates based on a control instruction from the control unit 510. The vibration unit 579 vibrates the communication terminal device 500 based on a control instruction from the control unit 510 when, for example, an incoming call or an e-mail is received.

  The communication terminal device 500 further includes an RFID (Radio Frequency Identification) 580. The RFID 580 is an RFID-based integrated circuit having a security function such as FeliCa (registered trademark), and communicates with a reading terminal (not shown) in a non-contact manner. The RFID 580 outputs data such as a terminal ID based on a control instruction from the control unit 510.

(Video display device)
Next, the video display device 600 will be described in detail.

  FIG. 5 is a block diagram showing an internal configuration of the video display device 600. FIG. 5 also shows a recording medium 555A for explanation. A recording medium 555A records a program 180A described later. That is, the program 180A is recorded on a medium or the like and distributed as a program product. The recording medium 555A is also distributed as a program product.

  Referring to FIG. 5, video display device 600 includes a display unit 630 and an audio output unit 670. The display unit 630 has a function of displaying characters, images, and the like. The display unit 630 is a device that uses an LCD panel (Liquid Crystal Display Panel). Note that the display unit 530 may be a device using a panel of a display method other than the above.

  The size of the image that can be displayed by the display unit 630 is larger than the size of the image that can be displayed by the display unit 530. Further, the resolution of the display unit 630 is larger than the resolution of the display unit 530. For example, the resolution of the display unit 630 is horizontal 1920 (dots) × vertical 1080 (dots). Note that the resolution of the display unit 630 is not limited to horizontal 1920 (dots) × vertical 1080 (dots), and may be other resolutions.

  The audio output unit 670 is provided outside the video display device 600. The audio output unit 670 has a function of outputting audio corresponding to processing performed by the control unit 610 described later. Audio output unit 670 includes a speaker that outputs audio. The audio output unit 670 outputs audio based on audio data received from the control unit 610 described later from the speaker.

  The video display device 600 further includes a control unit 610, a temporary storage unit 622, and a storage unit 620.

  The storage unit 620 has a function of storing data in a nonvolatile manner. The storage unit 620 is accessed by the control unit 610. The storage unit 620 is a hard disk capable of storing a large amount of data. Note that the storage unit 620 is not limited to a hard disk, and may be any medium (for example, a flash memory) that can hold data in a nonvolatile manner even when power is not supplied. The storage unit 620 stores a program 180A, recording data to be described later, a device ID for identifying the video display device 600, other various data, and the like.

  Control unit 610 has a function of performing various types of processing, arithmetic processing, and the like for each unit in video display device 600 in accordance with program 180A stored in storage unit 620. Since control unit 610 is similar to control unit 510 described above, detailed description will not be repeated.

  The temporary storage unit 622 is used as a work memory that is accessed by the control unit 610 and temporarily stores data. Since temporary storage unit 622 is similar to temporary storage unit 522 described above, detailed description thereof will not be repeated.

  The video display device 600 further includes an antenna 602, a tuner 605, and a data processing unit 607.

  The antenna 602 is connected to the tuner 605. The tuner 605 receives a broadcast signal having a frequency instructed by the control unit 610 via the antenna 602. The tuner 605 has a function of receiving broadcast signals based on digital broadcasting and analog broadcasting.

  The broadcast signal includes image data, audio data, text data, and EPG (registered trademark) data. When the broadcast signal is a signal based on digital broadcasting, the broadcast signal further includes the BML data described above. The tuner 605 transmits the received broadcast signal to the data processing unit 607.

  The data processing unit 607 demodulates the received broadcast signal to obtain demodulated data. When the received broadcast signal is a signal based on analog broadcast, the data processing unit 607 performs the following processing. First, the data processing unit 607 decodes the demodulated data to acquire image data and audio data, and acquires text data and EPG (registered trademark) data from the vertical blanking interval of the broadcast signal.

  When the data processing unit 607 receives a display instruction for displaying an image on the display unit 630 from the control unit 610, the data processing unit 607 transmits the image data to the VDP 632 described later. When receiving the image data, the VDP 632 displays an image (moving image or still image) based on the image data on the display unit 630.

  In addition, when the data processing unit 607 receives a recording instruction for performing a recording process from the control unit 610, the data processing unit 607 compresses the image data and the audio data, and stores them in the storage unit 620 as recorded data. The recorded data is data compressed in the MPEG2 format. The recorded data is not limited to data compressed in the MPEG2 format, and may be data compressed in another format. Here, the other format is, for example, H.264. H.264 or the like.

  When the received broadcast signal is a signal based on digital broadcast, the data processing unit 607 performs the following processing. First, the data processing unit 607 decodes the demodulated data based on the digital broadcasting standard to obtain decoded data. The decoded data includes image data, audio data, text data, EPG (registered trademark) data, and BML data. Image data and audio data included in the decoded data are data compressed in the MPEG2 format. The image data and audio data included in the decoded data are not limited to data compressed in the MPEG2 format, and may be data compressed in other formats. Here, the other format is, for example, H.264. H.264 or the like.

  When the data processing unit 607 receives a display instruction for causing the display unit 630 to display the image data from the control unit 610, the data processing unit 607 converts the image data included in the decoded data of the channel designated by the display instruction into a VDP 632 described later. Send to. When receiving the image data, the VDP 632 displays an image (moving image or still image) based on the image data on the display unit 630.

  Hereinafter, an image based on a broadcast signal received by the tuner 605 and displayed on the display unit 630 is also referred to as a TV image. Note that the number of types of TV image channels that can be directly selected by pressing the numeric buttons “1” to “12” provided on the remote controller 300 to be described later for operating the video display device 600 is as follows. Assume that the maximum is 12. As a matter of course, the more number buttons provided on the remote controller 300, the larger the number of TV image channel types that can be directly selected.

  Remote control channel numbers “1” to “12” are set in the numeric buttons “1” to “12” of the remote control 300, respectively. For example, the remote control channel number “3” is set to the numeric button “3”. One TV image channel can be registered in one remote control channel number. For example, it is assumed that the TV image channel number “8” is registered for the remote control channel number “1”. In this case, the numeric button “1” of the remote controller 300 is pressed by the user, so that a remote control signal for selecting a TV image of the channel number “8” is transmitted from the remote controller 300 to the video display device 600. Sent.

  Note that the video display device 600 has a function of simultaneously displaying a plurality of types of TV images on the display unit 630. In addition, the video display device 600 has a function of simultaneously displaying a TV image and other types of images on the display unit 630.

  In addition, when the data processing unit 607 receives a recording instruction for performing a recording process from the control unit 610, the data processing unit 607 causes the storage unit 620 to store the decoded data of the channel designated by the recording instruction as the recording data. The recorded data in this case is also referred to as content below. In this case, the recorded data includes image data, audio data, text data, and BML data.

The video display device 600 further includes a VDP 632 and a VRAM 636.
The VRAM 636 has a function of temporarily storing image data.

  The control unit 610 issues a drawing instruction to the VDP 632 according to the program 180A stored in the storage unit 620. The drawing instruction is an instruction for generating an image and causing the display unit 630 to display the image.

  The VDP 632 is connected to the display unit 630. In response to a drawing instruction from the control unit 610, the VDP 632 reads font data, graphic data, and the like from a program 180A described later in the storage unit 620, and generates an image using the VRAM 636. The VDP 632 reads out the image data stored in the VRAM 636 and causes the display unit 630 to display an image based on the image data.

  The video display device 600 further includes an input unit 640 and a recording medium access unit 650.

  Input unit 640 includes a plurality of buttons (not shown). The plurality of buttons are provided outside the video display device 600. When any one of the buttons is pressed by the user, the input unit 640 transmits a button signal corresponding to the pressed button to the control unit 610. Control unit 610 performs predetermined processing based on the received button signal. Hereinafter, the button operation of the input unit 640 by the user is also referred to as an interface operation T.

  The recording medium access unit 650 has a function of reading the program 180A from the recording medium 555A on which the program 180A is recorded. The program 180A stored in the recording medium 555A is read by the recording medium access unit 650 by the installation process of the control unit 610, and the control unit 610 stores the program 180A in the storage unit 620. The installation processing program is stored in advance in the storage unit 620, and the installation processing is performed by the control unit 610 based on the installation processing program.

  Note that the program 180A may not be installed in the storage unit 620. In this case, control unit 610 reads program 180A stored in recording medium 555A via recording medium access unit 650, and performs predetermined processing based on program 180A. Content data and the like are also recorded on recording medium 555A. The content data is, for example, music data, moving image data, and the like.

  The recording medium 555A is an SD memory card (registered trademark). The recording medium 555 is not limited to the SD memory card (registered trademark), and other media capable of recording data in a nonvolatile manner, such as Blu-ray Disc (registered trademark), HD-DVD (High-DVD). Definition Digital Versatile Disc (registered trademark), DVD-ROM (Digital Versatile Disk Read Only Memory), CD-ROM (Compact Disk Read Only Memory), and the like.

Video display device 600 further includes a communication unit 660 and a communication unit 662.
Communication unit 660 exchanges data with control unit 610. The communication unit 660 has a function of transmitting / receiving data to / from the communication terminal device 500 in a wired or wireless manner. Communication unit 660 has the same configuration and function as communication unit 560 described above, and therefore detailed description will not be repeated.

  Communication unit 662 transmits / receives data to / from control unit 610. Since communication unit 662 has the same configuration and function as communication unit 562 described above, detailed description will not be repeated. Therefore, communication unit 662 can perform data communication with communication unit 50 wirelessly. Communication unit 662 can perform data communication with communication unit 50 via, for example, a LAN cable.

  Therefore, video display apparatus 600 according to the present embodiment can also download a program from network 70 via communication unit 50 and communication unit 662 and store the program in storage unit 620. In this case, the downloaded program is the program 180A.

  Control unit 610 performs predetermined processing according to a program (program 180A) downloaded from network 70. The download program is stored in advance in the storage unit 620, and the download process is performed by the control unit 610 based on the download program.

  Video display device 600 further includes a remote control signal receiver 680. The remote control signal receiving unit 680 has a function of receiving a remote control signal for operating the video display device 600 output from the remote control (remote controller) 300. Remote control signal receiving unit 680 transmits the received remote control signal to control unit 610. Control unit 610 performs corresponding processing in accordance with the received remote control signal. As described above, the remote controller 300 is provided with numeric buttons “1” to “12” for selecting a TV image. Hereinafter, the operation of the remote controller 300 by the user is also referred to as an interface operation T.

  In addition, it can be assumed that the above-described communication terminal device 500 has the function of the remote controller 300, and there can be assumed a case where there are two communication terminal devices 500 and a remote controller 300 and a case where only one of them exists.

  The control unit 610 performs data communication with the voice output unit 670 described above. When control unit 610 transmits audio data to audio output unit 670, audio output unit 670 outputs audio based on the audio data received from control unit 610 from the speaker.

(Service server, search server and Web server)
FIG. 6 is a block diagram showing the internal configuration of the service server 800A. Referring to FIG. 6, service server 800A includes a display unit 830, a control unit 810, a temporary storage unit 822, and a storage unit 820.

  The display unit 830 has a function of displaying characters, images, and the like. Since display unit 830 is similar to display unit 630 described above, detailed description will not be repeated.

  The storage unit 820 has a function of storing data in a nonvolatile manner. The storage unit 820 is accessed by the control unit 810. The storage unit 820 is a hard disk capable of storing a large amount of data. Note that the storage unit 820 is not limited to a hard disk, and may be any medium (for example, a flash memory) that can hold data in a nonvolatile manner even when power is not supplied. The storage unit 820 stores a program 180B, recording data, content data, various other data, and the like.

  Control unit 810 has a function of performing various types of processing, arithmetic processing, and the like for each unit in service server 800A in accordance with program 180B stored in storage unit 820. Since control unit 810 is similar to control unit 510 described above, detailed description will not be repeated.

  The temporary storage unit 822 is accessed as data by the control unit 810, and is used as a work memory that temporarily stores data. Since temporary storage unit 822 is similar to temporary storage unit 522 described above, detailed description thereof will not be repeated.

Service server 800A further includes a VDP 832 and a VRAM 836.
The VRAM 836 has a function of temporarily storing image data.

  The control unit 810 issues a drawing instruction to the VDP 832 in accordance with the program 180B stored in the storage unit 820. The drawing instruction is an instruction for generating an image and causing the display unit 830 to display the image.

  The VDP 832 is connected to the display unit 830. In response to a drawing instruction from the control unit 810, the VDP 832 reads font data, graphic data, and the like from a program 180B described later in the storage unit 520, and generates an image using the VRAM 836. The VDP 832 reads out the image data stored in the VRAM 836 and causes the display unit 830 to display an image based on the image data.

Service server 800A further includes an input unit 840.
A mouse 842 and a keyboard 844 are connected to the input unit 840. The user uses the mouse 842 or the keyboard 844 to give an instruction to the service server 800A. An input instruction from the mouse 842 or the keyboard 844 is transmitted to the control unit 810 via the input unit 840. Control unit 810 performs predetermined processing based on an input instruction from input unit 840.

The service server 800A further includes a communication unit 860 and a communication unit 862.
The communication unit 860 performs data transmission / reception with the control unit 810. The communication unit 860 has a function of transmitting and receiving data to and from other devices not shown in a wired or wireless manner. Communication unit 860 has the same configuration and function as communication unit 560 described above, and therefore detailed description will not be repeated.

  Communication unit 862 transmits and receives data to and from control unit 810. Since communication unit 862 has the same configuration and function as communication unit 562 described above, detailed description will not be repeated. Accordingly, the communication unit 862 can perform data communication with the network 70 wirelessly. The communication unit 862 can perform data communication with the network 70 via, for example, a LAN cable.

  Each of search server 800S and Web server 800W has the same configuration as that of service server 800A described above, and thus detailed description will not be repeated.

(Remote controller)
Next, processing for using communication terminal device 500 as a remote controller for operating video display device 600 (hereinafter also referred to as a display device remote controller) will be described. When control unit 510 executes a remote control program of program 180 by interface operation M, communication terminal device 500 can be used as a display device remote control. In this case, the following remote control image MG100 is displayed on display unit 530.

  FIG. 7 is a diagram showing a remote control image MG100 as an example. Referring to FIG. 7, button images MBG110, MBG120, and MBG130 are arranged in remote control image MG100.

  Each of the button images MBG110, MBG120, and MBG130 is pressed by the interface operation M, so that the control unit 510 transmits a corresponding remote control signal described later to the video display device 600 using the communication unit 560. It is a button image for doing.

  The button image MBG110 is a button image for transmitting a power supply remote control signal to the video display device 600 by being pressed by the interface operation M. Here, the video display device 600 has a standby mode. The standby mode is a state in which the display unit 630 cannot display an image because the power for displaying an image on the display unit 630 is off, and the main power is not off. That is, the standby mode is a state in which no image is displayed on the display unit 630 and the main power supply is not turned off. Hereinafter, a power source for displaying an image on the display unit 630 is also referred to as an image display power source.

  Therefore, when the video display device 600 is in the standby mode, an image can be displayed on the display unit 630 by receiving the power remote control signal and turning on the image display power. In the following, the video display device 600 in which the image display power is on is also referred to as a normal mode. That is, the power supply remote control signal is a remote control signal for switching between the standby mode and the normal mode in the video display device 600.

  The button image MBG 120 is a button image for transmitting a program guide display remote control signal to the video display device 600 by being pressed by the interface operation M. The program guide display remote control signal is a remote control signal for causing the display unit 630 of the video display device 600 to display a program guide image to be described later.

  The button image MBG 130 is a button image for transmitting a menu display remote control signal to the video display device 600 by being pressed by the interface operation M. The menu display remote control signal is a remote control signal for causing a display unit 630 of the video display device 600 to display a menu image to be described later.

  In remote control image MG100, button images MBG142, MBG144, MBG152, and MBG154 are further arranged. Each of the button images MBG142, MBG144, MBG152, and MBG154 is pressed by the interface operation M, so that the control unit 510 uses a communication unit 560 to transmit a corresponding remote control signal to be described later to the video display device 600. It is a button image for transmitting to.

  The button image MBG 142 is a button image for transmitting a volume up remote control signal to the video display device 600 by being pressed by the interface operation M. The volume up remote control signal is a remote control signal for increasing the sound output from the audio output unit 670 of the video display device 600. The button image MBG 144 is a button image for transmitting a volume down remote control signal to the video display device 600 by being pressed by the interface operation M. The volume down remote control signal is a remote control signal for reducing the sound output from the audio output unit 670 of the video display device 600.

  The button image MBG 152 is a button image for transmitting a channel plus remote control signal to the video display device 600 by being pressed by the interface operation M. The channel plus remote control signal is a remote control signal for incrementing the remote control channel number by 1 when a TV image is displayed on the display unit 630 of the video display device 600. When the remote control channel number is “12” and the above-described process of incrementing by 1 is performed, the remote control channel number is “1”. The channel plus remote control signal may be a remote control signal for incrementing the TV image channel number by one.

  The button image MBG154 is a button image for transmitting a channel minus remote control signal to the video display device 600 by being pressed by the interface operation M. The channel minus remote control signal is a remote control signal for decrementing the remote control channel number by 1 when a TV image is displayed on the display unit 630 of the video display device 600. When the remote control channel number is “1” and the above decrementing process is performed, the remote control channel number is “12”. The channel minus remote control signal may be a remote control signal for decrementing the TV image channel number by one.

  In remote control image MG100, button images MBG170 and MBG180 are further arranged. Each of the button image MBG 170 and the button image MBG 180 is pressed by the interface operation M, so that the control unit 510 transmits a corresponding remote control signal described later to the video display device 600 using the communication unit 560. It is a button image for doing.

  Hereinafter, the operation mode of the communication terminal device 500 when the communication terminal device 500 can operate the video display device 600 by transmitting a remote control signal to the video display device 600 is also referred to as a remote control mode.

  In the remote control mode communication terminal device 500, when any of the 12 numeric buttons included in the numeric button group 546 is pressed for a short time, the control unit 510 transmits a remote control signal corresponding to the pressed numeric button. Output.

(data communication)
Next, processing performed in communication terminal device 500 in remote control mode (hereinafter also referred to as operation determination processing M) and processing performed in video display device 600 when a remote control signal transmitted from communication terminal device 500 is received ( Hereinafter, the control signal handling process T) will be described.

  FIG. 8 is a flowchart of the operation determination process M and the control signal handling process T. Referring to FIG. 8, in operation determination process M performed by communication terminal device 500, first, the process of step S10 is performed.

  In step S10, control unit 510 determines whether or not there is a control operation. Here, the control operation is a touch operation on the display unit 530 or a pressing operation of any of a plurality of external buttons provided outside the communication terminal device 500.

  The plurality of external buttons are twelve numeric buttons included in the direction buttons 541A, 541B, 541C, 541D, the enter button 541E, the function buttons 542A, 542B, 543A, 543B, and the numeric button group 546. If YES in step S10, the process proceeds to step S12. On the other hand, if NO at step S10, the process at step S10 is performed again.

  In step S <b> 12, control unit 510 uses communication unit 560 to transmit a remote control signal corresponding to the control operation as a control signal for operating video display device 600 to video display device 600. When the process of step S12 ends, the process of step S10 is performed again.

  In the control signal corresponding process T performed by the video display device 600, first, the process of step S20 is performed.

  In step S20, control unit 610 determines whether or not a remote control signal as a control signal has been received. If YES in step S20, the process proceeds to step S22. On the other hand, if NO at step S20, the process at step S20 is performed again.

  In step S22, control signal handling processing is performed. In the control signal handling process, control unit 610 performs a process according to the received remote control signal. When the process of step S22 ends, the process of step S20 is performed again.

(Registration of function information)
Next, a process for registering each function information of the communication terminal device 500 and the video display device 600 in the service server 800A will be described. Here, the function information is information indicating the function of the corresponding device. Here, the storage unit 620 of the video display device 600 stores the following function information table TD100. The function information table TD100 is a table indicating functions that the video display device 600 has.

  FIG. 9 is a diagram showing a function information table TD100 as an example. The function information table TD100 is composed of a plurality of function information. Referring to FIG. 9, in function information table TD100, “function name” is the name of a function. “Device ID” is information for identifying a device. Here, it is assumed that the device ID “11TA” is the device ID of the video display device 600.

  In the “function name” item, “image display function” is a function for displaying an image. “1920 × 1080” indicated by the function information table TD100 indicates the resolution (horizontal 1920 (dots) × vertical 1080 (dots)) of the display unit 630. The “moving image playback function” indicates a moving image format that can be played back by the corresponding device. The function information table TD100 indicates that the video display device 600 can reproduce a moving image in the MPEG2 format. In the “settlement function”, “number input” refers to a function (hereinafter also referred to as a number input settlement function) that allows the video display device 600 to accept a credit number input by operating the remote controller 300 or the like. That is, the video display device 600 has a number input settlement function.

  Since the “GPS function” has been described above, detailed description thereof will not be repeated. The “navigation function” is a function for guiding a route to a destination by designating the destination on a map or the like. The “camera function” is a function for imaging a subject. The “coupon function” is a function for using a coupon. The function information table TD100 indicates that the video display device 600 does not have “GPS function”, “navigation function”, “camera function”, and “coupon function”.

  Further, the storage unit 520 of the communication terminal device 500 stores the following function information table MD100. The function information table MD100 is a table indicating functions that the communication terminal device 500 has.

  FIG. 10 is a diagram illustrating a function information table MD100 as an example. The function information table MD100 is composed of a plurality of function information. Referring to FIG. 10, the plurality of items shown in function information table MD100 are the same as the plurality of items shown in function information table TD100 in FIG. 9, and thus detailed description will not be repeated. Here, it is assumed that the device ID “11MA” is the device ID of the communication terminal device 500.

  “240 × 400” indicated by the function information table MD100 indicates the resolution of the display unit 530 (horizontal 240 (dots) × vertical 400 (dots)). In the function information table MD100, the communication terminal device 500 includes This indicates that a H.264 format moving image can be reproduced. The function information table MD100 indicates that the communication terminal device 500 has a function for handling electronic money (hereinafter also referred to as an electronic money function). The function information table MD100 indicates that the communication terminal device 500 has a “GPS function”, a “navigation function”, a “camera function”, and a “coupon function”.

  Next, processing for registering the function information of communication terminal device 500 and video display device 600 in service server 800A (hereinafter also referred to as function information registration processing) will be described. Hereinafter, in the function information registration process, the process performed by the communication terminal device 500 is also referred to as a function information registration process M. In the function information registration process, the process performed by the video display device 600 is also referred to as a function information registration process T. In the function information registration process, the process performed by the service server 800A is also referred to as a function information registration process S.

  It is assumed that the IP address of the service server 800A is “111.222.111.222”. Hereinafter, the IP address of service server 800A is also referred to as a service IP address. Here, it is assumed that the service IP address is stored only in the storage unit 520 of the communication terminal device 500. Further, it is assumed that communication terminal apparatus 500 is set to the remote control mode. Further, it is assumed that remote control image MG100 of FIG. 7 is displayed on display unit 530 of communication terminal device 500.

  FIG. 11 is a flowchart of the function information registration process M, the function information registration process T, and the function information registration process S. Referring to FIG. 11, in function information registration process M, first, the process of step S110 is performed.

  In step S110, control unit 510 determines whether or not there is an initial setting operation. The initial setting operation is an interface operation M for pressing the button image MBG 170 in FIG. If YES in step S110, the process proceeds to step S111. On the other hand, if NO at step S110, the process at step S110 is performed again. Here, assuming that there is an initial setting operation, the process proceeds to step S111.

  In step S111, a device detection process M is performed. In device detection processing M, control unit 510 detects a device capable of data communication by wireless communication. Here, the wireless communication is, for example, communication using Bluetooth (registered trademark). When a device capable of data communication is detected by device detection processing M, control unit 510 causes display unit 530 to display a detection device image indicating the detected device using VDP 532. And the process of step S111 is complete | finished.

  Here, it is assumed that the video display device 600 is detected as a device capable of data communication. In this case, it is assumed that the following detection device image MG200 is displayed on display unit 530. If no device capable of data communication is detected, the process of step S111 is repeated.

  FIG. 12 is a diagram illustrating a detection device image MG200 as an example. Referring to FIG. 12, detection device image MG200 includes a message indicating that the device has been detected and button image MBG215. The button image MBG215 is a button image for registering the function information of the video display device 600 in the service server 800A. If a plurality of devices are detected by the process of step S111, a plurality of button images respectively corresponding to the detected plurality of devices are arranged in the detection device image MG200.

Referring to FIG. 11 again, after the process of step S111, the process proceeds to step S112.
In step S112, control unit 510 determines whether there is a registration operation M or not. The registration operation M is an interface operation M for pressing the button image MBG215. If YES in step S112, the process proceeds to step S113. On the other hand, if NO at step S112, the process at step S112 is performed again. Here, assuming that there is a registration operation M, the process proceeds to step S113.

  In step S113, registration required information transmission processing M is performed. In registration required information transmission processing M, control unit 510 transmits registration required information to service server 800A. Here, the registration necessary information is information necessary for registering the function information of the video display device 600 in the service server 800A. The registration necessary information includes a service IP address “111.222.111.222” and a unique ID.

  The unique ID is an ID for associating the function information of the video display device 600 and the function information of the communication terminal device 500 and registering them in the service server 800A. Here, it is assumed that the unique ID is generated by the control unit 510. The unique ID is assumed to be an ID generated based on the MAC address of the communication terminal device 500, for example. Here, it is assumed that the unique ID is “MM.11.22.” The unique ID is not limited to the ID generated by the above method. For example, the unique ID may be an IP address.

In the function information registration process T, first, the process of step S141 is performed.
In step S141, control unit 610 determines whether registration necessary information has been received or not. If YES in step S141, the process proceeds to step S142. On the other hand, if NO at step S141, the process at step S141 is performed again. Here, assuming that registration necessary information has been received, the process proceeds to step S142.

  In step S142, a function information transmission process T is performed. In the function information transmission process T, the control unit 610 transmits the unique ID and the function information table to the service server 800A specified by the service IP address included in the received registration necessary information. The service IP address is “111.222.111.222”. Here, it is assumed that the unique ID transmitted to the service server 800A is “MM.11.22.” Further, it is assumed that the function information table transmitted to the service server 800A is the function information table TD100 in FIG. When the process of step S142 ends, the function information registration process T ends.

In the function information registration process S, first, the process of step S181 is performed.
In step S181, control unit 810 determines whether a unique ID and a function information table have been received. If YES in step S181, the process proceeds to step S182. On the other hand, if NO at step S181, the process at step S181 is performed again. Here, assuming that the unique ID “MM.11.22” and the function information table TD100 are received, the process proceeds to step S182.

  In step S182, an information storage process S is performed. In the information storage process S, the control unit 810 stores the received function information table in the storage unit 820 as a related device function information table. In addition, the control unit 810 associates the received unique ID with the device ID indicated in the received function information table and causes the storage unit 820 to store the associated ID. Note that processing when the related device function information table is already stored in the storage unit 820 will be described later.

  Here, it is assumed that the storage unit 820 stores a function information table TD100 as a related apparatus function information table. Further, it is assumed that the unique ID “MM.11.22” and the device ID “11TA” indicated in the function information table TD100 are stored in the storage unit 820 in association with each other. Then, the process proceeds to step S183.

  In step S183, the control unit 810 determines whether or not a plurality of device IDs associated with the same unique ID are stored in the storage unit 820. If YES in step S183, the process proceeds to step S184. On the other hand, if NO at step S183, the process at step S181 is performed again. Here, assuming that one device ID “11TA” associated with the unique ID “MM.11.22” is stored in the storage unit 820, the process of step S181 is performed again.

In the function information registration process M, the process proceeds to step S114 after the process of step S113.
In step S114, a function information transmission process M is performed. In function information transmission process M, control unit 510 transmits the unique ID and the function information table to service server 800A specified by the service IP address. The service IP address is “111.222.111.222”. Here, it is assumed that the unique ID transmitted to the service server 800A is “MM.11.22.” The function information table transmitted to the service server 800A is assumed to be the function information table MD100 in FIG. Then, the function information registration process M ends.

  In the function information registration process S, it is determined that the unique ID “MM.11.22” and the function information table MD100 are received by the process of step S181 described above, and the process proceeds to step S182.

  In step S182, the same processing as described above is performed, and therefore detailed description will not be repeated. Here, it is assumed that a function information table TD100 as a related apparatus function information table is already stored in the storage unit 820. In this case, the control unit 810 adds the received function information table MD100 to the function information table TD100 as the related apparatus function information table. By this processing, it is assumed that a related device function information table SD100 described later is stored in the storage unit 820.

  Further, control unit 810 associates the received unique ID “MM.11.22” with the device ID indicated in received function information table MD100 and causes storage unit 820 to store the associated ID. By this processing, it is assumed that the unique ID “MM.11.22” and the device ID “11MA” indicated in the function information table MD100 are stored in the storage unit 820 in association with each other.

  In step S183, processing similar to that described above is performed, and therefore detailed description will not be repeated. Here, it is assumed that the storage unit 820 stores a device ID “11TA” and a device ID “11MA” associated with the same unique ID “MM.11.22”. In this case, YES is determined in step S183, and the process proceeds to step S184.

  In step S184, a related device identification table is generated. Here, the related device specifying table is a table for specifying a plurality of related devices. Specifically, the control unit 810 generates a related device identification table in which a plurality of device IDs associated with the same unique ID are associated with the unique ID. Then, the control unit 810 stores the generated related device identification table in the storage unit 820. Then, the process of step S184 ends.

  Here, it is assumed that the storage unit 820 stores a device ID “11TA” and a device ID “11MA” associated with the same unique ID “MM.11.22”. In this case, the following related device identification table SD80 is generated by the process of step S184.

  FIG. 13 is a diagram showing a related device identification table SD80 as an example. Referring to FIG. 13, video display device 600 specified by device ID “11TA” and communication terminal device 500 specified by device ID “11MA” are related devices by related device specification table SD80. I understand that there is.

  Note that the related device identification table is not limited to two devices, and three or more devices may be associated with each other.

  The related device identification table may be associated with an available expiration date. In this case, the related device specification table for which the corresponding expiration date has passed cannot be used.

  Referring to FIG. 11 again, after the process of step S184, the process of step S181 is performed again.

  FIG. 14 is a diagram illustrating a related device function information table SD100 as an example. The items shown in FIG. 14 are the same as those described with reference to FIG. 9, and thus detailed description will not be repeated. Referring to FIG. 14, related apparatus function information table SD100 indicates that, for example, video display apparatus 600 specified by apparatus ID “11TA” does not have a GPS function. Further, the related device function information table SD100 indicates that, for example, the communication terminal device 500 specified by the device ID “11MA” has a GPS function.

  Through the above processing, a related device function information table indicating the function information of each of the plurality of devices is generated and registered in the service server 800A. That is, the function information of each of the plurality of devices is registered in the service server 800A.

(Generation of UI (User Interface) content according to the device)
Next, processing for generating service UI content corresponding to the functions of each of communication terminal device 500 and video display device 600 (hereinafter also referred to as UI content generation processing) will be described. Here, the service UI content is data for notifying the user of an operation for receiving a service provided by the service server 800A. The service provided by the service server 800A is, for example, distribution of video content, payment processing, and the like.

  Here, in communication terminal device 500, for example, a plurality of services that can be provided by service server 800A are registered in communication terminal device 500 by an RSS (Rich Site Summary or Really Simple Syndication) reader. Here, an image displaying a list of a plurality of services registered in communication terminal device 500 is also referred to as a registered service list image. Here, it is assumed that the following registered service list image G100 is displayed on the display unit 530 of the communication terminal device 500.

  FIG. 15 is a diagram illustrating a registered service list image G100 as an example. Referring to FIG. 15, registered service list image G100 displays a plurality of service names respectively corresponding to a plurality of registered services. The service name “service A” is, for example, a service for distributing video. The service name “service B” is, for example, a navigation service using a map.

  In the registered service list image G100, a selection frame SL110 is further arranged. The selection frame SL110 is a frame for selecting one of a plurality of service names. Selection frame SL110 moves upward by pressing direction button 541A in communication terminal device 500. In addition, the selection frame SL110 moves downward when the direction button 541B is pressed in the communication terminal device 500.

  Next, UI content generation processing will be described. The service UI content generated by the UI content generation process includes a service scenario and a plurality of media data used when executing the service scenario. Here, the service scenario is data in which processing to be performed on content, processing to be performed on user operation, and the like are described. The media data is data such as script data, text data, and image data.

  The service scenario is generated using the original scenario and the scenario generation table based on the function of the device that executes the service scenario. Here, the original scenario is data in which processing to be performed on content, processing to be performed on user operation, and the like are described. The original scenario is described in XML (Extensible Markup Language). Note that the original scenario may be described in a language other than XML.

  FIG. 16 is a diagram showing a configuration of an original scenario SD200 as an example. The original scenario SD200 includes a plurality of processes indicated by scripts. Referring to FIG. 16, in the original scenario SD200, “process name” is a name of a plurality of processes. The “step number” is a number for specifying the corresponding process. Here, it is assumed that the original scenario SD200 is stored in advance in the storage unit 820 of the service server 800A.

  The scenario generation table is a table in which conditions for generating a service scenario are described. The service scenario is described in XML. The service scenario may be described in a language other than XML. The scenario generation table is generated so as to correspond to each process indicated in the original scenario.

  FIG. 17 is a diagram showing a scenario generation table SD210 as an example. Referring to FIG. 17, the step number shown in scenario generation table SD210 corresponds to the step number shown in original scenario SD200. The “scenario generation condition” is a condition for generating a service scenario. Details of the contents shown in the item “scenario generation condition” will be described later. Here, it is assumed that the scenario generation table SD210 is stored in advance in the storage unit 820 of the service server 800A.

  Hereinafter, the service scenario executed by communication terminal device 500 is also referred to as service scenario M. A service scenario executed by the video display device 600 is also referred to as a service scenario T. Further, it is assumed that the registered service list image G100 of FIG. 15 is displayed on the display unit 530 of the communication terminal device 500.

  FIG. 18 is a flowchart of UI content generation processing. FIG. 18 shows processing performed in each of communication terminal device 500, video display device 600, and service server 800A. In communication terminal device 500, first, the process of step S211 is performed.

  In step S211, control unit 510 determines whether or not there is a selection operation M. Here, the selection operation M is an operation of pressing the enter button 541E while the service name is selected by the selection frame SL110. If YES in step S211, the process proceeds to step S212. On the other hand, if NO at step S211, the process at step S211 is performed again. Here, assuming that there is a selection operation M, the process proceeds to step S212. It is assumed that the service name selected by the selection operation M is “service A”.

  In step S212, control unit 510 transmits a service UI content request instruction to service server 800A. The service UI content request instruction is an instruction for requesting service UI content to the service server 800A. It is assumed that the transmitted service UI content request instruction includes the device ID “11MA” of the communication terminal device 500 and the selected service name “service A”. And the process of step S212 is complete | finished.

In service server 800A, first, the process of step S281 is performed.
In step S281, control unit 810 determines whether or not a service UI content request instruction has been received. If YES in step S281, the process proceeds to step S290. On the other hand, if NO at step S281, the process at step S281 is performed again. Here, assuming that a service UI content request instruction has been received, the process proceeds to step S290.

  In step S290, a service scenario generation process S is performed. The service scenario generation process S is a process for generating the service scenario T and the service scenario M described above.

  FIG. 19 is a flowchart of the service scenario generation process S. Referring to FIG. 19, in step S <b> 291, control unit 810 receives from the storage unit 820 an original scenario and scenario generation table corresponding to the service whose service name included in the received service UI content request instruction is “service A”. Is read. It is assumed that the original scenario and the scenario generation table read out by this processing are the original scenario SD200 in FIG. 16 and the scenario generation table SD210 in FIG. 17, respectively. Then, the process proceeds to step S292.

  In step S292, control unit 810 acquires a device ID associated with device ID “11MA” included in the received service UI content request instruction in the related device identification table stored in storage unit 820. Here, it is assumed that the related apparatus specifying table is the related apparatus specifying table SD80 of FIG. In this case, the acquired device ID is “11TA”. Then, the process proceeds to step S293.

  In step S293, determination processing S is performed. In the determination process S, the control unit 810, based on the functions of each of the video display device 600 and the communication terminal device 500, and the scenario generation table, among the plurality of processes included in the original scenario, The process used in the communication terminal device 500 is determined.

  Specifically, the control unit 810 generates a determination table based on the related device function information table SD100 in FIG. 14 and the scenario generation table SD210 in FIG. The generated determination table is a table in which the control unit 810 determines a process to be used in the video display device 600 and the communication terminal device 500 among a plurality of processes included in the original scenario SD200. The control unit 810 causes the storage unit 820 to store the generated determination table.

  Here, each item of “scenario generation conditions” shown in the scenario generation table SD210 will be described. In the scenario generation table SD210, “high resolution side” means a condition that the processing of the corresponding step number (ST1) is used for a device having a high display unit resolution among the video display device 600 and the communication terminal device 500. It is. In this case, the control unit 810 uses the processing of the step number ST1 (content list display processing) included in the original scenario SD200 for the video display device 600 by the image display function shown in the related device function information table SD100. Judge that.

  In the scenario generation table SD210, “all” is a condition that the processing of the corresponding step number (ST2) is used for both the video display device 600 and the communication terminal device 500.

  In the scenario generation table SD210, “electronic money> number input” means a step number corresponding to a device having an electronic money function from a device having a number input settlement function among the video display device 600 and the communication terminal device 500. This is a condition that the process of (ST3) is used.

  In this case, the control unit 810 determines to use the process (purchase process) of step number ST3 included in the original scenario SD200 for the communication terminal apparatus 500 by the settlement function shown in the related apparatus function information table SD100. That is, in the purchase process, the electronic money function is used in preference to the number input settlement function.

  In the scenario generation table SD210, “MPEG2” means that the processing of the corresponding step number (ST4) is used for a device capable of reproducing a moving image in the MPEG2 format among the video display device 600 and the communication terminal device 500. It is a condition. In this case, the control unit 810 determines to use the process (content reproduction process) of step number ST4 included in the original scenario SD200 for the video display apparatus 600 by the moving image reproduction function shown in the related apparatus function information table SD100. To do.

  In the scenario generation table SD210, “apparatus that performs ST4” uses the process of the corresponding step number (ST5) for the apparatus that performs the process of step number ST4 out of video display apparatus 600 and communication terminal apparatus 500. This is the condition. In this case, control unit 810 determines that the process of step number ST5 (privilege display process) included in original scenario SD200 is used for video display apparatus 600 that performs the process of step number ST4.

  In the scenario generation table SD210, “apparatus having a coupon function” is a condition that the processing of the corresponding step number (ST6) is used for an apparatus having a coupon function among the video display apparatus 600 and the communication terminal apparatus 500. It is. In this case, when control unit 810 uses processing of step number ST6 (coupon acquisition processing) included in original scenario SD200 for communication terminal device 500 depending on the presence or absence of the coupon function shown in related device function information table SD100. judge.

  Based on the determination by the control unit 810, the following determination table SD300 is generated. Note that when the generated determination table SD300 is stored in the storage unit 820, the process of step S293 ends.

  FIG. 20 is a diagram illustrating a determination table SD300 as an example. Referring to FIG. 20, a plurality of step numbers indicated in the “step number” item correspond to the step numbers indicated in original scenario SD200. The device ID “11TA” is a device ID of the video display device 600. Device ID “11MA” is the device ID of communication terminal device 500. That is, the determination table SD300 is a table that determines processing to be used for each of the video display device 600 and the communication terminal device 500.

  In the determination table SD300, “use” indicates that the process of the corresponding step number included in the original scenario SD200 is used. “Not used” indicates that the processing of the corresponding step number included in the original scenario SD200 is not used.

Referring to FIG. 19 again, after the process of step S293, the process proceeds to step S294.
In step S294, scenario generation processing S is performed. The scenario generation process S is a process for generating a service scenario corresponding to the apparatus by using a process corresponding to the function of the apparatus among a plurality of processes included in the original scenario. In the scenario generation process S, the control unit 810 generates a service scenario corresponding to the functions of the video display device 600 and the communication terminal device 500 based on the original scenario and the determination table. The generated service scenario is data for the video display device 600 and the communication terminal device 500 to operate in cooperation with each other. Then, the control unit 810 stores the generated service scenario in the storage unit 820.

  Here, it is assumed that the original scenario is the original scenario SD200 of FIG. Assume that the determination table is the determination table SD300 of FIG. In this case, the control unit 810 generates the following service scenario STD400 and service scenario SMD400. The service scenario STD400 is a scenario executed by the video display device 600 with the device ID “11TA”. The service scenario SMD400 is a scenario executed by the communication terminal device 500 having the device ID “11MA”.

  FIG. 21 is a diagram illustrating a service scenario as an example. FIG. 21A shows a service scenario STD400 as an example. FIG. 21B shows a service scenario SMD 400 as an example.

  In service scenario STD400, step numbers TST1 to TST6 correspond to step numbers ST1 to ST6, respectively. In service scenario SMD400, step numbers MST1 to MST6 correspond to step numbers ST1 to ST6, respectively.

  First, a method for generating the service scenario STD 400 will be described. The service scenario STD400 is first generated using the process of the step number (for example, ST1, ST2) corresponding to “use” in the column of the device ID “11TA” of the determination table SD300 of FIG. For example, the process of step number ST1 (content list display process) in determination table SD300 is the process of step number TST1 of service scenario STD400. Similarly, the processes of step numbers ST2, ST4, and ST5 in determination table SD300 are the processes of step numbers TST2, TST4, and TST5 of service scenario STD400, respectively.

  In the column of the device ID “11TA” of the determination table SD300, there is a step number immediately before the step number corresponding to “unused” (hereinafter also referred to as an unused step number T), and the 1 When the previous step number is “use”, the following processing TA is performed. In the processing TA, the processing of the step number of the service scenario STD400 corresponding to the previous step number is performed, and the processing of the step number corresponding to the unused step number T in the service scenario SMD400 executed by the communication terminal device 500. A process to migrate is added.

  Specifically, the step number MST3 of the service scenario SMD400 is added to the process of the step number TST2 of the service scenario STD400 corresponding to the step number ST2 immediately preceding the step number ST3 as the unused step number T in the determination table SD300. Processing to shift to the processing of is added. It should be noted that, similarly to the process of step number TST2, a process for shifting to the process of service scenario SMD400 is added to the process of step number TST5.

  Further, when there is an unused step number T in the column of the device ID “11TA” of the determination table SD300, the following processing TA1 is performed. In the process TA1, the processes of the step numbers TST3 and TST6 of the service scenario STD400 corresponding to the step numbers ST3 and ST6 as the unused step numbers T of the determination table SD300 are the standby processes.

  As described above, the service scenario STD 400 is generated. The generated service scenario STD400 is a service scenario corresponding to the function of the video display device 600. That is, the service scenario STD 400 is processing data corresponding to the video display device 600. Note that the file name of the service scenario STD 400 is “VOD_TV.xml”.

  Next, a method for generating the service scenario SMD 400 will be described. First, service scenario SMD400 is generated using the process of the step number (for example, ST2, ST3, and ST6) corresponding to “use” in the column of device ID “11MA” of determination table SD300 in FIG. For example, the process of step number ST2 (content detail display process) in determination table SD300 is the process of step number MST2 of service scenario SMD400. Similarly, the processes of step numbers ST3 and ST6 in determination table SD300 are the processes of step numbers TST3 and TST6 of service scenario SMD400, respectively.

  In the column of the device ID “11MA” of the determination table SD300, there is a step number immediately before a step number corresponding to “unused” (hereinafter also referred to as an unused step number M), and the 1 When the previous step number is “use”, the following processing MA is performed. In the process MA, the process of the step number of the service scenario SMD400 corresponding to the previous step number is performed, and the process of the step number corresponding to the unused step number M in the service scenario STD400 executed by the video display device 600. A process to migrate is added.

  Specifically, the step number TST4 of the service scenario STD400 is added to the process of the step number MST3 of the service scenario SMD400 corresponding to the step number ST3 immediately before the step number ST4 as the unused step number M in the determination table SD300. Processing to shift to the processing of is added.

  Further, in the column of the device ID “11MA” of the determination table SD300, when there is an unused step number M that does not correspond to the content reproduction process, the following process MA1 is performed. In the process MA1, the processes of the step numbers MST1 and MST5 of the service scenario SMD400 corresponding to the step numbers ST1 and ST5 as the unused step numbers M in the determination table SD300 are video display device control processes. The video display device control process is a process for controlling the video display device 600.

  Further, in the column of the device ID “11MA” of the determination table SD300, when there is an unused step number M and a step number corresponding to the content reproduction process, the following process MA2 is performed. In the process MA2, the process of the step number MST4 of the service scenario SMD400 corresponding to the step number ST4 as the unused step number M in the determination table SD300 is set as the video display apparatus control process A. The video display device control process A is a process for controlling the reproduction of content in the video display device 600.

  As described above, the service scenario SMD 400 is generated. The generated service scenario SMD400 is a service scenario corresponding to the function of the communication terminal device 500. That is, the service scenario SMD 400 is processing data corresponding to the communication terminal device 500. Note that the file name of the service scenario SMD 400 is “VOD_Mobile.xml”.

  The service scenario STD400 and the service scenario SMD400 are data for the video display device 600 and the communication terminal device 500 to operate in cooperation with each other by being executed by the video display device 600 and the communication terminal device 500, respectively. . Service scenario STD400 and service scenario SMD400 are scenarios in which functions that are easy to use in cooperation (for example, electronic money functions) are preferentially used when video display device 600 and communication terminal device 500 operate in cooperation with each other. But there is.

  FIG. 22 is a diagram illustrating an example of a script description of a service scenario STD 400 executed by the video display device 600. Referring to FIG. 22, the second to fourth lines are script header portions. The sixth to tenth lines are an example of a script for content list display processing of step number TST1. The eleventh to fourteenth lines are an example of a script showing a content detail display process corresponding to step number TST2 and a process for shifting to the process of step number MST3 of service scenario SMD400.

  The fifteenth line is an example of a standby process script of step number TST3. Lines 16 to 22 are an example of a script for content reproduction processing. The 23rd line to the 26th line are an example of a script showing a privilege display process corresponding to the step number TST5 and a process of shifting to the process of the step number MST6 of the service scenario SMD400. The 27th line is an example of a standby process script of step number TST6. Detailed description of the script will be described later.

  FIG. 23 is a diagram illustrating an example of a script description of a service scenario SMD 400 executed by the communication terminal device 500. Referring to FIG. 23, the second to fourth lines are script header portions. The sixth line is an example of a video display device control process script of step number MST1. The seventh line to the tenth line are an example of a content detail display process script with a step number MST2.

  The 11th to 14th lines are an example of a script indicating the purchase process corresponding to the step number MST3 and the process of shifting to the process of the step number TST4 of the service scenario STD400. The fifteenth line is an example of a video display device control process A script of step number MST4. The 16th line is an example of a script for the video display device control process of step number MST5. The 17th to 20th lines are an example of a coupon acquisition process script of step number MST6. Detailed description of the script will be described later.

  Referring to FIG. 19 again, when the process of step S294 ends, the process returns to the UI content generation process of FIG. 18 and proceeds to step S296 subsequent to step S290.

  In step S296, UI content transmission processing S is performed. In UI content transmission processing S, control unit 810 transmits service UI content T and service UI content M to video display device 600 and communication terminal device 500, respectively. The service UI content T is content processed by the video display device 600. The service UI content M is content processed by the communication terminal device 500.

  The service UI content T includes a service scenario STD400 of FIG. 22 and a plurality of media data T used when the service scenario STD400 is executed. The media data T is data such as script data T, text data, and image data. The script data T is data (hereinafter also referred to as SVG data) generated based on the SVG (Scalable Vector Graphics) standard. The script data T is, for example, data having a file name “list display.svg” described in the sixth line of FIG.

  The service UI content M includes the service scenario SMD400 of FIG. 23 and a plurality of media data M used when executing the service scenario SMD400. The media data M is data such as script data M, text data, and image data. The script data M is data generated based on the SVG standard. The script data M is data having a file name “TV control.svg” described in the sixth line of FIG. 23, for example. Then, the process of the service server 800A in the UI content generation process ends.

  In the UI content generation process, communication terminal apparatus 500 proceeds to step S216 after the process of step S212.

  In step S216, UI content reception processing M is performed. In the UI content reception process M, the control unit 510 receives the service UI content M and causes the storage unit 520 to store the received service UI content M. Then, the process proceeds to step S217.

  In step S217, control unit 510 executes scenario execution process M by executing service scenario SMD400 included in service UI content M. The scenario execution process M is a process performed independently of other processes. And the process of the communication terminal device 500 in UI content production | generation process is complete | finished.

  In the UI content generation process, the video display device 600 performs the process of step S246.

  In step S246, UI content reception processing T is performed. In the UI content reception process T, the control unit 610 receives the service UI content T and causes the storage unit 620 to store the received service UI content T. Then, the process proceeds to step S247.

  In step S247, the control unit 610 executes the scenario execution process T by executing the service scenario STD400 included in the service UI content T. The scenario execution process T is a process performed independently of other processes. Then, the process of the video display device 600 in the UI content generation process ends.

  As described above, service server 800A generates a service scenario corresponding to the functions of video display device 600 and communication terminal device 500. Then, the service server 800A transmits the service UI content T including the service scenario STD400 of FIG. 22 corresponding to the function of the video display device 600 to the video display device 600. In addition, the service server 800A transmits the service UI content M including the service scenario SMD400 of FIG. 23 corresponding to the function of the communication terminal device 500 to the communication terminal device 500.

  The service scenario STD400 and the service scenario SMD400 are data for the video display device 600 and the communication terminal device 500 to operate in cooperation with each other by being executed by the video display device 600 and the communication terminal device 500, respectively. Service scenario STD400 and service scenario SMD400 are scenarios according to the functions of video display device 600 and communication terminal device 500, respectively. That is, service scenario STD400 and service scenario SMD400 are processing data corresponding to video display device 600 and communication terminal device 500, respectively.

  Accordingly, the video display device 600 and the communication terminal device 500 execute the service scenario STD400 and the service scenario SMD400, respectively, to fully utilize the functions of the video display device 600 and the communication terminal device 500, and It is possible to perform coordinated operations. That is, each of the plurality of devices can perform operations in cooperation with each other by fully utilizing the characteristics of the device itself. As a result, various kinds of processing can be realized.

  In the present invention, the function considered when generating the determination table in the determination process S of step S293 in FIG. 19 may be other than the functions shown in the related apparatus function information table SD100 in FIG. . For example, a call function, an e-mail transmission / reception function, a character input function, a map display function, a communication function, a character (news) display function, an advertisement browsing function, and the like may be considered when generating the determination table.

  Further, in the determination process S, the “scenario generation condition” considered when generating the determination table depends on the service provided by the service server 800A in addition to the conditions shown in the scenario generation table SD210 of FIG. Various conditions can be considered. For example, when the provided service uses a character input function, the generated “scenario generation condition” has a higher priority for the character input function of the communication terminal device 500 than the character input function by the remote controller in the video display device 600. It is a condition to do.

  In addition, when the provided service uses the map display function, the generated “scenario generation condition” is the larger of the screen size of the display unit 530 of the communication terminal device 500 and the display unit 630 of the video display device 600. This is a condition for increasing the priority.

  Further, when the provided service uses a communication function, the generated “scenario generation condition” is a condition for increasing the priority of a device capable of high-speed communication among the communication terminal device 500 and the video display device 600. . Further, when the provided service uses a character (news) display function, the generated “scenario generation condition” is a condition in which the priority is the same in the communication terminal device 500 and the video display device 600.

  In addition, when the provided service uses the advertisement browsing function, the generated “scenario generation condition” is the larger of the screen size of the display unit 530 of the communication terminal device 500 and the display unit 630 of the video display device 600. This is a condition for increasing the priority.

  The related device specification table and the related device function information table may be included in the communication terminal device 500 or the video display device 600 instead of the service server 800A. For example, it is assumed that the communication terminal device 500 has a related device specifying table and a related device function information table. In addition, it is assumed that the service server 800A has the original scenario.

  In this case, the communication terminal device 500 requests the service scenario according to the function of the device itself to the service server 800A, and acquires the service scenario. The communication terminal device 500 refers to the related device specification table and the related device function information table and determines that there is a device (hereinafter also referred to as device A) that can effectively use the service scenario other than its own device. To do. In this case, communication terminal apparatus 500 issues an instruction for transmitting a service scenario to apparatus A to service server 800A. The service server 800A transmits a service scenario to the device A in response to the instruction.

(Processing based on service scenario according to the device)
Next, processing based on a service scenario according to communication terminal device 500 and video display device 600 will be described. Specifically, the scenario execution process M and the scenario execution process T will be described. As described above, the scenario execution process M is a process performed when the control unit 510 of the communication terminal device 500 executes the service scenario SMD400. Further, the scenario execution process T is a process performed when the control unit 610 of the video display device 600 executes the service scenario STD400.

  FIG. 24 is a flowchart of the scenario execution process T and the scenario execution process M. Referring to FIG. 24, in scenario execution process T, first, the process of step S341 is performed.

  In step S341, content list display processing is performed. The content list display process is a process performed by the control unit 610 executing the sixth line in FIG. “Svg-viewer” in the sixth line is the name of an application (hereinafter also referred to as “SVG viewer”) for analyzing SVG data and displaying content corresponding to the SVG data. Note that the SVG viewer is stored in the storage unit 620 in advance. Hereinafter, the SVG viewer executed by the control unit 610 is also referred to as SVG viewer T.

  In the content list display process, the SVG viewer T analyzes the data whose file name is “list display.svg” in the sixth line in FIG. 22 to generate the following list image G300, and displays the list image 630 on the display unit 630. The image G300 is displayed.

  FIG. 25 is a diagram showing a list image G300 as an example. Referring to FIG. 25, list image G300 displays a list of titles of a plurality of contents that can be distributed by service server 800A. For example, “AB story” is the title of a movie. In addition, a selection frame SL310 is arranged in the list image G300. The selection frame SL310 is a frame for selecting one of a plurality of titles. The selection frame SL310 moves upward when the direction button 541A is pressed in the communication terminal device 500 in which the video display device control processing in step S311 described below is performed. The selection frame SL310 moves downward when the direction button 541B is pressed in the communication terminal device 500.

  In the list image G300, button images BG312 and BG314 are further arranged. The button image BG312 is a button image for causing the display unit 630 of the video display device 600 to display detailed information on the content of the title selected in the selection frame SL310 by being pressed. The button image BG314 is a button image for causing the display unit 530 of the communication terminal device 500 to display detailed information of the content of the title selected in the selection frame SL310 by being pressed.

  The button image BG312 and the button image BG314 are also operation guides for guiding operations to the user. Hereinafter, the button images displayed on the display unit 530 and the display unit 630 by execution of the service scenario are also referred to as operation guides.

  Referring again to FIG. 24, in scenario execution process M, first, the process of step S311 is performed.

  In step S311, a video display device control process is performed. The video display device control process is a process performed when control unit 510 executes the sixth line in FIG. Note that the SVG viewer is stored in the storage unit 520 in advance. Hereinafter, the SVG viewer executed by the control unit 510 is also referred to as SVG viewer M. The SVG viewer M analyzes the data whose file name is “TV control.svg” in the sixth line of FIG. 23, generates the following TV control image MG300, and displays the TV control image MG300 on the display unit 530. .

  FIG. 26 is a diagram showing a TV control image MG300 as an example. Referring to FIG. 26, TV control image MG300 is an image displaying a plurality of buttons included in input unit 540 shown in FIG. In the TV control image MG300, it is shown that the operation of the buttons indicated by hatching among the plurality of buttons included in the input unit 540 is effective. That is, the TV control image MG300 indicates that only the pressing operation of the direction buttons 541A, 541B, 541C, 541D and the determination button 541E in FIG. 2 is effective. In the following, among buttons provided on the communication terminal device 500, a button whose operation is valid is also referred to as an operation valid button.

  The above-mentioned “TV control.svg” data includes a remote control signal transmission script for recognizing the pressed operation effective button and transmitting a remote control signal corresponding to the operation effective button to the video display device 600. is described. When the operation valid button is pressed, control unit 510 transmits a remote control signal corresponding to the pressed operation valid button to video display device 600 based on the remote control signal transmission script. When receiving a remote control signal corresponding to the operation valid button, video display device 600 performs processing according to the received remote control signal.

  Referring to FIG. 24 again, in the scenario execution process T, the process proceeds to step S342 after the process in step S341.

  In step S342, control unit 610 determines whether or not detailed operation M has been performed. Detailed operation M is an operation for pressing the button image GB 314 by pressing the operation valid button in the communication terminal device 500 performed in a state where the title is selected by the selection frame SL 310 of FIG.

  If YES in step S342, control unit 610 determines that the file name is “user operation 1.txt” based on the script described in the data of “list display.svg” on the sixth line in FIG. In the text file “”, the character string “Details on the mobile phone” is described. In addition, the control unit 610 generates a selected title (for example, “for example,“ VOD content.txt ”) based on the script described in the data whose file name is“ list display.svg ”. The character string of “AB story”) is described. Note that the character string described in the text file with the file name “VOD content.txt” may be another character string as long as it is a character string specifying the selected title. Then, the process proceeds to step S342A.

  On the other hand, if NO at step S342, the process proceeds to step S343 described later. Here, assuming that there is a detailed operation M, the process proceeds to step S342A. It is assumed that the title selected by the detailed operation M is “AB story”.

  In step S342A, service data A generation processing T is performed. In the service data A generation process T, as shown in the scripts in the seventh and ninth lines of FIG. 22, “details on the mobile phone” is described in a text file with the file name “user operation 1.txt”. This process is performed when

  In the service data A generation process T, the control unit 610 performs the following as service data A based on the description of “xlink: href =“ VOD_Mobile.xml: id = detail display ”” in the ninth line of FIG. Service data TSD500A is generated. Then, the process of step S342A ends. "Xlink: href =" VOD_Mobile.xml: id = detailed display "" is linked to "step id =" detailed display "described in the service scenario SMD400 whose file name is" VOD_Mobile.xml ". I will show you.

  FIG. 27 is a diagram showing service data TSD 500A as an example. Referring to FIG. 27, in service data TSD 500A, a URI (Uniform Resource Identifier) is a URI for specifying a service scenario possessed by a device to which service data is transmitted. Here, the URI “http://service.com/VOD_Mobile.xml” specifies the service scenario SMD 400 stored in the storage unit 520 of the communication terminal device 500 and having the file name “VOD_Mobile.xml”. Further, “http://service.com/” included in the URI “http://service.com/VOD_Mobile.xml” is also information for specifying a service provided by the service server 800A. That is, the URI is also information for specifying a service provided by the service server 800A. That is, the service scenario specified by the URI is also data corresponding to the service specified by the URI.

  The “status ID” is status information for specifying a line to be executed in a service scenario of a service data transmission destination apparatus. In other words, the “status ID” is also information for specifying a process to be executed by the device to which the service data is transmitted. “File name” is a file name of media data included in the service data TSD 500A. That is, the service data TSD 500A includes a text file whose file name is “user operation 1.txt” and a text file whose file name is “VOD content.txt”.

  “Content” indicates a character string described in the data of the corresponding file name. For example, the service data TSD 500A indicates that a character string “details on a mobile phone” is described in a text file whose file name is “user operation 1.txt”.

  Referring to FIG. 24 again, after the process of step S342A, the process proceeds to step S342B.

  In step S342B, service data A transmission processing T is performed. In the service data A transmission process T, the control unit 610 performs the service data TSD 500A as the service data A based on the description of “xlink: href =“ VOD_Mobile.xml: id = detail display ”” in the ninth line in FIG. Is transmitted to the communication terminal device 500 by wireless communication. Then, the process of step S342B ends.

In the scenario execution process M, the process proceeds to step S312 after the process of step S311.
In step S312, control unit 510 determines whether or not service data TSD 500A of FIG. If YES in step S312, the process proceeds to step S313. On the other hand, if NO at step S312, the process at step S312 is performed again. Here, assuming that service data TSD 500A as service data A has been received, the process proceeds to step S313.

  In step S313, a detailed content display process M is performed. The content detail display process M is a process performed by the control unit 510 executing the seventh line in FIG. 23 specified by the status ID “detailed display” indicated in the received service data TSD 500A.

  In the content detail display processing M, the SVG viewer M analyzes the data whose file name is “detail display.svg” in the seventh line of FIG. 23 and generates the following detailed information display image MG400. Data whose file name is “detailed display.svg” is data included in the service UI content M received by the process of step S216 in FIG. Note that the “detailed display.svg” data includes a plurality of detailed information respectively corresponding to the plurality of titles displayed in FIG.

  Specifically, based on a script described in data whose file name is “detailed display.svg”, control unit 510 determines “AB story” described in a text file whose file name is “VOD content.txt”. The detailed information corresponding to “” is selected from a plurality of detailed information included in the data whose file name is “detailed display.svg”. Then, control unit 510 generates detailed information display image MG400 displaying the selected detailed information based on the script described in the data whose file name is “detail display.svg”, and displays details on display unit 530. An information display image MG400 is displayed. Then, the process of step S313 ends.

  FIG. 28 is a diagram showing a detailed information display image MG400 as an example. Referring to FIG. 28, detailed information display image MG400 displays detailed information of the title (“AB story”) of the selected content. A button image MBG414 is arranged in the detailed information display image G400. The button image MBG 414 is a button image for performing purchase processing by being pressed.

Referring to FIG. 24 again, after the process of step S313, the process proceeds to step S314.
In step S314, control unit 510 determines whether or not there is a purchase operation M. The purchase operation M is an operation for pressing the button image MBG 414 by pressing the operation valid button.

  If YES in step S314, control unit 510 causes file name “user operation 1.txt” to be based on the script described in the data of “detail display.svg” on line 7 in FIG. In the text file “,” describe the character string “purchase”. Then, the process proceeds to step S314A. On the other hand, if NO at step S314, the process proceeds to step S314N described later. Here, assuming that there is a purchase operation M, the process proceeds to step S314A.

  When the process proceeds to step S314A, the service data TSD500A becomes the following service data TSD500B.

  FIG. 29 is a diagram showing service data TSD 500B as an example. Referring to FIG. 29, the service data TSD 500B is “purchased” as compared with the service data TSD 500A in FIG. 27. The character string described in the text file with the file name “user operation 1.txt” is “purchase”. Is different. Other than that, it is the same as service data TSD 500A, and therefore detailed description will not be repeated.

  Referring to FIG. 24 again, in step S314A, purchase process M is performed. The purchase process M is performed when “Purchase” is described in the text file with the file name “User Operation 1.txt” as shown in the scripts in the 8th and 9th lines of FIG. This is a process performed by executing the eleventh line in which “step id =“ purchase display ”” is described by the description of “xlink: href =“ purchase display ”” in the ninth line of 23.

  In purchase process M, control unit 510 performs a settlement process for purchasing content to service server 800A. The payment process is, for example, payment using electronic money. Here, it is assumed that the purchased content is a content whose title is “AB story”.

  When the settlement process is completed, the SVG viewer M analyzes the data with the file name “purchase display.svg” in the eleventh line in FIG. 23 to generate the following purchased image MG500, and displays the purchased image on the display unit 530. MG500 is displayed. Then, the process of step S314A ends.

  FIG. 30 is a diagram showing a purchase image MG500 as an example. The purchase image MG500 is different from the detailed information display image MG400 of FIG. 28 in that a message indicating that the purchase has been made is displayed and a button image MBG514 is arranged instead of the button image MBG414. Other than that, it is similar to the detailed information display image MG400, and therefore detailed description will not be repeated. The button image MBG 514 is a button image for reproducing purchased content on the video display device 600 by being pressed.

Referring to FIG. 24 again, after the process of step S314A, the process proceeds to step S315.
In step S315, control unit 510 determines whether or not there is a reproduction operation M. The reproduction operation M is an operation for pressing the button image MBG 514 by pressing the operation valid button. If YES in step S315, control unit 510 determines that file name is “user operation 2.txt” based on the script described in the data of “purchase display.svg” on line 11 in FIG. In the text file “”, a character string “view on TV” is described.

  In addition, the control unit 510 uses the script described in the data with the file name “purchase display.svg” to create a text file with the file name “VOD content.txt” and the content with the title “AB story”. The file name (AB story.mpg) is described. Note that the URI for specifying the content may be described without being limited to the file name of the content. Then, the process proceeds to step S315A.

  On the other hand, if NO at step S315, the process at step S315 is performed again. Here, assuming that there is a reproduction operation M, the process proceeds to step S315A.

  In step S315A, service data B generation processing M is performed. In the service data B generation process M, as shown in the script on the 12th and 13th lines of FIG. 23, “view on TV” is described in a text file whose file name is “user operation 2.txt”. This process is performed when

  In service data B generation processing M, control unit 510 performs the following as service data B based on the description of “xlink: href =“ VOD_TV.xml: id = content playback ”” in line 13 of FIG. Service data TSD500C is generated. Then, the process of step S315A ends.

  FIG. 31 is a diagram showing service data TSD 500C as an example. Referring to FIG. 31, each item shown in service data TSD 500C has been described with reference to FIG. 27, and thus detailed description thereof will not be repeated. Here, the URI “http://service.com/VOD_TV.xml” specifies the service scenario STD400 stored in the storage unit 620 of the video display device 600 and having the file name “VOD_TV.xml”.

  Note that the service data TSD 500C further includes a text file having a file name “user operation 2.txt” as compared to the service data TSD 500B of FIG. Note that the file name (AB story.mpg) of the title “AB story” is described in the text file with the file name “VOD content.txt” included in the service data TSD 500C.

  Referring to FIG. 24 again, after the process of step S315A, the process proceeds to step S315B.

  In step S315B, service data B transmission processing M is performed. In the service data B transmission process M, the control unit 510 uses the service data TSD 500C as the service data B based on the description of “xlink: href =“ VOD_TV.xml: id = content playback ”” on the 13th line in FIG. Is transmitted to the video display device 600 by wireless communication. Then, the process of step S315B ends.

In the scenario execution process T, the process proceeds to step S345 after the process of step S342B.
In step S345, control unit 610 determines whether or not service data TSD 500C as service data B has been received. If YES in step S345, the flow proceeds to step S346. On the other hand, if NO at step 345, the process at step S345 is performed again. Here, assuming that service data TSD500C as service data B has been received, the process proceeds to step S346.

  In step S346, content reproduction processing is performed. The content reproduction process is a process performed by the control unit 610 executing the 16th line in FIG. 22 specified by the status ID “content reproduction” indicated in the received service data TSD 500C. “Movie-player” on the 16th line in FIG. 22 is the name of an application (hereinafter also referred to as a content reproduction program) for reproducing the content.

  Note that the content reproduction program is stored in the storage unit 620 in advance. Hereinafter, the content reproduction program executed by the control unit 610 is also referred to as a content reproduction program T. “@” On the 16th line in FIG. 22 indicates that the content reproduction program T acquires a character string described in a text file whose file name is “VOD content.txt”. Hereinafter, the content based on the description of “param =“ @ VOD content.txt ”” on the 16th line in FIG. 22 is also referred to as a reproduction target content. Here, it is assumed that the content to be played is content having a file name “AB story.mpg” described in a text file having a file name “VOD content.txt”.

  In the content reproduction process, the content reproduction program T requests the service server 800A for the content to be reproduced. The service server 800A performs streaming distribution of the reproduction target content to the video display device 600 in response to the request for the reproduction target content.

  The content reproduction program T reproduces the reproduction target content distributed from the service server 800A while receiving it via the network 70 and the communication unit 50. The content reproduction program T causes the display unit 630 to display an image of the content being reproduced.

In the scenario execution process M, the process proceeds to step S316 after the process of step S315B.
In step S316, video display device control processing A is performed. In the video display device control processing A, the fifteenth line in which “step id =“ TV control 2 ”” is described by the description of “move =“ TV control 2 ”” in the thirteenth line in FIG. The process performed by

  In the video display device control process A, the SVG viewer M analyzes the data whose file name is “playback control.svg” in the 15th line of FIG. 23 to generate the following playback control image MG300A and displays it on the display unit 530. Then, the reproduction control image MG300A is displayed.

  FIG. 32 is a diagram showing a reproduction control image MG300A as an example. Referring to FIG. 32, reproduction control image MG300A is an image displaying a plurality of buttons included in input unit 540 shown in FIG. In the TV control image MG300A, it is indicated that the operation of the buttons indicated by diagonal lines among the plurality of buttons included in the input unit 540 is valid. That is, the TV control image MG300 is effective only by pressing the direction buttons 541A, 541B, 541C, and 541D, the determination button 541E, and the two buttons, five buttons, and eight buttons included in the number button group 546 in FIG. Indicates that In the following, among buttons provided on the communication terminal device 500, a button whose operation is valid is also referred to as an operation valid button.

  The above-mentioned “reproduction control. is described. When the operation valid button is pressed, control unit 510 transmits a remote control signal corresponding to the pressed operation valid button to video display device 600 based on the remote control signal transmission script. When receiving a remote control signal corresponding to the operation valid button, video display device 600 performs processing according to the received remote control signal.

  When button 2 is pressed, control unit 510 transmits a stop remote control signal for stopping the content being played back on video display device 600 to video display device 600. When button 5 is pressed, control unit 510 transmits to video display device 600 a playback remote control signal for replaying content that has been stopped or paused in video display device 600. When the 8 button is pressed, control unit 510 transmits to video display device 600 a pause remote control signal for pausing the content being played back on video display device 600.

  In the content reproduction process of step S346, the content reproduction program T controls the reproduction of the content according to the remote control signal received from the communication terminal device 500. This control is performed based on “action” described in the 19th to 21st lines in FIG. For example, when the control unit 610 receives a pause remote control signal from the communication terminal device 500, the content being played back is paused.

  When the content reproduction is finished, the content reproduction program T describes the character string “end of content” in the text file with the file name “user operation 3.txt” based on the script on the 16th line in FIG. To do. Then, the process proceeds to step S346A.

  In step S346A, service data C generation processing T is performed. In the service data C generation process T, as shown in the scripts on the 17th and 18th lines in FIG. 22, “end of content” is described in the text file whose file name is “user operation 3.txt”. It is a process performed in the case.

  In the service data C generation process T, the control unit 610 performs the following as service data C based on the description of “xlink: href =“ VOD_Mobile.xml: id = TV control 3 ”” in the 18th line of FIG. Service data TSD500D is generated. Then, the process of step S346A ends.

  FIG. 33 is a diagram showing service data TSD 500D as an example. Referring to FIG. 33, the items shown in service data TSD 500D have been described with reference to FIG. 27, and thus detailed description will not be repeated. Here, the URI “http://service.com/VOD_Mobile.xml” specifies the service scenario SMD 400 stored in the storage unit 520 of the communication terminal device 500 and having the file name “VOD_Mobile.xml”.

  Note that the service data TSD 500D further includes a text file whose file name is “user operation 3.txt”, compared to the service data TSD 500C of FIG.

  Referring to FIG. 24 again, after the process of step S346A, the process proceeds to step S346B.

  In step S346B, service data C transmission processing T is performed. In the service data C transmission process T, the control unit 610 performs service data as service data C based on the description of “xlink: href =“ VOD_Mobile.xml: id = TV control 3 ”” in the 18th line of FIG. The TSD 500D is transmitted to the communication terminal device 500 by wireless communication. Then, the process of step S346B ends.

In the scenario execution process M, the process proceeds to step S316A after the process of step S316.
In step S316A, control unit 510 determines whether or not service data TSD 500D of FIG. If YES in step S316A, the process proceeds to step S317. On the other hand, if NO at step S316A, the process at step S316A is performed again. Here, assuming that service data TSD500D as service data C has been received, the process proceeds to step S317.

  In step S317, a video display device control process is performed. The video display device control process is a process performed by the control unit 510 executing the 16th line in FIG. 23 specified by the status ID “TV control 3” indicated in the received service data TSD 500D.

  In the video display device control process, the SVG viewer M analyzes the data whose file name is “TV control.svg” in the 16th line in FIG. 23 to generate the TV control image MG300 in FIG. The TV control image MG300 is displayed.

  Referring to FIG. 24 again, in the scenario execution process T, the process proceeds to step S347 after the process of step S346B.

  In step S347, a privilege display process T is performed. The privilege display process T is performed by executing the 23rd line in which "step id =" privilege display "" is described by the description of "move =" privilege display "" in the 18th line of FIG. It is.

  In the privilege display process T, the SVG viewer T analyzes the data whose file name is “privilege display.svg” in the 23rd line of FIG. 22, generates the following privilege display image G600, and displays the privilege on the display unit 630. Display image G600 is displayed.

  FIG. 34 is a diagram showing a privilege display image G600 as an example. Referring to FIG. 34, the privilege display image G600 displays a privilege message of the content that has been played back. For example, a message indicating that a coupon for related goods can be acquired is displayed. A button image BG614 is arranged in the privilege display image G600. Button image BG614 is a button image for performing processing for acquiring a coupon in communication terminal device 500 by being pressed.

  Referring to FIG. 24 again, in the scenario execution process T, the process proceeds to step S348 after the process in step S347.

  In step S348, control unit 610 determines whether or not coupon acquisition operation T has been performed. The coupon acquisition operation T is an operation for pressing the button image BG614 by pressing the operation valid button in the communication terminal device 500. If YES in step S348, control unit 610 determines that the file name is “user operation 4.txt” based on the script described in the data in which the file name on line 23 in FIG. 22 is “privilege display.svg”. Describe the character string “Coupon” in the text file. Then, the process proceeds to step S348A.

  On the other hand, if NO at step S348, the process at step S348 is performed again. Here, assuming that there is a coupon acquisition operation T, the process proceeds to step S348A.

  In step S348A, service data D generation processing T is performed. In the service data D generation process T, as shown in the script on the 24th and 25th lines in FIG. 22, the “coupon” is described in the text file whose file name is “user operation 4.txt”. It is a process performed in

  In the service data D generation process T, the control unit 610 performs the following service as service data D based on the description of “xlink: href =“ VOD_Mobile.xml: id = coupon ”” in the 25th line of FIG. Data TSD500E is generated. Then, the process of step S348A ends.

  FIG. 35 is a diagram showing service data TSD 500E as an example. Referring to FIG. 35, the items shown in service data TSD 500E have been described with reference to FIG. 33, and thus detailed description will not be repeated. Note that the service data TSD 500E further includes a text file whose file name is “user operation 4.txt”, compared to the service data TSD 500D of FIG.

  Referring to FIG. 24 again, after the process of step S348A, the process proceeds to step S348B.

  In step S348B, service data D transmission processing T is performed. In the service data D transmission process T, the control unit 610 converts the service data TSD 500E as the service data D based on the description of “xlink: href =“ VOD_Mobile.xml: id = coupon ”” in the 25th line of FIG. And transmitted to the communication terminal device 500 by wireless communication. Then, the process of step S348B ends.

In the scenario execution process M, the process proceeds to step S317A after the process of step S317.
In step S317A, control unit 510 determines whether or not service data TSD 500E of FIG. If YES in step S317A, the process proceeds to step S318. On the other hand, if NO at step S317A, the process at step S317A is performed again. Here, assuming that service data TSD500E as service data D has been received, the process proceeds to step S318.

  In step S318, a coupon acquisition process M is performed. The coupon acquisition process M is a process performed by the control unit 510 executing the 17th line in FIG. 23 specified by the status ID “coupon” indicated in the received service data TSD 500E.

  In the coupon acquisition process M, the SVG viewer M analyzes the data whose file name is “coupon display.svg” on the 17th line in FIG. 23, generates the following coupon display image MG700, and displays the coupon on the display unit 530. Display image MG700 is displayed.

  FIG. 36 is a diagram showing a coupon display image MG700 as an example. Referring to FIG. 36, coupon image MG710 and button image MBG714 are arranged in coupon display image MG700. Coupon image MG710 is an image that can be used to purchase a product described in the coupon at a discount price by showing it to a store clerk, for example. Button image MBG 714 is a button image for storing coupon image MG 710 in storage unit 520 by being pressed.

  Referring to FIG. 24 again, in coupon acquisition process M, when control unit 510 has coupon saving operation M based on the script described in the data whose file name is “coupon display.svg”, Coupon image MG710 is stored in storage unit 520. The coupon saving operation M is an interface operation M for pressing the button image MBG714. Then, based on the script described in the data with the file name “coupon display.svg” on the 17th line in FIG. 23, the control unit 510 creates a text file with the file name “user operation 3.txt”. Write the string "Save coupon".

  Then, as shown in the scripts in the 18th and 19th lines in FIG. 23, “Save Coupon” is described in the text file whose file name is “User Operation 3.txt”, and the 17th line in FIG. The script is executed again. If there is an interface operation M for ending the scenario execution process M, the process of step S318 ends, and the scenario execution process M ends.

  In the coupon acquisition process T, the process proceeds to step S348C after the process of step S348B.

  In step S348C, standby processing T is performed. The waiting process T is performed by executing the 27th line in which “step id =“ coupon is being acquired ”” is described by the description of “move = coupon is being acquired” in the 25th line in FIG. It is processing.

  In the standby process T, the SVG viewer T analyzes the data with the file name “coupon being acquired.svg” on the 27th line in FIG. 22 to generate the following coupon acquiring image G610 and display it on the display unit 630. To be displayed in front of the displayed image. Thereby, for example, the following standby image G600A is displayed on the display unit 630.

  FIG. 37 is a diagram showing a standby image G600A as an example. In the standby image G600A, a coupon acquisition image G610 is displayed.

  Referring to FIG. 24 again, standby process T in step S348C ends in accordance with the end of scenario execution process M, and coupon acquisition process T ends.

  Next, a process when there is no detailed operation M after the process of step S341 will be described. In this case, the process proceeds to step S343 by the process of step S342.

  In step S343, control unit 610 determines whether or not detailed operation T has been performed. The detailed operation T is an operation for pressing the button image BG312 by pressing the operation valid button in the communication terminal device 500 performed in a state where the title is selected in the selection frame SL310 of FIG.

  If YES in step S343, control unit 610 determines that the file name is “user operation 1.txt” based on the script described in the data of “list display.svg” on the sixth line in FIG. In the text file “”, the character string “details on TV” is described. Further, the control unit 610 selects a text file with the file name “VOD content.txt” based on the script described in the data with the file name “list display.svg” in the sixth line of FIG. A character string of the title (for example, “AB story”) is described. Note that the character string described in the text file with the file name “VOD content.txt” may be another character string as long as it is a character string specifying the selected title. Then, the process proceeds to step S343A.

  On the other hand, if NO at step S343, the process at step S342 is performed again. Here, assuming that there is a detailed operation T, the process proceeds to step S343A. It is assumed that the title selected by the detailed operation T is “AB story”.

  In step S343A, content detail display processing T is performed. In the content detail display process T, “detailed on TV” is described in a text file whose file name is “user operation 1.txt” as shown in the script on the seventh and eighth lines in FIG. In this case, the process is performed by executing the eleventh line according to the description of the eighth line in FIG.

  In the content detail display process T, the SVG viewer T analyzes the data whose file name is “detail display.svg” in the eleventh line of FIG. 22 and generates the following detailed information display image G400. Data whose file name is “detailed display.svg” is data included in the service UI content T received by the process of step S246 in FIG. Note that the “detailed display.svg” data includes a plurality of detailed information respectively corresponding to the plurality of titles displayed in FIG.

  Specifically, based on a script described in the data whose file name is “detail display.svg”, the control unit 610 determines “AB story” described in the text file whose file name is “VOD content.txt”. The detailed information corresponding to “” is selected from a plurality of detailed information included in the data whose file name is “detailed display.svg”. The control unit 610 generates a detailed information display image G400 displaying the selected detailed information based on the script described in the data whose file name is “detailed display.svg”, and displays the detailed information on the display unit 630. An information display image G400 is displayed. Then, the process of step S343A ends.

  FIG. 38 is a diagram showing a detailed information display image G400 as an example. Referring to FIG. 38, detailed information display image G400 displays detailed information on the title of the selected content (“AB story”). In the detailed information display image G400, a content image G410 and a button image BG414 are arranged. The content image G410 is a moving image of one scene of the selected content, for example. The button image BG414 is a button image for performing purchase processing in the communication terminal device 500 by being pressed.

  Referring to FIG. 24 again, after the process of step S343A, the process proceeds to step S343B.

  In step S343B, control unit 610 determines whether or not there is a purchase operation T. The purchase operation T is an operation for pressing the button image BG414 by pressing the operation valid button in the communication terminal device 500.

  If YES in step S343B, control unit 610 determines that the file name is “user operation 2.txt” based on the script described in the data of “detail display.svg” on line 11 in FIG. In the text file “”, the character string “Purchase with mobile phone” is described. Then, the process proceeds to step S343C. On the other hand, if NO at step S343B, the process of step S343B is performed again. Here, assuming that there is a purchase operation T, the process proceeds to step S343C.

  In step S343C, service data E generation processing T is performed. In the service data E generation process T, as shown in the script in the 12th and 13th lines of FIG. 22, “Purchase with mobile phone” is described in a text file whose file name is “User operation 2.txt”. This process is performed when

  In the service data E generation process T, the control unit 610 performs the following as the service data E based on the description of “xlink: href =“ VOD_Mobile.xml: id = purchase display ”” in the 13th line of FIG. Service data TSD500F is generated. Then, the process of step S343C ends. "Xlink: href =" VOD_Mobile.xml: id = purchase display "" is linked to "step id =" purchase display "described in the service scenario SMD400 whose file name is" VOD_Mobile.xml ". I will show you.

FIG. 39 is a diagram showing service data TSD 500F as an example.
Referring to FIG. 24 again, after the process of step S343C, the process proceeds to step S343D.

  In step S343D, service data E transmission processing T is performed. In the service data E transmission process T, the control unit 610 performs the service data TSD500F as the service data E based on the description of “xlink: href =“ VOD_Mobile.xml: id = purchase display ”” in the ninth line of FIG. Is transmitted to the communication terminal device 500 by wireless communication. Then, the process of step S343D ends.

  In the scenario execution process M, if NO in step S314 described above, the process proceeds to step S314N.

  In step S314N, control unit 510 determines whether or not service data TSD500F of FIG. If YES in step S314N, control unit 510 proceeds to step S314A described above by executing the eleventh line of FIG. 23 specified by the status ID “purchase display” indicated in received service data TSD500F. On the other hand, if NO at step S314N, the process at step S314 is performed again.

In the scenario execution process T, the process proceeds to step S344 after the process of step S343D.
In step S344, standby processing TN is performed. In the standby process TN, the 15th line in which “step id =“ buying with mobile phone ”” is described by the description of “move =“ buying with mobile phone ”” in the 13th line of FIG. It is a process performed by this.

  In the standby process TN, the SVG viewer T analyzes the data whose file name in the 15th line in FIG. 22 is “Purchasing with a mobile phone.svg”, generates the following purchase image G420, and displays it on the display unit 630. Display in front of the displayed image. Thereby, for example, the following standby image G400A is displayed on the display unit 630.

  FIG. 40 is a diagram illustrating a standby image G400A as an example. In the waiting image G400A, an image G420 for purchase is displayed.

  Referring again to FIG. 24, standby process TN in step S344 ends when a predetermined time (for example, 1 minute) has elapsed, and the process in step S345 described above is performed.

  Through the scenario execution process T and the scenario execution process M described above, each of the video display device 600 and the communication terminal device 500 can perform operations linked to each other by fully utilizing the functions of the own device. That is, each of the plurality of devices can perform operations in cooperation with each other by fully utilizing the characteristics of the device itself. As a result, various kinds of processing can be realized.

  The service scenario includes a plurality of processes respectively corresponding to a plurality of step numbers, but one service scenario may include only processes corresponding to one step number. In this case, the corresponding service scenario may be acquired from the service server 800A and executed as necessary.

  Note that service data may be directly transmitted / received between the video display device 600 and the communication terminal device 500 via wireless communication or the like, or may be transmitted / received via a network or the like.

  In addition, a plurality of data included in the service data may have different communication paths used for each data. For example, the status information may be a wireless communication path, and the media data may be a network capable of high-speed communication.

(Another example of UI content generation according to the device)
Next, another example of UI content generation processing other than moving image content will be described.

  Here, in communication terminal device 500, for example, it is assumed that a plurality of contents related to restaurants are registered in communication terminal device 500 by an RSS reader. Here, it is assumed that the following registered content list image G100A is displayed on the display unit 530 of the communication terminal device 500.

  FIG. 41 is a diagram showing a registered content list image G100A as an example. Referring to FIG. 41, a registered content list image G100A displays a plurality of store names respectively corresponding to a plurality of registered contents. A selection frame SL110 is arranged in the registered content list image G100A. The selection frame SL110 is a frame for selecting one of a plurality of store names. Selection frame SL110 moves upward by pressing direction button 541A in communication terminal device 500. In addition, the selection frame SL110 moves downward when the direction button 541B is pressed in the communication terminal device 500.

  Next, UI content generation processing will be described. Here, it is assumed that the following original scenario SD200A is stored in the storage unit 820 of the service server 800A.

  FIG. 42 is a diagram showing a configuration of an original scenario SD200A as an example. The original scenario SD200A includes a plurality of processes indicated by scripts. Referring to FIG. 42, since each item of original scenario SD200A has been described with reference to FIG. 16, detailed description will not be repeated.

  Further, it is assumed that the following scenario generation table SD210A is stored in the storage unit 820 of the service server 800A.

  FIG. 43 is a diagram showing a scenario generation table SD210A as an example. Referring to FIG. 43, each item of scenario generation table SD210A has been described with reference to FIG. 17, and therefore detailed description will not be repeated. The step number indicated in the scenario generation table SD210A corresponds to the step number indicated in the original scenario SD200A.

  Here, it is assumed that registered content list image G100A of FIG. 41 is displayed on display unit 530 of communication terminal device 500.

  Referring to FIG. 18 again, in step S211, the same processing as described above is performed, and thus detailed description will not be repeated. Here, assuming that there is a selection operation M, the process proceeds to step S212. It is assumed that the store name selected by the selection operation M is “AB restaurant”.

  In step S212, processing similar to that described above is performed, and therefore detailed description will not be repeated. With this processing, a service UI content request instruction is transmitted to the service server 800A. Note that the service UI content request instruction includes the device ID “11MA” of the communication terminal device 500.

In service server 800A, first, the process of step S281 is performed.
In step S281, the same processing as described above is performed, and therefore detailed description will not be repeated.

In step S290, a service scenario generation process S is performed.
Referring to FIG. 19 again, in step S291, processing similar to that described above is performed, and thus detailed description will not be repeated. Assume that the original scenario SD200A in FIG. 42 and the scenario generation table SD210A in FIG. 43 are read out by this processing.

  In step S292, processing similar to that described above is performed, and therefore detailed description will not be repeated. By this process, it is assumed that the device ID “11TA” associated with the device ID “11MA” included in the received service UI content request instruction is acquired.

  In step S293, processing similar to that described above is performed, and therefore detailed description will not be repeated. By this processing, the control unit 810 generates a determination table based on the related device function information table SD100 in FIG. 14 and the scenario generation table SD210A in FIG. The generated determination table is a table in which the control unit 810 determines a process to be used in the video display device 600 and the communication terminal device 500 among a plurality of processes included in the original scenario SD200A. The control unit 810 causes the storage unit 820 to store the generated determination table. Here, the following determination table SD300A is generated.

  FIG. 44 is a diagram showing a determination table SD300A as an example. Referring to FIG. 44, a plurality of step numbers shown in the “step number” item correspond to the step numbers shown in original scenario SD200A in FIG.

  Referring to FIG. 19 again, in step S294, the same processing as described above is performed, and thus detailed description will not be repeated. By this processing, the following service scenario STD400A and service scenario SMD400A are generated.

  FIG. 45 is a diagram illustrating a service scenario as an example. FIG. 45A shows a service scenario STD400A as an example. FIG. 45B shows a service scenario SMD 400A as an example. In service scenario STD400A, step numbers TST1 to TST3 correspond to step numbers ST1 to ST3 of original scenario SD200A, respectively. In service scenario SMD400A, step numbers MST1 to MST3 correspond to step numbers ST1 to ST3 of original scenario SD200A, respectively.

  The generation method of service scenario STD400A and service scenario SMD400A is the same as the generation method of service scenario STD400 and service scenario SMD400 described above, and therefore detailed description will not be repeated.

  Referring to FIG. 19 again, when the process of step S294 ends, the process returns to the UI content generation process of FIG. 18 and proceeds to step S296 subsequent to step S290.

  In step S296, processing similar to that described above is performed, and therefore detailed description will not be repeated. By this processing, service UI content T and service UI content M are transmitted to video display device 600 and communication terminal device 500, respectively.

  The service UI content T includes a service scenario STD400A shown in FIG. 45A and a plurality of media data T used when the service scenario STD400A is executed. The service UI content M includes a service scenario SMD 400A of FIG. 45B and a plurality of media data M used when executing the service scenario SMD 400A.

  In step S216, a UI content reception process M is performed as described above. Through this process, the service UI content M is stored in the storage unit 520.

  In step S217, as described above, control unit 510 executes scenario execution process M by executing service scenario SMD400A included in service UI content M. The scenario execution process M is a process performed independently of other processes.

  In step S246, a UI content reception process T is performed in the same manner as described above. With this processing, the service UI content T is stored in the storage unit 620.

  In step S247, as described above, control unit 610 executes scenario execution process T by executing service scenario STD400A included in service UI content T. The scenario execution process T is a process performed independently of other processes.

  Then, based on the execution of service scenario STD400A and service scenario SMD400A, processing similar to scenario execution processing T and scenario execution processing M of FIG. 24 described above is performed. Since processing based on execution of service scenario STD 400A and service scenario SMD 400A is similar to scenario execution processing T and scenario execution processing M in FIG. 24 described above, detailed description will not be repeated.

  FIG. 46 is a diagram illustrating an example of transition of images used by executing the service scenario STD400A and the service scenario SMD400A.

  First, in the video display device 600, the list image G800 of FIG. 46A is displayed on the display unit 630 by the store list display process. Button images BG812 and BG814 are arranged in the list image G800. When the button image BG812 is pressed, the list image G800A of FIG. 46B is displayed on the display unit 630 in the video display device 600 by the map display process. In the list image G800A, a map around the shop selected in the list image G800 is displayed. In the list image G800A, a button image BG814A is further arranged.

  Note that during the period in which the list image G800A is displayed on the display unit 630, the TV control image MG800A in FIG. 46E is displayed on the display unit 530 of the communication terminal device 500. Since TV control image MG800A is similar to TV control image MG300 in FIG. 26, detailed description will not be repeated.

  When the button image BG814A is pressed, the corresponding service data is transmitted from the video display device 600 to the communication terminal device 500. In communication terminal device 500, navigation to the destination is started by the navigation process. In communication terminal device 500, while navigation processing is being performed, in video display device 600, standby image G800B in FIG. 46C is displayed on display unit 630 by standby processing.

  When the button image BG 814 is pressed while the list image G 800 is displayed on the display unit 630, corresponding service data is transmitted from the video display device 600 to the communication terminal device 500. Then, list image MG800 is displayed on display unit 530 of communication terminal device 500. When the button image MBG 814 is pressed, corresponding service data is transmitted from the communication terminal device 500 to the video display device 600. Then, the video display device 600 performs the map display process described above.

  As described above, even in a service using a map, a navigation function, and the like, each of the video display device 600 and the communication terminal device 500 performs a coordinated operation by fully utilizing the functions of the own device. Can do. That is, each of the plurality of devices can perform operations in cooperation with each other by fully utilizing the characteristics of the device itself. As a result, various kinds of processing can be realized.

<Variation 1 of the first embodiment>
(Variation 1 of generation processing of related device specification table and related device function information table)
Next, another example of processing for generating a related device specification table and a related device function information table will be described.

  FIG. 47 is a flowchart of the function information registration process MA, the function information registration process TA, and the function information registration process SA in the first modification of the first embodiment. The function information registration process MA, the function information registration process TA, and the function information registration process SA are processes performed by the communication terminal device 500, the video display device 600, and the service server 800A, respectively.

  In FIG. 47, the processing with the same step number as in FIG. 11 is performed in the same manner as the processing described in FIG. In the following, processing different from the processing in FIG. 11 will be mainly described.

  In step S110, the same process as the process of step S110 of FIG. 11 described in the first embodiment is performed, and therefore detailed description will not be repeated. Here, assuming that there is an initial setting operation, the process proceeds to step S111A.

  In step S111A, device detection processing MA is performed. In device detection processing MA, control unit 510 detects a device capable of data communication by wireless communication. Here, the wireless communication is, for example, communication using Bluetooth (registered trademark). When a device capable of data communication is detected by device detection processing MA, control unit 510 causes display unit 530 to display a detection device image indicating the detected device using VDP 532. Then, control unit 510 acquires a device ID of a device capable of data communication and stores it in storage unit 520.

  Here, it is assumed that the video display device 600 is detected as a device capable of data communication. In this case, it is assumed that detection device image MG200 of FIG. 12 is displayed on display unit 530. Further, it is assumed that the acquired device ID is “11TA”. Then, the process proceeds to step S112.

  In step S112, a process similar to the process of step S112 described in the first embodiment is performed, and thus detailed description will not be repeated. If YES in step S112, the process proceeds to step S112A. On the other hand, if NO at step S112, the process at step S112 is performed again. Here, assuming that there is a registration operation M, the process proceeds to step S112A.

  In step S112A, control unit 510 determines whether or not the function information table of video display device 600 is stored in storage unit 520. If YES in step S112A, the flow proceeds to step S114A described later. On the other hand, if NO at step S112A, the process proceeds to step S112B. Here, assuming that the function information table of the video display device 600 is not stored in the storage unit 520, the process proceeds to step S112B.

  In step S112B, a function information acquisition process M is performed. In function information acquisition processing M, control unit 510 transmits function information request instruction M to video display device 600. The function information request instruction M is an instruction for requesting a function information table stored in the storage unit 620 of the video display device 600.

  In the function information registration process T, first, the process of step S140A is performed. Here, it is assumed that the function information table TD100 of FIG. 9 is stored in the storage unit 620 of the video display device 600.

  In step S140A, control unit 610 determines whether function information request instruction M has been received or not. If YES in step S140A, the process proceeds to step S142A. On the other hand, if NO at step S140A, the process at step S140A is performed again. Here, assuming that the function information request instruction M has been received, the process proceeds to step S142A.

  In step S142A, a function information transmission process TA is performed. In the function information transmission process TA, the control unit 610 transmits the function information table TD100 to the communication terminal device 500. Then, the function information registration process TA ends.

  In the function information registration process MA, in the function information acquisition process M of step S112B, when the control unit 510 receives the function information table TD100, the received function information table TD100 is stored in the storage unit 520. Then, the process proceeds to step S114A.

  In step S114A, a function information transmission process MA is performed. Here, it is assumed that the storage unit 520 stores the function information table MD100 and the function information table TD100 of FIG. In function information transmission process MA, control unit 510 transmits function information table MD100 of the own device and function information table TD100 of video display device 600 to service server 800A.

In the function information registration process SA, first, the process of step S181A is performed.
In step S181A, control unit 810 determines whether a plurality of function information tables have been received. If YES in step S181A, the process proceeds to step S182. On the other hand, if NO at step S181A, the process at step S181A is performed again. Here, assuming that function information table MD100 and function information table TD100 are received, the process proceeds to step S182A.

  In step S182A, an information storage process SA is performed. In the information storage process SA, the control unit 810 causes the storage unit 820 to store the received function information table MD100 and the table including the function information table TD100 as the related device function information table. With this processing, the related device function information table SD100 of FIG. 14 is stored in the storage unit 820. Then, the process proceeds to step S184A.

  In step S184A, the related device identification table A is generated. Here, the related device specifying table A is a table for specifying a plurality of related devices. Specifically, control unit 810 generates related device identification table A in which device ID “11MA” and device ID “11TA” are associated with each other, which are indicated by function information table MD100 and function information table TD100, respectively. Then, the control unit 810 stores the generated related device identification table A in the storage unit 820. Then, the process of step S184A ends. In this case, the generated related device specification table A is a table in which the unique ID is deleted from the related device specification table SD80 of FIG. Then, the function information registration process SA ends.

  As described above, the communication terminal device 500 acquires the function information table of the video display device 600, and the communication terminal device 500 uses the function information table of the own device and the function information table of the video display device 600 as a service. Transmit to server 800A.

  Then, a related device function information table indicating the function information of each of the plurality of devices is generated and registered in the service server 800A. That is, the function information of each of the plurality of devices is registered in the service server 800A.

  The function information registration process MA and the function information registration process TA may be performed by the video display device 600 and the communication terminal device 500, respectively. That is, the video display device 600 acquires the function information table of the communication terminal device 500, and the video display device 600 transmits the function information table of the own device and the function information table of the communication terminal device 500 to the service server 800A. May be. Then, the following UI content generation processing N is performed.

  FIG. 48 is a flowchart of UI content generation processing N in Modification 1 of the first embodiment. Compared with the UI content generation process of FIG. 18, the UI content generation process N includes a point where step S296N is performed instead of step S296, a step S216N is performed instead of step S216, and a step S216U is performed. The point is different. Other than that, it is the same as the UI content generation processing, and therefore detailed description will not be repeated.

  Similar to the first embodiment, the processing of steps S211, S212, S281, and S290 of the UI content generation process N is performed, so that the service scenario STD400 of FIG. A service scenario SMD 400 of FIG. 23 corresponding to the function of the communication terminal device 500 is generated.

  The service scenario STD400 and the service scenario SMD400 are data for the video display device 600 and the communication terminal device 500 to operate in cooperation with each other by being executed by the video display device 600 and the communication terminal device 500, respectively.

After the process of step S290, the process proceeds to step S296N.
In step S296N, UI content transmission processing SN is performed. In the UI content transmission process SN, the control unit 810 transmits the service UI content T and the service UI content M to the communication terminal device 500. Since service UI content T and service UI content M are the same as those described in step S296 in FIG. 18 in the first embodiment, detailed description thereof will not be repeated.

  In the UI content generation process N, the communication terminal apparatus 500 proceeds to step S216N after the process of step S212.

  In step S216N, UI content reception processing MN is performed. In the UI content reception process MN, the control unit 510 receives the service UI content T and the service UI content M, and causes the storage unit 520 to store the service UI content T and the service UI content M. Then, the process proceeds to step S216U.

  In step S216U, UI content transmission processing MN is performed. In UI content transmission processing MN, control unit 510 transmits service UI content T to video display device 600. Then, the process proceeds to step S217.

  That is, the communication terminal device 500 acquires the service UI content M of its own device and the service UI content T of the video display device 600, and the communication terminal device 500 acquires the service UI content T of the video display device 600 as the video display device. To 600.

  In the UI content generation process N, the video display device 600 performs the process of step S246.

  In step S246, UI content reception processing T is performed. In the UI content reception process T, the control unit 610 receives the service UI content T and causes the storage unit 620 to store the received service UI content T. Then, the process proceeds to step S247.

  Then, similarly to the first embodiment, the processes of steps S217 and S247 of the UI content generation process N are performed. Thereby, service scenario STD400 is executed in video display device 600, and service scenario SMD400 is executed in communication terminal device 500.

  Then, as in the first embodiment, scenario execution processing T and scenario execution processing M in FIG. 24 are performed.

  By performing the above processing, the same effects as those of the first embodiment can be obtained. That is, each of the video display device 600 and the communication terminal device 500 can perform operations in cooperation with each other by fully utilizing the functions of the device itself. That is, each of the plurality of devices can perform operations in cooperation with each other by fully utilizing the characteristics of the device itself. As a result, various kinds of processing can be realized.

  In the UI content generation process N, the video display apparatus 600 may perform the processes of steps S211, S212, S216N, S216U, and S217. Further, the communication terminal device 500 may perform the processes of steps S246 and S247. That is, the video display device 600 acquires the service UI content T of the own device and the service UI content M of the communication terminal device 500, and the video display device 600 acquires the service UI content M of the communication terminal device 500. You may transmit to 500.

<Modification 2 of the first embodiment>
(Modification 2 of generation processing of related device specification table and related device function information table)
Next, another example of processing for generating a related device specification table and a related device function information table will be described.

  FIG. 49 is a flowchart of the function information registration process MB, the function information registration process T, and the function information registration process SB in the second modification of the first embodiment. The function information registration process MB, the function information registration process T, and the function information registration process SB are processes performed by the communication terminal device 500, the video display device 600, and the service server 800A, respectively.

  In FIG. 49, the process with the same step number as in FIG. 11 is performed in the same way as the process described with reference to FIG. In the following, processing different from the processing in FIG. 11 will be mainly described.

  In step S110, a process similar to the process of step S110 described in the first embodiment is performed, and thus detailed description will not be repeated. Here, assuming that there is an initial setting operation, the process proceeds to step S110A.

  In step S110A, a function information transmission process MB is performed. In function information transmission process MB, control unit 510 transmits function information table MD100 of FIG. 10 to service server 800A. Then, the process of step S110A ends.

In the function information registration process SB, first, the process of step S180B is performed.
In step S180B, control unit 810 determines whether a function information table has been received. If YES in step S180B, the process proceeds to step S180C. On the other hand, if NO at step S180B, the process at step S180B is performed again. Here, assuming that function information table MD100 is received, the process proceeds to step S180C.

  In step S180C, an information storage process SB is performed. In the information storage process SB, the control unit 810 stores the received function information table MD100 in the storage unit 820 as a related apparatus function information table. Then, the process proceeds to step S180D.

  In step S180D, control unit 810 generates a unique ID and transmits the generated unique ID to communication terminal apparatus 500. Here, it is assumed that the generated unique ID is “MM.11.22.” Then, the process of step S180D ends.

  In the function information registration process MB, the process proceeds to step S110B after the process of step S110A.

  In step S110B, control unit 510 determines whether or not a unique ID has been received. If YES in step S110B, the process proceeds to step S111. On the other hand, if NO at step S110B, the process at step S110B is performed again. Here, assuming that the unique ID “MM.11.22” has been received, the process proceeds to step S111.

  In step S111, a process similar to the process of step S111 described in the first embodiment is performed, and thus detailed description will not be repeated. Assume that the video display device 600 is detected by this processing. In this case, the detection device image MG200 of FIG. 12 is displayed on the display unit 530.

  In step S112, a process similar to the process of step S112 described in the first embodiment is performed, and thus detailed description will not be repeated. If YES in step S112, the process proceeds to step S113B. On the other hand, if NO at step S112, the process at step S112 is performed again. Here, assuming that there is a registration operation M, the process proceeds to step S113B.

  In step S113B, registration required information transmission processing MB is performed. In registration required information transmission processing MB, control unit 510 transmits registration required information to video display device 600. Here, the registration necessary information is information necessary for registering the function information of the video display device 600 in the service server 800A. The registration necessary information includes the service IP address “111.222.111.222” and the received unique ID “MM.11.22.”. Then, the process of the function information registration process MB ends.

In the function information registration process T, first, the process of step S141 is performed.
In step S141, a process similar to the process of step S141 described in the first embodiment is performed, and thus detailed description will not be repeated. Here, assuming that registration necessary information has been received, the process proceeds to step S142.

  In step S142, a process similar to the process of step S142 described in the first embodiment is performed, and thus detailed description will not be repeated. With this process, the unique ID “MM.11.22” and the function information table TD100 are transmitted to the service server 800A. When the process of step S142 ends, the function information registration process T ends.

  In the function information registration process SB, the process proceeds to step S181 after the process of step S180D.

  In step S181, a process similar to the process of step S181 described in the first embodiment is performed, and thus detailed description will not be repeated. Here, assuming that the unique ID “MM.11.22” and the function information table TD100 are received, the process proceeds to step S183B.

  In step S183B, control unit 810 determines whether or not the received unique ID is the same as the generated unique ID. The reception unique ID is the unique ID received by the process of step S181. The generated unique ID is a unique ID generated by the process of step S180D. If YES in step S183B, the flow proceeds to step S183N. On the other hand, if NO at step S183B, the process at step S181 is performed again. Here, it is assumed that the received unique ID (“MM.11.22”) is the same as the generated unique ID, and the process proceeds to step S183N.

  In step S183N, an information storage process SBN is performed. In the information storage process SBN, the control unit 810 adds the received function information table TD100 to the function information table MD100 as a related device function information table stored in the storage unit 820. By this processing, it is assumed that the related device function information table SD100 of FIG. 14 is stored in the storage unit 820. Then, the process proceeds to step S184B.

  In step S184B, the related device identification table B is generated. Here, the related device specifying table B is a table for specifying a plurality of related devices. Specifically, the control unit 810 receives the device ID “11TA” indicated in the received function information table TD100, the device ID “11MA” indicated in the function information table MD100, and the generated unique ID (“MM.11.22”). )) Is associated with the related device identification table.

  Here, the function information table MD100 is a function information table of the communication terminal device 500 that is the transmission destination of the unique ID. By this process, the related device identification table SD80 of FIG. 13 is generated. Then, the control unit 810 causes the storage unit 820 to store the generated related device identification table SD80. Then, the function information registration process SB ends.

  Through the above processing, a related device function information table indicating the function information of each of the plurality of devices is generated and registered in the service server 800A. That is, the function information of each of the plurality of devices is registered in the service server 800A.

  49 may be performed by video display device 600 and communication terminal device 500, respectively.

  Then, the UI content generation process of FIG. 18 or the UI content generation process N of FIG. 48 is performed. With this process, the service scenario STD400 of FIG. 22 corresponding to the function of the video display device 600 and the service scenario SMD400 of FIG. 23 corresponding to the function of the communication terminal device 500 are generated.

  Then, as in the first embodiment, scenario execution processing T and scenario execution processing M in FIG. 24 are performed.

  By performing the above processing, the same effects as those of the first embodiment can be obtained. That is, each of the video display device 600 and the communication terminal device 500 can perform operations in cooperation with each other by fully utilizing the functions of the device itself. That is, each of the plurality of devices can perform operations in cooperation with each other by fully utilizing the characteristics of the device itself. As a result, various kinds of processing can be realized.

<Modification 3 of the first embodiment>
(Modification 3 of generation processing of related device specification table and related device function information table)
Next, another example of processing for generating a related device specification table and a related device function information table will be described.

  FIG. 50 is a flowchart of a function information registration process MC, a function information registration process TC, and a function information registration process SC in Modification 3 of the first embodiment. The function information registration process MC, the function information registration process TC, and the function information registration process SC are processes performed by the communication terminal device 500, the video display device 600, and the service server 800A, respectively.

  In FIG. 50, the process with the same step number as in FIG. 11 is performed in the same manner as the process described in FIG. In the following, processing different from the processing in FIG. 11 will be mainly described.

  In step S110, a process similar to the process of step S110 described in the first embodiment is performed, and thus detailed description will not be repeated. Here, assuming that there is an initial setting operation, the process proceeds to step S111.

  In step S111, a process similar to the process of step S111 described in the first embodiment is performed, and thus detailed description will not be repeated. Assume that the video display device 600 is detected by this processing. In this case, the detection device image MG200 of FIG. 12 is displayed on the display unit 530.

  In step S112, a process similar to the process of step S112 described in the first embodiment is performed, and thus detailed description will not be repeated. If YES in step S112, the process proceeds to step S113C. On the other hand, if NO at step S112, the process at step S112 is performed again. Here, assuming that there is a registration operation M, the process proceeds to step S113C.

  In step S113C, communication necessary information T acquisition processing M is performed. The communication necessary information T request process M is a process for acquiring the communication necessary information T. The communication necessary information T is information necessary for the service server 800A to perform data communication with the video display device 600. Here, as an example, it is assumed that the communication necessary information T is the IP address “TTT.222.111.222” of the video display device 600. The communication necessary information T may be information other than the IP address.

  In communication required information T acquisition processing M, control unit 510 transmits communication required information T request instruction M to video display device 600. The communication necessary information T request instruction M is an instruction for acquiring communication necessary information T (IP address) of the video display device 600. Then, the process of step S113C ends.

In the function information registration process TC, first, the process of step S141C is performed.
In step S141C, control unit 610 determines whether communication required information T request instruction M has been received or not. If YES in step S141C, the process proceeds to step S142C. On the other hand, if NO at step S141C, the process at step S141C is performed again. Here, assuming that communication necessary information T request instruction M is received, the process proceeds to step S142C.

  In step S142C, communication required information T transmission processing T is performed. In the communication necessary information T transmission process T, the control unit 610 transmits the communication necessary information T to the communication terminal device 500. Then, this function information registration process TC ends. It is assumed that the necessary communication information T to be transmitted is the IP address “TTT.222.111.222” of the video display device 600.

  In the function information registration process MC, in the communication required information T acquisition process M in step S112B, when the control unit 510 receives the communication necessary information T, the received communication necessary information T is stored in the storage unit 520. Then, the process proceeds to step S114C.

  In step S114C, function information transmission processing MC is performed. Here, it is assumed that the storage unit 520 stores the function information table MD100 of FIG. In function information transmission process MA, control unit 510 transmits communication necessary information T and function information table MD100 of the own apparatus to service server 800A. Here, it is assumed that the communication necessary information T is the IP address “TTT.222.111.222” of the video display device 600. Then, this function information registration process MC ends.

In the function information registration process SC, first, the process of step S181C is performed.
In step S181C, control unit 810 determines whether communication necessary information T and a function information table have been received. If YES at step S181C, the process proceeds to step S182C. On the other hand, if NO at step S181C, the process at step S181C is performed again. Here, assuming that the IP address “TTT.222.11.222” of the video display device 600 as the communication necessary information T and the function information table MD100 are received, the process proceeds to step S182C.

  In step S182C, an information storage process SC is performed. In the information storage process SC, the control unit 810 causes the storage unit 820 to store the received communication necessary information T and the function information table in association with each other. As a result of this processing, it is assumed that the IP address “TTT.222.111.222” of the video display device 600 and the function information table MD100 are associated with each other and stored in the storage unit 820. Then, the process proceeds to step S183C.

  In step S183C, a function information acquisition process SC is performed. In the function information acquisition process SC, the control unit 810 transmits a function information request instruction M to the video display device 600 specified by the IP address “TTT.2222.111.222”. The function information request instruction M is an instruction for requesting a function information table stored in the storage unit 620 of the video display device 600.

  In the function information registration process TC, first, after the process of step S142C, the process proceeds to step S144C. Here, it is assumed that the function information table TD100 of FIG. 9 is stored in the storage unit 620 of the video display device 600.

  In step S144C, control unit 610 determines whether function information request instruction M has been received or not. If YES in step S144C, the process proceeds to step S145C. On the other hand, if NO at step S144C, the process at step S144C is performed again. Here, assuming that the function information request instruction M has been received, the process proceeds to step S145C.

  In step S145C, a function information transmission process TC is performed. In the function information transmission process TC, the control unit 610 transmits the function information table TD100 to the service server 800A. Then, this function information registration process TC ends.

  In the function information registration process SC, when the control unit 810 receives the function information table TD100 in the function information acquisition process SC of step S183C, the received function information table TD100 and the function information table already stored in the storage unit 820 are displayed. A table including the MD 100 is stored in the storage unit 820 as a related device function information table. By this processing, it is assumed that the related device function information table SD100 of FIG. 14 is stored in the storage unit 820. Then, the process proceeds to step S184C.

  In step S184C, the same processing as step S184A of FIG. 47 described in the first modification of the first embodiment is performed, and therefore detailed description will not be repeated. By this processing, the related device identification table A is stored in the storage unit 820. The related device specification table A is a table in which the unique ID is deleted from the related device specification table SD80 of FIG. Then, this function information registration process SC ends.

  Through the above processing, a related device function information table indicating the function information of each of the plurality of devices is generated and registered in the service server 800A. That is, the function information of each of the plurality of devices is registered in the service server 800A.

  Note that the function information registration process MC and the function information registration process TC of FIG. 50 may be performed by the video display device 600 and the communication terminal device 500, respectively.

  Then, the UI content generation process of FIG. 18 or the UI content generation process N of FIG. 48 is performed. With this process, the service scenario STD400 of FIG. 22 corresponding to the function of the video display device 600 and the service scenario SMD400 of FIG. 23 corresponding to the function of the communication terminal device 500 are generated.

  Then, as in the first embodiment, scenario execution processing T and scenario execution processing M in FIG. 24 are performed.

  By performing the above processing, the same effects as those of the first embodiment can be obtained. That is, each of the video display device 600 and the communication terminal device 500 can perform operations in cooperation with each other by fully utilizing the functions of the device itself. That is, each of the plurality of devices can perform operations in cooperation with each other by fully utilizing the characteristics of the device itself. As a result, various kinds of processing can be realized.

<Modification 4 of the first embodiment>
(Modification 4 of related device function information table generation processing)
Next, another example of processing for generating a related device function information table will be described.

  FIG. 51 is a flowchart of the function information registration process MD and the function information registration process TA in Modification 4 of the first embodiment. The function information registration process MD and the function information registration process TA are processes performed by the communication terminal device 500 and the video display device 600, respectively.

  51, the process with the same step number as in FIG. 11 is performed in the same way as the process described in FIG. In the following, processing different from the processing in FIG. 11 will be mainly described.

  In step S110, the same process as the process of step S110 of FIG. 11 described in the first embodiment is performed, and therefore detailed description will not be repeated. Here, assuming that there is an initial setting operation, the process proceeds to step S111A.

  In step S111A, the same process as the apparatus detection process MA of step S111A of FIG. 47 described in the first modification of the first embodiment is performed, and therefore detailed description will not be repeated. It is assumed that the detection device image MG200 of FIG. 12 is displayed on the display unit 530 by this processing.

  In step S112, a process similar to the process of step S112 described in the first embodiment is performed, and thus detailed description will not be repeated. Here, assuming that there is a registration operation M, the process proceeds to step S112A.

  In step S112A, the same process as the process of step S112A of FIG. 47 described in the first modification of the first embodiment is performed, and thus detailed description will not be repeated. Here, assuming that the function information table of the video display device 600 is not stored in the storage unit 520, the process proceeds to step S112B. If YES in step S112A, the function information registration process MD ends.

  In step S112B, the same process as the function information acquisition process M in step S112B of FIG. 47 described in the first modification of the first embodiment is performed, and thus detailed description will not be repeated. Through this process, the function information request instruction M is transmitted to the video display device 600.

  In the function information registration process TA, first, the process of step S140A is performed. Here, it is assumed that the function information table TD100 of FIG. 9 is stored in the storage unit 620 of the video display device 600.

  In step S140A, the same process as the process of step S140A of FIG. 47 described in the first modification of the first embodiment is performed, and thus detailed description will not be repeated. Here, assuming that the function information request instruction M has been received, the process proceeds to step S142A.

  In step S142A, the same process as the process of step S142A of FIG. 47 described in the first modification of the first embodiment is performed, and therefore detailed description will not be repeated. With this process, the function information table TD100 is transmitted to the communication terminal device 500. Then, the function information registration process TA ends.

  Here, it is assumed that the function information table MD100 of FIG. 10 is stored in the storage unit 520 in advance.

  In the function information registration process MD, when the control unit 510 receives the function information table TD100 in the function information acquisition process M in step S112B, the received function information table TD100 and the function information table already stored in the storage unit 520 are displayed. A table including the MD 100 is stored in the storage unit 520 as a related device function information table. By this processing, it is assumed that the related device function information table SD100 of FIG. 14 is stored in the storage unit 520. Then, this function information registration process MD ends.

  As described above, in the present embodiment, the communication terminal device 500 can generate the related device function information table without the service server 800A.

  51 may be performed by video display device 600 and communication terminal device 500, respectively. That is, the related apparatus function information table may be generated by the video display apparatus 600.

  The generation processing of the related device specifying table and the related device function information table is not limited to the first embodiment and the first to fourth modifications of the first embodiment described above. For example, each of communication terminal device 500 and video display device 600 may access service server 800 and register its own function information table. In this case, in the service server 800, the user may generate a related device identification table by operating the mouse 842, the keyboard 844, and the like.

  In addition, the IP addresses of the communication terminal device 500 and the video display device 600 may be registered in advance in the service server 800 by the user. In this case, the service server 800 requests a function information table from each of the communication terminal device 500 and the video display device 600 specified by the registered IP address. Then, in the service server 800, the user may generate a related device identification table by operating the mouse 842, the keyboard 844, and the like.

  When the service server 800 is provided in the home network 501, the service server 800 transmits an instruction to request a function information table to the communication terminal device 500 and the video display device 600 in the home network 501 by broadcasting. To do. Then, the service server 800 acquires each function information table of the communication terminal device 500 and the video display device 600.

  In this case, in the service server 800, the user may generate a related device identification table by operating the mouse 842, the keyboard 844, and the like. In this case, the service server 800 generates a related device function information table based on the generated related device identification table.

<Second Embodiment>
Next, in service scenario MA and service scenario TA executed in communication terminal device 500 and video display device 600, respectively, the same processing (for example, content detail display processing in FIGS. 21A and 21B) is provided. The processing when not performing will be described.

  Since the network system in the present embodiment is similar to network system 1000 in the first embodiment, detailed description will not be repeated. The configuration of each of communication terminal device 500, video display device 600, and service server 800A is the same as that described in the first embodiment, and therefore detailed description thereof will not be repeated.

  First, the above-described processing in FIG. 11, processing in FIG. 47, processing in FIG. 49, and processing in FIG. 50 is performed, so that the related device in FIG. 14 is stored in the storage unit 820 of the service server 800A. It is assumed that the function information table SD100 is registered.

(Generation of UI content according to the device)
Next, in the present embodiment, a process (hereinafter also referred to as UI content generation process A) for generating service UI content corresponding to the functions of communication terminal apparatus 500 and video display apparatus 600 will be described. Here, it is assumed that the registered content list image G100 of FIG. 15 is displayed on the display unit 530 of the communication terminal device 500.

  Further, it is assumed that the following original scenario SD200B is stored in the storage unit 820 of the service server 800A.

  FIG. 52 is a diagram showing a configuration of an original scenario SD200B as an example. The original scenario SD200B includes a plurality of processes indicated by scripts. Referring to FIG. 52, original scenario SD200B is different from original scenario SD200 in FIG. 16 in that a selection process is added. Other than that, since it is the same as the original scenario SD200, detailed description will not be repeated.

  Further, it is assumed that the following scenario generation table SD210B is stored in the storage unit 820 of the service server 800A.

  FIG. 53 is a diagram showing a scenario generation table SD210B as an example. Since each item of the scenario generation table SD210B has been described with reference to FIG. 17, detailed description will not be repeated. The step number indicated in the scenario generation table SD210B corresponds to the step number indicated in the original scenario SD200B. Details of the contents shown in the item “scenario generation condition” will be described later.

  FIG. 54 is a flowchart of UI content generation processing A. FIG. 54 shows processing performed in each of communication terminal device 500, video display device 600, and service server 800A. In FIG. 54, the processing with the same step number as in FIG. 18 is performed in the same manner as the processing described in FIG. In the following, processing different from the processing in FIG. 18 will be mainly described.

  In step S211, a process similar to the process described in the first embodiment is performed, and thus detailed description will not be repeated. Here, assuming that there is a selection operation M, the process proceeds to step S212. It is assumed that the title selected by the selection operation M is “AB story”.

  In step S212, the same processing as that described in the first embodiment is performed, and therefore detailed description will not be repeated. With this processing, a service UI content request instruction is transmitted to the service server 800A. Note that the service UI content request instruction includes the device ID “11MA” of the communication terminal device 500.

In service server 800A, first, the process of step S281 is performed.
In step S281, processing similar to that described in the first embodiment is performed, and therefore detailed description will not be repeated. Then, the process proceeds to step S290A.

In step S290A, a service scenario generation process SA is performed.
FIG. 55 is a flowchart of the service scenario generation process SA. Referring to FIG. 55, service scenario generation process SA is different from service scenario generation process S of FIG. 19 in that the process of step S294A is performed instead of step S294. Other than that, it is the same as the service scenario generation process S, and therefore detailed description will not be repeated.

  In step S291, processing similar to that described in the first embodiment is performed, and therefore detailed description will not be repeated. It is assumed that the original scenario SD200B shown in FIG. 52 and the scenario generation table SD210B shown in FIG.

  In step S292, processing similar to that described in the first embodiment is performed, and therefore detailed description will not be repeated. By this process, it is assumed that the device ID “11TA” associated with the device ID “11MA” included in the received service UI content request instruction is acquired.

  In step S293, determination processing S is performed in the same manner as the processing described in the first embodiment. In the determination process S, the control unit 810, based on the functions of each of the video display device 600 and the communication terminal device 500, and the scenario generation table, among the plurality of processes included in the original scenario, The process used in the communication terminal device 500 is determined.

  Specifically, control unit 810 generates a determination table based on related device function information table SD100 in FIG. 14 and scenario generation table SD210B in FIG. The generated determination table is a table in which the control unit 810 determines a process to be used in the video display device 600 and the communication terminal device 500 among a plurality of processes included in the original scenario SD200B in FIG. The control unit 810 causes the storage unit 820 to store the generated determination table.

  Here, each item of the “scenario generation condition” shown in the scenario generation table SD210B will be described. In the scenario generation table SD210B, “only mobile phone” is a condition that the processing of the corresponding step number (ST1) is used for the communication terminal device 500. Therefore, the processing of step numbers ST1 to ST4 indicated in original scenario SD200B is used in communication terminal device 500.

  In the scenario generation table SD210B, “review display processing for non-selected devices” refers to a device that is determined not to use the processing of the corresponding step number (ST5) among the video display device 600 and the communication terminal device 500. On the other hand, the condition is that the review display process is used. Here, it is determined that the processing of the step number (ST5) (content reproduction processing) is used for the video display apparatus 600 capable of reproducing the moving image in the MPEG2 format, as described in the first embodiment. Therefore, it is determined that the review display process is used for the communication terminal device 500.

  Since the other items of “scenario generation condition” are the same as those described in the first embodiment, detailed description will not be repeated.

  Based on the determination by the control unit 810, the following determination table SD300B is generated. Note that when the generated determination table SD300B is stored in the storage unit 820, the process of step S293 ends.

  FIG. 56 is a diagram showing a determination table SD300B as an example. Referring to FIG. 56, each item of determination table SD300B has been described with reference to FIG. 20, and therefore detailed description will not be repeated.

Referring to FIG. 55 again, after the process of step S293, the process proceeds to step S294A.
In step S294A, scenario generation processing SA is performed. The scenario generation process SA is a process for generating a service scenario corresponding to the apparatus by using a process corresponding to the function of the apparatus among a plurality of processes included in the original scenario. In the scenario generation process SA, the control unit 810 generates a service scenario according to the functions of the video display device 600 and the communication terminal device 500 based on the original scenario, the scenario generation table, and the determination table. The generated service scenario is data for the video display device 600 and the communication terminal device 500 to operate in cooperation with each other. Then, the control unit 810 stores the generated service scenario in the storage unit 820.

  Here, it is assumed that the original scenario is the original scenario SD200B of FIG. The scenario generation table is assumed to be the scenario generation table SD210B of FIG. Assume that the determination table is the determination table SD300B of FIG. In this case, the control unit 810 generates the following service scenario STD400B and service scenario SMD400B. The service scenario STD400B is a scenario executed by the video display device 600 with the device ID “11TA”. The service scenario SMD400B is a scenario executed by the communication terminal device 500 having the device ID “11MA”.

  FIG. 57 is a diagram illustrating a service scenario as an example. FIG. 57A shows an example service scenario STD400B. FIG. 57B shows a service scenario SMD400B as an example.

  In service scenario STD400B, step numbers TST1 to TST6 correspond to step numbers ST1 to ST7 of original scenario SD200B, respectively. In service scenario SMD400B, step numbers MST1 to MST7 correspond to step numbers ST1 to ST7 of original scenario SD200B, respectively.

  First, a method for generating the service scenario STD400B will be described. The service scenario STD400B is first generated using the process of the step number (for example, ST5) corresponding to “use” in the column of the device ID “11TA” of the determination table SD300B of FIG. For example, the process of step number ST5 (content reproduction process) in determination table SD300B is the process of step number TST5 of service scenario STD400B. Similarly, the process of step number ST6 in determination table SD300B is the process of step number TST6 of service scenario STD400B.

  In the column of the device ID “11TA” of the determination table SD300B, there is a step number that is one step before the step number corresponding to “unused” (hereinafter also referred to as an unused step number T), and the 1 When the previous step number is “use”, the following processing TA is performed. In the process TA, the process of the step number of the service scenario STD400B corresponding to the previous step number is processed, or the process of the step number corresponding to the unused step number T in the service scenario SMD400B executed by the communication terminal apparatus 500. A process to migrate is added.

  More specifically, the step number MST7 of the service scenario SMD400B is added to the process of the step number TST2 of the service scenario STD400B corresponding to the step number ST6 immediately before the step number ST7 as the unused step number T in the determination table SD300B. Processing to shift to the processing of is added.

  Further, when there is an unused step number T in the column of the device ID “11TA” of the determination table SD300B and the unused step number T is not the last step number, the following processing TA2 is performed. In the process TA2, the process of the step numbers TST1 to TST4 of the service scenario STD400B corresponding to the step numbers ST1 to ST4 as the unused step numbers T in the determination table SD300B is set to “None”.

  Further, when the unused step number T exists in the column of the device ID “11TA” of the determination table SD300B, and the unused step number T is the last step number, the following processing TA3 is performed. In the process TA3, the process of the step number TST7 of the service scenario STD400B corresponding to the step number ST7 as the unused step number T in the determination table SD300B is set as a standby process.

  As described above, the service scenario STD 400B is generated. The generated service scenario STD400B is a service scenario corresponding to the function of the video display device 600.

  Next, a method for generating the service scenario SMD400B will be described. First, service scenario SMD400B is generated using the process of the step number (for example, ST1 to ST4, ST7) corresponding to “use” in the column of device ID “11MA” of determination table SD300B of FIG. For example, the process of step number ST1 (content list details display process) in determination table SD300B is the process of step number MST1 of service scenario SMD400B. Similarly, the processes of step numbers ST2 to ST4 in determination table SD300B are the processes of step numbers TST2 to TST4 of service scenario SMD400, respectively. Further, the process of step number ST7 in determination table SD300B is the process of step number TST7 of service scenario SMD400.

  In the column of the device ID “11MA” of the determination table SD300B, there is a step number immediately before the step number corresponding to “unused” (hereinafter also referred to as an unused step number M), and the 1 When the previous step number is “use”, the following processing MA is performed. In the process MA, the process of the step number of the service scenario SMD400B corresponding to the previous step number is processed, and the process of the step number corresponding to the unused step number M in the service scenario STD400B executed by the video display device 600. A process to migrate is added.

  Specifically, the step number TST5 of the service scenario STD400 corresponds to the process of the step number MST4 of the service scenario SMD400 corresponding to the step number ST4 immediately before the step number ST5 as the unused step number M in the determination table SD300B. Processing to shift to the processing of is added.

  Further, in the column of the device ID “11MA” of the determination table SD300B, when there is an unused step number M and a step number corresponding to the content reproduction process, the following process MA2 is performed. In the process MA2, the process of the step number MST5 of the service scenario SMD400B corresponding to the step number ST5 as the unused step number M in the determination table SD300B is the video display device control process A. The video display device control process A is a process for controlling the reproduction of content in the video display device 600.

  Further, when there is an unused step number M in the column of the device ID “11MA” of the determination table SD300B and the unused step number M is not the last step number, the following process MA3 is performed. In the process MA3, the process of the step number MST6 of the service scenario SMD400B corresponding to the step number ST6 as the unused step number M in the determination table SD300B is set to “none”.

  Also, the service scenario SMD400B corresponding to the step number ST5 as the unused step number M in the determination table SD300B according to the scenario generation condition of the step number ST5 of the scenario generation table SD210B in FIG. “Review display process” is added to the process of step number MST5.

  As described above, the service scenario SMD 400B is generated. The generated service scenario SMD400B is a service scenario according to the function of the communication terminal device 500. Each of service scenario STD400B and service scenario SMD400B is a scenario that does not include the same processing.

  In the scenario generation process SA, a deletion process S is further performed. In the deletion process S, the control unit 810 deletes the step number set to “None” in the generated service scenario STD400B and service scenario SMD400B, and reassigns the step number, whereby the following service scenario STD400C and service A scenario SMD400C is generated. In service scenario STD400C and service scenario SMD400C, the step number of the migration destination is also changed to the reassigned step number.

  FIG. 58 is a diagram illustrating a service scenario as an example. FIG. 58A shows a service scenario STD400C as an example. The generated service scenario STD400C is a service scenario corresponding to the function of the video display device 600. Note that the file name of the service scenario STD400C is “VOD_TV.xml”.

  FIG. 58B shows a service scenario SMD400C as an example. The generated service scenario SMD400C is a service scenario according to the function of the communication terminal device 500. Note that the file name of the service scenario SMD400C is “VOD_Mobile.xml”.

  The service scenario STD400C and the service scenario SMD400C are data for the video display device 600 and the communication terminal device 500 to operate in cooperation with each other by being executed by the video display device 600 and the communication terminal device 500, respectively. .

  As described above, each of service scenario STD400B and service scenario SMD400B is a scenario that does not include the same processing. Therefore, each of service scenario STD400C and service scenario SMD400C is a scenario that does not include the same processing.

  FIG. 59 is a diagram illustrating an example of a script description of a service scenario STD400C executed by the video display device 600. Referring to FIG. 59, the sixth to twelfth lines are examples of the content reproduction processing script of step number TST1 of service scenario STD400C of FIG. The 13th line is an example of a privilege display process script of step number TST2. The 17th line is an example of a standby process script of step number TST3. Detailed description of the script will be described later.

  FIG. 60 is a diagram illustrating an example of a script description of a service scenario SMD 400C executed by the communication terminal device 500. Referring to FIG. 60, the sixth line is an example of a script for the content list display process of step number MST1 of service scenario SMD400C of FIG. The 10th line is an example of a script for content detail display processing of step number MST2.

  The 14th line is an example of a script for the purchase process of step number MST3. The 18th line is an example of a script for selecting the step number MST4. The 23rd line is an example of a video display device control process A script of step number MST5. The 24th line is an example of a review display process script of step number MST5. The 28th line is an example of the coupon acquisition process script having the step number MST6. Detailed description of the script will be described later.

  Referring again to FIG. 55, when the process of step S294A is completed, the process returns to UI content generation process A of FIG.

  In step S296A, UI content transmission processing SA is performed. In UI content transmission processing SA, control unit 810 transmits service UI content MA to communication terminal device 500. The service UI content MA is content processed by the communication terminal device 500.

  The service UI content MA includes a service scenario SMD400C of FIG. 60 and a plurality of media data M used when executing the service scenario SMD400C. The media data M is data such as script data M, text data, and image data. The script data M is data generated based on the SVG standard. The script data M is data having a file name “list display.svg” described in the sixth line of FIG. 60, for example. Then, the process of step S296A ends.

  In the UI content generation process A, the communication terminal device 500 proceeds to step S216A after the process of step S212.

  In step S216A, UI content reception processing MA is performed. In the UI content reception process MA, the control unit 510 receives the service UI content MA and causes the storage unit 520 to store the received service UI content MA. Then, the process proceeds to step S217A.

  In step S217A, control unit 510 executes scenario execution process MA by executing service scenario SMD400C included in service UI content MA. The scenario execution process MA is a process performed independently of other processes. The scenario execution process TA is also executed by the process described later. Here, it is assumed that communication terminal apparatus 500 is set to the remote control mode.

  FIG. 61 is a flowchart of the scenario execution process TA and the scenario execution process MA. In the scenario execution process MA, first, the process of step S441 is performed.

  In step S411, content list display processing M is performed. The content list display process M is a process performed by the control unit 510 executing the sixth line in FIG. As described above, the SVG viewer executed by the control unit 510 is also referred to as an SVG viewer M.

  In the content list display process M, the SVG viewer M analyzes the data whose file name is “list display.svg” in the sixth line of FIG. 60, generates the following list image MG300A, and displays it on the display unit 530. List image MG300A is displayed.

  FIG. 62 is a diagram showing list image MG300A as an example. Referring to FIG. 62, list image MG300A displays a list of titles of a plurality of contents that can be distributed by service server 800A. In addition, selection frame MSL310 is arranged in list image MG300A. Selection frame MSL310 is a frame for selecting one of a plurality of titles. Selection frame MSL310 moves upward when direction button 541A is pressed. The selection frame MSL310 moves downward when the direction button 541B is pressed.

  In the list image MG300A, a button image MBG314 is further arranged. The button image MBG 314 is a button image for causing the display unit 530 of the communication terminal device 500 to display the detailed information of the content of the title selected in the selection frame MSL310 by being pressed.

  Referring again to FIG. 61, in the scenario execution process MA, the process proceeds to step S412 after the process of step S411.

  In step S412, control unit 510 determines whether or not detailed operation MA has been performed. The detailed operation MA is an interface operation M for pressing the button image MGB 314, which is performed in a state where the title is selected by the selection frame MSL310 of FIG.

  If YES in step S412, control unit 510 determines that file name is “user operation 1.txt” based on the script described in the data of “list display.svg” on the sixth line in FIG. In the text file of “”, describe the character string “view details”. In addition, the control unit 510 adds a selected title (for example, “for example,“ VOD content.txt ”) to a text file based on the script described in the data whose file name is“ list display.svg ”. The character string of “AB story”) is described. Then, the process proceeds to step S413. On the other hand, if NO at step S412, the process at step S412 is performed again. Here, assuming that there is a detailed operation MA, the process proceeds to step S413. It is assumed that the title selected by the detailed operation MA is “AB story”.

  In step S413, a content detail display process MA is performed. In the content detail display process MA, as shown in the script on the seventh and eighth lines in FIG. 60, “view details” is described in the text file whose file name is “user operation 1.txt”. Thus, the process is performed by executing the tenth line.

  In the detailed content display process MA, the SVG viewer M analyzes the data whose file name is “detailed display.svg” in the tenth line of FIG. 60 and generates the detailed information display image MG400 of FIG. Data whose file name is “detailed display.svg” is data included in the service UI content MA received by the process of step S216A of FIG. Note that the data of “detail display.svg” includes a plurality of pieces of detailed information corresponding to the plurality of titles displayed in FIG.

  Specifically, based on a script described in data whose file name is “detailed display.svg”, control unit 510 determines “AB story” described in a text file whose file name is “VOD content.txt”. The detailed information corresponding to “” is selected from a plurality of detailed information included in the data whose file name is “detailed display.svg”. Then, control unit 510 generates detailed information display image MG400 displaying the selected detailed information based on the script described in the data whose file name is “detail display.svg”, and displays details on display unit 530. An information display image MG400 is displayed. Then, the process proceeds to step S414.

  In step S414, processing similar to that in step S314 in FIG. If YES in step S414, control unit 510 determines that the file name is “user operation 2.txt” based on the script described in the data whose file name is “detailed display.svg” on line 10 in FIG. In the text file “”, the character string “purchase” is described. Then, the process proceeds to step S414A. On the other hand, if NO at step S414, the process at step S414 is performed again. Here, assuming that there is a purchase operation M, the process proceeds to step S414A.

  In step S414A, a purchase process MA is performed. As shown in the scripts on the 11th and 12th lines of FIG. 60, the purchase process MA is performed by the fact that “purchase” is described in the text file whose file name is “user operation 2.txt”. This process is performed by executing 14 lines.

  In purchase process MA, control unit 510 performs a settlement process for purchasing content to service server 800A. The payment process is, for example, payment using electronic money. Here, it is assumed that the purchased content is a content whose title is “AB story”.

  When the settlement process is completed, the SVG viewer M analyzes the data whose file name is “purchase display.svg” in the 14th line of FIG. 60 to generate the purchase image MG500 of FIG. The image MG500 is displayed. Then, the process proceeds to step S415.

  In step S415, processing similar to that in step S315 in FIG. 24 is performed, and thus detailed description will not be repeated. If YES in step S415, control unit 510 determines that file name is “user operation 3.txt” based on the script described in the data of “purchase display.svg” on line 14 in FIG. In the text file “”, a character string “view on TV” is described.

  In addition, the control unit 510 uses the script described in the data with the file name “purchase display.svg” to create a text file with the file name “VOD content.txt” and the content with the title “AB story”. The file name (AB story.mpg) is described. Then, the process proceeds to step S415N. On the other hand, if NO at step S415, the process at step S415 is performed again. Here, assuming that there is a reproduction operation M, the process proceeds to step S415N.

  In step S415N, control unit 510 transmits a UI content TA request instruction to service server 800A. Here, the UI content TA request instruction is an instruction for causing the service server 800A to transmit the service UI content TA including the service scenario STD400C of FIG. 59 to the video display device 600. Then, the process of step S415N ends.

  Referring to FIG. 54 again, after the process of step S296A, the process proceeds to step S297A.

  In step S297A, control unit 810 determines whether a UI content TA request instruction has been received or not. If YES in step S297A, the process proceeds to step S298A. On the other hand, if NO at step S297A, the process at step S297A is performed again. Here, assuming that the UI content TA request instruction is received, the process proceeds to step S298A.

  In step S298A, UI content transmission processing SB is performed. In the UI content transmission process SB, the control unit 810 transmits the service UI content TA to the video display device 600. The service UI content TA is content processed by the video display device 600.

  The service UI content TA includes a service scenario STD400C of FIG. 59 and a plurality of media data T used when executing the service scenario STD400C. The media data T is data such as script data T, text data, and image data. The script data T is data generated based on the SVG standard. The script data T is, for example, data having a file name “privilege display.svg” described in the 13th line of FIG. Then, the process of the service server 800A in the UI content generation process A ends.

  In the UI content generation process A, the video display device 600 performs the process of step S246A.

  In step S246A, UI content reception processing TA is performed. In the UI content reception process TA, the control unit 610 receives the service UI content TA and causes the storage unit 620 to store the received service UI content TA. Then, the process proceeds to step S247A.

  In step S247A, control unit 610 executes scenario execution process TA by executing service scenario STD400C included in service UI content TA. The scenario execution process TA is a process performed independently of other processes. Then, the process of the video display device 600 in the UI content generation process A ends.

  Referring to FIG. 61 again, after the process of step S415N, the process proceeds to step S415A.

  In step S415A, service data NA generation processing M is performed. In the service data NA generation processing M, as shown in the script on the 15th and 16th lines in FIG. 60, “view on TV” is described in a text file whose file name is “user operation 3.txt”. This process is performed when

  In service data NA generation processing M, control unit 510 performs the following as service data NA based on the description of “xlink: href =“ VOD_TV.xml: id = content playback ”” in the 16th line of FIG. Service data TSD500G is generated. Then, the process of step S415A ends.

  FIG. 63 is a diagram showing service data TSD 500G as an example. Referring to FIG. 63, each item shown in service data TSD 500G has been described with reference to FIG. 27, and thus detailed description thereof will not be repeated. Here, the URI “http://service.com/VOD_TV.xml” identifies the service scenario STD400C whose file name is “VOD_TV.xml” stored in the storage unit 620 of the video display device 600.

  The service data TSD500G includes a text file with file names “user operation 1.txt”, “user operation 2.txt”, and “user operation 3.txt”, a text file with a file name “VOD content.txt”, Is included.

Referring to FIG. 61 again, after the process of step S415A, the process proceeds to step S415B.
In step S415B, service data NA transmission processing M is performed. In the service data NA transmission process M, the control unit 510 uses the service data TSD 500G as the service data NA based on the description of “xlink: href =“ VOD_TV.xml: id = content playback ”” in the 16th line of FIG. Is transmitted to the video display device 600 by wireless communication. Then, the process of step S415B ends.

In the scenario execution process TA, first, the process of step S441 is performed.
In step S441, control unit 610 determines whether or not service data TSD 500G as service data NA has been received. If YES in step S441, the process proceeds to step S442. On the other hand, if NO at step S441, the process at step S441 is performed again. Here, assuming that service data TSD500G as service data NA has been received, the process proceeds to step S442.

  In step S442, content reproduction processing A is performed. The content reproduction process A is a process performed by the control unit 610 executing the sixth line in FIG. 59 specified by the status ID “content reproduction” indicated in the received service data TSD 500G. “Movie-player” in the sixth line in FIG. 59 is the name of an application for reproducing content (hereinafter also referred to as a content reproduction program).

  Note that the content reproduction program is stored in the storage unit 620 in advance. As described above, the content reproduction program executed by the control unit 610 is also referred to as a content reproduction program T. As described above, the content based on the description of “param =“ @ VOD content.txt ”” in the sixth line in FIG. 59 is also referred to as a reproduction target content. Here, it is assumed that the content to be played is content having a file name “AB story.mpg” described in a text file having a file name “VOD content.txt”.

  In the content playback process A, the content playback program T requests the service server 800A for playback target content. The service server 800A performs streaming distribution of the reproduction target content to the video display device 600 in response to the request for the reproduction target content.

  The content reproduction program T reproduces the reproduction target content distributed from the service server 800A while receiving it via the network 70 and the communication unit 50. The content reproduction program T causes the display unit 630 to display an image of the content being reproduced.

  In the scenario execution process MA, the process proceeds to step S416 after the process of step S415B.

  In step S416, a selection process M is performed. The selection process M is a process performed by executing the 18th line according to the description of the 16th line in FIG.

  In the selection process M, the SVG viewer M analyzes the data whose file name is “selection operation.svg” on the 18th line in FIG. 60, generates the following selection operation image MG500A, and displays the selection operation on the display unit 530. The image MG500A is displayed.

  FIG. 64 is a diagram showing a selection operation image MG500A as an example. Referring to FIG. 64, in selection operation image MG500A, a message for selecting an operation to be performed on the content being reproduced is displayed. Further, button images MBG522 and MBG524 are arranged in the selection operation image MG500A.

  The button image MBG 522 is a button image for controlling the content being reproduced by being pressed. The button image MBG 524 is a button image for displaying related information of the content being reproduced by being pressed.

Referring to FIG. 61 again, after the process of step S416, the process proceeds to step S416A.
In step S416A, control unit 510 determines whether there is information display operation M or not. The information display operation M is an interface operation M for pressing the button image MBG524. If YES in step S416A, control unit 510 causes file name “user operation 4.txt” to be based on the script described in the data of “selection operation.svg” on line 18 in FIG. In the text file “”, a character string “related information display” is described. Then, the process proceeds to step S416B. On the other hand, if NO at step S416A, the process proceeds to step S417J described later. Here, assuming that there is an information display operation M, the process proceeds to step S416B.

  In step S416B, a review display process M is performed. In the review display process M, as shown in the script on the 19th and 21st lines in FIG. 60, “related information display” is described in the text file whose file name is “user operation 4.txt”. Thus, the process is performed by executing the 24th line.

  In the review display process M, the SVG viewer M associates the file with the file name “relevant information display.svg” in the 24th line of FIG. 60 and the text file with the file name “playback result.txt”. An information display image is generated, and the related information display image is displayed on the display unit 530. Here, it is assumed that nothing is described in the initial state in the text file whose file name is “playback result.txt”. In this case, the following related information display image MG600 is generated, and the related information display image MG600 is displayed on the display unit 530. Then, the process of step S416B ends.

  FIG. 65 is a diagram showing a related information display image MG600 as an example. Referring to FIG. 65, related information display image MG600 displays a message that it is possible to refer to a review of the content being reproduced, and a message that there is enjoyment after the content reproduction ends. A button image MBG622 is arranged in the related information display image MG600. The button image MBG 622 is a button image for referring to a review of content being played back on the video display device 600 by being pressed.

  Referring to FIG. 61 again, after the process of step S416B, the process proceeds to step S416C.

  In step S416C, control unit 510 determines whether or not there is a review reference operation M. The review reference operation M is an interface operation M for pressing the button image MBG622. If YES in step S416C, the process proceeds to step S416D. On the other hand, if NO at step S416C, the process proceeds to step S416E described later. Here, assuming that there is a review reference operation M, the process proceeds to step S416D.

  In step S416D, a review reference process M is performed. In the review reference process M, for example, the control unit 510 accesses the service server 800A, acquires information on the review of the content being played back on the video display device 600, and causes the display unit 530 to display the information. Then, the process of step S416D ends.

  In the content reproduction process A in step S442 of the scenario execution process TA, the content reproduction program T controls the reproduction of content according to the remote control signal received from the communication terminal device 500, as in the content reproduction process in step S346 of FIG. To do. This control is performed based on “action” described in the ninth to eleventh lines in FIG.

  When the reproduction of the content is finished, the content reproduction program T describes the character string “end of content” in the text file whose file name is “user operation 1.txt” based on the script in the sixth line of FIG. To do. Further, the content reproduction program T describes a character string “reproduction end” in a text file whose file name is “reproduction result.txt” based on the script on the sixth line in FIG. Then, the process proceeds to step S442A.

  In step S442A, service data NB generation processing T is performed. In the service data NB generation process T, as shown in the script in the seventh and eighth lines of FIG. 59, “end of content” is described in the text file whose file name is “user operation 1.txt”. It is a process performed in the case.

  In the service data NB generation process T, the control unit 610 performs the following as service data NB based on the description of “xlink: href =“ VOD_Mobile.xml: id = related information display ”” in the eighth line of FIG. Service data TSD500H is generated. Then, the process of step S442A ends.

  FIG. 66 is a diagram showing service data TSD 500H as an example. Referring to FIG. 66, each item shown in service data TSD 500H has been described with reference to FIG. 27, and thus detailed description will not be repeated. Here, the URI “http://service.com/VOD_Mobile.xml” specifies the service scenario SMD400C having the file name “VOD_Mobile.xml” stored in the storage unit 520 of the communication terminal device 500.

  The service data TSD500H further includes a text file of “reproduction result.txt” in that the character string described in the “user operation 1.txt” is different from that of the service data TSD500G of FIG. The point is different. Other than that, it is the same as service data TSD500G, and therefore detailed description will not be repeated.

  Referring again to FIG. 61, after the process of step S442A, the process proceeds to step S442B.

  In step S442B, service data NB transmission processing T is performed. In the service data NB transmission process T, the control unit 610 uses the service data NB as service data NB based on the description of “xlink: href =“ VOD_Mobile.xml: id = related information display ”” in the eighth line of FIG. The TSD 500G is transmitted to the communication terminal device 500 by wireless communication. Then, the process of step S442B ends.

  In the scenario execution process MA, after the process of step S416D, the process proceeds to step S416E.

  In step S416E, control unit 510 determines whether or not service data TSD500G as service data NB has been received. If YES in step S416E, the process proceeds to step S416F. On the other hand, if NO at step S416E, the process at step S416C is performed again. Here, assuming that service data TSD500G as service data NB has been received, the process proceeds to step S416F.

  In step S416F, a review display process MA is performed. The review display process MA is a process performed when the control unit 510 executes the 24th line in FIG. 60 specified by the status ID “related information display” indicated in the received service data TSD 500G.

  In the review display process MA, the SVG viewer M performs the association based on the data with the file name “relevant information display.svg” in the 24th line of FIG. 60 and the text file with the file name “reproduction result. An information display image is generated, and the related information display image is displayed on the display unit 530. Here, it is assumed that a character string “reproduction end” is described in the text file whose file name is “reproduction result.txt”. In this case, the following related information display image MG600A is generated, and the related information display image MG600A is displayed on the display unit 530. Then, the process of step S416F ends.

  FIG. 67 is a diagram showing a related information display image MG600A as an example. 67, related information display image MG600A is different from related information display image MG600 in FIG. 65 in that button image MBG624 is further arranged. Other than that, since it is the same as the related information display image MG600, detailed description will not be repeated. That is, when the reproduction of the content is finished, the button image MBG624 is displayed.

  The button image MBG624 is a button image for acquiring a coupon by being pressed.

  Note that when the related information display image MG600A is displayed on the display unit 530 and there is a review reference operation M for pressing the button image MBG622, the above-described review reference process M in step S416D is performed. Then, it progresses to step S417 mentioned later.

Referring to FIG. 61 again, after the process of step S416F, the process proceeds to step S417.
In step S417, control unit 510 determines whether or not coupon acquisition operation M has been performed. The coupon acquisition operation M is an interface operation M for pressing the button image MBG624. If YES in step S417, control unit 510 has file name “user operation 5.txt” based on the script described in the “related information display.svg” data in line 24 of FIG. Describe the character string “Coupon” in the text file. Then, the process proceeds to step S418. On the other hand, if NO at step S417, the process proceeds to step S417A described later. Here, assuming that there is a coupon acquisition operation M, the process proceeds to step S418.

  In step S418, a coupon acquisition process M is performed as in step S318 of FIG. As shown in the script on the 25th line and the 26th line in FIG. 60, the coupon acquisition process M is performed by the fact that “coupon” is described in the text file whose file name is “user operation 5.txt”. This is a process performed by executing the 28th line.

  In the coupon acquisition process M, the SVG viewer M analyzes the data with the file name “coupon display.svg” on the 28th line in FIG. 60 to generate a coupon display image MG700 in FIG. Coupon display image MG700 is displayed.

  Note that the processing for storing the coupon is the same as step S318 in FIG. 24, and therefore detailed description will not be repeated. If there is an interface operation M for ending the scenario execution process MA, the process of step S418 ends, and the scenario execution process MA ends.

  In the coupon acquisition process TA, the process proceeds to step S447 after the process of step S442B.

  In step S447, a privilege display process T is performed as in step S347 of FIG. The privilege display process T is a process performed by executing the 13th line according to the description of the 8th line in FIG.

  In the privilege display process T, the SVG viewer T analyzes the data whose file name is “privilege display.svg” in the thirteenth line in FIG. 59 to generate a privilege display image G600 in FIG. A privilege display image G600 is displayed. Then, the process proceeds to step S448.

  In step S448, control unit 610 determines whether or not coupon acquisition operation T has been performed. The coupon acquisition operation T is an operation for pressing the button image BG614 in FIG. If YES in step S448, control unit 610 determines that the file name is “user operation 2.txt” based on the script described in the data in which the file name on line 13 in FIG. 59 is “privilege display.svg”. Describe the character string “Coupon” in the text file. Then, the process proceeds to step S448A.

  On the other hand, if NO at step S448, the process at step S448 is performed again. Here, assuming that there is a coupon acquisition operation T, the process proceeds to step S448A.

  In step S448A, service data NC generation processing T is performed. In the service data NC generation process T, as shown in the scripts in the 14th and 15th lines of FIG. 59, the “coupon” is described in the text file whose file name is “user operation 2.txt”. It is a process performed in

  In the service data NC generation process T, the control unit 610 performs the following service as the service data NC based on the description of “xlink: href =“ VOD_Mobile.xml: id = coupon ”” in the 15th line of FIG. Data TSD500J is generated. Then, the process of step S448A ends.

  FIG. 68 is a diagram showing service data TSD 500J as an example. Referring to FIG. 68, each item shown in service data TSD 500J has been described with reference to FIG. 27, and thus detailed description will not be repeated.

  Referring to FIG. 61 again, after the process of step S448A, the process proceeds to step S448B.

  In step S448B, service data NC transmission processing T is performed. In the service data NC transmission processing T, the control unit 610 converts the service data TSD 500J as the service data NC based on the description of “xlink: href =“ VOD_Mobile.xml: id = coupon ”” in the 15th line of FIG. And transmitted to the communication terminal device 500 by wireless communication. Then, the process of step S448B ends.

  In the scenario execution process MA, if NO in step S417, the process proceeds to step S417A.

  In step S417A, control unit 510 determines whether or not service data TSD 500J as service data NC has been received. If YES in step S417A, the flow proceeds to step S418. On the other hand, if NO at step S417A, the process at step S417 is performed again. Here, assuming that service data TSD500J as service data NC has been received, the process proceeds to step S418.

  In step S418, a coupon acquisition process M is performed as described above. In the coupon acquisition process M when the process of step S418 is performed after the process of step S417A, the control unit 510 is identified by the status ID “coupon” shown in the received service data TSD500J, line 28 in FIG. It is a process performed by executing. Since coupon acquisition processing M has been described above, detailed description will not be repeated.

  In the coupon acquisition process TA, the process proceeds to step S448C after the process of step S448B.

  In step S448C, standby processing T is performed as in step S348C of FIG. The standby process T is a process performed by executing the 17th line according to the description of the 15th line in FIG. By this processing, the standby image G600A of FIG. 37 is displayed on the display unit 630. In addition, it complete | finishes according to completion | finish of scenario execution process MA, and coupon acquisition process TA is complete | finished.

  Next, a process when there is no information display operation M after the process of step S416 in FIG. 61 will be described. In this case, NO is determined in step S416A, and the process proceeds to step S417J.

  In step S417J, control unit 510 determines whether or not there is a reproduction control operation M. The reproduction control operation M is an interface operation M for pressing the button image MBG522 in FIG. If YES in step S417J, control unit 510 determines that file name is “user operation 4.txt” based on the script described in the data of “selection operation.svg” on line 18 in FIG. The character string “TV control” is described in the text file “”. Then, the process proceeds to step S417K. On the other hand, if NO at step S417J, the process of step S416A is performed again. Here, assuming that there is a reproduction control operation, the process proceeds to step S417K.

  In step S417K, as in step S316 of FIG. 24, video display device control processing A is performed, and thus detailed description will not be repeated. In the video display device control process A, as shown in the script on the 19th and 20th lines in FIG. 60, “TV control” is described in the text file whose file name is “user operation 4.txt”. Thus, the process is performed by executing the 23rd line. By this processing, the reproduction control image MG300A of FIG. 32 is displayed on the display unit 530. Then, the process of step S416E described above is performed.

  As described above, even when the same processing is not included in the service scenario MA (service scenario SMD400C) and the service scenario TA (service scenario STD400C) executed in the communication terminal device 500 and the video display device 600, respectively. In the embodiment, the effects obtained in the first embodiment can be obtained.

  That is, by the scenario execution process TA and the scenario execution process MA, each of the video display device 600 and the communication terminal device 500 can perform operations linked to each other by fully utilizing the functions of the own device. That is, each of the plurality of devices can perform operations in cooperation with each other by fully utilizing the characteristics of the device itself. As a result, various kinds of processing can be realized.

<Modification of Second Embodiment>
Next, in service scenario MA and service scenario TA executed in communication terminal device 500 and video display device 600, respectively, the same processing (for example, content detail display processing in FIGS. 21A and 21B) is provided. Another example of the processing when not performing will be described.

  First, the above-described processing in FIG. 11, processing in FIG. 47, processing in FIG. 49, and processing in FIG. 50 is performed, so that the related device in FIG. 14 is stored in the storage unit 820 of the service server 800A. It is assumed that the function information table SD100 is registered.

(Generation of UI content according to the device)
Next, in the present embodiment, a process (hereinafter also referred to as UI content generation process B) for generating service UI content corresponding to the functions of communication terminal apparatus 500 and video display apparatus 600 will be described. Here, it is assumed that the registered content list image G100 of FIG. 15 is displayed on the display unit 530 of the communication terminal device 500.

  Further, it is assumed that the original scenario SD200B of FIG. 52 is stored in the storage unit 820 of the service server 800A. Further, it is assumed that the scenario generation table SD210B of FIG. 53 is stored in the storage unit 820 of the service server 800A.

  FIG. 69 is a flowchart of UI content generation processing B. FIG. 69 shows processing performed in each of communication terminal device 500, video display device 600, and service server 800A. In FIG. 69, the processing with the same step number as in FIG. 54 is performed in the same way as the processing described in FIG. 54, and therefore detailed description will not be repeated. In the following, processing different from the processing in FIG. 54 will be mainly described.

  Since the processing of steps S211 and S212 in FIG. 69 performed in communication terminal device 500 is the same as the processing described in the second embodiment, detailed description will not be repeated.

  Further, the processing of steps S281, S290A, and S296A performed in service server 800A is the same as the processing described in the second embodiment, and thus detailed description will not be repeated.

  In addition, the process in step S216A of FIG. 69 performed in communication terminal device 500 is the same as the process described in the second embodiment, and thus detailed description will not be repeated. Then, the process proceeds to step S217B.

  In step S217B, control unit 510 executes scenario execution process MB by executing service scenario SMD400C included in service UI content MA. The scenario execution process MB is a process performed independently of other processes. The scenario execution process TB is also executed by the process described later. Here, it is assumed that communication terminal apparatus 500 is set to the remote control mode.

  FIG. 70 is a flowchart of the scenario execution process TB and the scenario execution process MB. In FIG. 70, the processing with the same step number as in FIG. 61 is performed in the same way as the processing described with reference to FIG. In the following, processing different from the processing in FIG. 61 will be mainly described.

  Since the processes in steps S411, S412, S413, S414, S414A, and S415 of FIG. 70 performed in the scenario execution process MB are the same as those described in the second embodiment, detailed description thereof will not be repeated. If YES in step S415, the process proceeds to step S415A.

  Since the processing of steps S415A and S415B performed in the scenario execution processing MB is the same as the processing described in the second embodiment, detailed description will not be repeated. With this processing, the service data TSD 500G of FIG. 63 as the service data NA is transmitted to the video display device 600 by wireless communication.

  Referring to FIG. 69 again, in UI content generation process B, video display apparatus 600 performs the process of step S241B.

  In step S241B, control unit 610 determines whether or not service data TSD 500G as service data NA has been received. If YES in step S241B, the process proceeds to step S242B. On the other hand, if NO at step S241B, the process at step S241B is performed again. Here, assuming that service data TSD500G as service data NA has been received, the process proceeds to step S242B.

  In step S242B, a service data analysis process TB is performed. In the service data analysis process TB, the control unit 610 refers to the URI “http://service.com/VOD_TV.xml” indicated in the service data TSD 500G as the received service data NA. Here, it is assumed that the URI “http://service.com/VOD_TV.xml” specifies the service scenario STD400C of FIG. That is, service data TSD500G as service data NA is data corresponding to service scenario STD400C. Then, the process proceeds to step S243B.

  In step S243B, control unit 610 transmits a UI content TB request instruction to service server 800A. Here, the UI content TB request instruction is specified for the service server 800A by the URI “http://service.com/VOD_TV.xml” referenced by the service data analysis process TB in step S242B, as shown in FIG. This is an instruction for requesting the service UI content TA including the service scenario STD400C. Then, the process of step S243B ends.

  In service server 800A, after the process of step S296A, the process proceeds to step S297B.

  In step S297B, control unit 810 determines whether or not a UI content TB request instruction has been received. If YES in step S297B, the process proceeds to step S298A. On the other hand, if NO at step S297B, the process of step S297B is performed again. Here, assuming that the UI content TB request instruction has been received, the process proceeds to step S298A.

  In step S298A, a process similar to the process described in the second embodiment is performed, and thus detailed description will not be repeated. With this processing, the service UI content TA is transmitted to the video display device 600.

  In video display device 600, the process proceeds to step S246A after the process of step S243B.

  In step S246A, a process similar to that described in the second embodiment is performed, and thus detailed description will not be repeated. Then, the process proceeds to step S247B.

  In step S247B, control unit 610 executes scenario execution process TB by executing service scenario STD400C included in service UI content TA. The scenario execution process TB is a process performed independently of other processes. Then, the process of the video display device 600 in the UI content generation process B ends.

  Referring to FIG. 70 again, in the scenario execution process TB, the process of step S442 is performed. In addition, since the process after step S442 performed by scenario execution process TB is the same process as the process demonstrated in 2nd Embodiment, detailed description is not repeated. In addition, since the processing after step S416 performed in the scenario execution processing MB is the same as the processing described in the second embodiment, detailed description thereof will not be repeated.

  As described above, even when the same processing is not included in the service scenario MA (service scenario SMD400C) and the service scenario TA (service scenario STD400C) executed in the communication terminal device 500 and the video display device 600, respectively. In the embodiment, the effects obtained in the first embodiment can be obtained.

  That is, the scenario execution process TB and the scenario execution process MB allow the video display device 600 and the communication terminal device 500 to perform operations linked to each other by fully utilizing the functions of the own device. That is, each of the plurality of devices can perform operations in cooperation with each other by fully utilizing the characteristics of the device itself. As a result, various kinds of processing can be realized.

<Third Embodiment>
Next, processing when a plurality of communication terminal devices 500 are within a range in which direct data communication can be performed wirelessly with one video display device 600 will be described. That is, a process when a plurality of communication terminal devices 500 can directly perform data communication with one video display device 600 will be described.

  In the following description, it is assumed that the two communication terminal apparatuses 500 can directly perform data communication with the video display apparatus 600 by radio or the like. Hereinafter, one of the two communication terminal devices 500 is also referred to as a communication terminal device A. Of the two communication terminal devices 500, the other communication terminal device 500 is also referred to as a communication terminal device B. Assume that the device ID of the communication terminal device A is “11MA”. Assume that the device ID of the communication terminal device B is “11 MB”. Note that the number of communication terminal devices 500 is not limited to two, and may be three or more.

  The network system in the present embodiment is a system in which two communication terminal devices 500 are included in the home network 501 in the network system 1000 in the first embodiment. Other than that, it is the same as network system 1000 in the first embodiment, and therefore detailed description will not be repeated. The configuration of each of communication terminal device 500, video display device 600, and service server 800A is the same as that described in the first embodiment, and therefore detailed description thereof will not be repeated.

  First, communication terminal apparatus A, video display apparatus 600, and service server 800 perform any of the processes shown in FIG. 11, the process shown in FIG. 47, the process shown in FIG. 49, and the process shown in FIG. Assume that the related device identification table SD80 in FIG. 13 and the related device function information table SD100 in FIG. 14 are registered in the storage unit 820 of the service server 800A.

  Then, the communication terminal apparatus A executes steps S211 and S212 of the UI content generation process of FIG. 18, and the service server 800 executes steps S281 and S290 of the UI content generation process. Accordingly, the service scenario STD400 of FIG. 22 corresponding to the function of the video display device 600 and the service scenario SMD400 of FIG. 23 corresponding to the function of the communication terminal device A are generated.

  The service scenario STD400 and the service scenario SMD400 are data for the video display device 600 and the communication terminal device A to operate in cooperation with each other by being executed by the video display device 600 and the communication terminal device A, respectively.

  The communication terminal apparatus A may execute steps S211 and S212 of the UI content generation process N in FIG. 48, and the service server 800 may execute steps S281 and S290 of the UI content generation process N.

  Then, the service server 800 executes step S296 of the UI content generation process in FIG. 18, the communication terminal apparatus A executes steps S216 and S217 of the UI content generation process, and the video display apparatus 600 performs the UI content generation process. Steps S246 and S247 are executed. Thereby, the service UI content M is stored in the storage unit 520 of the communication terminal apparatus A. In addition, the service UI content T is stored in the storage unit 620 of the video display device 600.

  The service UI content M includes the service scenario SMD400 of FIG. 23 and a plurality of media data M used when executing the service scenario SMD400. The service UI content T includes a service scenario STD400 of FIG. 22 and a plurality of media data T used when the service scenario STD400 is executed.

  Further, in the communication terminal apparatus A, the scenario execution process M of FIG. 24 is performed by the process of step S217. Also, by the process in step S247, the scenario display process T in FIG. 24 is performed in the video display device 600.

  The service server 800 executes step S296N of the UI content generation process N of FIG. 48, the communication terminal device A executes steps S216N, S216U, and S217 of the UI content generation process N, and the video display device 600 Steps S246 and S247 of the UI content generation process N may be executed.

  Then, while the communication terminal apparatus A and the video display apparatus 600 are executing the scenario execution process M and the scenario execution process T, respectively, the communication terminal apparatus A and the video display apparatus 600 cannot communicate with each other. Suppose that

  The situation in which the communication terminal device A and the video display device 600 are unable to communicate with each other is, for example, a case where a user of the communication terminal device A needs to go out and needs to go out. In this case, the communication terminal device B takes over the continuation of the processing performed by the communication terminal device A.

  Next, a process for the communication terminal apparatus B to take over the continuation of the process performed by the communication terminal apparatus A will be described. Here, as an example, after the video display device 600 transmits the service data TSD500F in FIG. 39 as the service data E in step S343D in FIG. 24, the communication terminal device A and the video display device 600 exchange data with each other. It is assumed that a time during which communication is impossible continues for a predetermined time (for example, 1 minute) or longer.

  In this case, the control unit 610 of the video display device 600 temporarily stops the process after executing the fifteenth line in the service scenario STD400 in FIG. Then, in service scenario STD400, control unit 610 causes storage unit 620 to store information (hereinafter also referred to as temporary stop information T) for specifying the last executed script (15th line).

  Further, the communication terminal apparatus B performs the following alternative device execution process M. Note that the function of communication terminal apparatus B is the same as the function of communication terminal apparatus A. In this case, it is assumed that the storage unit 520 of the communication terminal device B stores the following function information table MD100B.

  FIG. 71 is a diagram showing a function information table MD100B as an example. 71, function information table MD100B has a different device ID compared to function information table MD100 in FIG. Other than that, it is the same as function information table MD100, and therefore detailed description will not be repeated. The details of the functions of the communication terminal apparatus B may be different from the details of the functions of the communication terminal apparatus A. For example, the electronic money function possessed by the communication terminal apparatus B and the electronic money function possessed by the communication terminal apparatus A may be functions that handle electronic money of different standards.

  FIG. 72 is a flowchart of the alternative device execution process M. FIG. 72 also shows processing performed in each of video display device 600 and service server 800. Referring to FIG. 72, in step S511, control unit 510 determines whether or not service data has been received. If YES in step S511, the flow proceeds to step S511A. On the other hand, if NO at step S511, the process at step S511 is performed again. Here, assuming that the service data TSD500F of FIG. 39 has been received, the process proceeds to step S511A.

  In step S511A, control unit 510 determines whether or not a service scenario corresponding to received service data TSD 500F is stored in storage unit 520. If YES in step S511A, the flow proceeds to step S527 described later. On the other hand, if NO at step S511A, the process proceeds to step S512. Here, assuming that the service scenario corresponding to the received service data TSD500F is not stored in the storage unit 520, the process proceeds to step S512.

  In step S512, function information acquisition processing M is performed in the same manner as in step S112B of FIG. 47, and thus detailed description will not be repeated. Through this process, the function information request instruction M is transmitted to the video display device 600.

In video display device 600, the process of step S540 is performed.
In step S540, the same processing as in step S140A of FIG. 47 is performed, and thus detailed description will not be repeated. If YES in step S540, the process proceeds to step S542. On the other hand, if NO at step S540, the process at step S540 is performed again. Here, assuming that the function information request instruction M has been received, the process proceeds to step S542.

  In step S542, function information transmission processing TA is performed in the same manner as in step S142A in FIG. 47, and therefore detailed description will not be repeated. Through this process, the function information table TD100 of FIG. 9 is transmitted to the communication terminal apparatus B. Then, the process of step S542 ends.

  In the alternative device execution process M, when the control unit 510 receives the function information table TD100 in the function information acquisition process M in step S512, the received function information table TD100 is stored in the storage unit 520. Then, the process proceeds to step S514.

  In step S514, function information transmission processing MA is performed as in step S114A of FIG. Here, it is assumed that the storage unit 520 stores the function information table MD100B and the function information table TD100 of FIG. In function information transmission process MA, control unit 510 transmits function information table MD100B of its own apparatus and function information table TD100 of video display apparatus 600 to service server 800A. And the process of step S514 is complete | finished.

In service server 800A, first, the process of step S581 is performed.
In step S581, the same process as in step S181A of FIG. 47 is performed, and thus detailed description will not be repeated. Here, assuming that function information table MD100B and function information table TD100 are received, the process proceeds to step S582.

  In step S582, an information storage process SD is performed. Here, it is assumed that the related device function information table SD100 of FIG. 14 is stored in the storage unit 820 of the service server 800A. In this case, the control unit 810 adds the received function information table MD100B to the related device function information table SD100. By this processing, it is assumed that the following related apparatus function information table SD100B is stored in the storage unit 820. Then, this process ends.

  FIG. 73 is a diagram showing a related device function information table SD100B as an example. Referring to FIG. 73, related apparatus function information table SD100B is a table in which function information table MD100B is added to related apparatus function information table SD100 in FIG.

Referring to FIG. 72 again, after the process of step S582, the process proceeds to step S583.
In step S583, it is determined whether or not communication terminal apparatus B is associated with video display apparatus 600. Specifically, the control unit 810 determines whether or not the device ID “11MB” of the communication terminal device B exists in the related device identification table SD80 of FIG. 13 stored in the storage unit 820. If YES in step S583, the flow proceeds to step S585A described later. On the other hand, if NO at step S583, the process proceeds to step S584. Here, it is assumed that there is no device ID “11MB” in the related device identification table SD80, and the process advances to step S584.

  In step S584, the related device identification table B is generated. Here, the related device specifying table B is a table for specifying a plurality of related devices. Specifically, control unit 810 generates related device specifying table B in which device ID “11MB” indicated by function information table MD100B is added to related device specifying table SD80. Then, the control unit 810 stores the generated related device identification table B in the storage unit 820. Then, the process of step S584 ends.

  Note that the process for registering the function information of the communication terminal device B in the service server 800A is not limited to the above process, and may be any of the processes in FIGS. 11, 49, 50, and 51. Good.

  Referring again to FIG. 72, in alternative device execution process M, the process proceeds to step S522 after the process of step S514.

  In step S522, a process similar to the process of step S212 in FIG. 18 is performed, and thus detailed description will not be repeated. With this processing, a service UI content request instruction is transmitted to the service server 800A. It is assumed that the service UI content request instruction includes the device ID “11MB” of the communication terminal device B. Then, the process of step S522 ends.

  In service server 800A, after the process of step S584, the process proceeds to step S585A.

  In step S585A, a process similar to the process of step S281 of FIG. 18 is performed, and thus detailed description will not be repeated. Here, assuming that the service UI content request instruction has been received, the process proceeds to step S590.

  In step S590, a service scenario generation process S is performed. The service scenario generation process S is the same as the description in which the communication terminal apparatus 500 is replaced with the communication terminal apparatus B and the apparatus ID “11MA” is replaced with the apparatus ID “11MB” in the description of each process of FIG. The explanation will not be repeated. By this processing, the service scenario STD400 of FIG. 22 and the service scenario SMD400 of FIG. 23 are generated. The service scenario STD400 is a service scenario corresponding to the function of the video display device 600. Service scenario SMD400 is a service scenario according to the functions of communication terminal apparatus B. Then, the process proceeds to step S596.

  In step S596, a UI content transmission process S is performed as in step S296 of FIG. 18, and thus detailed description will not be repeated. Through this process, service UI content T and service UI content M are transmitted to video display device 600 and communication terminal device B, respectively.

  The service UI content T includes a service scenario STD400 of FIG. 22 and a plurality of media data T used when the service scenario STD400 is executed. The service UI content M includes the service scenario SMD400 of FIG. 23 and a plurality of media data M used when executing the service scenario SMD400.

  Note that the transmission method of the service UI content T and the service UI content M is not limited to the method of step S596, and may be performed by the method described in FIG.

In the alternative device execution process M, the process proceeds to step S526 after the process of step S522.
In step S526, a UI content reception process M is performed as in step S216 of FIG. 18, and thus detailed description will not be repeated. With this process, the service UI content M is stored in the storage unit 520. Then, the process proceeds to step S527.

  In step S527, as in step S217 of FIG. 18, the control unit 510 executes the scenario execution process M by executing the service scenario SMD400 included in the service UI content M. The scenario execution process M is a process performed independently of other processes. Then, the alternative device execution process M ends.

  Referring to FIG. 24 again, in scenario execution process M, control unit 510 of communication terminal apparatus B specifies the status ID “purchase display” indicated in received service data TSD 500F in FIG. By executing the eleventh line, the process of step S314A described above is executed. Since the processing after step S314A is the same as described above, detailed description will not be repeated.

Referring to FIG. 72 again, after the process of step S542, the process proceeds to step S546.
In step S546, a UI content reception process T is performed as in step S246 of FIG. 18, and thus detailed description will not be repeated. With this process, the service UI content T is stored in the storage unit 620. Then, the process proceeds to step S547.

  In step S547, as in step S247 of FIG. 18, the control unit 610 executes the scenario execution process T by executing the service scenario STD400 included in the service UI content T. The scenario execution process T is a process performed independently of other processes. Then, the process of the video display device 600 in the UI content generation process ends.

  Referring to FIG. 24 again, in the scenario execution process T, the control unit 610 of the video display device 600 specifies the script specified by the temporary stop information T stored in the storage unit 620 (line 15 in FIG. 23). Execute. Thereby, the process of step S344 is performed. Since the processing after step S344 is the same as described above, detailed description will not be repeated.

  Note that in the scenario execution process T, information on the subsequent process suspended by the control unit 610 may be notified from the communication terminal apparatus B to the video display apparatus 600.

  As described above, when communication terminal apparatus A and video display apparatus 600 are unable to communicate with each other, service server 800A provides a service scenario (service scenario SMD400) corresponding to the function of communication terminal apparatus B. A service scenario (service scenario STD400) corresponding to the functions of the video display device 600 is generated. Then, service server 800A transmits service UI content T including service scenario STD400 to video display device 600. Service server 800A transmits service UI content M including service scenario SMD400 to communication terminal apparatus B.

  Then, the communication terminal device B executes processing subsequent to the processing interrupted in the communication terminal device A. In addition, the video display device 600 executes processing subsequent to the temporarily stopped processing.

  Therefore, even when communication terminal apparatus A and video display apparatus 600 cannot communicate with each other, video display apparatus 600 and communication terminal apparatus B each have video display apparatus 600 and communication terminal apparatus B. The functions can be fully utilized to perform operations linked to each other. That is, each of the plurality of devices can perform operations in cooperation with each other by fully utilizing the characteristics of the device itself. As a result, various kinds of processing can be realized.

(Function block diagram)
FIG. 74 is a functional block diagram of the control unit 810 in the first embodiment, the first to fourth modifications of the first embodiment, the second embodiment, and the modification of the second embodiment. It is. Referring to FIG. 74, control unit 810 includes an acquisition unit 811, a generation unit 813, and a transmission unit 815.

  The acquisition unit 811 acquires a plurality of pieces of device information respectively corresponding to a plurality of terminal devices. The generation unit 813 is data for the plurality of terminal devices to operate in cooperation with each other based on the plurality of device information, and generates a plurality of cooperation processing data corresponding to the plurality of terminal devices. The transmission part 815 transmits each of several cooperation processing data to a corresponding terminal device.

  Note that all or part of the acquisition unit 811, the generation unit 813, and the transmission unit 815 included in the control unit 810 may be configured by hardware.

  FIG. 75 illustrates the control unit 510 and the control unit 610 in the first embodiment, the first to fourth modifications of the first embodiment, the second embodiment, and the modification of the second embodiment. It is a functional block diagram. Referring to FIG. 75, control unit 510 includes a first acquisition unit 511, a transmission unit 513, a second acquisition unit 515, and an execution unit 517.

  The first acquisition unit 511 acquires device information of another terminal device from another terminal device. The transmission unit 513 transmits the device information of the own device and the device information of other terminal devices to the data generation device. The second acquisition unit 515 is data generated by the data generation device based on the device information of the own device and the device information of other terminal devices, and operates in cooperation with the other terminal devices. And the cooperative processing data corresponding to the own device is acquired from the data generation device. The execution unit 517 performs processing to operate in cooperation with other terminal devices by executing cooperative processing data corresponding to the own device.

  Note that all or part of the first acquisition unit 511, the transmission unit 513, the second acquisition unit 515, and the execution unit 517 included in the control unit 510 may be configured by hardware.

  The control unit 610 includes a first acquisition unit 611, a transmission unit 613, a second acquisition unit 615, and an execution unit 617.

  The first acquisition unit 611 acquires device information of another terminal device from another terminal device. The transmission unit 613 transmits the device information of the own device and the device information of other terminal devices to the data generation device. The second acquisition unit 615 is data generated by the data generation device based on the device information of the own device and the device information of other terminal devices, and operates in cooperation with the other terminal devices. And the cooperative processing data corresponding to the own device is acquired from the data generation device. The execution unit 617 performs processing to operate in cooperation with other terminal devices by executing cooperative processing data corresponding to the own device.

  Note that all or part of the first acquisition unit 611, the transmission unit 613, the second acquisition unit 615, and the execution unit 617 included in the control unit 610 may be configured by hardware.

  FIG. 76 is a control as another example in the first embodiment, the first to fourth modifications of the first embodiment, the second embodiment, and the second embodiment. 3 is a functional block diagram of a unit 510 and a control unit 610. FIG. Referring to FIG. 76, control unit 510 includes a first execution unit 511A and a transmission unit 515A.

  The first execution unit 511 </ b> A is data for operating in cooperation with the video display device 600, and executes processing based on first cooperation processing data corresponding to the communication terminal device 500. The transmission unit 515A transmits service data based on the processing executed by the first execution unit 511A to the video display device 600.

  Note that all or part of the first execution unit 511A and the transmission unit 515A included in the control unit 510 may be configured by hardware.

  Control unit 610 includes a reception unit 611A, an acquisition unit 613A, and a second execution unit 615A.

  The receiving unit 611A receives the service data transmitted by the transmitting unit 515A. The acquisition unit 613A is data corresponding to the received service data, and is data for operating in cooperation with the communication terminal device 500. The acquisition unit 613A receives second cooperative processing data corresponding to the video display device 600 from the outside. get. The second execution unit 615A executes a process based on the second cooperation process data.

  Note that all or part of the reception unit 611A, the acquisition unit 613A, and the second execution unit 615A included in the control unit 610 may be configured by hardware.

  FIG. 77 is a functional block diagram of the control unit 810 according to the third embodiment. Referring to FIG. 77, control unit 810 includes an acquisition unit 811A, a generation unit 813A, and a transmission unit 815A.

  When the first terminal device and the second terminal device cannot communicate with each other, the acquiring unit 811A acquires device information of the second terminal device and device information of the third terminal device. The generation unit 813A is data for the second terminal device and the third terminal device to operate in cooperation with each other on the basis of the device information of the second terminal device and the device information of the third terminal device. First cooperation processing data and second cooperation processing data corresponding to the terminal device and the third terminal device are generated. The transmission unit 815A transmits the first cooperation processing data and the second cooperation processing data to the second terminal device and the third terminal device, respectively.

  Note that all or part of the acquisition unit 811A, the generation unit 813A, and the transmission unit 815A included in the control unit 810 may be configured by hardware.

  The embodiment disclosed this time should be considered as illustrative in all points and not restrictive. The scope of the present invention is defined by the terms of the claims, rather than the description above, and is intended to include any modifications within the scope and meaning equivalent to the terms of the claims.

It is a figure which shows the structure of the network system in this Embodiment. It is the figure which showed the external appearance of the communication terminal device from the front. It is the figure which showed the external appearance of the communication terminal device from the back surface. It is the block diagram which showed the internal structure of the communication terminal device. It is the block diagram which showed the internal structure of the video display apparatus. It is the block diagram which showed the internal structure of the service server. It is a figure which shows the remote control image as an example. It is a flowchart of the operation determination process M and the control signal corresponding process T. It is a figure which shows the function information table as an example. It is a figure which shows the function information table as an example. 4 is a flowchart of a function information registration process M, a function information registration process T, and a function information registration process S. It is a figure which shows the detection apparatus image as an example. It is a figure which shows the related apparatus specific table as an example. It is a figure which shows the related apparatus function information table as an example. It is a figure which shows the registration content list image as an example. It is a figure which shows the structure of the original scenario as an example. It is a figure which shows the scenario production | generation table as an example. It is a flowchart of a UI content generation process. It is a flowchart of the service scenario generation process S. It is a figure which shows the determination table as an example. It is a figure which shows the service scenario as an example. It is a figure which shows an example of the description of the script of the service scenario performed by the video display apparatus. It is a figure which shows an example of the description of the script of the service scenario performed by the communication terminal device. It is a flowchart of scenario execution process T and scenario execution process M. It is a figure which shows the list image as an example. It is a figure which shows the TV control image as an example. It is a figure which shows the service data as an example. It is a figure which shows the detailed information display image as an example. It is a figure which shows the service data as an example. It is a figure which shows the purchase image as an example. It is a figure which shows the service data as an example. It is a figure which shows the reproduction | regeneration control image as an example. It is a figure which shows the service data as an example. It is a figure which shows the privilege display image as an example. It is a figure which shows the service data as an example. It is a figure which shows the coupon display image as an example. It is a figure which shows the waiting image as an example. It is a figure which shows the detailed information display image as an example. It is a figure which shows the service data as an example. It is a figure which shows the waiting image as an example. It is a figure which shows the registration content list image as an example. It is a figure which shows the structure of the original scenario as an example. It is a figure which shows the scenario production | generation table as an example. It is a figure which shows the determination table as an example. It is a figure which shows the service scenario as an example. It is a figure which shows an example of the transition of the image used by execution of two different service scenarios. 10 is a flowchart of a function information registration process MA, a function information registration process TA, and a function information registration process SA in Modification 1 of the first embodiment. It is a flowchart of UI content production | generation process N in the modification 1 of 1st Embodiment. 10 is a flowchart of a function information registration process MB, a function information registration process T, and a function information registration process SB in Modification 2 of the first embodiment. 15 is a flowchart of a function information registration process MC, a function information registration process TC, and a function information registration process SC in Modification 3 of the first embodiment. It is a flowchart of the function information registration process MD and the function information registration process TA in the modification 4 of 1st Embodiment. It is a figure which shows the structure of the original scenario as an example. It is a figure which shows the scenario production | generation table as an example. It is a flowchart of UI content generation processing A. It is a flowchart of service scenario generation processing SA. It is a figure which shows the determination table as an example. It is a figure which shows the service scenario as an example. It is a figure which shows the service scenario as an example. It is a figure which shows an example of the description of the script of the service scenario performed by the video display apparatus. It is a figure which shows an example of the description of the script of the service scenario performed by the communication terminal device. It is a flowchart of scenario execution process TA and scenario execution process MA. It is a figure which shows the list image as an example. It is a figure which shows the service data as an example. It is a figure which shows the selection operation image as an example. It is a figure which shows the related information display image as an example. It is a figure which shows the service data as an example. It is a figure which shows the related information display image as an example. It is a figure which shows the service data as an example. It is a flowchart of UI content generation processing B. It is a flowchart of scenario execution process TB and scenario execution process MB. It is a figure which shows the function information table as an example. 10 is a flowchart of an alternative device execution process M. It is a figure which shows the related apparatus function information table as an example. It is a functional block diagram of a control part in the 1st embodiment, the modifications 1-4 of the 1st embodiment, the 2nd embodiment, and the modification of the 2nd embodiment. The functional block diagram of two different control parts in the first embodiment, the first to fourth modifications of the first embodiment, the second embodiment, and the second embodiment. is there. Two different control units as other examples in the first embodiment, the first to fourth modified examples of the first embodiment, the second embodiment, and the modified example of the second embodiment It is a functional block diagram. It is a functional block diagram of the control part in 3rd Embodiment.

Explanation of symbols

  50 communication unit, 70 network, 180, 180A, 180B program, 300 remote control, 500 communication terminal device, 510, 610, 810 control unit, 520, 620, 820 storage unit, 530, 630 display unit, 540 input unit, 555 555A recording medium, 600 video display device, 800A service server, 800S search server, 800W Web server, 1000 network system.

Claims (6)

A communication terminal device capable of data communication with a video display device and a data generation device, and for controlling the video display device,
Storage means for storing device information of the communication terminal device;
First acquisition means for acquiring device information of the video display device from the video display device;
First transmission means for transmitting device information of the communication terminal device and device information of the video display device to the data generation device;
Data generated by the data generation device based on device information of the communication terminal device and device information of the video display device, and data for operating in cooperation with the video display device. Second acquisition means for acquiring first cooperation processing data corresponding to the communication terminal device for controlling the video display device from the data generation device;
Execution means for executing processing based on the first cooperation processing data;
A communication terminal device comprising: second transmission means for transmitting service data based on processing executed by the execution means to the video display device.   The communication terminal device according to claim 1, wherein the execution unit performs processing for operating in cooperation with the video display device according to the acquisition of the first cooperation processing data.   The second acquisition unit acquires information for operating in cooperation with the video display device from the video display device in response to the execution unit executing the first cooperation processing data. Item 4. The communication terminal device according to Item 1. The transmission unit transmits information for the video display device to operate in cooperation with a communication terminal device to the video display device in response to the execution unit executing the first cooperation processing data. The communication terminal device according to claim 1. The device information of the communication terminal device includes information on the function of the communication terminal device,
The communication terminal device according to claim 1, wherein the device information of the video display device includes information on a function of the video display device. A cooperative processing method executed by a communication terminal device capable of data communication with a video display device and a data generation device and controlling the video display device,
Obtaining device information of the video display device from the video display device;
Transmitting the device information of the communication terminal device and the device information of the video display device to the data generation device;
Data generated by the data generation device based on device information of the communication terminal device and device information of the video display device, and data for operating in cooperation with the video display device. Acquiring from the data generation device first cooperation processing data corresponding to the communication terminal device for controlling the video display device;
Executing a process based on the first cooperation process data;
And a step of transmitting service data based on processing executed by the execution means to the video display device.

Images