JP5388114B2 - Information communication system, communication apparatus, communication program, and communication method - Google Patents

Description

  The present invention relates to an information communication system, a communication apparatus, a communication program, and a communication method capable of purchasing a product using a network.

  An Internet service using a personal computer (PC) is known. In recent years, television devices that can use Internet services have also become widespread. An increasing number of users purchase products using such television devices.

  Also, mobile phones and personal computers having a biometric authentication function such as a fingerprint authentication function are known so as not to be misused by others or to browse information without permission. By installing a user authentication function and a billing / settlement function using electronic money as described above on a mobile phone or a personal computer, the user can easily and safely purchase a product.

  Generally, when purchasing a product using the Internet, a user needs to input a user ID, a password, or the like to a device used as user authentication at the time of purchase.

  For example, Japanese Patent Laid-Open No. 2002-232866 (Patent Document 1) discloses a product purchase order system and a billing method. According to Japanese Patent Laid-Open No. 2002-232866 (Patent Document 1), a broadcasting station converts product information of commodities that can be purchased in a video signal into a data signal and sends it to a viewer in synchronization with the video signal and the audio signal. . The receiving terminal converts the received data signal into product information and displays it in synchronization with the video signal. The viewer operates the remote controller to perform two-way communication with a mobile phone having a browse function connected to browse desired product information and purchase requests. The information center receives product information browsing and purchase requests from viewers, and transmits detailed product information to viewers and purchase requests to product information providers.

JP 2002-232866 A

  However, it is assumed that various new functions will be added to mobile phones and the like, and when functions and services are realized by a fixed system, flexibility becomes poor. For example, even when a user owns a mobile phone having a biometric authentication function as a new function, when the user purchases a product using another device such as a television, the mobile phone has a convenient The biometric authentication function cannot be used.

  Further, not only the biometric authentication function but also different functions installed in each connected mobile phone cannot be flexibly used.

  The present invention has been made in order to solve such a problem, and its purpose is in the case where a user holds a second communication device such as a mobile phone having a function for acquiring identification information. Provided is an information communication system, a communication device, a communication program, and a communication method that can use the functions of the second communication device when purchasing a product using the first communication device such as a television. It is to be.

  According to an aspect of the present invention, an information communication system including first and second communication devices is provided. The first communication device includes a first communication interface for communicating with a device external to the first communication device, a first display for displaying information on at least one product, and a first communication interface. By using a search means for searching for a second communication device that can communicate with itself and that can acquire identification information, and when a product is selected, the first communication interface is used. The first communication control means for transmitting the first information related to the selected product to the second communication device capable of communication. The second communication device obtains identification information by itself by using the second communication interface for communicating with a device outside the second communication device and the second communication interface. Second communication control means for notifying that it is possible, and acquisition means for acquiring identification information in accordance with the first information from the first communication device.

Preferably, the identification information specifies a user of the second communication device.
Preferably, the first information includes information regarding the selected product. The second communication device further includes a second display that displays information related to the selected product based on the first information from the first communication device.

  Preferably, the second display includes a touch panel for displaying information related to the product acquired from the first communication device and detecting a touch operation. The acquisition unit acquires the fingerprint as identification information by detecting a touch operation via the touch panel.

  Preferably, the first communication device further includes a receiving unit for sequentially receiving a product selection command. The first communication control means transmits first information corresponding to the selection command to the second communication device. The touch panel displays at least one selected product in a selectable manner based on the first information. The acquisition means receives a purchase command for the product and acquires a fingerprint by detecting a touch operation on the product via the touch panel.

  Preferably, the second display includes information about the product and a touch panel for detecting a touch operation. The acquisition unit acquires a signature as identification information by detecting a series of touch operations via the touch panel.

  Preferably, the first information indicates at least one of a name of the product, an image related to the product, a price of the product, and a device that can use the product.

  Preferably, the second communication device further includes an authentication unit for performing user authentication based on the identification information.

  Preferably, the information communication system further includes a first server. The second communication device further includes a third communication interface for communicating with a device external to the second communication device. The second communication control means transmits the authentication result to the first server by using the third communication interface. The first server includes billing means for performing billing processing relating to a product selected based on the authentication result from the second communication device.

  Preferably, the information communication system further includes a first server. The second communication control means transmits the authentication result to the first communication device by using the second communication interface. The first communication device further includes a fourth communication interface for communicating with a device external to the first communication device. The first communication control means transmits the authentication result to the first server by using the fourth communication interface. The first server includes a billing unit for performing a billing process on the product selected based on the authentication result from the first communication device.

  Preferably, the information communication system further includes a first server. The second communication control means transmits the identification information to the first communication device by using the second communication interface. The first communication device further includes authentication means for performing user authentication based on the identification information, and a fourth communication interface for communicating with a device external to the first communication device. The first communication control means transmits the authentication result to the first server by using the fourth communication interface. The first server includes a billing unit for performing a billing process on the product selected based on the authentication result from the first communication device.

  Preferably, the information communication system further includes a first server. The second communication control means transmits the identification information to the first communication device by using the second communication interface. The first communication device further includes a fourth communication interface for communicating with a device external to the first communication device. The first communication control means transmits the identification information to the first server by using the fourth communication interface. The first server includes an authentication unit for performing user authentication based on the identification information, and a charging unit for performing a charging process for the product selected based on the authentication result.

  Preferably, the product is content data. Content data refers to digital data such as video, audio, and images, related information related to them, electronic coupons, and the like. The information communication system includes a second server that stores at least one piece of content data in association with the second information. The first communication device further includes a fourth communication interface for communicating with a device external to the first communication device. The first communication control means receives at least one second information from the second server by using the fourth communication interface. The first display displays at least one product in a selectable manner based on at least one second information. The first communication control means transmits the first information to the second communication device based on the second information corresponding to the selected product.

  Preferably, the first communication control means receives the corresponding content data from the second server when the accounting process in the first server is completed.

  Preferably, the product is content data. The first server stores at least one content data in association with the second information. The first communication control means receives at least one second information from the first server. The first display displays at least one product in a selectable manner based on at least one second information. The first communication control means transmits the first information to the second communication device based on the second information corresponding to the selected product.

  Preferably, the first communication control means receives the corresponding content data from the first server when the accounting process in the first server is completed.

  According to another aspect of the present invention, a communication interface for communicating with an external device, a display for displaying information of at least one product, and a communication interface are used to communicate with itself. Search means for searching for another communication device capable of acquiring identification information, and when a product is selected, the communication interface is used to make the communication device another communication device capable of communicating with the selected product. And a communication control means for transmitting one piece of information.

  According to another aspect of the present invention, a communication interface for communicating with an external device and a communication control for notifying other communication devices that they can acquire identification information by using the communication interface. Means, a display for displaying information relating to the product based on the first information from the other communication device, and an acquisition means for acquiring the identification information according to the first information from the other communication device. A communication device is provided.

  When another situation of this invention is followed, the communication program for making a communication apparatus provided with a communication interface, a display, and an arithmetic processing part communicate is provided. The communication program causes the arithmetic processing unit to display information of at least one product on the display, and another communication device that can communicate with itself and obtain identification information by using the communication interface. And a step of transmitting first information about the selected product to another communication device capable of communication by using the communication interface when the product is selected.

  When another situation of this invention is followed, the communication program for making a communication apparatus provided with a communication interface, a display, and an arithmetic processing part communicate is provided. The communication program uses a communication interface to notify the arithmetic processing unit that other communication devices can acquire the identification information, and displays the first information from the other communication devices on the display. Based on the above, a step of displaying information on the product and a step of acquiring identification information according to the first information from another communication device are executed.

  When another situation of this invention is followed, the communication method in an information communication system is provided. The communication method includes a step of preparing a first communication device including a first communication interface and a first display, a second communication interface, communication with the first communication device, and identification information. Preparing a second communication device capable of acquiring the second communication device, and using the second communication interface by the second communication device, so that the first communication device can acquire identification information by itself. The step of notifying, the first communication device displaying information of at least one product on the first display, and the first communication device using the first communication interface, A step of searching for a communication device; and a second communication capable of communicating with the first communication device by using the first communication interface when a product is selected. Transmitting the first information related to the selected product to the communication device; and the second communication device acquiring identification information according to the first information from the first communication device. .

  As described above, according to the present invention, when a user holds a second communication device such as a mobile phone having a function for acquiring identification information, the first communication device such as a television is used. Thus, an information communication system, a communication device, a communication program, and a communication method are provided that can use the functions of the second communication device when purchasing a product.

1 is an image diagram showing an overall configuration of an information communication system according to Embodiment 1. FIG. 1 is a block diagram illustrating configurations of a mobile phone and a liquid crystal television according to Embodiment 1. FIG. It is a block diagram showing the hardware constitutions of the touchscreen which concerns on this Embodiment. It is the figure which showed the structure of the display panel, and the peripheral circuit of the said display panel. It is sectional drawing of a display panel and a backlight. It is the figure which showed the timing chart at the time of operating an optical sensor circuit. It is sectional drawing which showed the structure which a photodiode receives the light from a backlight in the case of a scan. It is the figure which showed schematic structure of the sensing command. It is the figure which showed the value of the data in each area | region of a sensing command, and the meaning content which the said value shows. It is the figure which showed schematic structure of the response data. It is the figure which showed the image obtained by scanning a finger | toe. It is an image figure which shows the data structure of the registration terminal list which a memory | storage part memorize | stores. 2 is a block diagram showing a configuration of a billing server according to Embodiment 1. FIG. It is a block diagram which shows the structure of a content server. It is an image figure which shows the data structure of the user registration database which a memory | storage part memorize | stores. It is a 1st image figure which shows a screen transition when a user inputs authentication information to a mobile phone. It is a 2nd image figure which shows a screen transition when a user inputs authentication information to a mobile telephone. It is a sequence diagram which shows the process sequence of the user registration process in an information communication system. It is an image figure which shows the screen transition of the liquid crystal television in a user registration process. It is a sequence diagram which shows the process sequence of the terminal selection process in an information communication system. It is an image figure which shows the screen transition of the liquid crystal television in a terminal selection process, and a mobile telephone. It is an image figure which shows the screen transition of a liquid crystal television when there is no mobile telephone which can communicate with a liquid crystal television. It is an image figure which shows the data structure of the data transmitted to a mobile telephone from the liquid crystal television in a terminal selection process. It is a sequence which shows the process sequence of the authentication / purchase process in an information communication system. It is an image figure which shows the screen transition of a liquid crystal television and a mobile telephone in authentication and purchase processing. It is a sequence which shows the modification of the process sequence of the terminal selection process in an information communication system. It is a 1st image figure which shows the screen transition of the liquid crystal television in a modification of a terminal selection process, and a mobile telephone. It is a 2nd image figure which shows the screen transition of the liquid crystal television in a modification of a terminal selection process, and a mobile telephone. It is an image figure which shows the data structure of the display control data of a mobile telephone in a terminal selection process. It is an image figure which shows the relationship between the touchscreen and the display area of each button in a terminal selection process. It is an image figure which shows the screen transition of the liquid crystal television in a 1st modification of the authentication and purchase processing in an information communication system, and a mobile telephone. It is an image figure which shows the screen transition of the mobile telephone in the 2nd modification of the authentication and purchase processing in an information communication system. 5 is an image diagram showing an overall configuration of an information communication system according to Embodiment 2. FIG. FIG. 9 is an image diagram showing an overall configuration of an information communication system according to a third embodiment. 10 is a block diagram illustrating configurations of a mobile phone and a liquid crystal television according to Embodiment 3. FIG. FIG. 10 is an image diagram showing an overall configuration of an information communication system according to a fourth embodiment. FIG. 10 is a block diagram illustrating configurations of a mobile phone and a liquid crystal television according to a fourth embodiment. FIG. 10 is a block diagram illustrating a configuration of a billing server according to a fourth embodiment.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings. In the following description, the same parts are denoted by the same reference numerals. Their names and functions are also the same. Therefore, detailed description thereof will not be repeated.

  The products handled in the present invention are intended to be digital data such as video, audio, and images, related information related to them, and other products that are actually delivered. Further, when the product is digital data provided via a network such as a television broadcast, an Internet broadcast, or a mobile phone network, one product can be provided from a plurality of servers or networks.

[Embodiment 1]
<Overall Configuration of Information Communication System 1>
First, the overall configuration of the information communication system 1 according to the present embodiment will be described with reference to FIG. FIG. 1 is an image diagram showing an overall configuration of an information communication system 1 according to the present embodiment.

  The information communication system 1 according to the present embodiment includes a liquid crystal television (first communication device) 600, a remote controller 300, a mobile phone 500 (second communication device), and a billing server 700 (first server). And a content server 800 (second server). The billing server 700 and the content server 800 may be configured by the same service (server).

  The liquid crystal television 600 displays an image such as a web page. The liquid crystal television 600 may be another device having a display such as a plasma television, for example. Further, the liquid crystal television 600 may be a device that includes a display device for displaying an image and an image data transmission device that transmits image data for display on the display device. Examples of the image data transmitting apparatus include an STB (Set Top Box), HDD recorder, DVD (Digital Versatile Disc) recorder, BD (Blu-ray Disc) recorder, and the like.

  The liquid crystal television 600 can be connected to the content server 800 via the network 80. The liquid crystal television 600 downloads Web page data from the content server 800 or downloads digital data as a product.

  The cellular phone 500 can perform data communication with a telephone network by radio. The telephone network is, for example, a telephone network for mobile phones. The mobile phone 500 may be an information communication terminal that can be carried by the user, such as a PDA (Personal Digital Assistance), a notebook personal computer, an electronic dictionary, and a smartphone.

  Mobile phone 500 performs data communication with billing server 700 via network 70. The mobile phone 500 performs user authentication and transmits the authentication result to the accounting server 700.

  The remote controller 300 performs data communication with the liquid crystal television 600. The remote controller 300 uses, for example, infrared rays to transmit a channel switching command, a product selection command, or a communication terminal selection command to the liquid crystal television 600.

  Mobile phone 500 and liquid crystal television 600 perform data communication wirelessly or by wire. That is, the mobile phone 500, the liquid crystal television 600, and the remote controller 300 constitute a video display system.

  The content server 800 is a server that provides the content itself, information related to the content, and the like to the liquid crystal television 600 via the network 80. The content is, for example, still image data, moving image data, music data, or the like. When the content is, for example, moving image data of a program, the information related to the content is, for example, program information, the price of the content, the data amount of the content, and the like. The content server 800 may be a workstation or a personal computer.

  In addition, the content server 800 stores Web page information for selling content and other products. In response to a request from the liquid crystal television 600 and the like, the content server 800 transmits data for indicating a Web page of a product sales site desired by the user of the liquid crystal television 600 to the liquid crystal television 600 via the network 80.

  Billing server 700 performs billing processing with cellular phone 500 via network 70. For example, the billing server 700 receives the user authentication result, information for identifying the product, the price of the product, etc. from the mobile phone 500, and withdraws an amount corresponding to the price of the product using the user's credit card number. To do. In addition to payment by credit card, for example, billing / settlement for a call charge by a mobile phone carrier or payment by an electronic money function installed in a mobile phone may be used. Moreover, any form of advance payment and postpay may be sufficient.

<Outline of operation of information communication system 1>
Next, with reference to FIG. 1, the operation | movement outline | summary of the information communication system 1 which concerns on this Embodiment is demonstrated. Hereinafter, a case where the user purchases the product (digital data) by browsing the product using the liquid crystal television 600 and performing user authentication using the mobile phone 500 will be described.

  First, an outline of the operation at the setting stage will be described. As step (1), the mobile phone 500 stores authentication information for authenticating the user. The mobile phone 500 registers a fingerprint image or a signature image of the user (for example, the owner) of the mobile phone 500 as authentication information. Information extracted from the fingerprint or signature image itself may be used instead.

  As step (2), the mobile phone 500 registers itself in the liquid crystal television 600. At this time, the mobile phone 500 and the liquid crystal television 600 are paired using Bluetooth (registered trademark). The liquid crystal television 600 registers the mobile phone 500 as a Bluetooth (registered trademark) partner. That is, the liquid crystal television 600 registers the mobile phone 500 as a user by storing information for identifying the mobile phone 500.

  As step (3), the liquid crystal television 600 registers the mobile phone 500 as a user service provided by the content server 800 via the network 80. The content server 800 registers the mobile phone 500 in the service by storing information for identifying the mobile phone 500 in association with the service. This is the setting stage.

  Next, an outline of the operation at the terminal selection stage will be described. In step (4), the user selects a product using the remote controller 300 while browsing the Web page using the liquid crystal television 600. More specifically, the liquid crystal television 600 displays a web page from the content server 800 to the user. The Web page includes information related to the product to be presented (product name, product image, product price, purchase conditions, etc.).

  When the user selects a desired product using the remote controller 300, the liquid crystal television 600 searches for a mobile phone 500 that can communicate with itself and can acquire identification information and perform user authentication. The mobile phone 500 capable of acquiring identification information and user authentication responds to the liquid crystal television 600 that it can acquire identification information and perform user authentication. The liquid crystal television 600 receives the response message from the mobile phone 500 and transmits the identification information and selection command of the mobile phone 500 detected (searched) via the network 80 to the content server 800.

  As a step (5), the content server 800 transmits to the liquid crystal television 600 identification information related to the mobile phone 500 that has already been registered in the above setting stage among the mobile phones 500 that can communicate.

  As step (6), the liquid crystal television 600 transmits information (first information) on the selected product and an authentication command to the mobile phone 500. More specifically, in the present embodiment, liquid crystal television 600 accepts a command for selecting mobile phone 500 for authentication from the user via remote controller 300 or the like. That is, the liquid crystal television 600 receives information (first information) on the selected product and an authentication command for the mobile phone 500 selected by the user among the mobile phones 500 that received the identification information from the content server 800. Send. Liquid crystal television 600 may transmit the first information to mobile phone 500 as an authentication command.

  Next, an outline of the operation at the authentication / purchase stage will be described. In step (7), the mobile phone 500 performs user authentication. More specifically, for example, the mobile phone 500 receives the first information and receives a touch operation with a user's finger. The mobile phone 500 acquires a fingerprint image as identification information. In this case, the mobile phone 500 performs fingerprint authentication. Alternatively, the mobile phone 500 receives the first information and receives a touch operation with the stylus pen. The mobile phone 500 acquires a signature image as identification information. In this case, the mobile phone 500 performs signature authentication.

  Alternatively, the mobile phone 500 acquires identification information by reading the IC chip or magnetic tape of the card. In this case, user authentication is performed based on data stored in an IC chip or a magnetic tape.

  As step (8), the mobile phone 500 transmits the authentication result and the first information to the charging server 700 via the network 70. The accounting server 700 collects a charge from the user based on the authentication result and the first information. That is, billing server 700 performs billing processing (or settlement processing) corresponding to the selected product.

  As step (9), when the charging process is normally completed, the charging server 700 transmits a message indicating that the charging process is completed to the mobile phone 500 via the network 70. The exchange between the mobile phone 500 and the billing server 700 is not limited to this, and may take various forms depending on the billing / settlement method.

  As step (10), the mobile phone 500 transmits a message to the effect that the billing process has been completed to the liquid crystal television 600. The liquid crystal television 600 transmits a message indicating that the accounting process is completed to the content server 800 via the network 80.

  In step (11), the content server 800 receives a message indicating that the accounting process has been completed, and transmits the selected product (digital data) to the liquid crystal television 600 via the network 80. At this time, the content server 800 may confirm the completion of the charging process with the charging server 700 via a network (not shown). The liquid crystal television 600 transmits the product (digital data) to the mobile phone 500. Accordingly, the mobile phone 500 can display content based on the product (digital data).

  However, the liquid crystal television 600 may store the product (digital data) from the content server 800 in its own HDD or the like. In this case, the liquid crystal television 600 can display content based on the product (digital data) of the HDD.

  Further, the content server 800 may accept a message indicating that the accounting process has been completed and display the message to the administrator of the content server 800. The administrator may deliver the product to the user of the mobile phone 500 based on the message.

  Thus, in the information communication system 1 according to the present embodiment, since the liquid crystal television 600 transmits the first information to the mobile phone 500, the mobile phone 500 displays the first information or the first information. Based on the information, it becomes possible to perform the accounting process together with the accounting server 700. That is, in the information communication system 1 according to the present embodiment, the liquid crystal television 600 transmits the first information to the mobile phone 500, the mobile phone 500 displays the first information, and the mobile phone 500 displays the identification information. , The mobile phone 500 can perform authentication processing, and the mobile phone 500 can perform charging processing together with the charging server 700 based on the first information and the authentication result.

Hereinafter, a configuration for realizing such a function will be described in detail.
<Configuration of mobile phone 500>
First, with reference to FIG. 2, one mode of a specific configuration of the mobile phone 500 configuring the information communication system 1 will be described. FIG. 2 is a block diagram showing configurations of mobile phone 500 and liquid crystal television 600 according to the present embodiment. Note that FIG. 2 also shows a recording medium 555 for explanation. In the recording medium 555, a program 180A described later is recorded. That is, the program 180A is recorded on a medium or the like and distributed as a program product. The recording medium 555 itself is also distributed as a program product.

The mobile phone 500 includes a CPU 510, a temporary storage unit 522, and a storage unit 520.
The storage unit 520 has a function of storing data in a nonvolatile manner. The storage unit 520 is accessed by the CPU 510. The storage unit 520 is a medium (for example, a flash memory) that can hold data in a nonvolatile manner even when power is not supplied. The storage unit 520 stores a program 180A, authentication information 180B described later, a product table 180L, and other various data. The program 180A includes a remote controller program described later.

  CPU 510 has a function of performing various types of processing, arithmetic processing, and the like for each unit in mobile phone 500 in accordance with program 180A stored in storage unit 520. The CPU 510 may be any of a microprocessor, a field programmable gate array (FPGA), an application specific integrated circuit (ASIC), a digital signal processor (DSP), and other circuits having arithmetic functions.

  The temporary storage unit 522 is accessed as data by the CPU 510 and is used as a work memory for temporarily storing data. The temporary storage unit 522 includes a RAM (Random Access Memory), an SRAM (Static Random Access Memory), a DRAM (Dynamic Random Access Memory), an SDRAM (Synchronous DRAM), a DDR-SDRAM (Double Data Rate SDRAM), and an RDRAM (Rambus Dynamic Random). (Access Memory (registered trademark)), Direct-RDRAM (Direct Rambus Dynamic Random Access Memory (registered trademark)), or any other circuit having a configuration capable of storing and storing data in a volatile manner.

  Mobile phone 500 further includes a VDP 532, a VRAM (Video Random Access Memory) 536, and a touch panel 530.

The VRAM 536 has a function of temporarily storing image data.
CPU 510 issues a drawing instruction to VDP 532 in accordance with program 180A stored in storage unit 520. The drawing instruction is an instruction to generate an image and display the image on the touch panel 530.

  VDP 532 is connected to touch panel 530. In response to a drawing instruction from the CPU 510, the VDP 532 reads font data, graphic data, and the like from a program 180A described later in the storage unit 520, and generates an image using the VRAM 536. The VDP 532 reads out the image data stored in the VRAM 536 and causes the touch panel 530 to display an image based on the image data.

  Touch panel 530 according to the present embodiment reads user identification information. A detailed configuration of touch panel 530 according to the present embodiment will be described later.

Mobile phone 500 further includes an input unit 540 and a recording medium access unit 556.
CPU 510 receives, from input unit 540, a button signal corresponding to a button that has been subjected to a short press operation or a long press operation among a plurality of buttons included in input unit 540. CPU 510 performs processing according to the received button signal.

  The recording medium access unit 556 can access the recording medium 555 when the recording medium 555 is inserted (attached) to the mobile phone 500 from the above-described recording medium insertion unit. As a result, the recording medium access unit 556 can read the program 180A from the recording medium 555.

  The program 180A stored in the recording medium 555 is read by the recording medium access unit 556 by the installation process of the CPU 510, and the CPU 510 stores the program 180A in the storage unit 520. The installation processing program is stored in advance in the storage unit 520, and the installation processing is performed by the CPU 510 based on the installation processing program.

  Note that the storage unit 520 may not have the program 180A installed. In this case, CPU 510 reads program 180A stored in recording medium 555 via recording medium access unit 556, and performs predetermined processing based on program 180A. The recording medium 555 further records content data and the like. The content data is, for example, music data, moving image data, and the like.

  The recording medium 555 includes a floppy (registered trademark) disk, a CF (Compact Flash (registered trademark)) card, SM (Smart Media (registered trademark)), MMC (Multi Media Card (registered trademark)), and SD (Secure Digital (registered trademark)). (Trademark)) Memory Card, Memory Stick (Registered Trademark), xD Picture Card (Registered Trademark), and non-volatile memory other than the above. Further, it may be a magnetic memory such as a hard disk.

  Mobile phone 500 further includes a communication unit (communication interface) 560 and a communication unit (communication interface) 562.

  Communication unit 560 exchanges data with CPU 510. Communication unit 560 has a function of transmitting / receiving data to / from liquid crystal television 600 in a wired or wireless manner.

  The communication unit 560 has a function of a communication interface for performing serial transfer based on the USB (Universal Serial Bus) 1.1 or USB 2.0 standard. Note that the standard of the communication interface for performing serial transfer is not limited to USB 1.1 or USB 2.0, but may be another standard.

  Further, the communication unit 560 may have a function of a communication interface that performs parallel transfer. The communication interface that performs parallel transfer is, for example, an interface that conforms to a Centronics standard or an IEEE 1284 (Institute of Electrical and Electronic Engineers 1284) standard. Further, the communication unit 560 may have a communication interface function based on the IEEE 1394 or SCSI standard.

  Communication unit 560 further has a wireless data communication function. The wireless data communication function has a function of performing data communication wirelessly using Bluetooth (registered trademark). Note that the wireless data communication is not limited to a method using Bluetooth (registered trademark). For example, IEEE 802.11a, IEEE 802.11b, which is another communication method using infrared rays, or a wireless LAN standard, and the like. It may be a wireless technology based on any of IEEE802.11g. Communication unit 560 wirelessly performs data communication with liquid crystal television 600 in accordance with a control instruction from CPU 510.

  Communication unit 562 transmits / receives data to / from CPU 510. The communication unit 562 has a function of performing data communication using a wireless technology based on any one of IEEE802.11a, IEEE802.11b, and IEEE802.11g, which are wireless LAN standards. Note that the radio technology is not limited to a technology based on any of IEEE 802.11a, IEEE 802.11b, and IEEE 802.11g, and may be other radio technologies. Therefore, communication unit 562 can perform data communication with communication unit 50 wirelessly.

  The communication unit 562 further has a communication interface function using Ethernet (registered trademark). Therefore, the communication unit 562 can perform data communication with the communication unit 50 via, for example, a LAN cable.

  Therefore, mobile phone 500 in the present embodiment can also download a program from network 70 via communication unit 50 and communication unit 562 and store the program in storage unit 520. In this case, the downloaded program is the program 180A.

  CPU 510 performs predetermined processing in accordance with a program (program 180A) downloaded from network 70. This download program is stored in advance in storage unit 520, and download processing is performed by CPU 510 based on the download program. Note that the download of the program or the like may be performed by a communication unit 566 described later.

Mobile phone 500 further includes an antenna 564 and a communication unit 566.
The antenna 564 is connected to the communication unit 566. That is, both implement a communication interface. The communication unit 566 has a function of transmitting and receiving a wireless communication signal using the antenna 564. The communication unit 566 receives a wireless communication signal having a frequency designated by the CPU 510 via the antenna 564. The wireless communication signal is a signal including voice data, character data, image data, and the like.

  Communication unit 566 uses antenna 564 to communicate with the nearest base station (not shown) using a wireless communication signal. The nearest base station can communicate with the telephone network. Accordingly, the communication unit 566 uses the antenna 564 to communicate with the telephone network via the nearest base station using a wireless communication signal. When receiving the wireless communication signal, the communication unit 566 demodulates the wireless communication signal and transmits data based on the demodulated wireless communication signal to the CPU 510. Further, when transmitting a wireless communication signal, the communication unit 566 receives data (for example, audio data) from the CPU 510 and converts the data into a wireless communication signal based on a predetermined protocol. Communication unit 566 then uses antenna 564 to transmit the converted wireless communication signal to the telephone network via the nearest base station (not shown).

  The communication unit 566 can also acquire information indicating the position of the base station (hereinafter also referred to as base station position information) by communicating with the nearest base station. The communication unit 566 transmits the acquired base station position information to the CPU 510 in response to a control instruction from the CPU 510. CPU 510 can roughly grasp the position of mobile phone 500 based on the received base station position information.

  The communication unit 566 has a GPS (Global Positioning System) function. The GPS function is a function of acquiring information (hereinafter also referred to as GPS position information) of the position (position based on latitude, longitude, altitude, etc.) of the mobile phone 500 by communicating with the artificial satellite. The communication unit 566 acquires GPS position information in response to a control instruction from the CPU 510 and transmits it to the CPU 510.

CPU 510 performs data communication with audio output unit 570 and audio input unit 574.
When CPU 510 transmits audio data to audio output unit 570, audio output unit 570 outputs audio based on the audio data received from CPU 510 from the speaker.

  When the user utters voice to the microphone included in the voice input unit 574, the voice input unit 574 converts the voice acquired by the microphone into voice data, and transmits the voice data to the CPU 510.

  The CPU 510 performs data communication with the LED 576 and the imaging unit 578. The LED 576 emits light based on a control instruction from the CPU 510.

  The imaging unit 578 performs the above-described imaging process based on a control instruction from the CPU 510 and transmits the captured image data to the CPU 510. When the captured image data is received, the CPU 510 stores the captured image data in any of the temporary storage unit 522, the storage unit 520, and the recording medium 555.

  The mobile phone 500 further includes a vibration unit 579. The vibration unit 579 has a function of vibrating the mobile phone 500 based on a control instruction from the CPU 510. The vibration unit 579 vibrates the mobile phone 500 based on a control instruction from the CPU 510 when, for example, an incoming call or an e-mail is received.

  Mobile phone 500 further includes RFID 577. The RFID 577 is an integrated circuit based on RFID (Radio Frequency Identification) such as FeliCa (registered trademark) and communicates with a reading terminal (not shown) in a non-contact manner. The RFID 577 outputs data such as a terminal ID based on a control instruction from the CPU 510.

(Hardware configuration of touch panel 530)
Next, with reference to FIG. 3, an aspect of a specific configuration of touch panel 530 according to the present embodiment will be described. FIG. 3 is a block diagram showing a hardware configuration of touch panel 530 according to the present embodiment.

  The touch panel 530 includes a driver 130, an optical sensor built-in liquid crystal panel 140 (hereinafter also referred to as a liquid crystal panel 140), an internal IF 178, a backlight 179, and an image processing engine 180.

  The driver 130 is a drive circuit for driving the liquid crystal panel 140 and the backlight 179. Various drive circuits included in the driver 130 will be described later.

  The liquid crystal panel 140 is a device having a liquid crystal display function and a photosensor function. That is, the liquid crystal panel 140 can perform image display using liquid crystal and sensing using an optical sensor. Details of the liquid crystal panel 140 will be described later.

  An internal IF (Interface) 178 mediates data exchange between the VDP 536 and the CPU 510 and the touch panel 530.

  The backlight 179 is a light source disposed on the back surface of the liquid crystal panel 140. The backlight 179 irradiates the back surface with uniform light.

  The image processing engine 180 controls the operation of the liquid crystal panel 140 via the driver 130. Here, the control is performed based on various data sent from the CPU 510 and the VDP 532 via the internal IF 178. Note that the various data includes commands to be described later. The image processing engine 180 processes the data output from the liquid crystal panel 140 and sends the processed data to the CPU 510 via the internal IF 178. Further, the image processing engine 180 includes a driver control unit 181, a timer 182, and a signal processing unit 183.

  The driver control unit 181 controls the operation of the driver 130 by sending a control signal to the driver 130. In addition, the driver control unit 181 analyzes commands sent from the CPU 510 and the VDP 532. Then, the driver control unit 181 sends a control signal based on the analysis result to the driver 130. Details of the operation of the driver 130 will be described later.

The timer 182 generates time information and sends the time information to the signal processing unit 183.
The signal processing unit 183 receives data output from the optical sensor. Here, since the data output from the optical sensor is analog data, the signal processing unit 183 first converts the analog data into digital data. Further, the signal processing unit 183 performs data processing on the digital data according to the contents of commands sent from the CPU 510 and the VDP 532. Then, the signal processing unit 183 sends data including the data after the above data processing and the time information acquired from the timer 182 (hereinafter referred to as response data) to the CPU 510. The signal processing unit 183 includes a RAM (not shown) that can store a plurality of scan data, which will be described later, continuously.

  The command includes a sensing command for instructing sensing by the optical sensor. Details of the sensing command and the response data will be described later (FIGS. 8 to 10).

  Note that the timer 182 is not necessarily provided in the image processing engine 180. For example, the timer 182 may be provided outside the image processing engine 180 in the touch panel 530. Alternatively, the timer 182 may be provided in the CPU 510.

  Here, the touch panel 530 is included in the system liquid crystal. The system liquid crystal is a device obtained by integrally forming peripheral devices of the liquid crystal panel 140 on the glass substrate of the liquid crystal panel 140. In the present embodiment, the driver 130 (excluding the circuit that drives the backlight 179), the internal IF 178, and the image processing engine 180 are integrally formed on the glass substrate of the liquid crystal panel 140. Note that the touch panel 530 is not necessarily configured using the system liquid crystal, and the driver 130 (excluding a circuit that drives the backlight 179), the internal IF 178, and the image processing engine 180 are other than the glass substrate. It may be configured on the substrate.

(Configuration and drive of liquid crystal panel 140)
Next, the configuration of the liquid crystal panel 140 and the configuration of peripheral circuits of the liquid crystal panel 140 will be described. FIG. 4 is a diagram showing a configuration of the liquid crystal panel 140 and peripheral circuits of the liquid crystal panel 140.

  Referring to FIG. 4, the liquid crystal panel 140 includes a pixel circuit 141, an optical sensor circuit 144, a scanning signal line Gi, a data signal line SRj, a data signal line SGj, a data signal line SBj, and a sensor signal line. SSj, sensor signal line SDj, read signal line RWi, and reset signal line RSi are included. Note that i is a natural number satisfying 1 ≦ i ≦ m, and j is a natural number satisfying 1 ≦ j ≦ n.

  3 includes a scanning signal line driving circuit 131, a data signal line driving circuit 132, an optical sensor driving circuit 133, a switch 134, and an amplifier as peripheral circuits of the liquid crystal panel 140. 135.

  The scanning signal line drive circuit 131 receives the control signal TC1 from the driver control unit 181 shown in FIG. The scanning signal line drive circuit 131 applies a predetermined voltage in order from the scanning signal line G1 to each scanning signal line (G1 to Gm) based on the control signal TC1. More specifically, the scanning signal line driving circuit 131 sequentially selects one scanning signal line from the scanning signal lines (G1 to Gm) per unit time, and a TFT (to be described later) with respect to the selected scanning signal line. A voltage capable of turning on the gate of the thin film transistor 142 is applied (hereinafter referred to as a high level voltage). Note that a low level voltage is applied to a scanning signal line that is not selected without applying a high level voltage.

  The data signal line driving circuit 132 receives image data (DR, DG, DB) from the driver control unit 181 shown in FIG. The data signal line driving circuit 132 applies a voltage corresponding to one row of image data to the 3n data signal lines (SR1 to SRn, SG1 to SGn, SB1 to SBn) for each unit time. Apply sequentially.

  Note that although a driving method called a so-called line-sequential method has been described here, the driving method is not limited to this.

  The pixel circuit 141 is a circuit for setting the luminance (transmittance) of one pixel. Further, m × n pixel circuits 141 are arranged in a matrix. More specifically, m pixel circuits 141 are arranged in the vertical direction in FIG. 4 and n in the horizontal direction.

  The pixel circuit 141 includes an R subpixel circuit 141r, a G subpixel circuit 141g, and a B subpixel circuit 141b. Each of these three circuits (141r, 141g, 141b) includes a TFT 142, a pair of electrode pairs 143 including a pixel electrode and a counter electrode, and a capacitor (not shown).

  In addition, CMOS (Complementary Metal Oxide Semiconductor) capable of forming n-type transistors and p-type transistors can be realized, and the movement speed of carriers (electrons or holes) is several hundreds compared to amorphous silicon thin film transistors (a-Si TFTs). Due to the fact that it is twice as fast, the touch panel 530 uses a polycrystalline silicon thin film transistor (p-Si TFT) as the TFT 142. Note that the TFT 142 will be described as an n-channel field effect transistor. However, the TFT 142 may be a p-type channel field effect transistor.

  The source of the TFT 142 in the R subpixel circuit 141r is connected to the data signal line SRj. The gate of the TFT 142 is connected to the scanning signal line Gi. Further, the drain of the TFT 142 is connected to the pixel electrode of the electrode pair 143. A liquid crystal is disposed between the pixel electrode and the counter electrode. The G sub-pixel circuit 141g and the B sub-pixel circuit 141b have the same configuration as the R sub-pixel circuit 141r except that the data signal line to which the source of each TFT 142 is connected is different. Therefore, description of these two circuits (141g, 141b) will not be repeated.

  Here, setting of luminance in the pixel circuit 141 will be described. First, the high level voltage is applied to the scanning signal line Gi. By the application of the high level voltage, the gate of the TFT 142 is turned on. In this manner, with the gate of the TFT 142 turned on, a specified voltage (voltage corresponding to image data for one pixel) is applied to each data signal line (SRj, SGj, SBj). Thereby, a voltage based on the designated voltage is applied to the pixel electrode. As a result, a potential difference is generated between the pixel electrode and the counter electrode. Based on this potential difference, the liquid crystal responds and the luminance of the pixel is set to a predetermined luminance. Note that the potential difference is held by the capacitor (auxiliary capacitor) (not shown) until the scanning signal line Gi is selected in the next frame period.

  The optical sensor drive circuit 133 receives the control signal TC2 from the driver control unit 181 shown in FIG.

  Then, the optical sensor drive circuit 133 sequentially selects one signal line from the reset signal lines (RS1 to RSm) for each unit time based on the control signal TC2, and determines in advance for the selected signal line. At a given timing, the voltage VDDR that is higher than usual is applied. Note that a voltage VSSR lower than the voltage applied to the selected reset signal line is kept applied to the unselected reset signal line. For example, the voltage VDDR may be set to 0V and the voltage VSSR may be set to −5V.

  Further, the optical sensor driving circuit 133 sequentially selects one signal line from the readout signal lines (RW1 to RWm) for each unit time based on the control signal TC2, and determines in advance for the selected signal line. At a given timing, a voltage VDD higher than usual is applied. Note that the voltage VSSR is applied to the read signal line that is not selected. For example, the value of VDD may be set to 8V.

  The timing for applying the voltage VDDR and the timing for applying the voltage VDD will be described later.

  The optical sensor circuit 144 includes a photodiode 145, a capacitor 146, and a TFT 147. In the following description, it is assumed that the TFT 147 is an n-type channel field effect transistor. However, the TFT 147 may be a p-type channel field effect transistor.

  The anode of the photodiode 145 is connected to the reset signal line RSi. On the other hand, the cathode of the photodiode 145 is connected to one electrode of the capacitor 146. The other electrode of the capacitor 146 is connected to the read signal line RWi. Hereinafter, a connection point between the photodiode 145 and the capacitor 146 is referred to as a node N.

  The gate of the TFT 147 is connected to the node N. The drain of the TFT 147 is connected to the sensor signal line SDj. Further, the source of the TFT 147 is connected to the sensor signal line SSj. Details of sensing using the optical sensor circuit 144 will be described later.

  The switch 134 is a switch provided to switch whether or not to apply a predetermined voltage to the sensor signal lines (SD1 to SDn). The switching operation of the switch 134 is performed by the optical sensor driving circuit 133. Note that the voltage applied to the sensor signal lines (SD1 to SDn) when the switch 134 is turned on will be described later.

  The amplifier 135 amplifies the voltage output from each sensor signal line (SS1 to SSn). The amplified voltage is sent to the signal processing unit 183 shown in FIG.

  The image processing engine 180 controls the timing for displaying an image on the liquid crystal panel 140 using the pixel circuit 141 and the timing for sensing using the optical sensor circuit 144.

  FIG. 5 is a cross-sectional view of the liquid crystal panel 140 and the backlight 179. Referring to FIG. 5, liquid crystal panel 140 includes an active matrix substrate 151A, a counter substrate 151B, and a liquid crystal layer 152. The counter substrate 151B is disposed to face the active matrix substrate 151A. The liquid crystal layer 152 is sandwiched between the active matrix substrate 151A and the counter substrate 151B. The backlight 179 is disposed on the opposite side of the liquid crystal layer 152 with respect to the active matrix substrate 151A.

  The active matrix substrate 151 </ b> A includes a polarizing filter 161, a glass substrate 162, a pixel electrode 143 a that constitutes the electrode pair 143, a photodiode 145, a data signal line 157, and an alignment film 164. Further, although not shown in FIG. 5, the active matrix substrate 151A includes the capacitor 146, the TFT 147, the TFT 142, and the scanning signal line Gi shown in FIG.

  In the active matrix substrate 151A, the polarizing filter 161, the glass substrate 162, the pixel electrode 143a, and the alignment film 164 are arranged in this order from the backlight 179 side. The photodiode 145 and the data signal line 157 are formed on the liquid crystal layer 152 side of the glass substrate 162.

  The counter substrate 151B includes a polarizing filter 161, a glass substrate 162, a light shielding film 163, color filters (153r, 153g, 153b), a counter electrode 143b constituting the electrode pair 143, and an alignment film 164.

  In the counter substrate 151B, the alignment film 164, the counter electrode 143b, the color filters (153r, 153g, 153b), the glass substrate 162, and the polarizing filter 161 are arranged in this order from the liquid crystal layer 152 side. The light shielding film 163 is formed in the same layer as the color filters (153r, 153g, 153b).

  The color filter 153r is a filter that transmits light having a red wavelength. The color filter 153g is a filter that transmits light having a green wavelength. The color filter 153b is a filter that transmits light having a blue wavelength. Here, the photodiode 145 is arranged at a position facing the color filter 153b.

  The liquid crystal panel 140 displays an image by blocking external light or light emitted from a light source such as a backlight 179 or transmitting the light. Specifically, the liquid crystal panel 140 changes the direction of liquid crystal molecules in the liquid crystal layer 152 by applying a voltage between the pixel electrode 143a and the counter electrode 143b, thereby blocking or transmitting the light. However, since the light cannot be completely blocked by the liquid crystal alone, a polarizing filter 161 that transmits only light having a specific polarization direction is provided.

  Note that the position of the photodiode 145 is not limited to the above position, and may be provided at a position facing the color filter 153r or a position facing the color filter 153g.

  Here, the operation of the optical sensor circuit 144 will be described. FIG. 6 is a diagram illustrating a timing chart when the optical sensor circuit 144 is operated. In FIG. 6, a voltage VINT indicates a potential at the node N in the photosensor circuit 144. A voltage VPIX is an output voltage from the sensor signal line SSj shown in FIG. 4 and is a voltage before being amplified by the amplifier 135.

  The following description will be divided into a reset period for resetting the optical sensor circuit 144, a sensing period for sensing light using the optical sensor circuit 144, and a readout period for reading the sensed result.

  First, the reset period will be described. In the reset period, the voltage applied to the reset signal line RSi is instantaneously switched from the low level (voltage VSSR) to the high level (voltage VDDR). On the other hand, the voltage applied to the read signal line RWi is kept at the low level (voltage VSSR). As described above, by applying the high-level voltage to the reset signal line RSi, a current starts to flow in the forward direction (from the anode side to the cathode side) of the photodiode 145. As a result, the voltage VINT which is the potential of the node N has a value represented by the following expression (1). In Equation (1), the forward voltage drop amount in the photodiode 145 is Vf.

VINT = VSSR + | VDDR−VSSR | −Vf (1)
Therefore, the potential of the node N is a value smaller by Vf than the voltage VDDR as shown in FIG.

  Here, since the voltage VINT is not more than the threshold value for turning on the gate of the TFT 147, there is no output from the sensor signal line SSj. For this reason, the voltage VPIX does not change. Further, a difference corresponding to the voltage VINT occurs between the electrodes of the capacitor 146. For this reason, the capacitor 146 accumulates charges corresponding to the difference.

  Next, the sensing period will be described. In the sensing period following the reset period, the voltage applied to the reset signal line RSi instantaneously switches from the high level (voltage VDDR) to the low level (voltage VSSR). On the other hand, the voltage applied to the read signal line RWi is kept at the low level (voltage VSSR).

  Thus, by changing the voltage applied to the reset signal line RSi to the low level, the potential of the node N becomes higher than the voltage of the reset signal line RSi and the voltage of the read signal line RWi. For this reason, in the photodiode 145, the voltage on the cathode side becomes higher than the voltage on the anode side. That is, the photodiode 145 is in a reverse bias state. In such a reverse bias state, when the photodiode 145 receives light from the light source, current starts to flow from the cathode side to the anode side of the photodiode 145. As a result, as shown in FIG. 6, the potential of the node N (that is, the voltage VINT) becomes lower with the passage of time.

  Since the voltage VINT continues to decrease in this way, the gate of the TFT 147 does not turn on. Therefore, there is no output from the sensor signal line SSj. For this reason, the voltage VPIX does not change.

  Next, the reading period will be described. In the readout period following the sensing period, the voltage applied to the reset signal line RSi is kept at the low level (voltage VSSR). On the other hand, the voltage applied to the read signal line RWi is instantaneously switched from the low level (voltage VSSR) to the high level (voltage VDD). Here, the voltage VDD is higher than the voltage VDDR.

  Thus, by applying a high level voltage instantaneously to the read signal line RWi, the potential of the node N is raised through the capacitor 146 as shown in FIG. Note that the increase width of the potential of the node N is a value corresponding to the voltage applied to the read signal line RWi. Here, since the potential of the node N (that is, the voltage VINT) is raised to a threshold value that turns on the gate of the TFT 147, the gate of the TFT 147 is turned on.

  At this time, if a constant voltage is applied in advance to the sensor signal line SDj (see FIG. 4) connected to the drain side of the TFT 147, the sensor signal line SSj connected to the source side of the TFT 147 will cause the VPIX in FIG. As shown in the graph, a voltage corresponding to the potential of the node N is output.

  Here, if the amount of light received by the photodiode 145 (hereinafter referred to as the amount of received light) is small, the slope of the straight line shown in the VINT graph of FIG. 6 becomes gentle. As a result, the voltage VPIX is higher than when the amount of received light is large. As described above, the optical sensor circuit 144 changes the value of the voltage output to the sensor signal line SSj in accordance with the amount of light received by the photodiode 145.

  By the way, in the above, the operation | movement was demonstrated paying attention to one optical sensor circuit 144 among the m * n optical sensor circuits which exist. Below, operation | movement of each photosensor circuit in the liquid crystal panel 140 is demonstrated.

  First, the optical sensor drive circuit 133 applies a predetermined voltage to all n sensor signal lines (SD1 to SDn). Next, the photosensor drive circuit 133 applies a voltage VDDR that is higher than normal to the reset signal line RS1. The other reset signal lines (RS2 to RSm) and read signal lines (RW1 to RWm) are kept in a state where a low level voltage is applied. As a result, the n photosensor circuits in the first row in FIG. 4 enter the reset period described above. Thereafter, the n photosensor circuits in the first row enter a sensing period. Further, thereafter, the n photosensor circuits in the first row enter a reading period.

  Note that the timing at which a predetermined voltage is applied to all n sensor signal lines (SD1 to SDn) is not limited to the above timing, and may be any timing that is applied at least before the readout period. .

  When the readout period of the n photosensor circuits in the first row is completed, the photosensor drive circuit 133 applies a voltage VDDR that is higher than usual to the reset signal line RS2. That is, the reset period of the n photosensor circuits in the second row starts. When the reset period ends, the n photosensor circuits in the second row enter a sensing period, and thereafter enter a reading period.

  Thereafter, the processing described above is sequentially performed on the n photosensor circuits in the third row, the n photosensor circuits in the fourth row,..., The n photosensor circuits in the m row. As a result, the sensing result of the first row, the sensing result of the second row,..., The sensing result of the m-th row are output in this order from the sensor signal lines (SS1 to SSn).

  In touch panel 530, sensing is performed for each row as described above, and a sensing result is output from liquid crystal panel 140 for each row. For this reason, hereinafter, the data after the signal processing unit 183 performs the above-described data processing on the data regarding the voltage for m rows from the first row to the m-th row output from the liquid crystal panel 140, This is called “scan data”. That is, scan data refers to image data obtained by scanning a scan target (for example, a user's finger). An image displayed based on the scan data is referred to as a “scanned image”. Further, in the following, sensing is referred to as “scan”.

  In the above description, the configuration in which scanning is performed using all the m × n photosensor circuits has been described as an example. However, the configuration is not limited thereto. Scanning may be performed on a partial region of the surface of the liquid crystal panel 140 using a photosensor circuit selected in advance.

  In the following, it is assumed that the mobile phone 500 can take either configuration. Further, switching between the components is performed by a command sent from the CPU 510 and the VDP 532 based on an input via the input unit 540 or the like. Note that when scanning is performed on a partial area on the surface of the liquid crystal panel 140, the image processing engine 180 sets a scan target area. In addition, it is good also as a structure which can specify the setting of the said area | region through the input part 540 by a user.

  As described above, when scanning is performed on a part of the surface of the liquid crystal panel 140, there are the following modes of use for displaying an image. The first is a mode in which an image is displayed in a surface area other than the partial area (hereinafter referred to as a scan area). The second is a mode in which no image is displayed in the surface area other than the scan area. Which mode is used is based on a command sent from the CPU 510 and the VDP 532 to the image processing engine 180.

  FIG. 7 is a cross-sectional view of the liquid crystal panel 140 and the backlight 179, showing a configuration in which the photodiode 145 receives light from the backlight 179 during scanning.

  Referring to FIG. 7, when the user's finger 900 is in contact with the surface of the liquid crystal panel 140, a part of the light emitted from the backlight 179 is part of the user's finger 900 (abbreviated in the contact area). Reflected on the plane). The photodiode 145 receives the reflected light.

  Even in a region where the finger 900 is not in contact, part of the light emitted from the backlight 179 is reflected by the user's finger 900. Even in this case, the photodiode 145 receives the reflected light. However, since the finger 900 is not in contact with the surface of the liquid crystal panel 140 in the region, the amount of light received by the photodiode 145 is smaller than the region in which the finger 900 is in contact. Note that the photodiode 145 cannot receive most of the light emitted from the backlight 179 that does not reach the user's finger 900.

  Here, by turning on the backlight 179 at least during the sensing period, the optical sensor circuit 144 can output a voltage corresponding to the amount of light reflected by the user's finger 900 from the sensor signal line SSj. it can. In this manner, by controlling the backlight 179 to be turned on and off, the liquid crystal panel 140 has a contact position of the finger 900, a range in which the finger 900 is in contact (determined by the pressing force of the finger 900), and the liquid crystal panel 140. The voltage output from the sensor signal lines (SS1 to SSn) varies depending on the direction of the finger 900 with respect to the surface of the sensor.

  As described above, the touch panel 530 can scan an image (hereinafter also referred to as a reflected image) obtained by reflecting light with the finger 900. Examples of scan objects other than the finger 900 include a stylus pen 99 and a barcode printed on a card. More specifically, the touch panel 530 acquires a fingerprint image based on the reflected light from the finger 900, or acquires contact coordinates between the stylus pen 99 and the touch panel 530 for each sensing based on the reflected light from the stylus pen 99. The user ID can be acquired based on the reflected light from the bar code written on the card.

  By the way, in this embodiment, a touch panel is described as an example of the display device of the mobile phone 500, but other panels such as an organic EL (Electro-Luminescence) panel and other authentication devices are used instead of the touch panel. And may be used.

(About data)
Next, the sensing command will be described. In touch panel 530, image processing engine 180 analyzes the content of the sensing command and sends back data (that is, response data) according to the analysis result to CPU 510.

  FIG. 8 is a diagram showing a schematic configuration of a sensing command. Referring to FIG. 8, the sensing command includes a header data area DA01, a timing data area DA02, a data type data area DA03, a reading method data area DA04, and image gradation data. An area DA05, a data area DA06 indicating resolution, and a spare data area DA07 are included.

  FIG. 9 is a diagram showing data values in each area of the sensing command and the meaning contents indicated by the values.

  Referring to FIG. 9, a sensing command in which “00” is set in the data area indicating the timing requests image processing engine 180 to transmit scan data at that time. That is, the sensing command requests transmission of scan data obtained by scanning using the optical sensor circuit 144 after the image processing engine 180 receives the sensing command. A sensing command in which “01” is set in the data area indicating the timing requests transmission of scan data when the scan result has changed. Furthermore, a sensing command in which “10” is set in the data area indicating the timing requests transmission of scan data at regular intervals.

  A sensing command in which “001” is set in the data area indicating the data type requests transmission of the coordinate value of the center coordinate in the partial image. In addition, a sensing command in which “010” is set in the data area indicating the data type requests transmission of only a partial image whose scan result has changed. Note that the change in the scan result indicates that the previous scan result is different from the current scan result. Further, a sensing command in which “100” is set in the data area indicating the data type requests transmission of the entire image.

  Here, the “entire image” is an image generated by the image processing engine 180 based on the voltage output from each photosensor circuit when scanning using m × n photosensor circuits. . The “partial image” is a part of the entire image. The reason why the partial image is requested to transmit only the partial image whose scan result has changed will be described later.

  The coordinate value and the partial image or the entire image may be requested at the same time. Further, in the case of a configuration in which a part of the surface of the liquid crystal panel 140 is scanned, the entire image is an image corresponding to the area to be scanned.

  A sensing command in which “00” is set in the data area indicating the reading method requests to scan with the backlight 179 on. A sensing command in which “01” is set in the data area indicating the reading method requests scanning with the backlight 179 off. A configuration for scanning with the backlight 179 off is described later (FIG. 13). Furthermore, a sensing command in which “10” is set in the data area indicating the reading method requests scanning using both reflection and transmission. Note that using both reflection and transmission refers to scanning a scanning object by switching between a method of scanning with the backlight 179 turned on and a method of scanning with the backlight turned off.

  A sensing command in which “00” is set in the data area indicating the image gradation requests monochrome image data of black and white. For example, the CPU 510 may request the image processing engine 180 for binary image data as data indicating the contact area. The image processing engine 180 may implement an acquisition unit 5102 described later. A sensing command in which “01” is set in the data area indicating the image gradation requests multi-gradation image data. Furthermore, a sensing command in which “10” is set in the data area indicating the image gradation requests RGB color image data.

  A sensing command in which “0” is set in the data area indicating the resolution requests image data with a high resolution. A sensing command in which “1” is set in the data area indicating the resolution requests image data with a low resolution.

  In addition to the data shown in FIGS. 8 and 9, the sensing command includes designation of a region to be scanned (region of a pixel that drives the optical sensor circuit 144), timing for scanning, and timing for lighting the backlight 179. Etc. are described.

  FIG. 10 is a diagram showing a schematic configuration of response data. The response data is data corresponding to the content of the sensing command, and is data that the image processing engine 180 of the touch panel 530 transmits to the CPU 510.

  Referring to FIG. 10, the response data includes a header data area DA11, a coordinate data area DA12, a time data area DA13, and an image data area DA14. Here, the value of the center coordinates of the partial image is written in the data area DA12 indicating the coordinates. In addition, time information acquired from the timer 182 of the image processing engine 180 is written in the data area indicating the time. Further, image data (that is, scan data) after being processed by the image processing engine 180 is written in the data area indicating the image.

  FIG. 11 is a diagram illustrating an image obtained by scanning the finger 900 (that is, a scanned image). Referring to FIG. 11, an image of a region W1 surrounded by a thick solid line is an entire image, and an image of a region P1 surrounded by a broken line is a partial image. The center point C1 of the cross indicated by a thick line is the center coordinate.

  In the present embodiment, a pixel (that is, a predetermined gradation or a pixel having a photosensor circuit which is a rectangular region and whose output voltage from the sensor signal line SSj is equal to or higher than a predetermined value). An area including all of the pixels having a luminance equal to or higher than a predetermined luminance is set as a partial image area.

  The center coordinates are coordinates determined in consideration of the gradation of each pixel in the partial image area. Specifically, for each pixel in the partial image, the center coordinates are determined by performing weighting processing based on the gradation of the pixel and the distance between the pixel and the rectangular center point (that is, the centroid). Is done. That is, the center coordinates do not necessarily match the centroid of the partial image.

  However, the position of the center coordinates is not necessarily limited to the above, and the center coordinates may be the coordinates of the centroid or the coordinates near the centroid.

  When “001” is set in the data area indicating the data type of the sensing command, the image processing engine 180 writes the value of the central coordinate in the data area DA12 indicating the coordinate. In this case, the image processing engine 180 does not write image data in the data area DA14 indicating an image. After writing the value of the center coordinate, the image processing engine 180 sends response data including the value of the center coordinate to the CPU 510. As described above, when “001” is set in the data area indicating the data type, the sensing command requests the output of the value of the center coordinate without requesting the output of the image data.

  Further, when “010” is set in the data area indicating the data type of the sensing command, the image processing engine 180 writes the image data of the partial image whose scan result has changed in the data area DA14 indicating the image. . In this case, the image processing engine 180 does not write the value of the center coordinate in the data area DA12 indicating the coordinate. The image processing engine 180 writes the image data of the partial image whose scan result has changed, and then sends response data including the image data of the partial image to the CPU 510. As described above, when “010” is set in the data area indicating the data type, the sensing command does not request the output of the value of the center coordinate, and the image data of the partial image whose scan result has changed. Request output.

  As described above, the reason for requesting transmission of only the partial image whose scan result has changed is that the scan data of the partial image area of the scan data is more important than the scan data of the other area. This is because the data is high, and the scan data in the region corresponding to the region of the partial image in the scan data is likely to change due to the contact state with the scan object such as the finger 900.

  When “011” is set in the data area indicating the data type of the sensing command, the image processing engine 180 writes the value of the central coordinate in the data area DA12 indicating the coordinate and also displays the data area indicating the image. The image data of the partial image whose scan result has changed is written in DA14. Thereafter, the image processing engine 180 sends response data including the value of the center coordinate and the image data of the partial image to the CPU 510. As described above, when “011” is set in the data area indicating the data type, the sensing command requests the output of the value of the center coordinate and the output of the image data of the partial image whose scan result has changed. To do.

  If “100” is set in the data area indicating the data type of the sensing command, the image processing engine 180 displays the image of the entire image in the data area DA14 indicating the image of the response data shown in FIG. Write data. In this case, the image processing engine 180 does not write the value of the center coordinate in the data area DA12 indicating the coordinate. After writing the image data of the whole image, the image processing engine 180 sends response data including the image data of the whole image to the CPU 510. As described above, when “100” is set in the data area indicating the data type, the sensing command requests the output of the image data of the entire image without requesting the output of the value of the center coordinate.

  When “101” is set in the data area indicating the data type of the sensing command, the image processing engine 180 writes the value of the central coordinate in the data area DA12 indicating the coordinate and also displays the data area indicating the image. Write the image data of the entire image to DA14. Thereafter, the image processing engine 180 sends response data including the value of the center coordinate and the image data of the entire image to the CPU 510. As described above, when “101” is set in the data area indicating the data type, the sensing command requests the output of the value of the center coordinate and the output of the image data of the entire image.

(Functional configuration of CPU 510)
Returning to FIG. 2, functions of the CPU 510 of the mobile phone 500 will be described. CPU 510 according to the present embodiment has functions of communication control unit 5101, acquisition unit 5102, authentication unit 5103, and registration unit 5104. Specifically, the CPU 510 implements the above function by executing the program 180A.

  By using the communication unit 560, the communication control unit 5101 transmits information indicating various functions of the mobile phone 500 to the liquid crystal television 600. For example, the communication control unit 5101 receives a message from the liquid crystal television 600, and identifies a mobile phone 500 with a terminal ID, a terminal name, presence / absence of an authentication function, presence / absence of a charging / settlement function, presence / absence of an information reading function. Information indicating whether or not current communication is possible is transmitted to the liquid crystal television 600. Further, the communication control unit 5101 uses the communication unit 562 to transmit an authentication result described later to the accounting server 700.

  The acquisition unit 5102 acquires image data as identification information from the touch panel 530. For example, when an authentication unit 5103 described later performs fingerprint authentication, the acquisition unit 5102 acquires image data indicating a fingerprint image from the touch panel 530.

  For example, when the authentication unit 5103 described later performs signature authentication, the acquisition unit 5102 sequentially acquires image data indicating the contact area from the touch panel 530. Then, the acquisition unit 5102 sequentially calculates center coordinates (center of gravity coordinates) of the contact area, and acquires a locus (sign image) of the center coordinates as identification information. That is, the acquisition unit 5102 sequentially acquires the center coordinates (center of gravity coordinates) of the contact area from the touch panel 530, and acquires the locus (sign image) of the center coordinates as identification information.

  When the authentication unit 5103 performs fingerprint authentication, the authentication unit 5103 substantially determines both based on the fingerprint image acquired by the acquisition unit 5102 and the authentication information (fingerprint image) 180B stored in the storage unit 520 at the preset stage. It is determined whether or not it matches The authentication unit 5103 determines that the user authentication has succeeded when both substantially match, and determines that the user authentication has failed when both do not substantially match.

  When performing authentication, the authentication unit 5103 substantially determines both based on the sign image acquired by the acquisition unit 5102 and the authentication information (sign image) 180B stored in the storage unit 520 at the preset stage. It is determined whether or not it matches The authentication unit 5103 determines that the user authentication has succeeded when both substantially match, and determines that the user authentication has failed when both do not substantially match.

  When performing fingerprint authentication, the registration unit 5104 stores the fingerprint image acquired by the acquisition unit 5102 as authentication information in the storage unit 520 when performing user registration, that is, at the setting stage. When performing signature authentication, the registration unit 5104 stores the signature image acquired by the acquisition unit 5102 as authentication information in the storage unit 520 when performing user registration, that is, at the setting stage.

(Modification of mobile phone 500)
However, the mobile phone 500 may include a card reader or the like instead of the touch panel 530. In this case, the acquisition unit 5102 acquires the user identification information by causing the card reader to read an IC chip or a magnetic tape of an authentication card owned by the user.

<Configuration of LCD TV 600>
Next, with reference to FIG. 2, one mode of a specific configuration of the liquid crystal television 600 constituting the information communication system 1 will be described.

The liquid crystal television 600 includes a CPU 610, a temporary storage unit 622, and a storage unit 620.
The storage unit 620 has a function of storing data in a nonvolatile manner. The storage unit 620 is accessed by the CPU 610. The storage unit 620 is a hard disk capable of storing a large amount of data. Note that the storage unit 620 is not limited to a hard disk, and may be any medium (for example, a flash memory) that can hold data in a nonvolatile manner even when power is not supplied. The storage unit 620 stores a program 180C, recorded data 180D described later, a registered terminal list 180E described later, a device ID for identifying the liquid crystal television 600, and other various data.

  The registered terminal list 180E will be described with reference to FIG. FIG. 12 is an image diagram showing a data structure of registered terminal list 180E stored in storage unit 620.

  The registered terminal list 180E stores information regarding each mobile phone 500 registered by the liquid crystal television 600. That is, identification information and other information are stored in the registered terminal list 180E for each mobile phone 500 that has been successfully registered (paired) in the past. The registered terminal list 180E according to the present embodiment includes, for each registered mobile phone 500, a registration number indicating a registration order, a terminal ID for identifying the mobile phone 500, a terminal name, presence / absence of an authentication function, charging and Stores the presence / absence of a settlement function, the presence / absence of an information reading function, and the availability of current communication.

  CPU 610 according to the present embodiment determines whether or not communication with each mobile phone 500 is possible at a predetermined timing (such as when a product is selected). Then, CPU 610 updates the communication availability column in the registered terminal list based on the determination result.

  CPU 610 has a function of performing various types of processing, arithmetic processing, and the like for each unit in liquid crystal television 600 in accordance with program 180C stored in storage unit 620. Since CPU 610 is similar to CPU 510 described above, detailed description will not be repeated.

  The temporary storage unit 622 is used as a work memory that is accessed by the CPU 610 and temporarily stores data. Since temporary storage unit 622 is similar to temporary storage unit 522 described above, detailed description thereof will not be repeated.

  The liquid crystal television 600 further includes an antenna 602, a tuner 605, and a data processing unit 607.

  The antenna 602 is connected to the tuner 605. The tuner 605 receives a broadcast signal having a frequency instructed by the CPU 610 via the antenna 602. The tuner 605 has a function of receiving broadcast signals based on digital broadcasting and analog broadcasting.

  The broadcast signal includes image data, audio data, text data, and EPG data. When the broadcast signal is a signal based on digital broadcasting, the broadcast signal further includes the BML data described above. The tuner 605 transmits the received broadcast signal to the data processing unit 607.

  The data processing unit 607 demodulates the received broadcast signal to obtain demodulated data. When the received broadcast signal is a signal based on analog broadcast, the data processing unit 607 performs the following processing. First, the data processing unit 607 decodes the demodulated data, acquires image data and audio data, and acquires text data and EPG data from the vertical blanking interval of the broadcast signal.

  When the data processing unit 607 receives a display instruction for displaying an image on the display 630 from the CPU 610, the data processing unit 607 transmits the image data to the VDP 632 described later. When receiving the image data, the VDP 632 displays an image (moving image or still image) based on the image data on the display 630.

  In addition, when the data processing unit 607 receives a recording instruction for performing a recording process from the CPU 610, the data processing unit 607 compresses the image data and the audio data, and stores them in the storage unit 620 as the recording data 180D. The recorded data 180D is data compressed in the MPEG2 format. The recorded data 180D is not limited to data compressed in the MPEG2 format, and may be data compressed in another format. Here, other formats include, for example, MPEG1, H.264, and the like. H.264 or the like.

  When the received broadcast signal is a signal based on digital broadcast, the data processing unit 607 performs the following processing. First, the data processing unit 607 decodes the demodulated data based on the digital broadcasting standard to obtain decoded data. The decoded data includes image data, audio data, text data, EPG data, and BML data. Image data and audio data included in the decoded data are data compressed in the MPEG2 format. The image data and audio data included in the decoded data are not limited to data compressed in the MPEG2 format, and may be data compressed in other formats. Here, other formats include, for example, MPEG1, H.264, and the like. H.264 or the like.

  When the data processing unit 607 receives a display instruction for displaying image data on the display 630 from the CPU 610, the data processing unit 607 transmits image data included in the decoded data of the channel designated by the display instruction to the VDP 632 described later. . When receiving the image data, the VDP 632 displays an image (moving image or still image) based on the image data on the display 630.

  In the following, an image based on a broadcast signal received by the tuner 605 and displayed on the display 630 is also referred to as a TV image. Note that the number of types of TV image channels that can be directly selected by pressing the numeric buttons “1” to “12” provided in the remote controller 300 to be described later for operating the liquid crystal television 600 is as follows. Assume that the maximum is 12. Naturally, the greater the number of numeric buttons provided on the remote controller 300, the greater the number of types of TV image channels that can be directly selected.

  Remote controller channel numbers “1” to “12” are set in the numeric buttons “1” to “12” of the remote controller 300, respectively. For example, the remote controller channel number “3” is set to the numeric button “3”. One TV image channel can be registered in one remote controller channel number. For example, it is assumed that the TV image channel number “8” is registered for the remote controller channel number “1”. In this case, when the number button “1” of the remote controller 300 is pressed by the user, the remote controller signal for selecting the TV image of the channel number “8” is transmitted from the remote controller 300 to the liquid crystal television. 600.

  Note that the liquid crystal television 600 has a function of simultaneously displaying a plurality of types of TV images on the display 630. In addition, the liquid crystal television 600 has a function of simultaneously displaying a TV image and other types of images on the display 630.

  In addition, when the data processing unit 607 receives a recording instruction for performing a recording process from the CPU 610, the data processing unit 607 stores the decoded data of the channel designated by the recording instruction in the storage unit 620 as the recording data. The recorded data in this case is also referred to as content below. In this case, the recorded data includes image data, audio data, text data, and BML data.

Liquid crystal television 600 further includes a VDP 632 and a VRAM 636.
The VRAM 636 has a function of temporarily storing image data.

  The CPU 610 issues a drawing instruction to the VDP 632 according to the program 180C stored in the storage unit 620. The drawing instruction is an instruction to generate an image and display the image on the display 630.

  VDP 632 is connected to display 630. In response to a drawing instruction from the CPU 610, the VDP 632 reads font data, graphic data, and the like from a program 180C described later in the storage unit 620, and generates an image using the VRAM 636. The VDP 632 reads the image data stored in the VRAM 636 and causes the display 630 to display an image based on the image data.

Liquid crystal television 600 further includes an input unit 640.
Input unit 640 includes a plurality of buttons (not shown). The plurality of buttons are provided outside the liquid crystal television 600. When any one of the plurality of buttons is pressed by the user, the input unit 640 transmits a button signal corresponding to the pressed button to the CPU 610. CPU 610 performs a predetermined process based on the received button signal.

  The liquid crystal television 600 further includes a communication unit (communication interface) 660 and a communication unit (communication interface) 662.

  Communication unit 660 exchanges data with CPU 610. Communication unit 660 has a function of transmitting / receiving data to / from mobile phone 500 in a wired or wireless manner. Communication unit 660 has the same configuration and function as communication unit 560 described above, and therefore detailed description will not be repeated.

  Communication unit 662 transmits / receives data to / from CPU 610. Since communication unit 662 has the same configuration and function as communication unit 562 described above, detailed description will not be repeated. Therefore, communication unit 662 can perform data communication with communication unit 50 wirelessly. Communication unit 662 can perform data communication with communication unit 50 via, for example, a LAN cable.

  Therefore, liquid crystal television 600 according to the present embodiment can also download a program from network 80 via communication unit 50 and communication unit 662 and store the program in storage unit 620. In this case, the downloaded program is the program 180C.

  CPU 610 performs predetermined processing in accordance with a program (program 180C) downloaded from network 80. A program for downloading is stored in the storage unit 620 in advance. CPU 610 downloads a new program based on the program to be downloaded.

  Liquid crystal television 600 further includes a remote controller signal receiving unit (remote control signal receiving unit) 680. The remote controller signal receiving unit 680 has a function of receiving a remote controller signal for operating the liquid crystal television 600 output from the remote controller 300. The remote controller signal receiving unit 680 transmits the received remote controller signal to the CPU 610. CPU 610 performs corresponding processing in accordance with the received remote controller signal. As described above, the remote controller 300 is provided with numeric buttons “1” to “12” for selecting a TV image.

  Note that the mobile phone 500 described above may have the function of the remote controller 300 described above.

  The CPU 610 performs data communication with the audio output unit 670. When CPU 610 transmits audio data to audio output unit 670, audio output unit 670 outputs audio based on the audio data received from CPU 610 from the speaker.

(Functional configuration of CPU 610)
Next, functions of the CPU 610 of the liquid crystal television 600 will be described. CPU 610 according to the present embodiment has functions of communication control unit 6101, search unit 6102, reception unit 6103, and registration unit 6104. Specifically, the CPU 610 realizes the above function by executing the program 180C.

  The accepting unit 6103 accepts a command (registration command) for registering a device from the remote controller 300 via the remote controller signal receiving unit 680. The accepting unit 6103 accepts a command (first selection command) for selecting a product from the remote controller 300 via the remote controller signal receiving unit 680. Accepting unit 6103 accepts a command (second selection command) for selecting mobile phone 500 for reading user identification information from remote controller 300 via remote controller signal receiving unit 680.

  The communication control unit 6101 performs pairing with the mobile phone 500 by using the communication unit 660 when the reception unit 6103 receives a registration command. Pairing is a process of registering devices with each other and permitting connection with the registered devices. Since pairing is a well-known technique, detailed description will not be repeated here. By using the communication unit 660, the communication control unit 6101 uses the mobile phone 500 to identify the mobile phone 500 from a terminal ID, a terminal name, presence / absence of an authentication function, presence / absence of a billing and settlement function, an information reading function The presence / absence of the current communication is received.

  The communication control unit 6101 receives the second selection command and uses the communication unit 660 to transmit the first information and the authentication command to the selected mobile phone 500.

  The communication control unit 6101 receives a notification from the mobile phone 500 that the charging process has been completed normally. The communication control unit 6101 uses the communication unit 662 to transmit the fact that the accounting process has been normally completed and the first information to the content server 800 in association with each other.

  The registration unit 6104 receives from the mobile phone 500 a terminal ID for identifying the mobile phone 500, the name of the terminal, the presence or absence of an authentication function, the presence or absence of a charging and settlement function, the presence or absence of an information reading function, the availability of current communication Is stored in the registered terminal list 180E of the storage unit 620.

  When the receiving unit 6103 receives the first selection command, the searching unit 6102 can communicate with itself and acquire user identification information via the communication control unit 6101 and the communication unit 660. Search the mobile phone 500. Search unit 6102 updates registered terminal list 180E of storage unit 620 according to the search result. The search unit 6102 refers to the latest registered terminal list 180E and recognizes the mobile phone 500 that is communicable and can perform user authentication. Thereby, the reception unit 6103 can receive a second selection command from the user.

  Note that the search timing of the mobile phone 500 is not limited to when a command for selecting a product (first selection command) is issued, but may be performed at all times or in advance at regular intervals. In this case, it is only necessary to refer to the latest registered terminal list 180E at the timing of a command for selecting a product.

<Communication unit 50>
Referring to FIG. 2, in the present embodiment, communication unit 50 is arranged in the house where liquid crystal television 600 is arranged. The communication unit 50 uses, for example, a wireless technology based on one of IEEE 802.11a, IEEE 802.11b, and IEEE 802.11g, which is a wireless LAN standard, to perform data communication simultaneously with a plurality of devices arranged in the vicinity. Has the function to perform. Communication unit 50 according to the present embodiment can perform data communication wirelessly with mobile phone 500, liquid crystal television 600, and networks 70 and 80.

  The communication unit 50 further has a communication interface using Ethernet (registered trademark). When a device in the video display system issues a connection request to the networks 70 and 80, the address of the device is It has a router function including a NAT (Network Address Translation) function for converting addresses to 70 and 80. Therefore, the communication unit 50 can perform data communication with each of the mobile phone 500, the liquid crystal television 600, and the networks 70 and 80, for example, via a LAN cable. That is, the communication unit 50 can perform data communication with each of the mobile phone 500, the liquid crystal television 600, and the networks 70 and 80 in a wired manner.

<Configuration of billing server 700>
Next, with reference to FIG. 13, an aspect of a specific configuration of the billing server 700 constituting the information communication system 1 will be described. FIG. 13 is a block diagram showing a configuration of billing server 700.

  Billing server 700 includes a display 730, a CPU 710, a temporary storage unit 722, and a storage unit 720.

  The display 730 has a function of displaying characters, images, and the like. Since display 730 is similar to display 630 described above, detailed description will not be repeated.

  The storage unit 720 has a function of storing data in a nonvolatile manner. Data is accessed in the storage unit 720 by the CPU 710. The storage unit 720 is a hard disk capable of storing a large amount of data. Note that the storage unit 720 is not limited to a hard disk and may be any medium (for example, a flash memory) that can hold data in a nonvolatile manner even when power is not supplied. The storage unit 720 stores a program 180F, a charging database 180G, and the like.

  CPU 710 has a function of performing various types of processing, arithmetic processing, and the like for each unit in billing server 700 in accordance with program 180F stored in storage unit 720. Since CPU 710 is similar to CPU 510 described above, detailed description will not be repeated.

  The temporary storage unit 722 is accessed as data by the CPU 710 and used as a work memory for temporarily storing data. Since temporary storage unit 722 is similar to temporary storage unit 522 described above, detailed description thereof will not be repeated.

Billing server 700 further includes a VDP 732 and a VRAM 736.
The VRAM 736 has a function of temporarily storing image data.

  The CPU 710 issues a drawing instruction to the VDP 732 in accordance with the program 180F stored in the storage unit 720. The drawing instruction is an instruction to generate an image and display the image on the display 730.

  VDP 732 is connected to display 730. In response to a drawing instruction from the CPU 710, the VDP 732 reads font data, graphic data, and the like from a program 180F described later in the storage unit 720, and generates an image using the VRAM 736. The VDP 732 reads out the image data stored in the VRAM 736 and causes the display 730 to display an image based on the image data.

Billing server 700 further includes an input unit 740.
A mouse 742 and a keyboard 744 are connected to the input unit 740. A user (such as a billing service manager) gives an instruction to billing server 700 using mouse 742 or keyboard 744. An input instruction from the mouse 742 or the keyboard 744 is transmitted to the CPU 710 via the input unit 740. CPU 710 performs predetermined processing based on an input instruction from input unit 740.

  Billing server 700 further includes a communication unit (communication interface) 760 and a communication unit (communication interface) 762.

  The communication unit 760 transmits / receives data to / from the CPU 710. The communication unit 760 has a function of transmitting / receiving data to / from another device (not shown) in a wired or wireless manner. Since communication unit 760 has the same configuration and function as communication unit 560 described above, detailed description will not be repeated.

  The communication unit 762 transmits / receives data to / from the CPU 710. The communication unit 762 can perform data communication with the network 70 wirelessly. That is, the communication unit 762 can perform data communication with the mobile phone 500 via the network 70. The communication unit 762 can perform data communication with the network 70 via, for example, a LAN cable.

(Functional configuration of CPU 710)
Next, functions of the CPU 710 of the accounting server 700 will be described. CPU 710 according to this embodiment has a function of charging unit 7101. Specifically, CPU 710 implements the function of billing unit 7101 by executing program 180F.

  The charging unit 7101 receives the authentication result and the first information from the mobile phone 500 by using the communication unit 762. Billing unit 7101 performs billing processing for the user of mobile phone 500 based on the authentication result and the first information. For example, the charging unit 7101 stores the user name and the product price in association with each other in the charging database 180G.

  The charging unit 7101 collects the product price from the user with reference to the charging database 180G. When the accounting process for the user is normally completed, the accounting unit 7101 notifies the mobile phone 500 of the completion of the accounting process via the network 70 using the communication unit 762. When the charging process for the user is normally completed, the charging unit 7101 may notify the content server 800 of the completion of the charging process via the network 80 using the communication unit 762.

<Configuration of Content Server 800>
Next, with reference to FIG. 14, one aspect of a specific configuration of the content server 800 configuring the information communication system 1 will be described. FIG. 14 is a block diagram showing the configuration of the content server 800.

  Hereinafter, among the blocks of the content server 800, the description of the block having the same function as that of the charging server 700 will not be repeated.

  The storage unit 820 has a function of storing data in a nonvolatile manner. Storage unit 820 is accessed by CPU 810. The storage unit 820 is a hard disk capable of storing a large amount of data. Note that the storage unit 820 is not limited to a hard disk, and may be any medium (for example, a flash memory) that can hold data in a nonvolatile manner even when power is not supplied. The storage unit 820 stores a program 180H, content data 180J, a user registration database 180K, and the like.

  The user registration database 180K will be described with reference to FIG. FIG. 15 is an image diagram showing a data structure of the user registration database 180K stored in the storage unit 820.

  The user registration database 180K stores user registration information for each user (mobile phone 500 or liquid crystal television 600) who desires registration for the service provided by the user registration database 180K. That is, the storage unit 820 stores a user registration database 180K for each service. The user registration database 180K stores identification information and other information for each user registered as a user. The user registration database 180K according to the present embodiment includes, for each registered user, a registration number indicating a registration order, user identification information for identifying the user, a password, and a terminal ID for identifying the user's mobile phone 500. The TV ID for identifying the liquid crystal television 600, the user's name, the user's name, the mail address of the user or the mail address of the user's mobile phone 500, the user's address, etc.

  CPU 810 has a function of performing various types of processing, arithmetic processing, and the like for each unit in content server 800 in accordance with program 180H stored in storage unit 820. Since CPU 810 is similar to CPU 510 described above, detailed description will not be repeated.

  A communication unit (communication interface) 862 transmits and receives data to and from the CPU 810. Since communication unit 862 has the same configuration and function as communication unit 562 described above, detailed description will not be repeated. The communication unit 862 can perform data communication with the network 80 wirelessly. That is, the communication unit 862 can perform data communication with the liquid crystal television 600 via the network 80. The communication unit 862 can perform data communication with the network 80 via, for example, a LAN cable.

(Functional configuration of CPU 810)
Next, functions of the CPU 810 of the content server 800 will be described. CPU 810 according to this embodiment has a function of registration unit 8101. Specifically, the CPU 810 implements the function of the registration unit 8101 by executing the program 180H.

  By using the communication unit 862, the registration unit 8101 uses a registration number indicating a registration order, user identification information for identifying a user, a password, for each registered user from the liquid crystal television 600 via the network 80. A terminal ID for identifying the user's mobile phone 500, a TV ID for identifying the liquid crystal television 600, the user's name, the user's pseudonym, the user's mail address or the mail address of the user's mobile phone 500, the user's Accept an address. The registration unit 8101 identifies, for each registered user, a registration number indicating a registration order, user identification information for identifying the user, a password, a terminal ID for identifying the user's mobile phone 500, and the liquid crystal television 600. The user ID is stored in the user registration database 180K of the storage unit 820 by storing the TV ID, the user's name, the user's name, the user's e-mail address or the user's mobile phone 500's e-mail address, and the user's address To do.

<First authentication information registration>
Next, referring to FIG. 2 and FIG. 16, registration of the first authentication information in mobile phone 500 according to the present embodiment, that is, processing of mobile phone 500 in the setting stage will be described. FIG. 16 is a first image diagram showing screen transition when the user inputs authentication information to the mobile phone 500.

  As shown in FIG. 16A, the CPU 510 of the mobile phone 500 functioning as the registration unit 5104 has a button for starting various applications and various setting information on the touch panel 530 (the liquid crystal panel 140 in FIG. 16). Displays a setting button for registering the. When the user touches the setting button on touch panel 530, as shown in FIG. 16B, CPU 510 registers a button for setting time, a button for setting volume, and authentication information on touch panel 530. Display buttons. At this time, the CPU 510 may cause the touch panel 530 to display a button for registering fingerprint authentication information and a button for registering signature authentication information.

  When the user touches a button for registering authentication information (of fingerprint) on touch panel 530, CPU 510 causes touch panel 530 to display area 140A for inputting a fingerprint, as shown in FIG. As shown in FIG. 16D, when the user touches the finger 900 on the area 140A for inputting the fingerprint on the touch panel 530 for a predetermined time or longer, the CPU 510 uses the optical sensor circuit 144 and the image processing engine 180 to print the fingerprint. Get an image.

  CPU 510 stores an image indicating a fingerprint in storage unit 520 as authentication information 180B. Note that not the image itself but information extracted from the image may be stored. As shown in FIG. 16E, CPU 510 causes touch panel 530 to display that the registration of authentication information has been completed.

<Second authentication information registration>
Next, registration of second authentication information in mobile phone 500 according to the present embodiment will be described with reference to FIGS. FIG. 17 is a second image diagram showing screen transition when the user inputs authentication information to mobile phone 500.

  As shown in FIG. 17A, the CPU 510 of the mobile phone 500 functioning as the registration unit 5104 registers buttons for starting various applications and various setting information on the touch panel 530 (liquid crystal panel 140). Display a setting button for the purpose. When the user touches a setting button on touch panel 530, as shown in FIG. 17B, CPU 510 has a button for setting time on touch panel 530, a button for setting volume, and a button for registering authentication information. Etc. are displayed. At this time, the CPU 510 may cause the touch panel 530 to display a button for registering fingerprint authentication information and a button for registering signature authentication information.

  When the user touches a button for registering (signature) authentication information on touch panel 530, CPU 510 causes touch panel 530 to display area 140B for inputting a sign, as shown in FIG. As shown in FIG. 17D, when the user inputs a signature (trajectory of the contact area) in the area 140B for inputting the signature of the touch panel 530 by handwriting, the CPU 510 passes through the optical sensor circuit 144 and the image processing engine 180. Get an image of the sign.

  CPU 510 stores an image indicating a signature in storage unit 520 as authentication information 180B. Note that not the image itself but information extracted from the image may be stored. As shown in FIG. 17E, CPU 510 causes touch panel 530 to display that the registration of authentication information has been completed.

<User registration process>
Next, with reference to FIGS. 1 to 15, 18, and 19, a processing procedure of user registration processing in the information communication system 1 will be described. FIG. 18 is a sequence diagram illustrating a processing procedure of user registration processing in the information communication system 1. FIG. 19 is an image diagram showing screen transition of the liquid crystal television 600 in the user registration process.

  The CPU 610 of the liquid crystal television 600 accepts a user registration command from the remote controller 300 as the registration unit 6104 and starts a user registration process (step S102). More specifically, with reference to FIG. 19A, CPU 610 of liquid crystal television 600 causes display 630 to display each of the Internet services in a selectable manner. Referring to FIG. 19B, CPU 610 receives a selection command for selecting user registration processing from remote controller 300 via remote controller signal receiving unit 680.

  The CPU 610 uses the communication unit 662 as the communication control unit 6101 to transmit information regarding the liquid crystal television 600 to the content server 800 (step S104). The CPU 610 uses the communication unit 660 as the search unit 6102 to search for the mobile phone 500 that can currently communicate with the liquid crystal television 600 (step S106). CPU 610 updates registered terminal list 180E of storage unit 620 based on the search result. CPU 610 refers to registered terminal list 180 </ b> E and uses communication unit 662 to transmit information related to mobile phone 500 that can communicate with liquid crystal television 600 to content server 800. Note that the registered terminal list 180E is updated as needed or at regular intervals, and only the registered terminal list 180E may be referred to in the search in this case.

  CPU 610 uses communication unit 662 to receive information related to mobile phone 500 that can be registered as a user from content server 800 (step S108). If there is no user-registerable mobile phone 500, CPU 610 receives a message from content server 800 that there is no terminal that can be registered. CPU 610 determines whether there is a user-registerable terminal based on information from content server 800 (step S110). CPU610 performs the process from step S118, when there is no terminal in which user registration is possible (when it is NO in step S110).

  If there is a terminal that can be registered as a user (YES in step S110), CPU 610 accepts a selection command for a terminal that desires user registration from remote controller 300 (user) (step S112). More specifically, with reference to FIG. 19C, CPU 610 causes display 630 to display a list of mobile phones 500 that can communicate with liquid crystal television 600. At this time, the CPU 610 causes the display 630 to display that the mobile phone 500 registered as a user in the content server 800 is already registered as a user in the content server.

  CPU 610 transmits information on selected mobile phone 500 to content server 800 using communication unit 662. CPU 610 determines whether or not selected mobile phone 500 is a terminal that is already registered as a user in content server 800 (step S116). When the selected mobile phone 500 is a mobile phone that has already been registered in the content server 800, the CPU 610 executes processing from step S122.

  CPU 610 accepts input of user registration information via remote controller 300 when selected mobile phone 500 is not yet registered as a user in content server 800 (NO in step S116) (step S118). ). More specifically, referring to FIG. 19D, CPU 610 causes display 630 to display a screen for accepting user registration.

  Here, CPU 610 displays on display 630 an area for inputting a user ID, an area for inputting a password, an area for inputting an address of the user, and an area for inputting an email address of the user. Is displayed. At this time, the CPU 610 causes the display 630 to display a registration button for registering the input user information in the content server. The user uses the remote controller 300 to input user information in each of the above areas.

  CPU 610 transmits the input user registration information to content server 800 using communication unit 662 (step S120). CPU 610 receives user registration information from content server 800 using communication unit 662 (step S122). More specifically, referring to FIG. 19E, CPU 610 uses communication unit 662 to receive a message indicating that user registration has been completed from content server 800, and that user registration has been completed on display 630. Display the message.

  CPU 610 determines whether or not the device corresponding to the user registration information is a terminal (mobile phone 500) (step S124). If the device corresponding to the user registration information is a terminal (mobile phone 500) (YES in step S124), CPU 610 uses communication unit 660 to target the user registration information (mobile phone 500). (Step S126). The CPU 610 ends the user registration process (step S128). If the device corresponding to the user registration information is not a terminal (mobile phone 500) (NO in step S124), CPU 610 ends the user registration process (step S128).

  On the other hand, the CPU 810 of the content server 800 receives information regarding the liquid crystal television 600 from the liquid crystal television 600 using the communication unit 862 as the registration unit 8101 (step S132). The CPU 810 uses the communication unit 862 to receive information related to the mobile phone 500 that can communicate with the liquid crystal television 600 from the liquid crystal television 600 (step S134).

  The CPU 810 determines whether there is a mobile phone 500 that can communicate with the liquid crystal television 600 (step S136). When mobile phone 500 that can communicate with liquid crystal television 600 exists (YES in step S136), CPU 810 extracts mobile phone 500 having the necessary function from mobile phone 500 (step S136). S138). CPU 810 refers to user registration database 180K and searches for extracted mobile phone 500 (step S140). The CPU 810 uses the communication unit 862 to transmit the information indicating the extracted mobile phone 500 to the liquid crystal television 600 in association with the information indicating whether or not the user has been registered (step S142).

  CPU 810 receives information related to selected mobile phone 500 using communication unit 862 (step S144). The CPU 810 refers to the user registration database 180K in the storage unit 820 and determines whether or not the selected mobile phone 500 has been registered (step S146). If the extracted mobile phone 500 has already been registered as a user (YES in step S146), CPU 810 associates the information related to the liquid crystal television and the extracted information related to mobile phone 500 with each other in the user registration database. Registration is made to 180K (step S148). CPU810 performs the process from step S152.

  CPU 810 receives user registration information from liquid crystal television 600 using communication unit 862 if the extracted mobile phone 500 is not yet registered as a user (NO in step S146) (step S150). CPU810 performs the process from step S152.

  In step S136, if there is no mobile phone 500 that can communicate with liquid crystal television 600 (NO in step S136), CPU 810 displays a message indicating that there is no mobile phone that can be registered via liquid crystal unit 862. It transmits to the television 600 (step S154). CPU 810 receives user registration information from liquid crystal television 600 using communication unit 862 (step S156). CPU 810 updates user registration database 180K in storage unit 820 based on the user registration information from liquid crystal television 600 (step S152).

  The CPU 810 refers to the user registration database 180K and transmits the user registration information corresponding to the extracted mobile phone 500 to the liquid crystal television 600 using the communication unit 862 (step S158). The CPU 810 ends the user registration process (step S160).

  On the other hand, CPU 510 of mobile phone 500 receives user registration information corresponding to mobile phone 500 from liquid crystal television 600 using communication unit 560 as registration unit 5104 (step S162). CPU 510 stores the user registration information in storage unit 520 (step S164).

<Terminal selection process>
Next, with reference to FIGS. 1 to 15, 20, and 21, a processing procedure of terminal selection processing in the information communication system 1 will be described. FIG. 20 is a sequence diagram illustrating a procedure of terminal selection processing in the information communication system 1. FIG. 21 is an image diagram showing screen transitions of liquid crystal television 600 and mobile phone 500 in the terminal selection process.

  First, referring to FIG. 21A, CPU 610 of liquid crystal television 600 causes display 630 to display one or more products in a selectable manner based on the product information from content server 800. In such a state, the CPU 610 of the liquid crystal television 600 accepts various operation commands as the accepting unit 6103 from the remote controller 300 via the remote controller signal receiving unit 680 (step S202).

  For example, referring to FIG. 21B, CPU 610 receives a product selection command from remote controller 300 via remote controller signal receiving unit 680 and is selected based on the product information of the selected product. Detailed information about the product is displayed on the display 630. At this time, CPU 610 causes display 630 to display a purchase button for determining purchase of the product.

  CPU 610 determines whether user authentication is required based on the operation command (step S204). If user authentication is not required (NO in step S204), for example, if a product is selected in the state shown in FIG. 21A, CPU 610 repeats the processing from step S202.

  When user authentication is required (YES in step S204), for example, when the purchase button is pressed in the state shown in FIG. 21B, CPU 610 refers to the latest registered terminal list 180E ( The registration terminal list 180E is updated), and information regarding the mobile phone 500 that can communicate with the liquid crystal television 600 is transmitted to the content server 800 using the communication unit 662 (step S206).

  CPU 610 uses communication unit 662 to receive information related to user-registered mobile phone 500 from content server 800 (step S208). CPU 610 determines whether or not user-registered mobile phone 500 exists (step S210). If there is no user-registered mobile phone 500 (NO in step S210), CPU 610 displays the next processing screen on display 630 as shown in FIG. 22C described later (step S212). ), The process from step S202 is repeated.

  Here, an operation when there is no mobile phone 500 that can communicate with the liquid crystal television 600 will be described. FIG. 22 is an image diagram showing screen transition of liquid crystal television 600 when mobile phone 500 capable of communicating with liquid crystal television 600 does not exist.

  Referring to FIG. 22C, CPU 610 receives from mobile server 500 a message indicating that mobile phone 500 capable of communicating with liquid crystal television 600 does not exist from content server 800, and displays an area for inputting a user ID on display 630. An area for entering a password and an area for entering card information are displayed. At this time, the CPU 610 also causes the display 630 to display a transmission button for transmitting the input user information to the content server.

  When CPU 610 transmits user information to content server 800 using communication unit 662, content server 800 performs user authentication. When the user authentication by the content server 800 is successful, as shown in FIG. 22D, the CPU 610 causes the display 630 to display a message indicating that the authentication process for purchasing the product has been completed.

  20 and 21, CPU 610 performs authentication and authentication from remote controller 300 via remote controller signal receiving unit 680 when user-registered mobile phone 500 exists (YES in step S210). A device selection command for purchase operation is received (step S214). More specifically, referring to FIG. 21C, CPU 610 causes display 630 to display a list of terminals that are currently in communication.

  CPU 610 determines whether any mobile phone 500 has been selected, that is, whether a terminal selection command has been accepted (step S216). CPU 610 displays the next processing screen on display 630 (step S212) when it does not accept the selection command and selects to purchase on the television (NO in step S216), and from step S202. Repeat the process. That is, after that, the purchase process is continued by the remote control operation of the liquid crystal television 500 without using the mobile phone 500.

  When CPU 610 accepts a terminal selection command (YES in step S216), communication unit 660 sends a message requesting activation of an application for authentication and purchase and information on a product to be purchased. Is transmitted to the mobile phone 500 (step S218). More specifically, referring to FIG. 21D, CPU 610 causes display 630 to display a message indicating that information related to the product has been transmitted to the mobile phone. The CPU 610 executes authentication / purchase processing described later.

  Here, data transmitted from the liquid crystal television 600 to the mobile phone 500 will be described. FIG. 23 is an image diagram showing a data structure of data transmitted from liquid crystal television 600 to mobile phone 500 in the terminal selection process.

  Referring to FIG. 23, in step S 218, CPU 610 uses communication unit 660 to cause mobile phone 500 to select a product selection number, user ID of mobile phone 500, TV ID of liquid crystal television 600, A message indicating the purchase target ID, the data format, the target device, the authentication target image, the authentication target price, the service source, and the URL of the billing settlement site is transmitted. The message may be data received by the liquid crystal television 600D from the content server 800, or data generated by the liquid crystal television 600D based on the data.

  20 and 21, CPU 810 of content server 800 receives information about mobile phone 500 that can communicate with liquid crystal television 600 from liquid crystal television 600 using communication unit 862 (step S222). CPU 810 refers to user registration database 180K in storage unit 820 to search for mobile phone 500 (step S224).

  The CPU 810 determines whether there is a mobile phone 500 registered as a user in the service currently being executed (step S226). If there is mobile phone 500 registered as a user for the service currently being executed (YES in step S226), CPU 810 uses communication unit 862 to display information on mobile phone 500 that has been registered as a liquid crystal. It transmits to the television 600 (step S228).

  If there is no mobile phone 500 registered as a user in the service currently being executed (NO in step S226), CPU 810 uses mobile unit 862 to register the mobile phone that has been registered as a user in liquid crystal television 600. Information about 500 is transmitted (step S230). The CPU 810 executes authentication / purchase processing described later.

  On the other hand, CPU 510 of mobile phone 500 uses authentication unit 5103 as communication unit 560 to receive a message requesting activation of an application for authentication and purchase and information related to the purchase target from liquid crystal television 600 (step S232). . CPU 510 activates an application for authentication and purchase in response to the message (step S234).

  CPU 510 causes touch panel 530 to display information related to the purchase target (step S236). More specifically, with reference to FIG. 21E, CPU 51 of mobile phone 500 causes touch panel 530 to display detailed information on the selected product. The CPU 510 executes authentication / purchase processing described later.

<Authentication / Purchase Processing>
Next, a processing procedure of authentication / purchase processing in the information communication system 1 will be described with reference to FIGS. FIG. 24 is a sequence showing a processing procedure of authentication / purchase processing in the information communication system 1. FIG. 25 is a conceptual diagram showing screen transition of liquid crystal television 600 and mobile phone 500 in the authentication / purchase process.

  The CPU 510 of the mobile phone 500 accepts a touch operation from the user using the touch panel 530 as the authentication unit 5103 (step S302). That is, CPU 510 receives image data indicating a contact area from touch panel 530.

  Based on the contact area (image data) from touch panel 530, CPU 510 determines whether or not a contact area is included in the authentication function area (step S304). CPU510 repeats the process from step S302, when the contact area | region is not contained in the authentication function area | region (when it is NO in step S304).

  If the contact area is included in the authentication function area (YES in step S304), CPU 510 acquires biometric information based on the image data from touch panel 530 (step S306). Referring to FIG. 25F, CPU 510 of mobile phone 500 determines whether or not a touch operation is input to touch panel 530 (liquid crystal panel 140). That is, CPU 510 acquires image data indicating a fingerprint via touch panel 530.

  CPU 510 performs user authentication as authentication unit 5103 based on authentication information 180B stored in storage unit 520 in advance and image data from touch panel 530 (step S308). CPU 510 determines whether or not the user authentication is successful (step S310). CPU510 performs the process from step S316, when user authentication is not successful (when it is NO in step S310).

  When the user authentication is successful (YES in step S310), CPU 510 transmits purchase information to billing server 700 using communication unit 562 (step S312). The purchase information includes a message indicating that user authentication has been successful and information related to the selected product (for example, the price of the product). More specifically, when user authentication is successful, referring to FIG. 25G, CPU 510 causes touch panel 530 to display a message indicating that authentication processing has been completed normally.

  CPU 510 uses communication unit 562 to receive a message indicating that purchase processing (billing processing) has been completed normally from billing server 700 (step S314). More specifically, referring to FIG. 25H, CPU 510 causes touch panel 530 to display a message indicating that purchase processing (billing processing) with billing server 700 has been completed normally.

  CPU 510 transmits the authentication result to liquid crystal television 600 using communication unit 560 (step S316). CPU 510 ends the authentication / purchase application (step S318). CPU 510 receives content data from liquid crystal television 600 using communication unit 560 (step S320). More specifically, referring to FIG. 25K, CPU 510 of mobile phone 500 causes touch panel 530 to display an image indicating the purchased content when content data acquisition is completed. The CPU 510 shifts to a waiting state.

  On the other hand, CPU 710 of billing server 700 receives purchase information from mobile phone 500 using communication unit 762 (step S332). CPU 710 performs purchase processing based on the received purchase information (step S334). CPU 710 transmits information indicating the result of the purchase process to mobile phone 500 using communication unit 762 (step S336). CPU 710 receives a confirmation message from content server 800 using communication unit 762 (corresponding to step S374), and transmits to content server 800 that the purchase process has been confirmed normally using communication unit 762. (Step S338). The CPU 710 shifts to a waiting state (step S340).

  In this embodiment, user authentication is performed when a product is purchased. In order to log in to various services and to view member-only content (free), content that has already been purchased is used. User authentication may be performed for viewing (downloading). In this case, the content server 800 also performs processing corresponding to the accounting server 700 in the present embodiment, and exchanges target information for login or the like instead of purchase information.

  In addition, in the product purchase process by the user, whether only charging is first made in step S334 or whether payment is made in step S334 differs for each service. For example, when a product is purchased using prepaid electronic money, from the user's point of view, charging and settlement are performed at the same time.

  On the other hand, the CPU 610 of the liquid crystal television 600 receives the authentication result from the mobile phone 500 as the communication control unit 6101 (step S342). More specifically, referring to FIG. 25I, CPU 610 of liquid crystal television 600 receives a message from mobile phone 500 indicating that the authentication process has been completed normally, and the product purchase process on display 630 is normal. Display a message to the effect of completion.

  CPU 610 uses communication unit 662 to transmit the authentication result and TV ID for identifying liquid crystal television 600 to content server 800 (step S344). CPU 610 receives the processing result from content server 800 using communication unit 662 (step S346). CPU 610 determines whether or not the content has been normally received (step S348). That is, CPU 610 determines whether or not an error message has been received from content server 800.

  If CPU 610 does not normally receive content data from content server 800 (NO in step S348), CPU 610 causes display 630 to display a message indicating that content data acquisition has failed (step S350). The CPU 610 shifts to a normal operation state (step S352).

  When the content data is normally received (YES in step S348), CPU 610 determines whether or not the received content data is usable by mobile phone 500 (step S354). When the received content data is available on mobile phone 500 (YES in step S354), CPU 610 transmits the content data to mobile phone 500 using communication unit 660 (step S356). . More specifically, referring to FIG. 25J, CPU 610 causes display 630 to display a message indicating that content data is being transmitted to the mobile phone. The CPU 610 shifts to a normal operation state (step S358).

  If the received content data is not available on mobile phone 500 (NO in step S354), CPU 610 displays the content on display 630 based on the received content data (step S360). The CPU 610 shifts to a normal operation state (step S362).

  On the other hand, the CPU 810 of the content server 800 receives the authentication result and the TV ID from the liquid crystal television 600 using the communication unit 862 (step S372). The CPU 810 uses the communication unit 862 to check with the charging server 700 whether or not the purchase process has been normally completed (step S374). The CPU 810 determines whether or not both the authentication process and the purchase process are normally completed (step S376).

  CPU 810 transmits an error message to liquid crystal television 600 using communication unit 862 when either of the authentication process and the purchase process has not been completed normally (NO in step S376) (step S378). . The CPU 810 transitions to a normal operation state (step S380).

  CPU 810 transmits the corresponding content data to liquid crystal television 600 using communication unit 862 when both the authentication process and the purchase process are normally completed (YES in step S376) ( Step S382). CPU 810 stores the update history in storage unit 820 (step S384). The CPU 810 may update the purchase history stored in advance in the storage unit 820. The CPU 810 shifts to a normal operation state (step S386).

<Modification of terminal selection process>
Next, with reference to FIG. 1 to FIG. 15 and FIG. 26 to FIG. 30, a modified example of the processing procedure of the terminal selection processing in the information communication system 1 according to the present embodiment will be described. Here, a case where the user selects a plurality of products using the liquid crystal television 600, temporarily puts the plurality of products in a shopping cart, and then purchases the shopping cart products collectively or by selecting them. explain.

  FIG. 26 is a sequence illustrating a modified example of the process procedure of the terminal selection process in the information communication system 1. FIG. 27 is a first image diagram showing screen transition of liquid crystal television 600 and mobile phone 500 in a modification of the terminal selection process. FIG. 28 is a second image diagram showing screen transitions of liquid crystal television 600 and mobile phone 500 in a modification of the terminal selection process. FIG. 29 is an image diagram showing a data structure of display control data of mobile phone 500 in the terminal selection process. FIG. 30 is an image diagram showing a relationship between the touch panel 530 and the display area of each button in the terminal selection process.

  First, referring to FIG. 27A and FIG. 28A, CPU 610 of liquid crystal television 600 causes display 630 to display one or more products in a selectable manner based on the product information from content server 800. . In such a state, the CPU 610 of the liquid crystal television 600 accepts various operation commands as the accepting unit 6103 from the remote controller 300 via the remote controller signal receiving unit 680 (step S402).

  For example, referring to FIG. 27B and FIG. 28B, CPU 610 receives a product selection command from remote controller 300 via remote controller signal receiving unit 680, and converts it to product information of the selected product. Based on this, detailed information on the selected product is displayed on the display 630. At this time, CPU 610 causes display 630 to display a button for putting the product into the shopping cart.

  CPU 610 determines whether user authentication is required based on the operation command (step S404). If user authentication is not required (NO in step S404), for example, if a product is selected in the state shown in FIGS. 27A and 28A, CPU 610 repeats the processing from step S402. .

  If user authentication is required (YES in step S404), for example, if the button is pressed in the state shown in FIGS. 27B and 28B, CPU 610 has already received a user from content server 800. It is determined whether or not information related to a registered terminal has been received (step S406).

  When CPU 610 has already received information related to a terminal that has been registered as a user from content server 800 (YES in step S406), CPU 610 executes processing from step S412. When CPU 610 has not yet received information related to the user registered terminal from content server 800 (NO in step S406), CPU 610 uses communication unit 662 for information related to mobile phone 500 that can communicate with liquid crystal television 600. Is transmitted to the content server 800 (step S408).

  CPU 610 uses communication unit 662 to receive information about mobile phone 500 that has been registered as a user from content server 800 (step S410). CPU 610 determines whether or not user-registered mobile phone 500 exists (step S412). If there is no user-registered mobile phone 500 (NO in step S412), CPU 610 displays the next processing screen on display 630 as shown in FIG. 22C (step S414). The processing from step S402 is repeated.

  CPU 610, when there is a user-registered mobile phone 500 (YES in step S412), is a device for user authentication and purchase operation from remote controller 300 via remote controller signal receiver 680. A selection command is accepted (step S416). For example, as shown in FIGS. 27C and 28C, CPU 610 may accept a selection command as to whether to perform authentication / purchase using mobile phone 500 via display 630. .

  CPU 610 determines whether any mobile phone 500 has been selected, that is, whether a terminal selection command has been received (step S418). CPU 610 displays the next processing screen on display 630 (step S 414) when not accepting the selection command and selects to purchase on the television (when NO at step S 418), from step S 402. Repeat the process.

  When CPU 610 accepts a terminal selection command (YES in step S418), communication unit 660 sends a message requesting activation of an application for authentication and purchase and information on a product to be purchased. To the mobile phone 500 (step S420). For example, as shown in FIGS. 27D and 28D, CPU 610 causes display 630 to display a message indicating that information related to the product has been transmitted to the mobile phone. The CPU 610 executes authentication / purchase processing described later.

  On the other hand, CPU 810 of content server 800 receives information regarding mobile phone 500 that can communicate with liquid crystal television 600 from liquid crystal television 600 using communication unit 862 (step S422). CPU 810 refers to user registration database 180K in storage unit 820 and searches for mobile phone 500 (step S424).

  The CPU 810 determines whether there is a mobile phone 500 registered as a user in the service currently being executed (step S426). If there is mobile phone 500 registered as a user for the service currently being executed (YES in step S426), CPU 810 uses communication unit 862 to display information on mobile phone 500 that has been registered as a liquid crystal display. It transmits to the television 600 (step S428).

  When there is no mobile phone 500 registered as a user in the service currently being executed (NO in step S426), CPU 810 uses mobile unit 862 to register the mobile phone that has been registered as a user with liquid crystal television 600. Information about 500 is transmitted (step S430). The CPU 810 executes authentication / purchase processing described later.

  In the present embodiment, the process in which liquid crystal television 600 transmits information relating to products to mobile phone 500 and the process in which mobile phone 500 performs authentication / purchase processing via the screen operate independently. CPU 510 uses communication unit 562 to receive a message requesting activation of an application for authentication / purchase and product information (step S434). CPU 510 determines whether or not the authentication / purchase application has already been activated (step S436).

  If the authentication / purchase application has not yet been activated (NO in step S436), CPU 510 activates the authentication / purchase application (step S438). As shown in (E) of FIG. 27, CPU 510 displays information on the product to be authenticated / purchased on touch panel 530 (step S440).

  If the authentication / purchase application has already been activated (YES in step S436), CPU 510 displays information on the product to be authenticated / purchased on touch panel 530 as shown in FIG. S442). CPU 510 changes the authentication function allocation area (step S444).

  More specifically, referring to FIG. 29, storage unit 520 of mobile phone 500 stores a product table 180L. The product table 180L includes, for each product selected on the liquid crystal television 600, a selection number, a TV ID for identifying the liquid crystal television 600, an authentication target product ID, an image of the authentication target product, and an authentication target product. The price, the service provider, the URL of the charging / settlement site, and the contact area are stored in association with each other. No. at the bottom of FIG. 9999 means all items in the previous row. That is, no. When 9999 is selected / purchased, both book A and book B are purchased.

  The CPU 510 refers to the product table 180L, and displays the authentication target product ID and the authentication target image in the contact area of the touch panel 530 as shown in FIG. The CPU 510 functioning as the authentication unit 5103 can recognize which product the user has selected based on the position of the touch operation and the contact area. For example, if the position of the touch operation is within the range of coordinates (X11, Y11) − (X12, Y12), the book A is selected.

  In the present embodiment, authentication unit 5103 performs user authentication based on image data (fingerprint image) corresponding to a touch operation and authentication information 180B in storage unit 520 at the same time that a product is selected. it can. That is, mobile phone 500 according to the present embodiment can perform user authentication at the same time when the user inputs a product selection command to mobile phone 500. In other words, the user can complete product selection and user authentication with a single touch operation.

  However, the authentication unit 5103 may accept only a product selection command based on a touch operation and perform user authentication based on a signature image.

<Modification of authentication / purchase processing>
Next, a modified example (first modified example) of the processing procedure of the authentication / purchase process in the information communication system 1 according to the present embodiment will be described with reference to FIGS. 1 to 15, 24, and 31. . FIG. 31 is an image diagram showing screen transitions of liquid crystal television 600 and mobile phone 500 in the first modification of authentication / purchase processing in information communication system 1. Here, a case will be described in which the user selects a product from the products in the shopping cart using the mobile phone 500 and then purchases the product or purchases the products in the shopping cart at once. .

  Note that a part of the processing procedure of the first modified example of the authentication / purchase processing in the information communication system 1 is the same as that shown in FIG. 24, and therefore detailed description thereof will not be repeated here. Hereinafter, only the steps different from each other will be described with reference to FIGS.

  The number of authentication function areas in step S304 shown in FIG. 24 is one, but in step S304 according to this modification (a state in which a plurality of products are in the “shopping basket”), the authentication function The number of areas is plural. The purchase information in step S312 and step S332 includes information corresponding to at least one product selected by mobile phone 500.

<Second Modification of Authentication / Purchase Processing>
A second modification of the authentication / purchase process will be described with reference to FIG. FIG. 32 is an image diagram showing screen transition of mobile phone 500 in the second modification of the authentication / purchase process in information communication system 1.

  Referring to FIG. 32A, CPU 510 of mobile phone 500 causes touch panel 530 to display the first selected product on liquid crystal television 600. In the state shown in FIG. 32A, when CPU 510 accepts a fingerprint image via fingerprint input area 140A of touch panel 530, CPU 510 performs user authentication based on the fingerprint image and purchase command (selection command) for book A. Accept. CPU 510 further displays a button for switching products (image 140R indicating the right direction of the triangle in FIG. 32A) on touch panel 530. CPU 510 accepts a product switching command (pressing image 140R indicating the right direction) from the user via touch panel 530, and displays the next product on touch panel 530 as shown in FIG.

  In the state shown in FIG. 32B, upon receiving a fingerprint image via the fingerprint input area 140A of the touch panel 530, the CPU 510 performs user authentication based on the fingerprint image and purchase command (selection command) for book B Accept. CPU 510 further displays, on touch panel 530, buttons for switching products (image 140R indicating the right direction of the triangle and image 140L indicating the left direction in FIG. 32B). CPU 510 accepts a product switching command (pressing image 140L indicating the left direction) from the user via touch panel 530, and displays the previous product on touch panel 530, as shown in FIG. CPU 510 receives a product switching command (pressing of image 140R indicating the right direction) from the user via touch panel 530, and displays the next product on touch panel 530 as shown in FIG.

  In the state shown in FIG. 32C, upon receiving a fingerprint image via the fingerprint input area 140A of the touch panel 530, the CPU 510 performs user authentication based on the fingerprint image and purchase command (selection command) of the book C. Accept. CPU 510 further displays, on touch panel 530, buttons for switching products (image 140R indicating the right direction of the triangle and image 140L indicating the left direction in FIG. 32C). CPU 510 accepts a product switching command (pressing image 140L indicating the left direction) from the user via touch panel 530, and displays the previous product on touch panel 530, as shown in FIG. The CPU 510 receives a product switching command (pressing the image 140R indicating the right direction) from the user via the touch panel 530, and as shown in FIG. 32D, a screen for purchasing products in a batch on the touch panel 530 ( Button).

  In the state shown in FIG. 32D, when CPU 510 receives a fingerprint image via fingerprint input area 140A of touch panel 530, CPU 510 performs user authentication based on the fingerprint image and purchases books A to C at once. To accept instructions. CPU 510 further displays a button for switching products (image 140L showing the left direction of the triangle in FIG. 32D) on touch panel 530. CPU 510 accepts a product switching instruction (pressing image 140L indicating the left direction) from the user via touch panel 530, and displays the previous product on touch panel 530 as shown in FIG.

[Embodiment 2]
Next, a second embodiment of the present invention will be described. In the information communication system 1 according to the first embodiment described above, the product billing process is performed between the mobile phone 500 and the billing server 700. On the other hand, in information communication system 1B according to the present embodiment, billing processing for products is performed between liquid crystal television 600B and billing server 700B.

  First, the overall configuration of the information communication system 1B according to the present embodiment will be described with reference to FIG. FIG. 33 is an image diagram showing an overall configuration of information communication system 1B according to the present embodiment.

  The information communication system 1B according to the present embodiment includes a liquid crystal television (first communication device) 600B, a remote controller 300, a mobile phone 500B (second communication device), and a billing server 700B (first server). And a content server 800 (second server).

  The liquid crystal television 600B displays an image such as a web page. The liquid crystal television 600B may be another device having a display such as a plasma television, for example. In addition, the liquid crystal television 600B may be a device that includes a display device for displaying an image and an image data transmission device that transmits image data for display on the display device. Examples of the image data transmitting apparatus include an STB (Set Top Box), an HDD recorder, a DVD (Digital Versatile Disc) recorder, and a BD (Blu-ray Disc) recorder.

  The liquid crystal television 600B can be connected to the accounting server 700B via the network 70. The liquid crystal television 600B receives the authentication result from the mobile phone 500B and transmits the authentication result to the accounting server 700B. The liquid crystal television 600 </ b> B can be connected to the content server 800 via the network 80. The liquid crystal television 600B downloads web page data from the content server 800 or downloads digital data as a product.

  The cellular phone 500B can perform data communication with a telephone network by radio. The telephone network is, for example, a telephone network for mobile phones. The mobile phone 500B may be an information communication terminal that can be carried by the user, such as a PDA (Personal Digital Assistance) or a notebook personal computer. The mobile phone 500B performs user authentication and transmits the authentication result to the liquid crystal television 600B.

  Cellular phone 500B and liquid crystal television 600B perform data communication wirelessly or by wire. That is, the mobile phone 500B, the liquid crystal television 600B, and the remote controller 300 constitute a video display system.

  Billing server 700B performs billing processing with liquid crystal television 600B via network 70. For example, billing server 700B receives the user authentication result and the price of the product from liquid crystal television 600B, and withdraws the price of the product using the credit card number of the user of mobile phone 500B.

<Outline of operation of information communication system 1B>
Next, with reference to FIG. 33, an outline of operation of information communication system 1B according to the present embodiment will be described. Here, a case will be described in which a user purchases the product (digital data) by browsing the product using the liquid crystal television 600B and performing user authentication using the mobile phone 500B.

  Note that the operation outline of the setting stage and the terminal selection stage is the same as that of the first embodiment, and thus description thereof will not be repeated here. In the following, an outline of the operation at the authentication / purchase stage will be described.

  In step (7), the mobile phone 500 performs user authentication. More specifically, for example, the mobile phone 500 receives the first information and receives a touch operation with a user's finger. The mobile phone 500 acquires a fingerprint image as identification information. In this case, the mobile phone 500 performs fingerprint authentication. Alternatively, the mobile phone 500 receives the first information and receives a touch operation with the stylus pen. The mobile phone 500 acquires a signature image as identification information. In this case, the mobile phone 500 performs signature authentication.

  Alternatively, the mobile phone 500 acquires identification information by reading the IC chip or magnetic tape of the card. In this case, user authentication is performed based on data stored in an IC chip or a magnetic tape.

  As step (8), the mobile phone 500B transmits the authentication result to the liquid crystal television 600B via the network 70.

  As step (9), the liquid crystal television 600B transmits the authentication result in the mobile phone 500B and the first information to the accounting server 700B. Billing server 700B collects a charge from the user based on the authentication result and the first information. That is, billing server 700B performs billing processing corresponding to the selected product.

  As step (10), when the accounting process is normally completed, accounting server 700B transmits a message indicating that the accounting process has been completed to liquid crystal television 600B via network 70.

  As step (11), the liquid crystal television 600B transmits a message to the content server 800 indicating that the accounting process has been completed.

  In step (12), the content server 800 receives a message indicating that the accounting process has been completed, and transmits the selected product (digital data) to the liquid crystal television 600B via the network 80. The liquid crystal television 600B transmits the product (digital data) to the mobile phone 500B. Accordingly, the mobile phone 500B can display content based on the product (digital data).

  However, the liquid crystal television 600B may store the product in its own HDD or the like. In this case, the liquid crystal television 600B can display the content based on the product. In addition, the content server 800 may accept a message indicating that the accounting process has been completed and display the message to the administrator. The administrator may deliver the product to the user of the mobile phone 500B based on the message.

  Thus, in the information communication system 1B according to the present embodiment, since the liquid crystal television 600B transmits the first information to the mobile phone 500B, the mobile phone 500B displays the first information or the first information. The user authentication process can be performed based on the information. That is, in the information communication system 1B according to the present embodiment, the liquid crystal television 600B transmits the first information to the mobile phone 500B, the mobile phone 500B displays the first information, and the mobile phone 500B displays the identification information. , The mobile phone 500B can perform authentication processing, and the liquid crystal television 600B can perform charging processing together with the charging server 700B based on the first information and the authentication result.

Hereinafter, a configuration for realizing such a function will be described in detail.
<Configuration of mobile phone 500B>
First, with reference to FIG. 2, one mode of a specific configuration of mobile phone 500B constituting information communication system 1B will be described. Note that the hardware configuration of mobile phone 500B and the functional configuration of a part of CPU 510 are the same as those of Embodiment 1, and therefore description thereof will not be repeated here.

  The functional configuration of CPU 510 according to the present embodiment is different from that of CPU 510 according to Embodiment 1 in that communication control unit 5101 transmits an authentication result only to liquid crystal television 600B using communication unit 560.

<Configuration of LCD TV 600B>
Next, an aspect of a specific configuration of the liquid crystal television 600B constituting the information communication system 1B will be described. Note that the hardware configuration of liquid crystal television 600B and a part of the functional configuration of CPU 610 are the same as those of Embodiment 1, and therefore description thereof will not be repeated here.

  The functional configuration of the CPU 610 according to the present embodiment is different from the CPU 610 according to the first embodiment in that the communication control unit 6101 transmits an authentication result to the accounting server 700B using the communication unit 662.

<Configuration of charging server 700B>
Next, with reference to FIG. 13, an aspect of a specific configuration of billing server 700B configuring information communication system 1B will be described. Note that the hardware configuration of billing server 700B and a part of the functional configuration of CPU 710 are the same as those of the first embodiment, and thus description thereof will not be repeated here.

  Compared with the CPU 710 according to the first embodiment, the functional configuration of the CPU 710 according to the present embodiment is that the charging unit 7101 receives the authentication result and the first information from the liquid crystal television 600B by using the communication unit 762. The charging unit 7101 uses the communication unit 762 to notify the liquid crystal television 600B that the charging process has been completed.

[Embodiment 3]
Next, a third embodiment of the present invention will be described. In the information communication system 1B according to the second embodiment described above, the mobile phone 500B performs the authentication process. On the other hand, in the information communication system 1C according to the present embodiment, the liquid crystal television 600C performs an authentication process. That is, mobile phone 500C according to the present embodiment reads identification information and transmits the identification information to liquid crystal television 600C.

  First, with reference to FIG. 34, the overall configuration of information communication system 1C according to the present embodiment will be described. FIG. 34 is an image diagram showing an overall configuration of information communication system 1C according to the present embodiment.

  An information communication system 1C according to the present embodiment includes a liquid crystal television (first communication device) 600C, a remote controller 300, a mobile phone 500C (second communication device), and a billing server 700C (first server). And a content server 800 (second server).

  The liquid crystal television 600C displays an image such as a web page. The liquid crystal television 600C may be another device having a display such as a plasma television, for example. In addition, the liquid crystal television 600C may be a device that includes a display device for displaying an image and an image data transmission device that transmits image data for display on the display device. Examples of the image data transmitting apparatus include an STB (Set Top Box), HDD recorder, DVD (Digital Versatile Disc) recorder, BD (Blu-ray Disc) recorder, and the like.

  The liquid crystal television 600C can be connected to the accounting server 700B via the network 70. The liquid crystal television 600C receives identification information from the mobile phone 500C and performs an authentication process based on the identification information. The liquid crystal television 600C transmits the authentication result to the accounting server 700B. The liquid crystal television 600 </ b> C can be connected to the content server 800 via the network 80. The liquid crystal television 600C downloads web page data from the content server 800 or downloads digital data as a product.

  The mobile phone 500C can perform data communication with a telephone network by radio. The telephone network is, for example, a telephone network for mobile phones. The mobile phone 500C may be an information communication terminal that can be carried by the user, such as a PDA (Personal Digital Assistance) or a notebook personal computer. The mobile phone 500C acquires identification information for identifying the user, and transmits the identification information to the liquid crystal television 600C.

  Cellular phone 500C and liquid crystal television 600C perform data communication wirelessly or by wire. That is, the mobile phone 500C, the liquid crystal television 600C, and the remote controller 300 constitute a video display system.

  Accounting server 700B performs accounting processing with liquid crystal television 600C via network 70. For example, billing server 700B receives the user authentication result and the price of the product from liquid crystal television 600C, and withdraws the price of the product using the credit card number of the user of mobile phone 500C.

<Outline of operation of information communication system 1C>
Next, with reference to FIG. 34, an outline of operation of information communication system 1C according to the present embodiment will be described. Here, the user browses the product using the liquid crystal television 600C, and transmits the user identification information to the liquid crystal television 600C using the mobile phone 500C. A case where the user purchases the product (digital data) by performing user authentication based on the identification information by the liquid crystal television 600C will be described.

  First, an outline of the operation at the setting stage will be described. As step (1), the mobile phone 500C stores user identification information. The mobile phone 500C stores a fingerprint image or a signature image of the user (for example, the owner) of the mobile phone 500C as identification information.

  As step (2), the mobile phone 500C registers itself in the liquid crystal television 600C. At this time, the mobile phone 500C and the liquid crystal television 600C are paired using Bluetooth (registered trademark). The mobile phone 500C transmits information and identification information related to the mobile phone 500C to the liquid crystal television 600C.

  As step (3), the liquid crystal television 600C registers the mobile phone 500C as a Bluetooth (registered trademark) partner. That is, liquid crystal television 600C registers mobile phone 500C by storing information for identifying mobile phone 500C and identification information of the user of mobile phone 500C in registration terminal list 180E as authentication information.

  As step (4), the liquid crystal television 600C registers the user of the mobile phone 500C as a service provided by the content server 800 via the network 80. The content server 800 registers the mobile phone 500C with the service by storing information for identifying the mobile phone 500C in association with the service. This is the setting stage for purchasing the product.

  Next, an outline of the operation at the terminal selection stage will be described. In step (5), the user selects a product using the remote controller 300 while browsing the Web page using the liquid crystal television 600C. More specifically, the liquid crystal television 600C displays a web page from the content server 800 to the user. The Web page includes information about the product to be presented (product name, product image, product price, etc.). Then, the liquid crystal television 600C searches for a mobile phone 500C that can communicate. The liquid crystal television 600C transmits the detected identification information and selection command of the mobile phone 500C to the content server 800 via the network 80.

  As step (6), the content server 800 transmits identification information regarding the mobile phone 500C registered as a user in the setting stage among the above-described mobile phones 500C capable of communication to the liquid crystal television 600C.

  As step (7), the liquid crystal television 600C transmits information (first information) relating to the selected product and an identification information transmission command to the mobile phone 500C. At this time, the liquid crystal television 600 </ b> C may receive a selection command for the mobile phone 500 </ b> C used for obtaining the identification information from the user via the remote controller 300.

  Next, an outline of the operation at the authentication / purchase stage will be described. As step (8), the liquid crystal television 600C acquires the identification information from the selected mobile phone 500C. More specifically, the mobile phone 500C receives a touch operation with a user's finger and acquires a fingerprint image as identification information. Alternatively, the mobile phone 500C receives a touch operation with a stylus pen and acquires a sign image as identification information. Alternatively, the mobile phone 500C acquires identification information by reading the IC chip or magnetic tape of the card.

  As step (9), the mobile phone 500C transmits identification information (fingerprint image, signature image, etc.) to the liquid crystal television 600C.

  As step (10), the liquid crystal television 600C performs user authentication for the user of the mobile phone 500C based on the received identification information. For example, when the identification information is a fingerprint image, the liquid crystal television 600C performs fingerprint authentication. For example, when the identification information is a sign image, liquid crystal television 600C performs sign authentication. For example, the liquid crystal television 600C performs user authentication based on data stored in an IC chip or a magnetic tape.

  As step (11), the authentication result in the liquid crystal television 600C and the first information are transmitted to the accounting server 700C. The accounting server 700C collects a fee from the user based on the authentication result and the first information. That is, charging server 700C performs charging processing corresponding to the selected product.

  As step (12), when the accounting process is normally completed, accounting server 700C transmits a message to the effect that the accounting process is completed to liquid crystal television 600C via network 70.

  As step (13), the liquid crystal television 600C transmits a message to the content server 800 that the accounting process is completed.

  In step (14), the content server 800 receives a message indicating that the accounting process has been completed, and transmits the selected product (digital data) to the liquid crystal television 600C via the network 80. The liquid crystal television 600C transmits the product (digital data) to the mobile phone 500C. Accordingly, the mobile phone 500C can display content based on the product (digital data).

  However, the liquid crystal television 600C may store the product in its own HDD or the like. In this case, the liquid crystal television 600C can display the content based on the product. In addition, the content server 800 may accept a message indicating that the accounting process has been completed and display the message to the administrator. The administrator may deliver the product to the user of the mobile phone 500C based on the message.

  Thus, in the information communication system 1C according to the present embodiment, since the liquid crystal television 600C transmits the first information to the mobile phone 500C, the mobile phone 500C displays the first information or the first information. The identification information can be acquired based on the information. That is, in the information communication system 1C according to the present embodiment, the liquid crystal television 600C transmits the first information to the mobile phone 500C, the mobile phone 500C displays the first information, and the mobile phone 500C displays the identification information. , The liquid crystal television 600B can perform authentication processing, and the liquid crystal television 600C can perform billing processing together with the billing server 700B based on the first information and the authentication result.

Hereinafter, a configuration for realizing such a function will be described in detail.
<Configuration of mobile phone 500C>
First, with reference to FIG. 35, an aspect of a specific configuration of mobile phone 500C configuring information communication system 1C will be described. FIG. 35 is a block diagram showing configurations of mobile phone 500C and liquid crystal television 600C according to the present embodiment. Note that the hardware configuration of mobile phone 500C is the same as that of Embodiment 1, and therefore description thereof will not be repeated here.

(Functional configuration of CPU 510C)
The functions of the CPU 510C of the mobile phone 500C will be described. CPU 510C according to the present embodiment has functions of communication control unit 5101 and acquisition unit 5102. Specifically, the CPU 510C implements the above functions by executing the program 180A.

  The communication control unit 5101 transmits information indicating various functions of the mobile phone 500 </ b> C to the liquid crystal television 600 by using the communication unit 560. For example, the communication control unit 5101 receives a message from the liquid crystal television 600, and identifies a mobile phone 500C terminal ID, terminal name, presence / absence of an authentication function, presence / absence of a charging / settlement function, presence / absence of an information reading function. Information indicating whether or not current communication is possible is transmitted to the liquid crystal television 600.

  Further, the communication control unit 5101 transmits identification information described later to the liquid crystal television 600C by using the communication unit 560 according to the first information from the liquid crystal television 600C.

  The acquisition unit 5102 acquires image data as identification information from the touch panel 530. For example, when liquid crystal television 600 </ b> C performs fingerprint authentication, acquisition unit 5102 acquires image data indicating a fingerprint image from touch panel 530.

  For example, when liquid crystal television 600 </ b> C performs signature authentication, acquisition unit 5102 sequentially acquires image data indicating a contact area from touch panel 530. Then, the acquisition unit 5102 sequentially calculates center coordinates (center of gravity coordinates) of the contact area, and acquires a locus (sign image) of the center coordinates as identification information. Note that the acquisition unit 5102 sequentially acquires the center coordinates (center of gravity coordinates) of the contact area from the touch panel 530, and acquires the locus (sign image) of the center coordinates as identification information.

(Modification of mobile phone 500C)
However, the mobile phone 500C may include a card reader or the like instead of the touch panel 530. In this case, the acquisition unit 5102 acquires the identification information of the user by causing the card reader to read the IC chip or the magnetic tape of the authentication card owned by the user.

<Configuration of LCD TV 600C>
Next, an aspect of a specific configuration of the liquid crystal television 600C constituting the information communication system 1C will be described. Since the hardware configuration of liquid crystal television 600C is the same as that of Embodiment 1, the description thereof will not be repeated here.

(Functional configuration of CPU 610C)
Next, functions of the CPU 610C of the liquid crystal television 600C will be described. The CPU 610 according to the present embodiment has functions of a communication control unit 6101, a search unit 6102, a reception unit 6103, a registration unit 6104, and an authentication unit 6105. Specifically, the CPU 610C realizes the above function by executing the program 180C.

  The accepting unit 6103 accepts a command (registration command) for registering a device from the remote controller 300 via the remote controller signal receiving unit 680. The accepting unit 6103 accepts a command (first selection command) for selecting a product from the remote controller 300 via the remote controller signal receiving unit 680. The accepting unit 6103 accepts a command (second selection command) for selecting the mobile phone 500 that reads user identification information from the remote controller 300 via the remote controller signal receiving unit 680.

  The communication control unit 6101 performs pairing with the mobile phone 500 by using the communication unit 660 when the reception unit 6103 receives a registration command. By using the communication unit 660, the communication control unit 6101 uses the mobile phone 500 to identify the mobile phone 500 from a terminal ID, a terminal name, presence / absence of an authentication function, presence / absence of a billing and settlement function, an information reading function The presence / absence of the current communication is received.

  The communication control unit 6101 transmits the authentication result to the accounting server 700C by using the communication unit 662. In addition, the communication control unit 6101 receives a notification from the charging server 700C that the charging process has been completed normally. The communication control unit 6101 uses the communication unit 662 to transmit the fact that the accounting process has been normally completed and the first information to the content server 800 in association with each other.

  The registration unit 6104 receives the received terminal ID, terminal name, presence / absence of an authentication function, presence / absence of a charging / settlement function, presence / absence of an information reading function, and information indicating whether communication is currently possible. And stored in the registered terminal list 180E of the storage unit 620. When performing fingerprint authentication, registration unit 6104 stores the fingerprint image acquired from mobile phone 500C as registration information 180B in registration terminal list 180E of storage unit 620 when performing user registration. When performing signature authentication, registration unit 6104 stores the signature image acquired from mobile phone 500C as registration information 180B in registration terminal list 180E of storage unit 620 when performing user registration.

  When the receiving unit 6103 receives the first selection command, the searching unit 6102 can communicate with itself and acquire user identification information via the communication control unit 6101 and the communication unit 660. Search the mobile phone 500. Search unit 6102 updates registered terminal list 180E of storage unit 620 according to the search result. The search unit 6102 refers to the latest registered terminal list 180E and recognizes the mobile phone 500 that can communicate. Thereby, the reception unit 6103 can receive the second selection command.

  For example, when performing fingerprint authentication, the authentication unit 6105 substantially matches both based on the fingerprint image acquired from the mobile phone 500C and the authentication information (fingerprint image) stored in the storage unit 620 in advance. Determine whether or not. The authentication unit 6105 determines that the user authentication has succeeded when both substantially match, and determines that the user authentication has failed when both do not substantially match.

  For example, when performing signature authentication, the authentication unit 6105 substantially matches the signature image acquired from the mobile phone 500C and the authentication information (signature image) stored in the storage unit 620 in advance. Determine whether or not. The authentication unit 6105 determines that the user authentication has succeeded when both substantially match, and determines that the user authentication has failed when both do not substantially match.

[Embodiment 4]
Next, a fourth embodiment of the present invention will be described. In the information communication system 1C according to the third embodiment described above, the liquid crystal television 600B performs the authentication process. On the other hand, in information communication system 1D according to the present embodiment, billing server 700D performs authentication processing. That is, mobile phone 500D according to the present embodiment reads identification information and transmits the identification information to charging server 700D via liquid crystal television 600D.

  First, the overall configuration of the information communication system 1D according to the present embodiment will be described with reference to FIG. FIG. 36 is an image diagram showing an overall configuration of information communication system 1D according to the present embodiment.

  An information communication system 1D according to the present embodiment includes a liquid crystal television 600D (first communication device), a remote controller 300, a mobile phone 500D (second communication device), and a billing server 700D (first server). And a content server 800 (second server).

  The liquid crystal television 600D displays an image such as a web page. For example, the liquid crystal television 600D may be another device having a display such as a plasma television. In addition, the liquid crystal television 600D may be a device that includes a display device for displaying an image and an image data transmission device that transmits image data for display on the display device. Examples of the image data transmitting apparatus include an STB (Set Top Box), HDD recorder, DVD (Digital Versatile Disc) recorder, BD (Blu-ray Disc) recorder, and the like.

  The liquid crystal television 600D can be connected to the accounting server 700D via the network 70. The liquid crystal television 600D receives the identification information from the mobile phone 500D and transmits the identification information to the accounting server 700D via the network 70. The liquid crystal television 600D receives the authentication result from the accounting server 700D.

  The liquid crystal television 600D can be connected to the content server 800 via the network 80. The liquid crystal television 600D downloads web page data from the content server 800 or downloads digital data as a product.

  The mobile phone 500D can perform data communication with a telephone network by radio. The telephone network is, for example, a telephone network for mobile phones. The mobile phone 500D may be an information communication terminal that can be carried by the user, such as a PDA (Personal Digital Assistance) or a notebook personal computer. The mobile phone 500D acquires identification information for identifying the user, and transmits the identification information to the liquid crystal television 600D.

  Cellular phone 500D and liquid crystal television 600D perform data communication wirelessly or by wire. That is, the mobile phone 500D, the liquid crystal television 600D, and the remote controller 300 constitute a video display system.

  The accounting server 700D performs accounting processing with the liquid crystal television 600D via the network 70. For example, billing server 700D receives the user identification information and the product price from liquid crystal television 600D, and performs user authentication based on the identification information. When the user authentication is successful, billing server 700D uses the credit card number of the user of mobile phone 500D to withdraw the price of the product based on the price of the product.

<Outline of operation of information communication system 1D>
Next, with reference to FIG. 36, the operation | movement outline | summary of the information communication system 1D which concerns on this Embodiment is demonstrated. Here, the user browses the product using the liquid crystal television 600D, and transmits the user identification information to the liquid crystal television 600D using the mobile phone 500D. Then, the liquid crystal television 600D transmits the identification information to the accounting server 700D. Note that the identification information may be transmitted directly from the mobile phone 500D to the accounting server 700D instead of from the liquid crystal television 600D. The accounting server 700D will describe a case where the user purchases the product (digital data) by performing user authentication based on the identification information.

  First, an outline of the operation at the setting stage will be described. As step (1), the mobile phone 500D stores user identification information. The mobile phone 500D stores a fingerprint image or a signature image of the user (for example, the owner) of the mobile phone 500D as identification information.

  As step (2), the mobile phone 500D registers itself in the liquid crystal television 600D. At this time, the mobile phone 500D and the liquid crystal television 600D are paired using Bluetooth (registered trademark). The mobile phone 500D transmits information related to the mobile phone 500D and identification information of the user of the mobile phone to the liquid crystal television 600D. The liquid crystal television 600D registers the mobile phone 500D as a Bluetooth (registered trademark) partner. That is, liquid crystal television 600D registers mobile phone 500D by storing information related to mobile phone 500D in registered terminal list 180E.

  As step (3), the liquid crystal television 600D transmits information on the mobile phone 500D and user identification information to the accounting server 700D via the network 70.

  In step (4), charging server 700D registers mobile phone 500D by storing information for identifying mobile phone 500D and identification information of the user of mobile phone 500D in storage unit 720 as authentication information.

  As step (5), billing server 700D notifies liquid crystal television 600D that registration has been completed.

  As step (6), the liquid crystal television 600 </ b> D registers the user of the mobile phone 500 </ b> D with the service provided by the content server 800 via the network 80. The content server 800 registers the mobile phone 500D with the service by storing information for identifying the mobile phone 500D in association with the service. This is the setting stage for purchasing the product.

  Next, an outline of the operation at the terminal selection stage will be described. In step (7), the user selects a product using the remote controller 300 while browsing the Web page using the liquid crystal television 600D. More specifically, the liquid crystal television 600D displays a web page from the content server 800 to the user. The Web page includes information about the product to be presented (product name, product image, product price, etc.). Then, the liquid crystal television 600D searches for a mobile phone 500D that can communicate. The liquid crystal television 600D transmits the identification information and selection command of the detected mobile phone 500D to the content server 800 via the network 80.

  In step (8), the content server 800 transmits identification information regarding the mobile phone 500D registered as a user at the setting stage among the mobile phones 500D that can be communicated to the liquid crystal television 600D.

  As step (9), the liquid crystal television 600D transmits information (first information) on the selected product and an identification information transmission command to the mobile phone 500D. At this time, the liquid crystal television 600 </ b> C receives a selection command for the mobile phone 500 </ b> D used for the billing process from the user via the remote controller 300.

  Next, an outline of the operation at the authentication / purchase stage will be described. In step (10), the mobile phone 500D acquires identification information. More specifically, the mobile phone 500D receives a touch operation with a user's finger and acquires a fingerprint image as identification information. Alternatively, the mobile phone 500D receives a touch operation with a stylus pen and acquires a sign image as identification information. Alternatively, the mobile phone 500D acquires identification information by reading an IC chip or a magnetic tape of a card.

  As step (11), the mobile phone 500D transmits the identification information to the liquid crystal television 600D via the network 70.

  As step (12), the liquid crystal television 600D transmits the received identification information and first information to the accounting server 700D via the network 70.

  As step (13), billing server 700D performs user authentication for the user of mobile phone 500D based on the identification information and the authentication information. For example, when the identification information is a fingerprint image, billing server 700D performs fingerprint authentication. For example, when the identification information is a signature image, billing server 700D performs signature authentication. For example, billing server 700D performs user authentication based on data stored in an IC chip or a magnetic tape.

  Then, billing server 700D collects a charge from the user based on the authentication result and the first information. That is, billing server 700D performs billing processing corresponding to the selected product.

  As step (14), when the accounting process is normally completed, accounting server 700D transmits a message to the effect that the accounting process is completed to liquid crystal television 600D via network 70.

  As step (15), the liquid crystal television 600D transmits a message to the content server 800 that the accounting process is completed.

  In step (16), the content server 800 receives a message indicating that the accounting process is completed, and transmits the selected product (digital data) to the liquid crystal television 600D via the network 80. The liquid crystal television 600D transmits the product (digital data) to the mobile phone 500D. Accordingly, the mobile phone 500D can display content based on the product (digital data).

  However, the liquid crystal television 600D may store the product in its own HDD or the like. In this case, the liquid crystal television 600D can display the content based on the product. In addition, the content server 800 may accept a message indicating that the accounting process has been completed and display the message to the administrator. The administrator may deliver the product to the user of the mobile phone 500D based on the message.

  Thus, in the information communication system 1D according to the present embodiment, since the liquid crystal television 600D transmits the first information to the mobile phone 500D, the mobile phone 500D displays the first information or the first information. The identification information can be acquired based on the information. That is, in the information communication system 1D according to the present embodiment, the liquid crystal television 600D transmits the first information to the mobile phone 500D, the mobile phone 500D displays the first information, and the mobile phone 500D displays the identification information. , The charging server 700D can perform the authentication process, and the charging server 700D can perform the charging process based on the first information and the authentication result.

Hereinafter, a configuration for realizing such a function will be described in detail.
<Configuration of mobile phone 500D>
First, with reference to FIG. 37, an aspect of a specific configuration of mobile phone 500D configuring information communication system 1D will be described. Since the hardware configuration of mobile phone 500D is the same as that of Embodiment 1, the description thereof will not be repeated here.

(Functional configuration of CPU 510D)
The functions of the CPU 510D of the mobile phone 500D will be described. The CPU 510D according to this embodiment has functions of a communication control unit 5101 and an acquisition unit 5102. Specifically, the CPU 510D realizes the above function by executing the program 180A.

  By using the communication unit 560, the communication control unit 5101 transmits information indicating various functions of the mobile phone 500D to the liquid crystal television 600. For example, the communication control unit 5101 receives a message from the liquid crystal television 600D and identifies the terminal ID for identifying the mobile phone 500D, the name of the terminal, the presence / absence of an authentication function, the presence / absence of a charging / settlement function, the presence / absence of an information reading function Information indicating whether or not current communication is possible is transmitted to the liquid crystal television 600D. In addition, the communication control unit 5101 transmits the identification information to the liquid crystal television 600D by using the communication unit 560.

  The acquisition unit 5102 acquires image data as identification information from the touch panel 530. For example, when liquid crystal television 600D performs fingerprint authentication, acquisition unit 5102 acquires image data indicating a fingerprint image from touch panel 530.

  For example, when liquid crystal television 600D performs signature authentication, acquisition unit 5102 sequentially acquires image data indicating the contact area from touch panel 530. Then, the acquisition unit 5102 sequentially calculates center coordinates (center of gravity coordinates) of the contact area, and acquires a locus (sign image) of the center coordinates as identification information. Note that the acquisition unit 5102 sequentially acquires the center coordinates (center of gravity coordinates) of the contact area from the touch panel 530, and acquires the locus (sign image) of the center coordinates as identification information.

(Modification of mobile phone 500D)
However, the mobile phone 500D may include a card reader or the like instead of the touch panel 530. In this case, the acquisition unit 5102 acquires the identification information of the user by causing the card reader to read the IC chip or the magnetic tape of the authentication card owned by the user.

<Configuration of LCD TV 600D>
Next, an aspect of a specific configuration of the liquid crystal television 600D constituting the information communication system 1D will be described. Since the hardware configuration of liquid crystal television 600D is the same as that of Embodiment 1, the description thereof will not be repeated here.

(Functional configuration of CPU 610D)
Next, functions of the CPU 610D of the liquid crystal television 600D will be described. The CPU 610D according to the present embodiment has functions of a communication control unit 6101, a search unit 6102, a reception unit 6103, and a registration unit 6104. Specifically, the CPU 610D realizes the above function by executing the program 180C.

  The accepting unit 6103 accepts a command (registration command) for registering a device from the remote controller 300 via the remote controller signal receiving unit 680. The accepting unit 6103 accepts a command (first selection command) for selecting a product from the remote controller 300 via the remote controller signal receiving unit 680. The accepting unit 6103 accepts a command (second selection command) for selecting the mobile phone 500D that reads user identification information from the remote controller 300 via the remote controller signal receiving unit 680.

  The communication control unit 6101 performs pairing with the mobile phone 500 by using the communication unit 660 when the reception unit 6103 receives a registration command. The communication control unit 6101 uses the communication unit 660 to identify, from the mobile phone 500D, a terminal ID for identifying the mobile phone 500D, a terminal name, presence / absence of an authentication function, presence / absence of a charging and settlement function, an information reading function The presence / absence of the current communication is received.

  Communication control unit 6101 receives user identification information and first information from mobile phone 500D. Communication control unit 6101 transmits user identification information and first information from mobile phone 500D to billing server 700D.

  Communication control unit 6101 receives a notification to the effect that the accounting process has been completed normally from accounting server 700D. The communication control unit 6101 uses the communication unit 662 to transmit the fact that the accounting process has been normally completed and the first information to the content server 800 in association with each other.

  The registration unit 6104 receives the received terminal ID, terminal name, presence / absence of an authentication function, presence / absence of a charging / settlement function, presence / absence of an information reading function, and information indicating whether communication is currently possible. And stored in the registered terminal list 180E of the storage unit 620.

  When the reception unit 6103 receives the first selection command, the search unit 6102 can communicate with itself and acquire user identification information via the communication control unit 6101 and the communication unit 660. Search for mobile phone 500D. Search unit 6102 updates registered terminal list 180E of storage unit 620 according to the search result. The search unit 6102 refers to the latest registered terminal list 180E and recognizes the mobile phone 500 that can communicate. Thereby, the reception unit 6103 can receive the second selection command.

<Configuration of charging server 700D>
Next, with reference to FIG. 38, an aspect of a specific configuration of billing server 700D configuring information communication system 1D will be described. FIG. 38 is a block diagram showing a configuration of billing server 700D according to the present embodiment. Note that the hardware configuration of billing server 700D and the partial functional configuration of CPU 710 are the same as those of the first embodiment, and thus description thereof will not be repeated here.

  The functional configuration of the CPU 710 according to the present embodiment is different from the CPU 710 according to the first embodiment in that it includes a charging unit 7101, an authentication unit 7102, and a registration unit 7103.

  The registration unit 7103 stores the fingerprint image received from the mobile phone 500D and the liquid crystal television 600D using the communication unit 762 in the storage unit 720 as the authentication information 180B when performing user registration. Alternatively, the registration unit 7103 stores the signature image acquired from the mobile phone 500D and the liquid crystal television 600D using the communication unit 762 in the storage unit 520 as the authentication information 180B when performing user registration.

  For example, when performing fingerprint authentication, authentication unit 7102 substantially matches both based on the fingerprint image acquired from mobile phone 500D and authentication information (fingerprint image) stored in storage unit 720 in advance. Determine whether or not. The authentication unit 7102 determines that the user authentication has succeeded when both substantially match, and determines that the user authentication has failed when both do not substantially match.

  For example, when authenticating the signature, the authentication unit 7102 substantially matches the signature image acquired from the mobile phone 500D and the authentication information (signed image) stored in the storage unit 720 in advance. Determine whether or not. The authentication unit 7102 determines that the user authentication has succeeded when both substantially match, and determines that the user authentication has failed when both do not substantially match.

  Billing unit 7101 performs billing processing for the user of mobile phone 500D based on the authentication result from authentication unit 7102 and the first information from liquid crystal television 600D. For example, when the user authentication is successful, the charging unit 7101 stores the user name and the product price in association with each other in the charging database 180G.

  The charging unit 7101 collects the product price from the user with reference to the charging database 180G. When the accounting process for the user is normally completed, accounting unit 7101 notifies liquid crystal television 600D that the accounting process has been completed using communication unit 762.

<Other embodiments>
It goes without saying that the present invention can also be applied to a case where it is achieved by supplying a program to a system or apparatus. Then, a storage medium storing a program represented by software for achieving the present invention is supplied to the system or apparatus, and the computer (or CPU or MPU) of the system or apparatus stores the program code stored in the storage medium It is possible to enjoy the effects of the present invention also by reading and executing.

  In this case, the program code itself read from the storage medium realizes the functions of the above-described embodiment, and the storage medium storing the program code constitutes the present invention.

  As a storage medium for supplying the program code, for example, hard disk, optical disk, magneto-optical disk, CD-ROM, CD-R, magnetic tape, nonvolatile memory card (IC memory card), ROM (mask ROM, flash) EEPROM, etc.) can be used.

  Further, by executing the program code read by the computer, not only the functions of the above-described embodiments are realized, but also an OS (operating system) running on the computer based on the instruction of the program code However, it is needless to say that a part or all of the actual processing is performed and the functions of the above-described embodiments are realized by the processing.

  Further, after the program code read from the storage medium is written to a memory provided in a function expansion board inserted into the computer or a function expansion unit connected to the computer, the function expansion is performed based on the instruction of the program code. It goes without saying that the CPU or the like provided in the board or function expansion unit performs part or all of the actual processing and the functions of the above-described embodiments are realized by the processing.

  In the embodiment, the embodiment has been described in which the processing for searching for the mobile phone 600 is performed when a product is selected on the liquid crystal television 500. However, the present invention is not limited to this. The connection status and information may be acquired, and the registration terminal list 180E may be updated. In this case, it is only necessary to refer to the registered terminal list 180E at the search timing in the embodiment.

  The embodiment disclosed this time should be considered as illustrative in all points and not restrictive. The scope of the present invention is defined by the terms of the claims, rather than the description above, and is intended to include any modifications within the scope and meaning equivalent to the terms of the claims.

  1, 1B, 1C, 1D information communication system, 50 communication unit, 70, 80 network, 99 stylus pen, 130 driver, 131 scanning signal line drive circuit, 132 data signal line drive circuit, 133 photosensor drive circuit, 134 switch, 135 amplifier, 140 photosensor built-in liquid crystal panel, 140A fingerprint input area, 140B sine input area, 141 pixel circuit, 141b, 141g, 141r subpixel circuit, 143 electrode pair, 143a pixel electrode, 143b counter electrode, 144 photosensor circuit, 145, 145b, 145g, 145r photodiode, 146 capacitor, 151A active matrix substrate, 151B counter substrate, 152 liquid crystal layer, 153b, 153g, 153r color filter, 157 data signal line, 161 Polarizing filter, 162 Glass substrate, 163 Light shielding film, 164 Alignment film, 179 Backlight, 180 Image processing engine, 181 Driver control unit, 182 Timer, 183 Signal processing unit, 300 Remote controller, 500, 500B, 500C, 500D Telephone, 510 CPU, 5101 communication control unit, 5102 acquisition unit, 5103 authentication unit, 5104 registration unit, 520 storage unit, 522 temporary storage unit, 530 touch panel, 540 input unit, 555 recording medium, 556 recording medium access unit, 560, 562, 566 Communication unit, 564 antenna, 570 audio output unit, 574 audio input unit, 578 imaging unit, 579 vibration unit, 600, 600B, 600C, 600D LCD television, 602 antenna, 605 tuner, 607 Data processing unit, 610 CPU, 6101 communication control unit, 6102 search unit, 6103 reception unit, 6104 registration unit, 6105 authentication unit, 620 storage unit, 622 temporary storage unit, 630 display, 640 input unit, 660, 662 communication unit, 670 Audio output unit, 680 Remote controller signal receiving unit, 700, 700B, 700D Accounting server, 710 CPU, 7101 Accounting unit, 7102 Authentication unit, 7103 Registration unit, 720 Storage unit, 722 Temporary storage unit, 730 Display, 740 Input unit , 742 mouse, 744 keyboard, 760,762 communication unit, 800 content server, 810 CPU, 8101 registration unit, 820 storage unit, 840 input unit, 862 communication unit, 900 finger, 180A program, 180B authentication information, 80C programs, 180D recording data, 180E registered terminal list, 180F program, 180G billing database, 180H program, 180J content data, 180K user registration database, 180L product table, DB1, DB2 data bus.

Claims (21)

An information communication system comprising first and second communication devices,
The first communication device is:
A first communication interface for communicating with a device external to the first communication device;
A first display for displaying information of at least one product;
By using the first communication interface, search means for searching for the second communication device capable of communicating with itself and acquiring identification information;
When the product is selected, the first communication interface is used to transmit first information including information about the selected product to the second communication device capable of communication. 1 communication control means,
The second communication device is:
A second communication interface for communicating with a device external to the second communication device;
By using the second communication interface, a second communication control means for notifying the first communication device that it can acquire identification information;
A second display for displaying information on the selected product based on the first information from the first communication device;
An information communication system comprising: an acquisition means for acquiring identification information when information on the selected product is displayed on the second display. The first communication device is:
When the product is selected, the information processing apparatus further includes a selection unit that receives selection of the second communication device for transmitting the first information among the second communication devices searched by the search unit. The information communication system according to claim 1.   The information communication system according to claim 1, wherein the identification information specifies a user of the second communication device. The second display includes a touch panel for displaying information related to the product acquired from the first communication device and detecting a touch operation.
The acquisition means detects the touch operation via the touch panel,
The information communication system according to claim 1, wherein a fingerprint is acquired as the identification information. The first communication device further includes receiving means for sequentially receiving the product selection command,
The first communication control means transmits the first information corresponding to the selection command to the second communication device,
The touch panel displays at least one selected product based on the first information in a selectable manner,
The information communication system according to claim 4, wherein the acquisition unit receives a purchase command for the product and acquires the fingerprint by detecting a touch operation on the product via the touch panel. The second display includes information about the product and a touch panel for detecting a touch operation.
The information communication system according to claim 1, wherein the acquisition unit acquires a signature as the identification information by detecting a series of the touch operations via the touch panel.   The information communication system according to claim 1, wherein the first information indicates at least one of a name of the product, an image related to the product, a price of the product, and a device that can use the product. .   The information communication system according to any one of claims 1 to 7, wherein the second communication device further includes an authentication unit for performing user authentication based on the identification information. The information communication system further includes a first server,
The second communication device further includes a third communication interface for communicating with a device external to the second communication device,
The second communication control means transmits the authentication result by the authentication means to the first server by using the third communication interface,
9. The information communication system according to claim 8, wherein the first server includes a billing unit for performing a billing process on the selected product based on the authentication result from the second communication device. The information communication system further includes a first server,
The second communication control means transmits the authentication result by the authentication means to the first communication device by using the second communication interface,
The first communication device further includes a fourth communication interface for communicating with a device external to the first communication device,
The first communication control means transmits the authentication result to the first server by using the fourth communication interface,
The information communication system according to claim 8, wherein the first server includes a charging unit for performing a charging process for the selected product based on an authentication result from the first communication device. The information communication system further includes a first server,
The second communication control means transmits the identification information to the first communication device by using the second communication interface,
The first communication device is:
Authentication means for performing user authentication based on the identification information;
A fourth communication interface for communicating with a device external to the first communication device;
The first communication control means transmits the authentication result by the authentication means to the first server by using the fourth communication interface,
The information according to any one of claims 1 to 7, wherein the first server includes a charging unit for performing a charging process on the selected product based on the authentication result from the first communication device. Communications system. The information communication system further includes a first server,
The second communication control means transmits the identification information to the first communication device by using the second communication interface,
The first communication device further includes a fourth communication interface for communicating with a device external to the first communication device,
The first communication control means transmits the identification information to the first server by using the fourth communication interface,
The first server is
Authentication means for performing user authentication based on the identification information;
The information communication system according to any one of claims 1 to 7, further comprising billing means for performing billing processing on the selected product based on an authentication result by the authentication means. The product is content data,
The information communication system includes a second server that stores at least one content data in association with second information,
Before SL first communication control means, by using the fourth communication interface, receiving at least one of said second information from the second server,
The first display displays at least one product in a selectable manner based on the at least one second information,
It said first communication control means, based on the second information corresponding to the selected item, and transmits the first information to the second communication device, to any one of claims 10 to 12, The information communication system described.   14. The information communication system according to claim 13, wherein the first communication control means receives corresponding content data from the second server when the accounting process in the first server is completed. The product is content data,
The first server stores at least one of the content data in association with the second information,
The first communication control means receives at least one second information from the first server;
The first display displays at least one product in a selectable manner based on the at least one second information,
Said first communication control means, based on the second information corresponding to the selected item, and transmits the first information to the second communication device, to any of claims 9 to 12, The information communication system described.   16. The information communication system according to claim 15, wherein the first communication control means receives corresponding content data from the first server when the accounting process in the first server is completed. A communication interface for communicating with external devices;
A display for displaying information of at least one product;
By using the communication interface, search means for searching for another communication device that can communicate with itself and that can acquire identification information;
Selection means for accepting selection of the other communication device for transmitting first information related to the selected product among the other communication devices searched by the search means when the product is selected. When,
A communication apparatus comprising: a communication control means for transmitting the first information to the selected other communication apparatus by using the communication interface. A communication interface for communicating with external devices;
By using the communication interface, communication control means for notifying other communication devices that they can acquire identification information;
When at least one product displayed on the other communication device is selected, the at least one product on the basis of the first information including information on the selected product from the other communication device. A display that displays information;
A communication apparatus comprising: an acquisition unit configured to acquire identification information when information on the selected product is displayed on the display. A communication program for causing a communication device including a communication interface, a display, and an arithmetic processing unit to communicate with the arithmetic processing unit.
Displaying at least one item of information on the display;
Searching for another communication device that can communicate with itself and obtain identification information by using the communication interface;
A step of accepting selection of the other communication device for transmitting first information related to the selected product among the other communication devices searched in the searching step when the product is selected; When,
A communication program that causes the selected other communication device to execute first information related to the selected product by using the communication interface. A communication program for causing a communication device including a communication interface, a display, and an arithmetic processing unit to communicate with the arithmetic processing unit.
Notifying other communication devices that they can acquire identification information by using the communication interface;
When at least one product displayed on the other communication device is selected on the display, the selection is performed based on first information including information on the selected product from the other communication device. Displaying information about the selected product,
A communication program for executing the step of obtaining identification information when information on the selected product is displayed on the display. A first communication device including a first communication interface and a first display, a second communication interface and a second display, and capable of communicating with the first communication device and having identification information. A communication method in an information communication system comprising a second communication device that can be obtained ,
A step before Symbol second communication apparatus, by using the second communication interface, which is itself in the first communication device to notify that it is capable of acquiring identification information,
The first communication device displaying information of at least one product on the first display;
The first communication device searching for the second communication device by using the first communication interface;
When the first communication device uses the first communication interface when the product is selected, the first communication device includes the first communication interface including information related to the selected product. Sending the information of
The second communication device displaying information on the selected product on the second display based on the first information from the first communication device;
The second communication device includes a step of obtaining identification information when information on the selected product is displayed on the second display.

Images