JP4953802B2 - Communications system - Google Patents

Description

  The present invention relates to a communication system and a mobile terminal device, and more particularly to a communication system and a mobile terminal device that perform processing for performing communication between a plurality of devices.

In recent years, videophones have become widespread. Japanese Patent Laid-Open No. 11-234642 (Patent Document 1) discloses a technology of a videophone using a mobile phone and a television (hereinafter also referred to as a first prior art).
Japanese Patent Laid-Open No. 11-234642

  In the first prior art, voice communication is performed between two mobile phones using a telephone line network, and a network different from the telephone line network is used between two terminal adapters connected to a television. Image communication. That is, the first prior art has a problem that the network utilization efficiency is poor because two different networks are used to make a videophone call.

  The present invention has been made to solve the above-described problems, and an object thereof is to provide a communication system and a portable terminal device capable of performing communication using a network efficiently.

  In order to solve the above-described problems, according to one aspect of the present invention, a plurality of portable terminal devices that can communicate with the first network and a second network can communicate with each of the plurality of portable terminal devices. Each of the plurality of mobile terminal devices includes identification information of the own device and identification information of the mobile terminal device to be communicated among the plurality of mobile terminal devices. Generating means for generating a communication code including, and providing means for giving the communication code to the corresponding communication terminal device, each of the plurality of communication terminal devices acquiring means for acquiring the communication code from the corresponding mobile terminal device; And a transmission means for transmitting communication request data including the network address of the own device and the acquired communication code to the second network. Based on a plurality of communication request data transmitted to the work, specify at least two communication terminal devices that request communication of main information using the second network, and between the specified at least two communication terminal devices, Communication establishment processing for establishing communication of main information using the second network is performed.

Preferably, the main information is image and audio information.
Preferably, in the communication establishment process, each of the plurality of network addresses respectively used by the at least two communication terminal apparatuses to establish communication of main information using the second network between the at least two communication terminal apparatuses. , A process of transmitting to the corresponding communication terminal device.

  Preferably, each of the plurality of portable terminal devices further includes a communication target portable terminal device when the own device does not have identification information of a communication target portable terminal device used for generating a communication code. Receiving means for receiving the identification information from the portable terminal device to be communicated via the first network.

  Preferably, the communication system further includes a management server capable of communicating with the second network, and the management server receives a communication request data transmitted from each of the plurality of communication terminal devices to the second network. And at least two communications for requesting communication of main information using the second network based on the plurality of communication request data stored in the storage means A specifying means for specifying a terminal device and a communication establishing means for performing a communication establishment execution process for establishing communication of main information using the second network between the specified at least two communication terminal devices.

  Preferably, the communication establishment execution process includes each of a plurality of network addresses respectively used by the at least two communication terminal apparatuses to establish communication of main information using the second network between the at least two communication terminal apparatuses. Is transmitted to the corresponding communication terminal device.

  Preferably, the specifying unit requests communication of main information using the second network based on two pieces of identification information included in each of the plurality of communication codes respectively included in the plurality of communication request data. A communication terminal device is specified.

  Preferably, the communication code further includes communication establishment necessary information necessary for establishing communication between at least two communication terminal apparatuses.

  Preferably, the communication code further includes time limit information indicating a time limit during which communication between at least two communication terminal devices is possible.

  According to another aspect of the present invention, communication that is included in a communication system and that transmits communication request data including the network address of the own device and the acquired communication code to the second network by acquiring the communication code. A mobile terminal device associated with a terminal device, wherein the mobile terminal device generates a communication code including identification information of the own device and identification information of a mobile terminal device to be communicated, and a communication code Providing means for giving to the corresponding communication terminal device.

  A communication system according to the present invention includes a plurality of mobile terminal devices that can communicate with a first network, and a plurality of communication terminal devices that can communicate with a second network and respectively correspond to the plurality of mobile terminal devices. . Each of the plurality of mobile terminal devices gives a communication code including the identification information of the own device and the identification information of the mobile terminal device to be communicated to the corresponding communication terminal device. Each of the plurality of communication terminal devices acquires a communication code from the corresponding mobile terminal device, and transmits communication request data including the network address of the own device and the acquired communication code to the second network. The communication system specifies at least two communication terminal devices based on a plurality of communication request data, and establishes communication of main information using the second network between the specified at least two communication terminal devices. The communication establishment process is performed.

  Therefore, communication of main information using one second network can be established between at least two communication terminal devices without using the first network. As a result, it is possible to perform communication using the network efficiently.

  The portable terminal device according to the present invention gives a communication code including the identification information of the own device and the identification information of the portable terminal device to be communicated to the corresponding communication terminal device. By acquiring the communication code, the communication terminal device transmits communication request data including the network address of the own device and the acquired communication code to the second network. The communication system specifies at least two communication terminal devices based on a plurality of communication request data, and establishes communication of main information using the second network between the specified at least two communication terminal devices. The communication establishment process is performed.

  Therefore, communication of main information using one second network can be established between at least two communication terminal devices without using the first network. As a result, it is possible to perform communication using the network efficiently.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings. In the following description, the same parts are denoted by the same reference numerals. Their names and functions are also the same. Therefore, detailed description thereof will not be repeated.

<First Embodiment>
(System configuration)
FIG. 1 is a diagram illustrating a configuration of a network system 1000 according to the present embodiment. Referring to FIG. 1, network system 1000 includes home networks 501.1, 501.2,. n is included. In the following, the home networks 501.1, 501.2,. n (n: natural number) is also collectively referred to as a home network 501.

  The home network 501 is a network provided in the store. The home network 501 is not limited to the network provided in the store, but may be a network provided in the user's home, company, or the like. The home network 501 includes a mobile terminal device 500, a communication terminal device 600, an information processing server 700, and a communication unit 50.

  The mobile terminal device 500 is a mobile phone. The mobile terminal device 500 is not limited to a mobile phone, and any device (for example, a PDA (Personal Digital Assistance) or a PC (Personal Computer)) that has a communication function and is portable can be used. Good.

  The mobile terminal device 500 can perform data communication with the telephone network 60 by radio. The telephone network 60 is a telephone network for mobile phones, for example. Note that, when the mobile terminal device 500 performs data communication with the telephone network 60, a packet fee corresponding to the amount of data used at the time of data communication is generated.

  Communication terminal device 600 is assumed to be a general display-integrated PC having no special hardware configuration, including a display device for displaying images. Communication terminal device 600 is not limited to a display-integrated PC, and may be any device that can display an image. Communication terminal apparatus 600 may be an apparatus configured by a display device for displaying an image and an image data transmission device for transmitting image data for display on the display device. The image data transmission device is, for example, a PC.

  The information processing server 700 is a PC. The information processing server 700 is not limited to a PC, and may be another device.

  The mobile terminal device 500 and the communication terminal device 600 perform data communication wirelessly or by wire.

  The communication unit 50 has a function of performing data communication with each of the communication terminal device 600, the information processing server 700, and the network 70. The network 70 is an external network such as the Internet.

  The communication unit 50 has a function of performing data communication simultaneously with a plurality of devices by using a wireless technology based on IEEE 802.11g, which is a wireless LAN standard. The wireless technology is not limited to the technology based on IEEE 802.11g, and may be other wireless technology. Therefore, communication unit 50 can wirelessly perform data communication with each of communication terminal device 600, information processing server 700, and network 70.

  The communication unit 50 further includes a communication interface using Ethernet (registered trademark). Accordingly, the communication unit 50 can perform data communication with each of the communication terminal device 600, the information processing server 700, and the network 70 via, for example, a LAN cable. That is, the communication unit 50 can perform data communication with each of the communication terminal device 600, the information processing server 700, and the network 70 by wire.

  The network 70 can perform data communication with the telephone network 60 by radio or wire. Therefore, the mobile terminal device 500 can perform data communication with the network 70 via the telephone network 60.

The network system 1000 further includes a management server 800A.
The management server 800A includes in-home networks 501.1, 501.2,. n is a server that manages the information processing server 700 included in each of n. The management server 800A is a PC. The management server 800A is not limited to a PC, and may be another device.

The management server 800A performs data communication with the network 70 wirelessly or by wire.
In the present embodiment, it is assumed that communication unit 50 can perform high-speed data communication with each of communication terminal device 600, information processing server 700, and network 70. It is assumed that the communication unit 50 can perform data communication with each of the communication terminal device 600, the information processing server 700, and the network 70, for example, at a maximum speed of 100 Mbps (Mega bit per second).

  Further, it is assumed that the network 70 can perform high-speed data communication with each of the communication unit 50, the telephone network 60, and the management server 800A. It is assumed that the network 70 can perform data communication with each of the communication unit 50, the telephone network 60, and the management server 800A, for example, at a maximum speed of 100 Mbps. Therefore, for example, it is assumed that the maximum speed of data communication between communication terminal apparatus 600 and network 70 is 100 Mbps.

  It is assumed that the data communication speed between portable terminal device 500 and telephone network 60 is slower than the data communication speed between communication terminal device 600 and network 70. It is assumed that the maximum speed of data communication between the mobile terminal device 500 and the telephone network 60 is, for example, 256 kbps.

(Mobile terminal device)
Next, the mobile terminal device 500 will be described in detail.

  FIG. 2 is a diagram showing the external appearance of the mobile terminal device 500 from the front. With reference to FIG. 2, the mobile terminal device 500 includes a display unit 530, an audio output unit 570, an LED 576, and an input unit 540.

  The display unit 530 has a function of displaying characters, images, and the like. The display unit 530 is a device using an LCD panel (Liquid Crystal Display Panel). Note that the display unit 530 may be a device using a panel of a display method other than the above.

  The resolution of the display unit 530 is horizontal 480 (dots) × vertical 640 (dots). The resolution of the display unit 530 is not limited to horizontal 480 (dots) × vertical 640 (dots), and may be other resolutions.

  The display unit 530 has a touch panel function that allows the user to input information by directly touching the screen. Display unit 530 transmits the position information of the user touching the screen to control unit 510 described later. Control unit 510 performs predetermined processing based on the received position information.

  The voice output unit 570 has a function of outputting the voice of the telephone. Audio output unit 570 includes a speaker that outputs audio. The audio output unit 570 outputs audio based on audio data received from the control unit 510 described later from the speaker.

  The LED 576 performs light notification according to processing performed in the mobile terminal device 500. For example, the LED 576 blinks light when an incoming call is received.

  The input unit 540 includes a button group 541. The button group 541 includes direction buttons 541A, 541B, 541C, 541D, and an enter button 541E. The direction buttons 541A, 541B, 541C, and 541D are displayed when the image is displayed on the display unit 530 by a short time (for example, less than 1 second) pressing operation (hereinafter also referred to as a short pressing operation) by the user. This is a button for moving an object to be moved (for example, a cursor) vertically and horizontally.

  Specifically, the direction buttons 541A, 541B, 541C, and 541D in which a short press operation has been performed are buttons for moving the cursor up, down, left, and right, respectively, for example. In addition, the direction buttons 541A, 541B, 541C, and 541D can be operated by pressing the user for a long time (for example, one second or longer) (hereinafter, also referred to as a long press operation), for example, to move the screen up, down, left, or right It is also possible to scroll the screen.

  The determination button 541E is a button for determining an item or the like selected by a short press operation of the direction buttons 541A, 541B, 541C, 541D, for example.

  Input unit 540 further includes function buttons 542A, 542B, 543A, and 543B. Each of the function buttons 542A and 542B is a button for starting a program or the like preset by the user, for example, by a short press operation.

  The function button 543A is a button for making a call. For example, the function button 543A is subjected to a process of making a call to the terminal device of the input telephone number by inputting the telephone number by a short press operation of a numerical button group 546 described later and then pressing the function button 543A. The function button 543A is a button for starting a call by a short press operation when a call is made to the mobile terminal device 500. The function button 543B is a button for ending the call by a short press operation when the mobile terminal device 500 is in a call. The function button 543B is a button for switching the power of the mobile terminal device 500 on and off by a user's long time (for example, 1 second or longer) pressing operation (hereinafter also referred to as a long pressing operation). is there.

  Input unit 540 further includes a number button group 546. The number button group 546 includes 12 number buttons. The number of number buttons included in the number button group 546 is not limited to twelve. Each of the twelve number buttons is a button for inputting numbers, characters, symbols, or the like by a short press operation. The names of the 12 numeric buttons are referred to as 0 button, 1 button, 2 button, 3 button, 4 button, 5 button, 6 button, 7 button, 8 button, 9 button, symbol button 1 and symbol button 2, respectively.

  The input unit 540 transmits a button signal corresponding to a short-pressed or long-pressed button among a plurality of buttons included in the input unit 540 to the control unit 510 described later. That is, the input unit 540 is an interface for the user to operate the mobile terminal device 500. Hereinafter, an operation of the input unit 540 or a touch operation on the display unit 530 by the user is also referred to as an interface operation M.

  The mobile terminal device 500 further includes an audio input unit 574. The voice input unit 574 has a function of inputting voice during a call. The voice input unit 574 includes a microphone for inputting voice. The voice input unit 574 converts the voice acquired by the microphone into voice data, and transmits the voice data to the control unit 510 described later in the mobile terminal device 500.

  The portable terminal device 500 further includes a recording medium insertion unit 550A. The recording medium insertion unit 550 </ b> A is a part for inserting a recording medium, which will be described later, into the mobile terminal device 500.

  The mobile terminal device 500 further includes an imaging unit 578. The imaging unit 578 has a function of performing an imaging process for imaging a subject to be imaged. The imaging unit 578 includes an imaging lens, a light receiving unit, and a color filter unit (not shown). The light receiving unit has a function of converting input light into an electrical signal. The light receiving unit is composed of a plurality of light receiving elements. The light receiving element is an element using, for example, a CCD (Charge Coupled Device) image sensor or a CMOS (Complementary Metal Oxide Semiconductor) image sensor.

  The color filter unit is composed of a plurality of color filters. The color filter is a filter corresponding to each of R, G, and B. The plurality of color filters are provided corresponding to the plurality of light receiving elements, respectively.

  The following processing is performed in the imaging processing. First, the imaging unit 578 inputs light reflected by the subject to be imaged and incident on the imaging lens to the light receiving unit via the color filter unit. The light receiving unit converts the input light into an electrical signal. The imaging unit 578 converts the converted electrical signal into digital data (hereinafter also referred to as captured image data). Note that the mobile terminal device 500 may not include the imaging unit 578.

  FIG. 3 is a block diagram illustrating an internal configuration of the mobile terminal device 500. Note that FIG. 3 also shows a recording medium 555 for explanation. A recording medium 555 stores a program 180 described later. That is, the program 180 is recorded on a medium or the like and distributed as a program product. The recording medium 555 is also distributed as a program product.

  With reference to FIG. 3, portable terminal device 500 further includes a control unit 510, a temporary storage unit 522, and a storage unit 520.

  The storage unit 520 has a function of storing data in a nonvolatile manner. The storage unit 520 is accessed by the control unit 510. The storage unit 520 is a medium (for example, a flash memory) that can hold data in a nonvolatile manner even when power is not supplied. The storage unit 520 stores a program 180 and other various data.

  Control unit 510 has a function of performing various types of processing, arithmetic processing, and the like for each unit in portable terminal device 500 in accordance with program 180 stored in storage unit 520. Control unit 510 is a CPU (Central Processing Unit). Control unit 510 is not limited to a CPU, and may be another circuit having an arithmetic function.

  Temporary storage unit 522 is accessed as data by control unit 510 and used as a work memory for temporarily storing data. The temporary storage unit 522 is a DRAM (Dynamic Random Access Memory). Note that the temporary storage unit 522 is not limited to a DRAM, and may be another circuit capable of storing data in a volatile manner.

  When control unit 510 receives a display instruction for displaying an image on display unit 530, control unit 510 transmits the image data to a VDP (Video Display Processor) 532 described later. When receiving the image data, the VDP 532 displays an image (moving image or still image) based on the image data on the display unit 530.

  The mobile terminal device 500 further includes a VDP 532 (Video Display Processor) and a VRAM (Video Random Access Memory) 536.

The VRAM 536 has a function of temporarily storing image data.
Control unit 510 issues a drawing instruction to VDP 532 according to program 180 stored in storage unit 520. The drawing instruction is an instruction for generating an image and causing the display unit 530 to display the image.

  The VDP 532 is connected to the display unit 530. The VDP 532 reads font data, graphic data, and the like from a program 180 (to be described later) in the storage unit 520 in response to a drawing instruction from the control unit 510 and generates an image using the VRAM 536. The VDP 532 reads out the image data stored in the VRAM 536 and causes the display unit 530 to display an image based on the image data.

  The portable terminal device 500 further includes an input unit 540 and a recording medium access unit 550.

  Control unit 510 receives, from input unit 540, a button signal corresponding to a button that has been subjected to a short press operation or a long press operation among the plurality of buttons included in input unit 540. Control unit 510 performs processing according to the received button signal.

  The recording medium access unit 550 can access the recording medium 555 when the recording medium 555 is inserted (attached) to the portable terminal device 500 from the recording medium insertion unit 550A. As a result, the recording medium access unit 550 can read the program 180 from the recording medium 555 on which the program 180 is recorded.

  The program 180 stored in the recording medium 555 is read by the recording medium access unit 550 by the installation process of the control unit 510, and the control unit 510 stores the program 180 in the storage unit 520. The installation processing program is stored in advance in the storage unit 520, and the installation processing is performed by the control unit 510 based on the installation processing program.

  Note that the program 180 may not be installed in the storage unit 520. In this case, control unit 510 reads program 180 stored in recording medium 555 via recording medium access unit 550, and performs predetermined processing based on program 180.

  The recording medium 555 is an SD (Secure Digital (registered trademark)) memory card. The recording medium 555 is not limited to the SD memory card (registered trademark), and may be another medium capable of recording data in a nonvolatile manner.

The mobile terminal device 500 further includes a communication unit 560 and a communication unit 562.
Communication unit 560 exchanges data with control unit 510. Communication unit 560 has a function of transmitting / receiving data to / from communication terminal device 600 in a wired or wireless manner.

  The communication unit 560 has a function of a communication interface that performs serial transfer based on the USB (Universal Serial Bus) 2.0 standard. Note that the standard of the communication interface for performing serial transfer is not limited to USB 2.0, and may be another standard.

  Note that the communication unit 560 may have a function of a communication interface that performs parallel transfer. The communication interface that performs parallel transfer is, for example, an interface that conforms to a Centronics-compliant standard. Further, the communication unit 560 may have a communication interface function based on the IEEE 1394 or SCSI standard.

  Communication unit 560 further has a wireless data communication function. The wireless data communication function has a function of performing data communication wirelessly using Bluetooth (registered trademark). Note that the wireless data communication is not limited to a method using Bluetooth (registered trademark), and may be another communication method using infrared light, for example. Communication unit 560 performs data communication with communication terminal device 600 wirelessly in response to a control instruction from control unit 510.

  Communication unit 562 exchanges data with control unit 510. The communication unit 562 has a function of performing data communication using a wireless technology based on IEEE 802.11g, which is a wireless LAN standard. The wireless technology is not limited to the technology based on IEEE 802.11g, and may be other wireless technology.

The mobile terminal device 500 further includes an antenna 564 and a communication unit 566.
The antenna 564 is connected to the communication unit 566. The communication unit 566 has a function of transmitting and receiving a wireless communication signal using the antenna 564. The communication unit 566 receives a wireless communication signal having a frequency designated by the control unit 510 via the antenna 564. The wireless communication signal is a signal including voice data, character data, image data, and the like.

  Communication unit 566 uses antenna 564 to communicate with the nearest base station (not shown) using a wireless communication signal. The nearest base station can communicate with the telephone network 60. Therefore, the communication unit 566 uses the antenna 564 to communicate with the telephone network 60 via the nearest base station using a wireless communication signal. When receiving the wireless communication signal, the communication unit 566 demodulates the wireless communication signal and transmits data based on the demodulated wireless communication signal to the control unit 510.

  Further, when transmitting a wireless communication signal, the communication unit 566 receives data (for example, audio data) from the control unit 510 and converts the data into a wireless communication signal based on a predetermined protocol. Communication unit 566 then uses antenna 564 to transmit the converted wireless communication signal to telephone network 60 via the nearest base station (not shown).

  The portable terminal device 500 can also download a program from the network 70 via the telephone network 60 and store the program in the storage unit 520 through the processing of the control unit 510 and the communication unit 566. In this case, the downloaded program is the program 180.

  Control unit 510 performs predetermined processing in accordance with a program (program 180) downloaded from network 70. The download program is stored in advance in the storage unit 520, and the download process is performed by the control unit 510 based on the download program.

The control unit 510 performs data communication with the voice output unit 570 and the voice input unit 574 described above.
When control unit 510 transmits audio data to audio output unit 570, audio output unit 570 outputs audio based on the audio data received from control unit 510 from the speaker.

  When the user utters voice to the microphone included in the voice input unit 574, the voice input unit 574 converts voice acquired by the microphone into voice data, and transmits the voice data to the control unit 510.

  The control unit 510 performs data communication with the LED 576 and the imaging unit 578 described above. The LED 576 emits light based on a control instruction from the control unit 510.

  The imaging unit 578 performs the above-described imaging processing based on a control instruction from the control unit 510 and transmits captured image data to the control unit 510. Upon receiving the captured image data, control unit 510 stores the captured image data in any of temporary storage unit 522, storage unit 520, and recording medium 555.

  The mobile terminal device 500 further includes an RFID 580. The RFID 580 is an integrated circuit based on RFID (Radio Frequency Identification) having a security function such as FeliCa (registered trademark), and communicates with a reading terminal (not shown) in a non-contact manner. The RFID 580 outputs data such as a terminal ID based on a control instruction from the control unit 510.

(Communication terminal device)
Next, the communication terminal device 600 will be described in detail.

  FIG. 4 is a block diagram showing the internal configuration of communication terminal apparatus 600. FIG. 4 also shows a recording medium 555A for explanation. A recording medium 555A records a program 180A described later. That is, the program 180A is recorded on a medium or the like and distributed as a program product. The recording medium 555A is also distributed as a program product.

Referring to FIG. 4, communication terminal apparatus 600 includes a display unit 630, an audio output unit 670, an audio input unit 674, and an imaging unit 678. The display unit 630 has a function of displaying characters, images, and the like. The display unit 630 is a device that uses an LCD panel (Liquid Crystal Display Panel). The display unit 6 30 may be a device using a panel of display method other than the above. The size of the image that can be displayed by the display unit 630 is larger than the size of the image that can be displayed by the display unit 530. Further, the resolution of the display unit 630 is larger than the resolution of the display unit 530. For example, the resolution of the display unit 630 is a resolution of horizontal 1280 (dots) × vertical 768 (dots) at which a PC image can be displayed. Note that the resolution of the display unit 630 is not limited to horizontal 1280 (dots) × vertical 768 (dots), and may be other resolutions.

  The display unit 630 has a touch panel function that allows the user to input information by directly touching the screen. The display unit 630 transmits the position information on the screen touched by the user to the control unit 610 described later. Control unit 610 performs predetermined processing based on the received position information.

  Audio output unit 670 is provided outside communication terminal device 600. The audio output unit 670 has a function of outputting audio corresponding to processing performed by the control unit 610 described later. Audio output unit 670 includes a speaker that outputs audio. The audio output unit 670 outputs audio based on audio data received from the control unit 610 described later from the speaker.

  Voice input unit 674 is provided outside communication terminal apparatus 600. The voice input unit 674 has a function of inputting voice. Audio input unit 674 includes a microphone for inputting audio. The voice input unit 674 converts voice acquired by the microphone into voice data, and transmits the voice data to the control unit 610 described later.

  The imaging unit 678 is provided outside the communication terminal device 600. Since imaging unit 678 has the same configuration and function as imaging unit 578 of portable terminal device 500 described above, detailed description will not be repeated. That is, the imaging unit 678 has a function of performing an imaging process for imaging a subject to be imaged.

  In the imaging processing, the imaging unit 678 causes the light that is reflected by the subject to be imaged and incident on the imaging lens to be input to the light receiving unit via the color filter unit, similarly to the imaging unit 578 described above. The light receiving unit converts the input light into an electrical signal. The imaging unit 678 converts the converted electrical signal into digital data (hereinafter also referred to as captured image data).

  Communication terminal device 600 further includes a control unit 610, a temporary storage unit 622, and a storage unit 620.

  The storage unit 620 has a function of storing data in a nonvolatile manner. The storage unit 620 is accessed by the control unit 610. The storage unit 620 is a hard disk capable of storing a large amount of data. Note that the storage unit 620 is not limited to a hard disk, and may be any medium (for example, a flash memory) that can hold data in a nonvolatile manner even when power is not supplied. Storage unit 620 stores a program 180A, a device ID for identifying communication terminal device 600, and other various data.

  Control unit 610 has a function of performing various types of processing, arithmetic processing, and the like for each unit in communication terminal device 600 in accordance with program 180A stored in storage unit 620. Since control unit 610 is similar to control unit 510 described above, detailed description will not be repeated.

  The temporary storage unit 622 is used as a work memory that is accessed by the control unit 610 and temporarily stores data. Since temporary storage unit 622 is similar to temporary storage unit 522 described above, detailed description thereof will not be repeated.

Communication terminal apparatus 600 further includes VDP 632 and VRAM 636.
The VRAM 636 has a function of temporarily storing image data.

  The control unit 610 issues a drawing instruction to the VDP 632 according to the program 180A stored in the storage unit 620. The drawing instruction is an instruction for generating an image and causing the display unit 630 to display the image.

  The VDP 632 is connected to the display unit 630. In response to a drawing instruction from the control unit 610, the VDP 632 reads font data, graphic data, and the like from a program 180A described later in the storage unit 620, and generates an image using the VRAM 636. The VDP 632 reads out the image data stored in the VRAM 636 and causes the display unit 630 to display an image based on the image data.

  Communication terminal device 600 further includes an input unit 640 and a recording medium access unit 650.

  Input unit 640 includes a plurality of buttons (not shown). The plurality of buttons are provided outside communication terminal device 600. When any one of the buttons is pressed by the user, the input unit 640 transmits a button signal corresponding to the pressed button to the control unit 610. Control unit 610 performs predetermined processing based on the received button signal. Hereinafter, the button operation of the input unit 640 by the user is also referred to as an interface operation T. In the following, a touch operation on the display unit 630 by the user is also referred to as an interface operation T.

  The recording medium access unit 650 has a function of reading the program 180A from the recording medium 555A on which the program 180A is recorded. The program 180A stored in the recording medium 555A is read by the recording medium access unit 650 by the installation process of the control unit 610, and the control unit 610 stores the program 180A in the storage unit 620. The installation processing program is stored in advance in the storage unit 620, and the installation processing is performed by the control unit 610 based on the installation processing program.

  Note that the program 180A may not be installed in the storage unit 620. In this case, control unit 610 reads program 180A stored in recording medium 555A via recording medium access unit 650, and performs predetermined processing based on program 180A. Content data and the like are also recorded on recording medium 555A. The content data is, for example, music data, moving image data, and the like.

  The recording medium 555A is a CD-ROM (Compact Disk Read Only Memory). Note that the recording medium 555A is not limited to a CD-ROM, and other media capable of recording data in a nonvolatile manner, such as Blu-ray Disc (registered trademark), HD-DVD (High-Definition Digital Versatile Disc). ) (Registered trademark), DVD-ROM (Digital Versatile Disk Read Only Memory), SD memory card (registered trademark), or the like.

Communication terminal device 600 further includes communication unit 660 and communication unit 662.
Communication unit 660 exchanges data with control unit 610. Communication unit 660 has a function of transmitting / receiving data to / from portable terminal device 500 in a wired or wireless manner. Communication unit 660 has the same configuration and function as communication unit 560 described above, and therefore detailed description will not be repeated.

  Communication unit 662 transmits / receives data to / from control unit 610. Since communication unit 662 has the same configuration and function as communication unit 562 described above, detailed description will not be repeated. Therefore, communication unit 662 can perform data communication with communication unit 50 wirelessly.

  The communication unit 662 further has a communication interface function using Ethernet (registered trademark). Therefore, communication unit 662 can perform data communication with communication unit 50 via, for example, a LAN cable.

  Therefore, communication terminal apparatus 600 in the present embodiment can also download a program from network 70 via network 70 via communication unit 50 and communication unit 662, and store the program in storage unit 620. In this case, the downloaded program is the program 180A.

  Control unit 610 performs predetermined processing according to a program (program 180A) downloaded from network 70. The download program is stored in advance in the storage unit 620, and the download process is performed by the control unit 610 based on the download program.

  The control unit 610 performs data communication with the voice output unit 670 described above. When control unit 610 transmits audio data to audio output unit 670, audio output unit 670 outputs audio based on the audio data received from control unit 610 from the speaker.

The control unit 610 performs data communication with the voice input unit 674 described above.
When the user utters voice to the microphone included in the voice input unit 674, the voice input unit 674 converts voice acquired by the microphone into voice data and transmits the voice data to the control unit 610.

  The control unit 610 performs data communication with the imaging unit 678 described above. The imaging unit 678 performs the above-described imaging process based on a control instruction from the control unit 610 and transmits the captured image data to the control unit 610. Upon receiving the captured image data, control unit 610 stores the captured image data in any of temporary storage unit 622, storage unit 620, and recording medium 555A.

(Information processing server)
FIG. 5 is a block diagram showing the internal configuration of the information processing server 700. With reference to FIG. 5, the information processing server 700 includes a display unit 730, a control unit 710, a temporary storage unit 722, and a storage unit 720.

  The display unit 730 has a function of displaying characters, images, and the like. Since display unit 730 is similar to display unit 630 described above, detailed description will not be repeated.

  The storage unit 720 has a function of storing data in a nonvolatile manner. The storage unit 720 is accessed by the control unit 710. The storage unit 720 is a hard disk capable of storing a large amount of data. Note that the storage unit 720 is not limited to a hard disk and may be any medium (for example, a flash memory) that can hold data in a nonvolatile manner even when power is not supplied. The storage unit 720 stores a program 181 and other various data.

  The control unit 710 has a function of performing various types of processing, arithmetic processing, and the like for each unit in the information processing server 700 according to the program 181 stored in the storage unit 720. Since control unit 710 is similar to control unit 510 described above, detailed description will not be repeated.

  The temporary storage unit 722 is accessed as data by the control unit 710 and is used as a work memory that temporarily stores data. Since temporary storage unit 722 is similar to temporary storage unit 522 described above, detailed description thereof will not be repeated.

The information processing server 700 further includes a VDP 732 and a VRAM 736.
The VRAM 736 has a function of temporarily storing image data.

  The control unit 710 issues a drawing instruction to the VDP 732 according to the program 181 stored in the storage unit 720. The drawing instruction is an instruction for generating an image and causing the display unit 730 to display the image.

  The VDP 732 is connected to the display unit 730. In response to a drawing instruction from the control unit 710, the VDP 732 reads font data, graphic data, and the like from a program 181 described later in the storage unit 720, and generates an image using the VRAM 736. The VDP 732 reads the image data stored in the VRAM 736 and causes the display unit 730 to display an image based on the image data.

The information processing server 700 further includes an input unit 740.
A mouse 742 and a keyboard 744 are connected to the input unit 740. The user gives an instruction to the information processing server 700 using the mouse 742 or the keyboard 744. An input instruction from the mouse 742 or the keyboard 744 is transmitted to the control unit 710 via the input unit 740. Control unit 710 performs predetermined processing based on an input instruction from input unit 740.

The information processing server 700 further includes a communication unit 760 and a communication unit 762.
Communication unit 760 transmits and receives data to and from control unit 710. The communication unit 760 has a function of transmitting / receiving data to / from another device (not shown) in a wired or wireless manner. Since communication unit 760 has the same configuration and function as communication unit 560 described above, detailed description will not be repeated.

  The communication unit 762 performs data transmission / reception with the control unit 710. Since communication unit 762 has the same configuration and function as communication unit 662 described above, detailed description will not be repeated. Therefore, communication unit 762 can perform data communication with network 70 wirelessly. The communication unit 762 can perform data communication with the network 70 via, for example, a LAN cable and the communication unit 50.

(Management server)
FIG. 6 is a block diagram showing the internal configuration of the management server 800A. Referring to FIG. 6, management server 800A includes a display unit 830, a control unit 810, a temporary storage unit 822, and a storage unit 820.

  The display unit 830 has a function of displaying characters, images, and the like. Since display unit 830 is similar to display unit 630 described above, detailed description will not be repeated.

  The storage unit 820 has a function of storing data in a nonvolatile manner. The storage unit 820 is accessed by the control unit 810. The storage unit 820 is a hard disk capable of storing a large amount of data. Note that the storage unit 820 is not limited to a hard disk, and may be any medium (for example, a flash memory) that can hold data in a nonvolatile manner even when power is not supplied. The storage unit 820 stores a program 180B and other various data.

  Control unit 810 has a function of performing various types of processing, arithmetic processing, and the like for each unit in management server 800A in accordance with program 180B stored in storage unit 820. Since control unit 810 is similar to control unit 510 described above, detailed description will not be repeated.

  The temporary storage unit 822 is accessed as data by the control unit 810, and is used as a work memory that temporarily stores data. Since temporary storage unit 822 is similar to temporary storage unit 522 described above, detailed description thereof will not be repeated.

The management server 800A further includes a VDP 832 and a VRAM 836.
The VRAM 836 has a function of temporarily storing image data.

  The control unit 810 issues a drawing instruction to the VDP 832 in accordance with the program 180B stored in the storage unit 820. The drawing instruction is an instruction for generating an image and causing the display unit 830 to display the image.

  The VDP 832 is connected to the display unit 830. In response to a drawing instruction from the control unit 810, the VDP 832 reads font data, graphic data, and the like from a program 180B described later in the storage unit 520, and generates an image using the VRAM 836. The VDP 832 reads out the image data stored in the VRAM 836 and causes the display unit 830 to display an image based on the image data.

The management server 800A further includes an input unit 840.
A mouse 842 and a keyboard 844 are connected to the input unit 840. The user uses the mouse 842 or the keyboard 844 to give an instruction to the management server 800A. An input instruction from the mouse 842 or the keyboard 844 is transmitted to the control unit 810 via the input unit 840. Control unit 810 performs predetermined processing based on an input instruction from input unit 840.

The management server 800A further includes a communication unit 860 and a communication unit 862.
The communication unit 860 performs data transmission / reception with the control unit 810. The communication unit 860 has a function of transmitting and receiving data to and from other devices not shown in a wired or wireless manner. Communication unit 860 has the same configuration and function as communication unit 560 described above, and therefore detailed description will not be repeated.

  Communication unit 862 transmits and receives data to and from control unit 810. Since communication unit 862 has the same configuration and function as communication unit 662 described above, detailed description will not be repeated. Accordingly, the communication unit 862 can perform data communication with the network 70 wirelessly. The communication unit 862 can perform data communication with the network 70 via, for example, a LAN cable.

(Process for making a videophone call)
Next, processing for making a videophone call between two users using two communication terminal devices 600 respectively included in two different home networks 501 (hereinafter also referred to as videophone processing) will be described. .

  In the present embodiment, as an example, it is assumed that a user of mobile terminal device 500 included in home network 501.1 and a user of mobile terminal device 500 included in home network 501.2 make a videophone call. Hereinafter, the mobile terminal device 500 included in the home network 501.1 is also referred to as a mobile terminal device A. Communication terminal device 600 included in home network 501.1 is also referred to as communication terminal device A. The mobile terminal device 500 included in the home network 501.2 is also referred to as a mobile terminal device B. Communication terminal device 600 included in home network 501.2 is also referred to as communication terminal device B.

  Here, it is assumed that the telephone number “090111000” is assigned to the mobile terminal device A by a telephone company or the like. Further, it is assumed that the telephone number “090222000” is assigned to the mobile terminal device B by a telephone company or the like. That is, the telephone number assigned to each of the mobile terminal device A and the mobile terminal device B becomes identification information for specifying the mobile terminal device.

  Further, it is assumed that the device ID of the communication terminal device A is “11TA”. Here, the device ID is identification information for identifying the device. Further, it is assumed that the device ID of the communication terminal device B is “22TB”.

  The management server 800A includes in-home networks 501.1, 501.2,. The device IDs (for example, “11TA” and “22TB”) of the communication terminal device 600 included in each of n are managed. That is, in the storage unit 820 of the management server 800A, the home networks 501.1, 501.2,. Device IDs of a plurality of communication terminal devices 600 respectively corresponding to n are stored.

  Note that the communication terminal device 600 used for the video phone has a home network 501.1, 501.2,. There may be two or more of each n.

  Further, the number of communication terminal devices 600 used for the videophone is not limited to two, and may be three or more. In this case, each of the users of the three or more portable terminal devices 500 simultaneously makes a videophone call.

  First, between the portable terminal device A and the portable terminal device B, a process for making a call (hereinafter also referred to as a call process M) is performed. Here, it is assumed that the mobile terminal device A calls the mobile terminal device B. In this case, the mobile terminal device A becomes a calling side device. The mobile terminal device B is a called device. That is, the mobile terminal device B is a device that is a call target of the mobile terminal device A (hereinafter also referred to as a call target device). Further, the mobile terminal device A becomes a call target device of the mobile terminal device B.

  Here, the storage unit 520 of the mobile terminal device A stores a telephone number “090111000” that is identification information of the device itself, a telephone number “090222000” that is identification information of the mobile terminal device B, and a videophone keyword. Suppose that Further, it is assumed that the storage unit 520 of the mobile terminal device B stores a telephone number “090222000” that is identification information of the own device and a videophone keyword. Here, the videophone keyword is a keyword for making a videophone call. The videophone keyword is assumed to be “TV-TEL-AB”, for example.

  FIG. 7 is a flowchart of the call process M. In FIG. 7, the process performed in each of the portable terminal device A and the portable terminal device B is shown. In the mobile terminal device A, first, the process of step S110 is performed.

  In step S110, control unit 510 determines whether or not there is a call start operation A. The call start operation A is an interface operation M for making a call to the mobile terminal device B. Here, the call start operation A is a phone number “090222000” of the mobile terminal device B in a state where a program such as a phone book for performing a process of displaying a plurality of phone numbers stored in the storage unit 520 is executed. After “” is selected by the interface operation M, the function button 543A is short-pressed.

  Note that the call start operation A may be an operation of performing a short press operation of the function button 543A after inputting the telephone number “090222000” of the mobile terminal device B by a short press operation of the number button group 546. If YES in step S110, the process proceeds to step S112. On the other hand, if NO at step S110, the process at step S110 is performed again. Here, assuming that there is a call start operation, the process proceeds to step S112.

  In step S112, call processing M is performed. In the call processing M, the control unit 510 uses the communication unit 566 to send a signal for making a call (hereinafter also referred to as a telephone signal) to the mobile terminal device B via the telephone network 60 as a network. Send. The telephone signal includes a telephone number “090111000” that is identification information of the own apparatus (mobile terminal apparatus A).

And the process of step S112 is complete | finished.
In the mobile terminal device B, the process of step S140 is performed.

  In step S140, control unit 510 determines whether or not a telephone signal has been received via telephone network 60 as a network. If YES in step S140, the process proceeds to step S142. On the other hand, if NO at step S140, the process at step S140 is performed again. Here, assuming that a telephone signal is received, the process proceeds to step S142.

  In step S142, control unit 510 executes incoming call process M. The incoming call process M is a process performed independently of other processes. Then, the process proceeds to step S144.

  The incoming call process M is a process for notifying the user of the mobile terminal device B that a telephone signal has been received. The incoming call process M is a process for the control unit 510 to generate a ring tone from a speaker (not shown), for example. The incoming call process M ends when a call start operation B described later is performed.

  In step S144, control unit 510 determines whether there is a call start operation B or not. Here, the call start operation B is a short press operation of the function button 543A. If YES in step S144, the process proceeds to step S146. On the other hand, if NO at step S144, the process at step S144 is performed again. Here, assuming that there is a call start operation B, the process proceeds to step S146.

  With the above processing, a user can communicate with the user of the communication terminal device A and the user of the mobile terminal device B. The user of the communication terminal device A and the user of the mobile terminal device B make a call to start a videophone, for example.

  In step S146, control unit 510 determines whether the call has ended. The case where it is determined that the call has ended is a case where a call end operation has been performed. The call end operation is a short press operation of the function button 543B for ending the call, which is performed in either the communication terminal apparatus A or the mobile terminal apparatus B. If YES in step S146, the process proceeds to step S148. On the other hand, if NO at step S146, the process at step S146 is performed again. Here, it is assumed that the call termination operation is performed in the mobile terminal device B and the call is terminated, and the process proceeds to step S148.

  In step S148, an information storage process MB is performed. In the information storage processing MB, the control unit 510 causes the storage unit 520 to store the telephone number “090111000”, which is identification information of the mobile terminal device A, and the call end date / time included in the received telephone signal. The call end date and time is the date and time when the call ends. As an example, the call end date and time is “15:00:00 on December 20, 2006”. As described above, it is assumed that the videophone keyword “TV-TEL-AB” is stored in advance in the storage unit 520 before step 148.

  In the storage unit 520 of the mobile terminal device B, a telephone number “090111000” that is identification information of the mobile terminal device A may be stored in advance. In this case, in step S148, the process of storing the telephone number “090111000” that is the identification information of the mobile terminal device A is not performed. Then, the process proceeds to step S149.

  In step S149, control unit 510 executes videophone processing M. The videophone process M is a process performed independently of other processes. And the process of the portable terminal device B in the telephone call process M is complete | finished.

  Note that the processing in steps S144 and S146 may not be performed. That is, the mobile terminal device B that is the called device does not have to make a call with the mobile terminal device A. In this case, after the incoming call process M is performed for a predetermined time (for example, 30 seconds), the process of step S148 is performed.

  In communication terminal apparatus A, the process of step S116 is performed after the process of step S112.

  In step S116, control unit 510 determines whether the call has ended. The case where it is determined that the call has ended is a case where a call end operation has been performed. Since the process of step S116 is the same as the process of step S146, detailed description will not be repeated. If YES in step S116, the process proceeds to step S118. On the other hand, if NO at step S116, the process at step S116 is performed again. Here, it is assumed that the call termination operation is performed in the mobile terminal device B and the call is terminated, and the process proceeds to step S118.

  In step S118, an information storage process MA is performed. In the information storage process MA, the control unit 510 causes the storage unit 520 to store the call end date and time. The call end date and time is the date and time when the call ends. As an example, the call end date and time is “15:00:00 on December 20, 2006”. Then, the process proceeds to step S119.

  In step S119, control unit 510 executes videophone process M. The videophone process M is a process performed independently of other processes. And the process of the communication terminal device A in the telephone call process M is complete | finished.

  Next, videophone processing will be described. In the videophone process, the process performed by either the mobile terminal device A or the mobile terminal device B is the videophone process M described above. In the following, in videophone processing, processing performed by either communication terminal device A or communication terminal device B is also referred to as videophone processing T.

  Here, in the storage unit 520 of the mobile terminal device A, the telephone number “090111000” which is identification information of the own device, the telephone number “090222000” which is identification information of the mobile terminal device B, and the videophone keyword “TV− It is assumed that “TEL-AB” is stored. Further, it is assumed that the call end date and time “December 20, 2006, 15:00:00” is stored in the storage unit 520 of the mobile terminal device A by the process of step S118 of the call process M described above.

  Further, it is assumed that the storage unit 520 of the mobile terminal device B stores a telephone number “090222000” that is identification information of the own device and a videophone keyword “TV-TEL-AB”. Further, in the storage unit 520 of the mobile terminal device B, the telephone number “090111000” that is the identification information of the mobile terminal device A and the call end date and time “December 20, 2006” are obtained by the processing in step S148 of the call processing M described above. It is assumed that “15:00:00” is stored.

  In the above-described example, an example of a telephone call is shown. However, the telephone number “090222000” that is identification information of the mobile terminal device A may be notified to the mobile terminal device B by transmitting an e-mail.

  As described above, the mobile terminal device A and the communication terminal device A are included in the home network 501.1. That is, the mobile terminal device A is in the vicinity of the communication terminal device A. Further, the mobile terminal device B and the communication terminal device B are included in the home network 501.2. That is, the mobile terminal device B is in the vicinity of the communication terminal device B. In the present embodiment, it is assumed that a videophone call is performed between communication terminal apparatus A and communication terminal apparatus B. Here, each of communication terminal apparatus A and communication terminal apparatus B is an apparatus that requests to make a videophone using network 70 (hereinafter also referred to as a videophone requesting apparatus). Note that a videophone is a communication of image and audio information.

  FIG. 8 is a flowchart of the videophone process M, the videophone process T, and the process performed by the management server 800A. With reference to FIG. 8, first, the videophone process M performed by the mobile terminal device A will be described.

  In step S210, a communication code generation process M is performed. In the communication code generation process M, the control unit 510 stores the telephone number, which is the identification information of the own apparatus, stored in the storage unit 520, and the telephone number, which is the identification information of the apparatus to be called in the call process M of FIG. The communication code is generated using the videophone keyword stored in the storage unit 520 and the call end date and time stored in the storage unit 520. And the process of step S210 is complete | finished.

  Here, it is assumed that the telephone number which is identification information of the own device is “090111000”. In the call process M of FIG. 7, it is assumed that the call target device of the mobile terminal device A is the mobile terminal device B. Therefore, the telephone number which is identification information of the call target device is “090222000”. The videophone keyword is “TV-TEL-AB”. The call end date and time is assumed to be “December 20, 2006, 15:00”. In this case, the generated communication code is the following communication code MAD100.

  FIG. 9 is a diagram showing a communication code MAD100 as an example. Referring to FIG. 9, in communication code MAD100, “portable terminal ID1” is a telephone number which is identification information of the own device. “Portable terminal ID2” is a telephone number which is identification information of a call target device. Each of “mobile terminal ID1” and “mobile terminal ID2” is not limited to a telephone number, and may be, for example, a device ID.

  “Generation date” is the date and time when the communication code was generated. Here, it is assumed that the process of step S210 is performed after a minute time (for example, 0.01 seconds) has elapsed from the time when the process of step S119 or step S149 of FIG. For this reason, the date and time when the communication code is generated is almost equal to the call end date and time described above. Therefore, the “generation date / time” is the above-described call end date / time (“December 20, 2006, 15:00”).

  The “video phone time limit” is a time limit during which a video phone call can be made. The “video phone time limit” is set to the date and time after a predetermined time has elapsed from the “generation date and time”. If the “Generation Date / Time” is “December 20, 2006 15:00:00” and the predetermined time is, for example, 30 minutes, then “Video Phone Deadline” “December 20, 2006 15:30” .

  Again referring to FIG. 8, in videophone process T performed by communication terminal apparatus A, the process of step S240 is performed.

  In step S240, an initial image display process T is performed. In the initial image display process T, the control unit 610 generates the following initial image G100 using the VDP 632, and causes the display unit 630 to display the initial image G100. Then, the process of step S240 ends.

  FIG. 10 is a diagram illustrating an image displayed on the display unit 630. FIG. 10A is a diagram showing an initial image G100 as an example. Referring to FIG. 10A, button image BG110 is arranged in initial image G100. The button image BG110 is a button image for performing processing for registering a communication code by being pressed.

Referring to FIG. 8 again, after the process of step S240, the process proceeds to step S241.
In step S241, control unit 610 determines whether or not there is a registration start operation T. Here, the registration start operation T is an interface operation T for pressing the button image BG110. If YES in step S241, the process proceeds to step S242. On the other hand, if NO at step S241, the process at step S241 is performed again. Here, assuming that there is a registration start operation T by the user of the mobile terminal device A, the process proceeds to step S242.

In the portable terminal device A, the process proceeds to step S212 after the process of step S210.
In step S212, control unit 510 transmits the communication code to a nearby communication terminal device by radio. Here, the communication terminal device in the vicinity of the mobile terminal device A is the communication terminal device A. Here, it is assumed that the communication code to be transmitted is the communication code MAD100 in FIG. Therefore, communication code MAD100 is transmitted to communication terminal apparatus A. And the process of the portable terminal device A in the videophone process M is complete | finished.

  Note that the communication code may not be automatically transmitted after the process of step S210. In this case, for example, after the process of step S210, control unit 510 causes display unit 530 to display an image on which a code transmission button image for transmitting a communication code is displayed. When the interface operation M for pressing the code transmission button image is performed, the process of step S212 is performed.

  If it is determined YES in step S241, communication terminal apparatus A proceeds to step S242.

  In step S242, control unit 610 determines whether a communication code has been received. If YES in step S242, the process proceeds to step S243. On the other hand, if NO at step S242, the process at step S242 is performed again. Here, assuming that communication code MAD100 has been received, the process proceeds to step S243.

  In step S243, a communication code registration process T is performed. In the communication code registration process T, the control unit 610 causes the storage unit 620 to store the received communication code. Through this process, the communication code MAD100 is stored in the storage unit 620 of the communication terminal apparatus A. Then, using the VDP 632, the control unit 610 generates the following registration notification image G100A and causes the display unit 630 to display the registration notification image G100A. And the process of step S243 is complete | finished.

  Referring to FIG. 10 again, FIG. 10B is a diagram showing a registration notification image G100A as an example. In the registration notification image G100A, a message indicating that the communication code has been registered is displayed.

  Referring to FIG. 8 again, mobile terminal apparatus A may perform the following process MA instead of the process of transmitting the communication code to communication terminal apparatus A (step S212).

  In the process MA, the mobile terminal device A causes the display unit 530 to display a QR (Quick Response) code (registered trademark). The QR code (registered trademark) displayed on the display unit 530 is a code indicating information indicated by the communication code MAD100. The user of the mobile terminal device A brings the display unit 530 on which the QR code (registered trademark) is displayed closer to the imaging unit 678 of the communication terminal device A so that the imaging unit 678 of the communication terminal device A can capture images.

  In communication terminal apparatus A, instead of step S <b> 242, imaging unit 678 captures the QR code (registered trademark) displayed on display unit 530 and transmits the captured image data to control unit 610. Then, the control unit 610 receives the captured image data and acquires information indicated by the communication code MAD100. Then, control unit 610 performs a process of storing the acquired information in storage unit 620 instead of step S243. Then, the control unit 610 causes the display unit 630 to display the registration notification image G100A.

After the process of step S243, the process proceeds to step S244.
In step S244, control unit 610 transmits videophone request data for requesting a videophone call to management server 800A via network 70. The transmitted videophone request data includes the device ID of the device itself, the network address of the device itself, and the communication code. That is, the device that transmits the videophone request data is the videophone request device described above. Then, the process of step S244 ends.

  Here, the device performing the process of step S244 is the communication terminal device A. In this case, the device ID of the own device included in the videophone request data is “11TA”. Further, the network address of the own device included in the videophone request data is a network address assigned to the own device (communication terminal device A) at the time when the process of step S244 is performed. The network address is, for example, an IP (Internet Protocol) address. It is assumed that the communication code included in the videophone request data is the communication code MAD100. Therefore, the transmitted videophone request data is the following videophone request data TAD200.

  FIG. 11 is a diagram showing videophone request data TAD200 as an example. Referring to FIG. 11, videophone request data TAD200 is different from communication code MAD100 in FIG. 9 in that information of “communication terminal ID” and “communication terminal address” is added. Other than that, it is the same as communication code MAD100, and therefore detailed description will not be repeated. “Communication terminal ID” is the device ID “11TA” of the own device (communication terminal device A).

  The “communication terminal address” is a network address assigned to the own apparatus (communication terminal apparatus A) at the time when the process of step S244 is performed. The network address is, for example, an IP address.

  Referring to FIG. 8 again, management server 800A first performs the process of step S281.

  In step S281, control unit 810 determines whether videophone request data has been received. If YES in step S281, the process proceeds to step S282. On the other hand, if NO at step S281, the process at step S281 is performed again. Here, assuming that videophone request data TAD200 has been received, the process proceeds to step S282.

  In step S282, control unit 810 causes received videophone request data to be stored in storage unit 820. Through this process, the videophone request data TAD200 is stored in the storage unit 820. Then, the process proceeds to step S283.

  In step S283, control unit 810 determines whether or not identification of at least two videophone requesting devices (hereinafter also referred to as mutual videophone requesting devices) that perform videophone calls with each other has been completed. As described above, the videophone requesting device is a device that requests to make a videophone using the network 70. If YES in step S283, the process proceeds to step S285 described later. On the other hand, if NO at step S283, the process proceeds to step S284.

  In the method for specifying the mutual videophone request device, first, control unit 810 determines whether or not a plurality of videophone request data is stored in storage unit 820. If a plurality of videophone request data is not stored, the identification of the mutual videophone requesting device is not terminated. Here, it is assumed that one videophone request data TAD200 is stored in the storage unit 820. In this case, the identification of the mutual videophone requesting device is not completed, and it is determined as NO in Step S283, and the process proceeds to Step S284. Note that processing when a plurality of videophone request data is stored in the storage unit 820 will be described later.

  Hereinafter, a device that is a communication target for the videophone requesting device to make a videophone call is also referred to as a communication target device. Here, in the communication code included in the videophone request data transmitted by the videophone request device, the communication code in which the identification information corresponding to the portable terminal ID1 and the identification information corresponding to the portable terminal ID2 are exchanged is the communication target device. Communication code included in the videophone request data (hereinafter also referred to as communication target communication code).

Here, it is assumed that the videophone requesting device that transmitted the videophone request data is the communication terminal device A. In this case, device communication terminal apparatus A be communicated to cormorants row videophone is a communication terminal apparatus B. Therefore, the communication terminal apparatus B is a communication target apparatus.

  When the videophone request data transmitted by the communication terminal device A is the videophone request data TAD200 of FIG. 11, the communication code (communication target communication code) included in the videophone request data of the communication terminal device B that is the communication target device. Is a communication code in which the identification information corresponding to the portable terminal ID1 and the identification information corresponding to the portable terminal ID2 are replaced in the communication code MAD100 included in the videophone request data TAD200. That is, the communication target communication code is a communication code whose identification information corresponding to the portable terminal ID1 is “090222000” and whose identification information corresponding to the portable terminal ID2 is 090111000. The communication target communication code included in the videophone request data of the communication terminal device B that is the target device is not stored in the storage unit 820. That is, the communication target communication code of the communication target device is not registered in the management server 800A. .

  In step S284, control unit 810 transmits an unregistered notification to the device that transmitted the videophone request data determined to have been received in step S281. The unregistered notification is a notification that the communication target communication code of the communication target device is not registered. That is, this is a notification that the communication target communication code is not stored in the storage unit 820. Here, the device that transmitted the videophone request data is the communication terminal device A. Therefore, the unregistered notification is transmitted to the communication terminal device A. And the process of step S284 is complete | finished and the process of step S281 is performed again.

In the communication terminal device A, the process proceeds to step S245 after the process of step S244.
In step S245, notification reception standby processing T is performed. In the notification reception standby process T, the control unit 610 waits for a predetermined time to receive a notification from the management server 800A. The predetermined time is, for example, 1 minute.

  Here, it is assumed that an unregistered notification is received from the management server 800A within a predetermined time. In this case, the control unit 610 generates the following registration standby image G100B using the VDP 632 and causes the display unit 630 to display the registration standby image G100B. Note that when the predetermined time has elapsed, the process of step S245 ends.

  FIG. 12 is a diagram illustrating an image displayed on the display unit 630. FIG. 12A is a diagram illustrating a registration standby image G100B as an example. Referring to FIG. 12A, a message indicating that registration of the communication target device is waiting is displayed on registration standby image G100B.

Next, the videophone process M performed by the mobile terminal device B will be described.
Referring to FIG. 8 again, in step S210, the same processing as described above is performed, and thus detailed description will not be repeated. Here, it is assumed that the telephone number which is identification information of the own device is “090222000”. In the call processing M of FIG. 7, it is assumed that the call target device of the mobile terminal device B is the mobile terminal device A. Therefore, the telephone number which is identification information of the call target device is “090111000”. The videophone keyword is “TV-TEL-AB”. The call end date and time is assumed to be “December 20, 2006, 15:00”. In this case, the generated communication code is the following communication code MBD100.

  FIG. 13 is a diagram illustrating a communication code MBD100 as an example. Referring to FIG. 13, communication code MBD100 differs in “mobile terminal ID1” and “mobile terminal ID2” compared to communication code MAD100 in FIG. Other than that, it is the same as communication code MAD100, and therefore detailed description will not be repeated.

  As described above, “mobile terminal ID1” is a telephone number which is identification information of the own device. As described above, “portable terminal ID2” is a telephone number that is identification information of the call target device.

  Again referring to FIG. 8, in videophone process T performed by communication terminal apparatus B, the process of step S240 is performed.

  In step S240, processing similar to that described above is performed, and therefore detailed description will not be repeated. By this processing, the initial image G100 of FIG. 10A is displayed on the display unit 630 of the communication terminal apparatus B.

  In step S241, processing similar to that described above is performed, and therefore detailed description will not be repeated. Here, assuming that there is a registration start operation T by the user of the mobile terminal device B, the process proceeds to step S242.

In the mobile terminal device B, the process proceeds to step S212 after the process of step S210.
In step S212, processing similar to that described above is performed, and therefore detailed description will not be repeated. Through this process, the communication code MBD100 of FIG. 13 is transmitted to the communication terminal apparatus B. And the process of the portable terminal device B in the videophone process M is completed.

  Note that the communication code may not be automatically transmitted after the process of step S210. In this case, for example, after the process of step S210, control unit 510 causes display unit 530 to display an image on which a code transmission button image for transmitting a communication code is displayed. When the interface operation M for pressing the code transmission button image is performed, the process of step S212 is performed.

  If it is determined YES in step S241, communication terminal apparatus B proceeds to step S242.

  In step S242, processing similar to that described above is performed, and therefore detailed description will not be repeated. Here, assuming that communication code MBD100 of FIG. 13 has been received, the process proceeds to step S243.

  In step S243, processing similar to that described above is performed, and therefore detailed description will not be repeated. Through this process, the communication code MBD100 is stored in the storage unit 620 of the communication terminal apparatus B. Then, the registration notification image G100A shown in FIG. 10B is displayed on the display unit 630. And the process of step S243 is complete | finished.

  Referring to FIG. 8 again, mobile terminal apparatus B may perform the following process MB instead of the process of transmitting the communication code to communication terminal apparatus B (step S212).

  In the processing MB, the mobile terminal device B causes the display unit 530 to display a QR code (registered trademark). The QR code (registered trademark) displayed on the display unit 530 is a code indicating information indicated by the communication code MBD100. The user of the mobile terminal device B brings the display unit 530 on which the QR code (registered trademark) is displayed closer to the imaging unit 678 of the communication terminal device B so that the imaging unit 678 of the communication terminal device B can capture images.

  In communication terminal device B, instead of step S <b> 242, imaging unit 678 images the QR code (registered trademark) displayed on display unit 530 and transmits the captured image data to control unit 610. And control part 610 acquires information which communication code MBD100 shows by receiving picked-up image data. Then, control unit 610 performs a process of storing the acquired information in storage unit 620 instead of step S243. Then, the control unit 610 causes the display unit 630 to display the registration notification image G100A.

  In step S244, processing similar to that described above is performed, and therefore detailed description will not be repeated. Through this processing, videophone request data necessary for making a videophone is transmitted to management server 800A. The transmitted videophone request data includes the device ID of the device itself, the network address of the device itself, and the communication code.

  Here, the device performing the process of step S244 is the communication terminal device B. That is, the communication terminal apparatus B is the videophone request apparatus described above. In this case, the device ID of the device included in the videophone request data is “22TB”. The network address of the own device included in the videophone request data is the network address assigned to the own device (communication terminal device B) at the time when the process of step S244 is performed. The network address is, for example, an IP address. It is assumed that the communication code included in the videophone request data is communication code MBD100. Therefore, the transmitted videophone request data is the following videophone request data TBD200.

  FIG. 14 is a diagram showing videophone request data TBD200 as an example. Referring to FIG. 14, videophone request data TBD200 is different from communication code MBD100 of FIG. 13 in that information of “communication terminal ID” and “communication terminal address” is added. Other than that, it is the same as communication code MBD100, and therefore detailed description will not be repeated. “Communication terminal ID” is the device ID “22TB” of the own device (communication terminal device B).

  The “communication terminal address” is a network address assigned to the own apparatus (communication terminal apparatus B) at the time when the process of step S244 is performed. The network address is, for example, an IP address.

  Referring to FIG. 8 again, management server 800A performs the process of step S281.

  In step S281, the same processing as described above is performed, and therefore detailed description will not be repeated. Here, assuming that videophone request data TBD200 has been received, the process proceeds to step S282.

  In step S282, the same processing as described above is performed, and therefore detailed description will not be repeated. Through this process, the videophone request data TBD200 is stored in the storage unit 820. Then, the process proceeds to step S283.

  In step S283, processing similar to that described above is performed. Specifically, control unit 810 determines whether a plurality of videophone request data is stored in storage unit 820. Here, it is assumed that videophone request data TAD200 and videophone request data TBD200 are stored in storage unit 820. In this case, it is determined that the storage unit 820 stores a plurality of videophone request data.

  Control unit 810 corresponds to a communication code included in one videophone request data among a plurality of videophone request data, identification information corresponding to portable terminal ID1 and portable terminal ID2 in the communication code. It is determined whether or not the communication code (communication target communication code) in which the identification information is replaced is stored in the storage unit 820. If it is determined that the communication target communication code is not stored in the storage unit 820, the identification of the mutual videophone request device is not completed, and NO is determined in step S283, and the process proceeds to step S284.

  Here, it is assumed that videophone request data TAD200 and videophone request data TBD200 are stored in storage unit 820. In this case, in the communication code MAD100 included in the videophone request data TAD200, the communication code in which the identification information corresponding to the portable terminal ID1 and the identification information corresponding to the portable terminal ID2 are interchanged is included in the videophone request data TBD200. Communication code MBD100.

  In this case, it is determined that the communication target communication code is stored in the storage unit 820. In this case, control unit 810 identifies communication terminal apparatus A that has transmitted videophone request data TAD200 and communication terminal apparatus B that has transmitted videophone request data TBD200 as a mutual videophone request apparatus. That is, two pieces of identification information included in each of communication code MAD100 and communication code MBD100 included in videophone request data TAD200 and videophone request data TBD200 (telephone number indicated by portable terminal ID1 and telephone number indicated by portable terminal ID2) Based on the above, two mutual videophone requesting devices are identified.

  As a result, the identification of the mutual videophone requesting device has been completed. In step S283, the determination is YES, and the process proceeds to step S285.

  In the following, the videophone request data transmitted by each of the two communication terminal devices identified as the mutual videophone requesting device is also referred to as communication establishment necessary data. Therefore, each of the videophone request data TAD200 and the videophone request data TBD200 transmitted by the communication terminal device A and the communication terminal device B is data for establishing communication. Video phone request data TAD200 and video phone request data TBD200, which are communication establishment necessary data, are stored in association with storage unit 820.

  In step S285, it is determined whether authentication is successful. Specifically, the control unit 810 matches the “videophone keyword” indicated by each of the two communication establishment necessary data stored in association with the storage unit 820, and the current time is two. It is determined whether or not the time is before the “video phone time limit” indicated by any of the communication establishment necessary data. If YES in step S285, the process proceeds to step S287 described later. On the other hand, if NO at step S285, the process proceeds to step S286. Here, it is assumed that the “videophone keyword” indicated by each of the two communication establishment necessary data does not match, and the process proceeds to step S286.

  In step S286, control unit 810 transmits an authentication failure notification to the two communication terminal devices respectively identified by the two communication terminal IDs indicated by the two communication establishment necessary data. Here, the authentication failure notification is a notification that the authentication has failed. Here, it is assumed that the authentication failure notification is transmitted to each of the communication terminal device A and the communication terminal device B. Then, the process of step S281 is performed again.

Here, it is assumed that communication terminal apparatus A is performing the process of step S245.
In step S245, the above-described processing is performed, and thus detailed description will not be repeated. Here, it is assumed that an authentication failure notification is received within a predetermined time. In this case, the control unit 610 generates the following authentication failure image G100C using the VDP 632, and causes the display unit 630 to display the authentication failure image G100C. If an authentication failure notification is received within a predetermined time, the authentication failure image G100C is displayed for a predetermined time (for example, 10 seconds), and the process proceeds to step S246.

  Referring to FIG. 12 again, FIG. 12B is a diagram showing an authentication failure image G100C as an example. Referring to FIG. 12B, in authentication failure image G100C, a message indicating that the keyword of its own device does not match the keyword of the communication target device and a message indicating that the communication processing is to be terminated are displayed. Is done.

  Referring to FIG. 8 again, as described above, when an authentication failure notification is received within a predetermined time in the process of step S245, the authentication failure image G100C is displayed for a predetermined time (for example, 10 seconds). Then, the process proceeds to step S246.

  In step S246, control unit 810 determines whether or not an authentication failure notification has been received. If YES in step S246, the process of step S240 is performed again. On the other hand, if NO at step S246, the process proceeds to step S247 described later. Here, assuming that an authentication failure notification has been received, the process of step S240 is performed again.

  The processing in the communication terminal device B when the authentication failure notification is transmitted to the communication terminal device B is the same as the processing after the authentication failure notification is received in the processing in step S245 of the communication terminal device A described above. The explanation will not be repeated.

  Next, in the process of step S285, the two communication establishment necessary data to be determined are the videophone request data TAD200 and the videophone request data TBD200, and the current time at the time when the process of step S285 is performed is: For example, processing in the case of “December 20, 2006, 15:05” will be described.

  In this case, the “videophone keyword” indicated by each of the videophone request data TAD200 and the videophone request data TBD200 is “TV-TEL-AB” and matches. In addition, the current time “December 20, 2006, 15:05” at the time when the process of step S285 is performed is “Video phone deadline” (one of the video phone request data TAD200 and the video phone request data TBD200) ( The time is before “December 20, 2006, 15:30”). In this case, YES is determined in step S285, and the process proceeds to step S287.

  In step S287, control unit 810 transmits an authentication success notification to two communication terminal devices (mutual videophone requesting devices) respectively identified by two communication terminal IDs indicated by two pieces of communication establishment necessary data. Here, the authentication success notification is a notification that the authentication is successful.

  Here, the two communication establishment necessary data are the videophone request data TAD200 and the videophone request data TBD200. Therefore, the two communication terminal devices specified by the communication terminal ID “11TA” and the communication terminal ID “22TB” respectively indicated by the videophone request data TAD200 and the videophone request data TBD200 are the communication terminal device A and the communication terminal device B. It is. Therefore, an authentication success notification is transmitted to each of communication terminal apparatus A and communication terminal apparatus B, which are mutual videophone requesting apparatuses. Then, the processing in management server 800A ends.

  The authentication success notification transmitted to the communication terminal device A includes the IP address “222.222.2.2” of the communication terminal device B that is the communication target of the communication terminal device A. In addition, the authentication success notification transmitted to the communication terminal apparatus B includes the IP address “111.111.1.1” of the communication terminal apparatus A that is the communication target of the communication terminal apparatus B.

  Next, the processing of communication terminal apparatus A when an authentication success notification is transmitted to each of communication terminal apparatus A and communication terminal apparatus B, which are mutual videophone requesting apparatuses, by the process of step S287 will be described.

Here, it is assumed that communication terminal apparatus A is performing the process of step S245.
In step S245, the above-described processing is performed, and thus detailed description will not be repeated. Here, it is assumed that an authentication success notification including the IP address “222.222.2.2” of the communication terminal apparatus B is received within a predetermined time. In this case, the control unit 610 causes the storage unit 620 to store the IP address “222.222.2.2” included in the received authentication success notification. Then, the control unit 610 generates the following authentication success image G100D using the VDP 632, and causes the display unit 630 to display the authentication success image G100D. If an authentication success notification is received within a predetermined time, the authentication success image G100D is displayed for a predetermined time (for example, 10 seconds), and the process proceeds to step S246.

  FIG. 15 is a diagram illustrating an authentication success image G100D as an example. Referring to FIG. 15, a message that authentication is successful and a message that communication processing is started are displayed on authentication success image G100D.

  Referring to FIG. 8 again, as described above, when the authentication success notification is received in the process of step S245, the authentication success image G100D is displayed for a predetermined time (for example, 10 seconds), and then step The process proceeds to S246.

  In step S246, processing similar to that described above is performed, and therefore detailed description will not be repeated. Here, assuming that the authentication failure notification has not been received, the process proceeds to step S247.

  In step S247, control unit 810 determines whether an authentication success notification has been received. If YES in step S247, the process proceeds to step S248. On the other hand, if NO at step S247, the process at step S240 is performed again. Here, assuming that an authentication success notification including the IP address “222.222.2.2” of communication terminal apparatus B has been received, the process proceeds to step S248.

  In step S248, a videophone image display process T is performed. In the videophone image display process T, the control unit 610 generates the following videophone image G200 using the VDP 632 and causes the display unit 630 to display the videophone image G200. And the process of step S248 is complete | finished.

  FIG. 16 is a diagram showing a videophone image G200 as an example. Referring to FIG. 16, status display image G205, communication target device captured image G210, own device captured image G220, and button images BG250 and BG290 are arranged in videophone image G200.

  The status display image G205 is an image indicating the communication status between the device itself and the communication target device. When data communication between the own device and the communication target device is possible, online is displayed. When data communication between the own device and the communication target device is impossible, “offline” is displayed.

  In the communication target device captured image G210, an image captured by the image capturing unit 678 of the communication target device is displayed. In the own device captured image G220, an image captured by the imaging unit 678 of the own device is displayed.

  The button image BG250 is a button image for performing a settlement process described later by being pressed. The button image BG290 is a button image for ending communication with the communication target device by being pressed.

  Here, it is assumed that the device performing the process of step S248 is the communication terminal device A. In this case, the own apparatus in the description of the videophone image G200 of FIG. In addition, the communication target device in the description of the videophone image G200 described above is the communication terminal device B.

  Next, the processing of communication terminal apparatus B when an authentication success notification is transmitted to each of communication terminal apparatus A and communication terminal apparatus B, which are mutual videophone request apparatuses, by the process of step S287 described above will be described. . As described above, the authentication success notification transmitted to the communication terminal apparatus B includes the IP address “111.111.1.1” of the communication terminal apparatus A to be communicated.

Here, it is assumed that the communication terminal apparatus B is performing the process of step S245.
In step S245, the above-described processing is performed, and thus detailed description will not be repeated. Here, it is assumed that an authentication success notification including the IP address “111.111.1.1” of the communication terminal apparatus A is received within a predetermined time. In this case, the control unit 610 causes the storage unit 620 to store the IP address “111.111.1.1” included in the received authentication success notification. Then, using the VDP 632, the control unit 610 generates the authentication success image G100D in FIG. 15 and causes the display unit 630 to display the authentication success image G100D. If an authentication success notification is received within a predetermined time, the authentication success image G100D is displayed for a predetermined time (for example, 10 seconds), and the process proceeds to step S246.

  In step S246, processing similar to that described above is performed, and therefore detailed description will not be repeated. Here, assuming that the authentication failure notification has not been received, the process proceeds to step S247.

  In step S247, the same processing as described above is performed, and therefore detailed description will not be repeated. Here, assuming that an authentication success notification including the IP address “111.111.1.1” of communication terminal apparatus A is received, the process proceeds to step S248.

  In step S248, processing similar to that described above is performed, and therefore detailed description will not be repeated. By this processing, the videophone image G200 of FIG. 16 is displayed on the display unit 630 of the communication terminal apparatus B. In this case, the own device in the description of the videophone image G200 of FIG. In addition, the communication target device in the description of the videophone image G200 described above is the communication terminal device A.

  In each of communication terminal apparatus A and communication terminal apparatus B, the process proceeds to step S249 after the process of step S248.

  In step S249, a communication process T is performed. In the communication process T, the control unit 610 identifies captured image data obtained by the imaging process of the imaging unit 678 of its own device by the IP address stored in the storage unit 620 via the network 70. The process of transmitting to the communication target device is repeated every predetermined time (for example, 1/30 second).

  Further, the control unit 610 uses the VDP 632 to display the captured image data obtained by the imaging process of the imaging unit 678 of the own device, and displays the captured image data of FIG. 16 on the display unit 630 of the own device. The process of changing the image G220 to an image based on the captured image data is repeated every predetermined time (for example, 1/30 second).

  Further, in the communication process T, when the user operating the own device utters a voice, the control unit 610 stores voice data based on the uttered voice via the network 70 when the voice input unit 674 speaks. The data is transmitted to the communication target device specified by the IP address stored in unit 620.

  In the communication process T, the control unit 610 ends the communication process T when a communication end operation is performed. Here, the communication end operation is an interface operation T for pressing the button image BG290.

  Here, a process when the communication terminal apparatus A is performing the process of step S249 will be described. In this case, the control unit 610 uses the IP address stored in the storage unit 620 via the network 70 as the captured image data obtained by the imaging unit 678 of the own device (communication terminal device A). The process of transmitting to the communication terminal apparatus B that is the communication target apparatus specified by “222.222.2.2” is repeated every predetermined time (for example, 1/30 second).

  In the communication terminal device B, every time the control unit 610 receives captured image data, the VDP 632 is used to capture the communication target device image of FIG. 16 displayed on the display unit 630 of the own device (communication terminal device B). The image G210 is changed to an image based on the received captured image data. For example, when the control unit 610 receives captured image data every 1/30 seconds, the communication target device captured image G210 is a moving image that changes every 1/30 seconds. That is, the moving image is a moving image that displays 30 frames per second.

  In addition, the control unit 610 uses the VDP 632 to display captured image data obtained by the imaging processing of the imaging unit 678 of the own device (communication terminal device A) using the display unit of the own device (communication terminal device A). The self-device captured image G220 shown in FIG. 16 displayed at 630 is changed to an image based on the captured image data repeatedly every predetermined time (for example, 1/30 second). By this processing, the captured image G220 of the own device becomes a moving image that changes every 1/30 seconds. That is, the moving image is a moving image that displays 30 frames per second.

  When the user who operates communication terminal apparatus A utters a voice, voice input unit 674 transmits voice data based on the uttered voice to IP stored in storage unit 620 via network 70. The data is transmitted to the communication terminal apparatus B that is the communication target apparatus specified by the address “222.222.2.2”.

  In communication terminal apparatus B, when control unit 610 receives audio data, control unit 610 transmits the received audio data to audio output unit 670. The audio output unit 670 outputs audio based on the received audio data from the speaker.

  In addition, when the user who operates communication terminal apparatus A performs the above-described communication end operation, control unit 610 ends communication process T. As a result, the videophone call with the communication terminal apparatus B is terminated.

  Note that the process when communication terminal apparatus B is performing the process of step S249 is similar to the process when communication terminal apparatus A is performing the process of step S249, and therefore detailed description thereof will not be repeated.

  The communication process T described above is performed in each of the communication terminal device A and the communication terminal device B, which are mutual videophone requesting devices, so that a videophone call is made between the communication terminal device A and the communication terminal device B. Can be performed.

  As described above, in the present embodiment, each of the mobile terminal device A and the mobile terminal device B includes a telephone number that is identification information of the own device, a telephone number that is identification information of the call target device, and a videophone. A communication code including a keyword and a videophone deadline is generated. Then, the mobile terminal device A transmits the generated communication code MAD100 to the communication terminal device A. The mobile terminal device B transmits the generated communication code MBD100 to the communication terminal device B.

  The communication terminal device A acquires the communication code MAD100 generated by the mobile terminal device A. The communication terminal device B acquires the communication code MBD100 generated by the mobile terminal device B.

  Communication terminal device A transmits videophone request data TAD200 including the device ID of the device itself, the network address of the device itself, and the acquired communication code MAD100 to management server 800A via network 70. Communication terminal apparatus B transmits videophone request data TBD200 including the apparatus ID of the apparatus itself, the network address of the apparatus itself, and the acquired communication code MBD100 to management server 800A via network 70.

  Management server 800A receives videophone request data TAD200 transmitted from communication terminal apparatus A and videophone request data TBD200 transmitted from communication terminal apparatus B. Then, management server 800A specifies the mutual videophone requesting device based on videophone request data TAD200 and videophone request data TBD200.

  The mutual videophone requesting device is identified by a communication code included in one videophone request data among a plurality of videophone request data, identification information (telephone number) corresponding to the portable terminal ID1 in the communication code, This is performed by simple determination as to whether or not the communication code (communication target communication code) in which the identification information (telephone number) corresponding to the portable terminal ID2 is replaced is stored in the storage unit 820. Therefore, management server 800A can easily identify the mutual videophone requesting device.

  In the present embodiment, in communication code MAD100 included in videophone request data TAD200, communication in which identification information (telephone number) corresponding to portable terminal ID1 and identification information (phone number) corresponding to portable terminal ID2 are switched. The code (communication target communication code) is the communication code MBD100 included in the videophone request data TBD200. Therefore, control unit 810 identifies communication terminal apparatus A that transmitted videophone request data TAD200 and communication terminal apparatus B that transmitted videophone request data TBD200 as the mutual videophone request apparatus.

  That is, two pieces of identification information included in each of communication code MAD100 and communication code MBD100 included in videophone request data TAD200 and videophone request data TBD200 (telephone number indicated by portable terminal ID1 and telephone number indicated by portable terminal ID2) Based on the above, two mutual videophone requesting devices are identified.

  Then, the management server 800A matches the “videophone keyword” indicated by each of the videophone request data TAD200 and the videophone request data TBD200, and the current time is the videophone request data TAD200 and the videophone request data TBD200. It is determined whether or not the authentication is successful by determining whether or not the time is before the “video phone time limit” indicated by any of them.

  Then, only when the authentication is successful, the management server 800A notifies the communication terminal device A, which is the mutual videophone request device, of the authentication success notification including the network address of the communication terminal device B, and the mutual videophone request. An authentication success notification including the network address of the communication terminal device A is notified to the communication terminal device B which is a device.

  Through the above processing, each of communication terminal apparatus A and communication terminal apparatus B, which are mutual videophone requesting apparatuses, can make a videophone call through one network 70 without using telephone network 60. It becomes.

  Therefore, when performing a videophone call, there is an effect that communication using the network can be performed efficiently.

  In the present embodiment, each of the mobile terminal device A and the mobile terminal device B generates a communication code by a simple operation in which the mobile terminal device A makes a call to the mobile terminal device B, and the generation is performed. The transmitted communication code is transmitted to the corresponding communication terminal device.

  Then, each of the communication terminal device A and the communication terminal device B performs processing for transmitting data including the network address of the own device and the communication code to the management server 800A, so that the communication terminal device A and the communication terminal are transmitted. It is possible to make a videophone call with the device B. Therefore, there is an effect that a videophone can be easily performed without performing a complicated operation.

  In this embodiment, a videophone call can be made without using the imaging unit 578 provided in the mobile terminal device 500. In other words, in this embodiment, a videophone call can be made using an inexpensive portable terminal device having only a calling function, not an expensive camera-equipped portable terminal device. Communication terminal device 600 used for a videophone is a general display-integrated PC that does not have a special hardware configuration. Therefore, it is possible to make a videophone call with an inexpensive system.

  Further, by performing authentication using the “videophone keyword” and “videophone time limit”, it is possible to prevent communication between a plurality of unintended communication terminal apparatuses.

(Processing for fee settlement)
Next, a process for performing fee settlement will be described. Here, the liquidation fee is, for example, a food and drink fee, a ticket fee, or the like.

  Hereinafter, the information processing server 700 included in the home network 501.1 is also referred to as an information processing server A. Information processing server 700 included in home network 501.2 is also referred to as information processing server B. Each of the information processing server A and the information processing server B is a server that performs fee settlement processing and the like.

  Here, each of in-home network 501.1 including communication terminal device A and information processing server A and in-home network 501.2 including communication terminal device B and information processing server B is, for example, an in-store network. Here, the store is, for example, a restaurant. It is assumed that the communication terminal device A and the information processing server A are installed in the same store (hereinafter also referred to as store A). It is assumed that the communication terminal device B and the information processing server B are installed in the same store (hereinafter also referred to as store B). Hereinafter, the user (customer) in the store A is also referred to as a user A. User A is a user of communication terminal apparatus A. A user (customer) in the store B is also referred to as a user B. User B is a user of communication terminal apparatus B.

  In the present embodiment, as an example, user A of communication terminal apparatus A included in home network 501.1 and user B of communication terminal apparatus B included in home network 501.2 are connected to communication terminal apparatus A and communication respectively. Assume that a videophone call is made using the terminal device B.

  Here, in each of the communication terminal device A and the communication terminal device B, it is assumed that the user A and the user B are making videophone calls by performing the communication process T in step S249 described above. It is assumed that the videophone image G200 of FIG. 16 is displayed on each display unit 630 of the communication terminal device A and the communication terminal device B.

  Next, in the store A, the user A operates the communication terminal device A, so that the charge that the user A should pay to the store A and the charge that the user B should pay to the store B are collectively Processing for clearing at the store A (hereinafter also referred to as clearing processing) will be described. Hereinafter, the clearing process performed in the communication terminal apparatus A installed in the store A is also referred to as a clearing process TA. Further, the clearing process performed by the information processing server A installed in the store A is also referred to as a clearing process SA. Further, the clearing process performed by the information processing server B installed in the store B is also referred to as a clearing process SB.

  Here, the information processing server A inputs information on charges (such as food and drink hereinafter) input to the terminal by inputting a charge such as food and beverage charges ordered by the user (customer) to a terminal (not shown) by the store clerk of the store A. It is assumed that the charge information SA) is received from the terminal by wireless communication, stored in the storage unit 720, and managed. In addition, the information processing server A communicates with the communication terminal device A, so that information on the usage fee of the videophone used in the communication terminal device A (hereinafter also referred to as videophone usage fee information TA) is also stored in the storage unit. 720 stores and manages. The information processing server A can communicate with a register A (not shown) installed in the store A.

  In addition, the information processing server B inputs information on the fee for food and drink ordered by the user (customer) to a terminal (not shown) by the store clerk of the store B, so that information on the fee input to the terminal (hereinafter referred to as food and beverage charge) Information SB) is received from the terminal by wireless communication, and is stored in the storage unit 720 and managed. In addition, the information processing server B communicates with the communication terminal device B, thereby storing information on the usage fee of the videophone (hereinafter also referred to as videophone usage fee information TB) performed in the communication terminal device B. 720 stores and manages. The information processing server B can communicate with a register B (not shown) installed in the store B.

  FIG. 17 is a flowchart of the settlement process SA, the settlement process TA, and the settlement process SB. Referring to FIG. 17, in the clearing process TA performed by communication terminal apparatus A, first, the process of step S341 is performed.

  In step S341, control unit 610 determines whether there is a settlement operation T or not. The clearing operation T is an interface operation T for pressing the button image BG250 of the videophone image G200 of FIG. 16 displayed on the display unit 630. If YES in step S341, the process proceeds to step S342. On the other hand, if NO at step S341, the process at step S341 is performed again. Here, assuming that there is a settlement operation T, the process proceeds to step S342.

  In step S342, control unit 610 transmits a fee acquisition request TA to information processing server A. The fee acquisition request TA is a request for acquiring a fee paid by the user A operating the communication terminal device A to the store A. Then, the process proceeds to step S343.

  In step S343, the fee acquisition request TB is transmitted to the information processing server B. The fee acquisition request TB is a request for acquiring a fee paid by the user B operating the communication terminal apparatus B to the store B. Then, the process of step S343 ends.

In the settlement process SA performed by the information processing server A, the process of step S371 is performed.
In step S371, control unit 710 determines whether or not fee acquisition request TA has been received. If YES in step S371, the process proceeds to step S372. On the other hand, if NO at step S371, the process at step S371 is performed again. Here, assuming that the fee acquisition request TA has been received, the process proceeds to step S372.

  In step S372, control unit 710 transmits fee information SA to communication terminal apparatus A. The fee information SA is a fee paid by the user A operating the communication terminal apparatus A to the store A. The fee information SA includes the food and beverage fee information SA and the videophone usage fee information TA stored in the storage unit 720. Here, it is assumed that each of the eating and drinking fee information SA and the videophone usage fee information TA is a fee paid by the user A to the store A. Then, the process of step S372 ends.

In the communication terminal device A, the process proceeds to step S344 after the process of step S343.
In step S344, fee information reception processing T is performed. In fee information reception processing T, control unit 610 performs processing for receiving fee information from each of information processing server A and information processing server B.

  Upon receiving the fee information SA, the control unit 610 stores the received fee information SA in the storage unit 620. The process of step S344 is performed until the reception of fee information from each of the information processing server A and the information processing server B is completed.

In the settlement process SB performed by the information processing server B, the process of step S381 is performed.
In step S381, the control unit 710 determines whether a fee acquisition request TB has been received. If YES in step S381, the process proceeds to step S382. On the other hand, if NO at step S381, the process at step S381 is performed again. Here, assuming that the fee acquisition request TB has been received, the process proceeds to step S382.

  In step S382, control unit 710 transmits fee information SB to communication terminal apparatus A. The fee information SB is a fee paid to the store B by the user B operating the communication terminal device B. The fee information SB includes the food and beverage fee information SB and the videophone usage fee information TB stored in the storage unit 720. Here, it is assumed that each of the eating and drinking fee information SB and the videophone usage fee information TB is a fee paid by the user B to the store B. Then, the process of step S382 ends.

  In the clearing process TA performed by the communication terminal device A, in the process of step S344, the control unit 610 receives the fee information SB and causes the storage unit 620 to store the received fee information SB. Thereby, since reception of the charge information from each of the information processing server A and the information processing server B is completed, the process proceeds to step S345.

  In step S345, a charge display process T is performed. In the fee display process T, the control unit 610 generates the following fee display image G300 indicating the received fee information SA and fee information SB using the VDP 632, and displays the fee display image G300 on the display unit 630. Let Then, the process of step S345 ends.

  FIG. 18 is a diagram showing a charge display image G300 as an example. Referring to FIG. 18, fee detail display image G310, fee detail display image G320, and button images BG360 and BG370 are arranged in fee display image G300.

  The fee detail display image G310 is an image showing information of fee information SA paid by the user A to the store A. In the fee detail display image G310, as an example, the total fee paid by the user A to the store A (hereinafter also referred to as the total fee A) is 650 yen.

  The fee detail display image G320 is an image showing information of fee information SB that the user B pays to the store B. As an example, the total fee paid by the user B to the store B (hereinafter also referred to as the total fee B) is 500 yen.

  The button image BG360 is a button image for performing processing for paying only the fee paid by the user A. Button image BG370 is a button image for performing a process for collectively adjusting total fee A and total fee B.

Referring to FIG. 17 again, after the process of step S345, the process proceeds to step S346.
In step S346, control unit 610 determines whether or not summing operation T has been performed. The summing operation T is an interface operation T for pressing the button image BG370. If YES in step S346, the process proceeds to step S347. On the other hand, if NO at step S346, the process proceeds to step S350 described later. Here, assuming that there is a total clearing operation T, the process proceeds to step S347.

  In step S347, control unit 610 transmits summation settlement notice TB to information processing server B. The total settlement notification TB is a notification that the fee paid to the store B by the user B operating the communication terminal device B (total fee B) has become 0 yen. Then, the process proceeds to step S348.

  In step S348, control unit 610 transmits summation settlement notification TA to information processing server A. The total clearing notification TA includes information on a charge obtained by adding the total charge A and the total charge B (hereinafter also referred to as the total charge A). When the total charge A is 650 yen and the total charge B is 500 yen, the combined total charge A is 1150 yen. Then, the settlement process TA ends.

  In the clearing process SB performed by the information processing server B, the process proceeds to step S384 after the process of step S382.

  In step S384, control unit 710 determines whether or not summation settlement notice TB has been received. If YES at step S384, the process proceeds to step S385. On the other hand, if NO at step S384, the process at step S384 is performed again. Here, assuming that the total settlement notice TB has been received, the process proceeds to step S385.

  In step S385, a settlement confirmation process SB is performed. In the settlement settlement process SB, the control unit 710 transmits a settlement termination notification SB to the communication terminal apparatus B. The settlement completion notification SB is a notification that the total fee B has become 0 yen.

  In this case, in the communication terminal device B, the control unit 610 receives the settlement completion notification SB, and uses the VDP 632 to send a message that the user A has paid the fee that the user B pays to the store B. The displayed image is generated, and the generated image is displayed on the display unit 630. Thereby, the user B can know that the charge which he pays to the shop B is lost.

  In the settlement confirmation process SB, the control unit 610 transmits a settlement completion notification SB to the register B. Thereby, in the register B, the settlement of the total fee B is completed. Then, the clearing process SB ends.

  In the clearing process SA performed by the information processing server A, the process proceeds to step S374 after the process of step S372.

  In step S374, control unit 710 determines whether or not summation settlement notification TA has been received. If YES in step S374, the flow proceeds to step S378. On the other hand, if NO at step S374, the process proceeds to step S375 described later. Here, assuming that the total settlement notification TA has been received, the process proceeds to step S378.

  In step S378, a clearing fee storage process A is performed. In the settlement fee storage process A, the control unit 710 performs a process according to the received notification.

  When the total settlement notification TA is received, the control unit 710 causes the storage unit 720 to store information on the total total fee A (1150 yen) included in the total settlement notification TA. Then, the settlement process SA ends.

  In this case, when the user A performs the settlement of the combined total fee A, the register A inquires the information processing server A about the combined total fee A according to the operation of the store clerk. Thereby, the register A can specify the total charge A. Accordingly, the user A pays the combined total fee A to the store clerk operating the register A, whereby the settlement is completed.

  In the clearing process TA performed by the communication terminal device A, if NO in step S346 described above, the process proceeds to step S350.

  In step S350, control unit 610 determines whether or not individual settlement operation T has been performed. The individual settlement operation T is an interface operation T for pressing the button image BG360. If YES in step S350, the process proceeds to step S352. On the other hand, if NO at step S350, the process at step S346 is performed again. Here, assuming that there is an individual settlement operation T, the process proceeds to step S352.

  In step S352, control unit 610 transmits individual settlement notification TA to information processing server A. The individual settlement notification TA includes information on the total fee A. Total charge A is 650 yen. Then, the settlement process TA ends.

  In the settlement process SA performed by the information processing server A, if the result is NO in step S374 described above, the process proceeds to step S375.

  In step S375, control unit 710 determines whether or not individual settlement notification TA has been received. If YES in step S375, the process proceeds to step S378. On the other hand, if NO at step S375, the process at step S374 is performed again. Here, assuming that the individual settlement notification TA is received, the process proceeds to step S378.

  In step S378, the above-described clearing fee storage process A is performed. In the settlement fee storage process A, the control unit 710 performs a process according to the received notification.

  When receiving the individual settlement notification TA, the control unit 710 causes the storage unit 720 to store information on the total fee A (650 yen) included in the individual settlement notification TA. Then, the settlement process SA ends.

  In this case, when the user A performs the settlement of the total fee A, the register A inquires the information processing server A about the total fee A according to the operation of the store clerk. Thereby, the register A can specify the total fee A. Therefore, the user A pays the total fee A to the clerk who operates the register A, so that the settlement is completed.

  By performing the processing of FIG. 17 described above, one of the communication terminal device A and the communication terminal device B can perform settlement of the user's fee and the partner's fee. Therefore, it is possible to improve the convenience of fee settlement.

<Second Embodiment>
In the first embodiment, the processing for making a videophone call using the management server 800A has been described. In the present embodiment, a process for making a videophone call without using management server 800A will be described.

  FIG. 19 is a diagram showing a configuration of a network system 1000A in the present embodiment. Referring to FIG. 19, network system 1000A is different from network system 1000 in FIG. 1 in that a DDNS (Dynamic Domain Name System) server 900 is included instead of management server 800A. Other than that, it is the same as network system 1000, so detailed description will not be repeated.

  The DDNS server 900 has a function of dynamically registering and managing an IP address dynamically assigned and a domain name corresponding to the IP address. The DDNS server 900 can perform data communication with the network 70.

  In addition, since each structure of the portable terminal device 500, the communication terminal device 600, and the information processing server 700 is the same as the structure demonstrated in 1st Embodiment, detailed description is not repeated.

  Note that the home networks 501.1, 501.2,. Information processing server 700 may not be included in each of n. In this case, the home networks 501.1, 501.2,. The communication unit 50 included in each of n may be omitted. When there is no communication unit 50, the home networks 501.1, 501.2,. Communication terminal apparatus 600 included in each of n performs direct data communication with network 70. That is, the communication unit 50 may not be provided.

(Process for making a videophone call)
Next, processing for making a videophone call between two users using two communication terminal devices 600 respectively included in two different home networks 501 (hereinafter also referred to as videophone processing) will be described. .

  In the present embodiment, as an example, it is assumed that a user of mobile terminal device 500 included in home network 501.1 and a user of mobile terminal device 500 included in home network 501.2 make a videophone call. As in the first embodiment, the mobile terminal device 500 included in the home network 501.1 is also referred to as a mobile terminal device A. Communication terminal device 600 included in home network 501.1 is also referred to as communication terminal device A. The mobile terminal device 500 included in the home network 501.2 is also referred to as a mobile terminal device B. Communication terminal device 600 included in home network 501.2 is also referred to as communication terminal device B.

  As in the first embodiment, it is assumed that the telephone number “090111000” is assigned to the mobile terminal device A by a telephone company or the like. Further, it is assumed that the telephone number “090222000” is assigned to the mobile terminal device B by a telephone company or the like. That is, the telephone number assigned to each of the mobile terminal device A and the mobile terminal device B becomes identification information for specifying the mobile terminal device.

  Further, it is assumed that the device ID of the communication terminal device A is “11TA”. Further, it is assumed that the device ID of the communication terminal device B is “22TB”.

  Note that the communication terminal device 600 used for the video phone has a home network 501.1, 501.2,. There may be two or more of each n.

  Note that the number of communication terminal devices 600 used for the videophone is not limited to two, but may be three or more. In this case, each of the users of the three or more portable terminal devices 500 simultaneously makes a videophone call.

  First, between the mobile terminal device A and the mobile terminal device B, the call processing M in FIG. 7 is performed in each of the mobile terminal device A and the mobile terminal device B. Here, in the storage unit 520 of the mobile terminal device A, the telephone number “090111000” which is identification information of the own device, the telephone number “090222000” which is identification information of the mobile terminal device B, and the videophone keyword “TV− It is assumed that “TEL-AB” is stored. Further, it is assumed that the storage unit 520 of the mobile terminal device B stores a telephone number “090222000” that is identification information of the own device.

  Since call processing M is the same as that in the first embodiment, detailed description will not be repeated. By the call process M, the call end date and time is stored in the storage unit 520 of the mobile terminal device A. As an example, the call end date and time is “15:00:00 on December 20, 2006”.

  Here, it is assumed that the videophone keyword “TV-TEL-AB” is stored in the storage unit 520 of the mobile terminal device B. Further, by the call processing M, the storage unit 520 of the mobile terminal device B stores the telephone number “090111000” that is the identification information of the mobile terminal device A and the call end date and time. As an example, the call end date and time is “15:00:00 on December 20, 2006”.

  Further, the above-described videophone processing M is executed in each of the mobile terminal device A and the mobile terminal device B by the call processing M.

  Next, the videophone processing M performed in each of the mobile terminal device A and the mobile terminal device B will be described.

  FIG. 20 is a flowchart of processing performed in the videophone processing M and the communication terminal device (any one of the communication terminal device A and the communication terminal device B). Referring to FIG. 20, the process with the same step number as in FIG. 8 is the same as the process of FIG. 8 described in the first embodiment, and therefore detailed description will not be repeated.

First, the videophone process M performed by the mobile terminal device A will be described.
In step S210, a process similar to that described in the first embodiment is performed, and thus detailed description will not be repeated. By this process, the communication code MAD100 of FIG. 9 is generated.

  Referring to FIG. 20 again, in communication terminal apparatus A, the process of step S240 is performed.

  In step S240, a process similar to the process described in the first embodiment is performed, and thus detailed description will not be repeated. By this processing, the initial image G100 of FIG. 10A is displayed on the display unit 630 of the communication terminal apparatus A.

  In step S241, processing similar to that described in the first embodiment is performed, and therefore detailed description will not be repeated. Here, assuming that there is a registration start operation T by the user of communication terminal apparatus A, the process proceeds to step S242.

In the portable terminal device A, the process proceeds to step S212 after the process of step S210.
In step S212, the same processing as that described in the first embodiment is performed, and therefore detailed description will not be repeated. Through this process, the communication code MAD100 in FIG. 9 is transmitted to the communication terminal apparatus A. And the process of the communication terminal device A in the videophone process M is complete | finished.

  Note that the communication code may not be automatically transmitted after the process of step S210. In this case, for example, after the process of step S210, control unit 510 causes display unit 530 to display an image on which a code transmission button image for transmitting a communication code is displayed. When the interface operation M for pressing the code transmission button image is performed, the process of step S212 is performed.

  If it is determined YES in step S241, communication terminal apparatus A proceeds to step S242.

  In step S242, a process similar to the process described in the first embodiment is performed, and thus detailed description will not be repeated. Here, assuming that communication code MAD100 has been received, the process proceeds to step S243.

  In step S243, a process similar to the process described in the first embodiment is performed, and thus detailed description will not be repeated. Through this process, the communication code MAD100 is stored in the storage unit 620 of the communication terminal apparatus A. Then, the registration notification image G100A shown in FIG. 10B is displayed on the display unit 630. And the process of the communication terminal device A is complete | finished.

  Note that the mobile terminal device A may perform the above-described process MA instead of the process of transmitting the communication code to the communication terminal apparatus A (step S212). In this case, as described above, the user of the mobile terminal device A can image the display unit 530 on which the QR code (registered trademark) indicating the information indicated by the communication code MAD100 is displayed by the imaging unit 678 of the communication terminal device A. As such, the image capturing unit 678 of the communication terminal apparatus A is brought closer. In communication terminal apparatus A, instead of step S242, image capturing unit 678 captures the QR code (registered trademark) displayed on display unit 530, whereby control unit 610 acquires information indicated by communication code MAD100. . Then, control unit 610 performs a process of storing the acquired information in storage unit 620 instead of step S243. Then, the control unit 610 causes the display unit 630 to display the registration notification image G100A.

Next, the videophone process M performed by the mobile terminal device B will be described.
In step S210, a process similar to that described in the first embodiment is performed, and thus detailed description will not be repeated. Through this process, the communication code MBD100 of FIG. 13 is generated.

  Again referring to FIG. 20, in videophone process T performed by communication terminal apparatus B, the process of step S240 is performed.

  In step S240, a process similar to the process described in the first embodiment is performed, and thus detailed description will not be repeated. By this processing, the initial image G100 of FIG. 10A is displayed on the display unit 630 of the communication terminal apparatus B.

  In step S241, processing similar to that described in the first embodiment is performed, and therefore detailed description will not be repeated. Here, assuming that there is a registration start operation T by the user of the mobile terminal device B, the process proceeds to step S242.

In the mobile terminal device B, the process proceeds to step S212 after the process of step S210.
In step S212, the same processing as that described in the first embodiment is performed, and therefore detailed description will not be repeated. Through this process, the communication code MBD100 of FIG. 13 is transmitted to the communication terminal apparatus B. And the process of the portable terminal device B in the videophone process M is completed.

  Note that the communication code may not be automatically transmitted after the process of step S210. In this case, for example, after the process of step S210, control unit 510 causes display unit 530 to display an image on which a code transmission button image for transmitting a communication code is displayed. When the interface operation M for pressing the code transmission button image is performed, the process of step S212 is performed.

  If it is determined YES in step S241, communication terminal apparatus B proceeds to step S242.

  In step S242, a process similar to the process described in the first embodiment is performed, and thus detailed description will not be repeated. Here, assuming that communication code MBD100 of FIG. 13 has been received, the process proceeds to step S243.

  In step S243, a process similar to the process described in the first embodiment is performed, and thus detailed description will not be repeated. Through this process, the communication code MBD100 is stored in the storage unit 620 of the communication terminal apparatus B. Then, the registration notification image G100A shown in FIG. 10B is displayed on the display unit 630. And the process of the communication terminal device B is complete | finished.

  Note that the mobile terminal apparatus B may perform the above-described process MB instead of the process of transmitting the communication code to the communication terminal apparatus B (step S212). In this case, as described above, the user of the mobile terminal apparatus B can image the display unit 530 on which the QR code (registered trademark) indicating the information indicated by the communication code MBD100 is displayed by the imaging unit 678 of the communication terminal apparatus B. As such, the image capturing unit 678 of the communication terminal apparatus B is brought closer. In communication terminal apparatus B, instead of step S242, imaging unit 678 captures the QR code (registered trademark) displayed on display unit 530, whereby control unit 610 acquires information indicated by communication code MBD100. . Then, control unit 610 performs a process of storing the acquired information in storage unit 620 instead of step S243. Then, the control unit 610 causes the display unit 630 to display the registration notification image G100A.

(Process to become server for communication target device)
Next, in order to make a videophone call between the communication terminal device A and the communication terminal device B, the communication terminal device B becomes a server for the communication terminal device A, and the communication terminal device A Processing for becoming a client will be described.

  First, in communication terminal apparatus B, a process (hereinafter also referred to as server registration process TB) for the own apparatus (communication terminal apparatus B) to become a server for communication terminal apparatus A will be described. Here, it is assumed that the domain name “bbb.co.jp” is set in the communication terminal apparatus B.

  Further, it is assumed that the domain name “bbb.co.jp” of the communication terminal apparatus B is stored in the storage unit 620 of the communication terminal apparatus A in advance. Further, in the storage unit 620 of the communication terminal device A, the communication code MAD100 of FIG. 9 is further stored by the process of step S243 of FIG.

  It is assumed that the domain name “bbb.co.jp” of the own device is stored in advance in the storage unit 620 of the communication terminal device B. Further, the communication code MBD100 of FIG. 13 is further stored in the storage unit 620 of the communication terminal apparatus B by the process of step S243 of FIG. Here, it is assumed that the IP address “222.222.2.2” is set in the communication terminal apparatus B.

  FIG. 21 is a flowchart of the server registration process TB and the process performed in the DDNS server 900. Referring to FIG. 21, in server registration process TB performed by communication terminal apparatus B, first, the process of step S442 is performed.

  In step S442, identification information inclusion domain name generation processing TB is performed. Here, the identification information inclusion domain name is a mobile terminal device B (hereinafter referred to as a code-providing mobile terminal) in which a communication code is given to the communication terminal device B as its own device in the domain name “bbb.co.jp” of its own device. Domain name added with identification information). The identification information of the code-providing mobile terminal device (mobile terminal device B) is the telephone number “090222000” indicated by the mobile terminal ID1 of the communication code MBD100 of FIG. 13 stored in the storage unit 620.

  Specifically, in the identification information inclusion domain name generation process TB, the control unit 610 uses the identification information of the code-providing mobile terminal device (mobile terminal device B) before the domain name “bbb.co.jp” of its own device. An identification information inclusion domain name is generated by adding a telephone number “090222000”. In this case, the generated identification information inclusion domain name is “090222000.bbb.co.jp”. Then, the process proceeds to step S444.

  In step S444, control unit 610 transmits registration request TB to DDNS server 900. Here, the registration request TB is a request for registering the identification information inclusion domain name and the IP address “222.222.2.2” of the own device in association with each other. Here, the identification information inclusion domain name is “090222000.bbb.co.jp”. Then, this server registration process TB ends.

In the DDNS server 900, first, the process of step S494 is performed.
In step S494, the DDNS server 900 determines whether a registration request TB has been received. If YES in step S494, the process proceeds to step S496. On the other hand, if NO at step S494, the process at step S494 is performed again. Here, assuming that the registration request TB is received, the process proceeds to step S496.

  In step S496, identification information inclusion domain name registration processing is performed. In the identification information inclusion domain name registration process, the DDNS server 900 stores the identification information inclusion domain name “090222000.bbb.co.jp” and the IP address “222.222. 2.2 ”is registered in association with each other. Then, the process of the DDNS server 900 ends.

(Videophone execution process)
Next, the communication terminal device A, which is a client of the communication terminal device B, connects to the communication terminal device B that has become the server by the server registration processing TB of FIG. The telephone execution process will be described. In the videophone execution process, the process performed by the communication terminal apparatus A is also referred to as a videophone execution process TA. In the videophone execution process, the process performed by the communication terminal apparatus B is also referred to as a videophone execution process TB.

  Here, the storage unit 620 of the communication terminal device A stores the domain name “bbb.co.jp” of the communication terminal device B and the communication code MAD100 of FIG.

  Further, the storage unit 620 of the communication terminal apparatus B stores the domain name “bbb.co.jp” of the own apparatus and the communication code MBD100 of FIG. Here, it is assumed that the IP address “111.111.1.1” is set in the communication terminal apparatus A.

  FIG. 22 is a flowchart of the videophone execution process TA and the videophone execution process TB. Referring to FIG. 22, in the videophone execution process TA performed by communication terminal apparatus A, first, the process of step S540 is performed.

  In step S540, connection destination domain name generation processing TA is performed. In the connection destination domain name generation process TA, a connection destination domain name is generated. The destination domain name is the identification information of the mobile terminal device B before the domain name “bbb.co.jp” of the communication target device (communication terminal device B) that is the communication target for the device itself to make a videophone call. This is the added domain name.

  The identification information of the mobile terminal device B is the telephone number “090222000” indicated by the mobile terminal ID2 of the communication code MAD100 of FIG. 9 stored in the storage unit 620. In this case, the generated connection destination domain name is “090222000.bbb.co.jp”. Then, the process proceeds to step S541.

  In step S541, an IP address acquisition process TA is performed. In the IP address acquisition process TA, the control unit 610 inquires the DDNS server 900 about the IP address registered in association with the connection destination domain name “090222000.bbb.co.jp”. Thereby, the control unit 610 acquires the IP address “222.222.2.2” of the communication target device (communication terminal device B) corresponding to the connection destination domain name “090222000.bbb.co.jp”. Then, the control unit 610 stores the acquired IP address “222.222.2.2” in the storage unit 620. Then, the process proceeds to step S542.

  In step S542, control unit 610 transmits the communication code and the IP address of its own device (communication terminal device A) to the communication target device (communication terminal device B). The communication code to be transmitted is the communication code MAD100 in FIG. The transmitted IP address is “111.111.1.1”. Then, the process of step S542 ends.

  In the videophone execution process TB performed by the communication terminal apparatus B, first, the process of step S560 is performed.

  In step S560, control unit 610 determines whether a communication code and an IP address have been received. If YES in step S560, the process proceeds to step S561. On the other hand, if NO at step S560, the process at step S560 is performed again. Here, assuming that the communication code MAD100 of FIG. 9 and the IP address “111.111.1.1” of the communication terminal apparatus A) are received, the process proceeds to step S561.

  In step S561, a reception information storage process TB is performed. In the reception information storage process TB, the control unit 610 stores the received communication code MAD100 and the IP address “111.111.1.1” in the storage unit 620. Then, the process proceeds to step S565.

  In step S565, it is determined whether authentication is successful. Specifically, control unit 610 matches communication code MAD100 stored in storage unit 620 with the “videophone keyword” indicated by each of communication code MBD100 in FIG. It is determined whether or not the time is before the “video phone time limit” indicated by one of the communication codes.

  If YES in step S565, the process proceeds to step S567. On the other hand, if NO at step S565, the process proceeds to step S566. Here, assuming that the “videophone keyword” indicated by each of the two communication codes does not match, the process proceeds to step S566.

  In step S566, control unit 610 transmits an authentication failure notification to communication terminal apparatus A specified by the received IP address “111.111.1.1”. Here, the authentication failure notification is a notification that the authentication has failed. Then, the process of step S560 is performed again.

In communication terminal apparatus A, the process proceeds to step S545 after the process of step S542.
In step S545, notification reception standby processing TA is performed. In notification reception standby process T, control unit 610 waits for a predetermined time to receive a notification from communication terminal apparatus B. The predetermined time is, for example, 1 minute. Note that when the predetermined time has elapsed, the process of step S545 ends.

  Here, it is assumed that an authentication failure notification is received from the communication terminal apparatus B within a predetermined time. In this case, the control unit 610 uses the VDP 632 to generate the authentication failure image G100C in FIG. 12B and causes the display unit 630 to display the authentication failure image G100C. In the notification reception waiting process TA, when an authentication failure notification is received within a predetermined time, the authentication failure image G100C is displayed for a predetermined time (for example, 10 seconds), and then the process proceeds to step S546.

  In step S546, control unit 610 determines whether or not an authentication failure notification has been received. If YES in step S546, the process of step S240 in FIG. 20 is performed again. On the other hand, if NO at step S546, the process proceeds to step S547 described later. Here, assuming that an authentication failure notification has been received, the videophone execution process TA ends.

  Next, in the process of step S565, the two communication codes to be determined are the communication code MAD100 of FIG. 9 and the communication code MBD100 of FIG. 13, and the current time when the process of step S565 is performed is For example, processing in the case of “December 20, 2006, 15:05” will be described.

  In this case, the “videophone keyword” indicated by each of the communication code MAD100 and the communication code MBD100 is “TV-TEL-AB” and matches. Further, the current time “December 20, 2006, 15:05” at the time when the process of step S565 is performed is “videophone time limit” (“2006 12” indicated by either communication code MAD100 or communication code MBD100. It is the time before “15:30 on March 20”). In this case, YES is determined in step S565, and the process proceeds to step S567.

  In step S567, control unit 610 transmits an authentication success notification to communication terminal apparatus A identified by the received IP address “111.111.1.1”. Here, the authentication success notification is a notification that the authentication is successful. Then, the process of step S567 ends.

  Next, the process of the communication terminal apparatus A when the authentication success notification is transmitted to the communication terminal apparatus A by the process of step S567 will be described.

Here, it is assumed that communication terminal apparatus A is performing the process of step S545.
In step S545, the above-described processing is performed, and thus detailed description will not be repeated. Here, it is assumed that an authentication success notification is received within a predetermined time. In this case, the control unit 610 generates the authentication success image G100D of FIG. 15 using the VDP 632, and causes the display unit 630 to display the authentication success image G100D. If the authentication success notification is received within the predetermined time, the authentication success image G100D is displayed for a predetermined time (for example, 10 seconds), and then the process proceeds to step S546.

  In step S546, the same processing as described above is performed, and thus detailed description will not be repeated. Here, assuming that the authentication failure notification has not been received, the process proceeds to step S547.

  In step S547, control unit 610 determines whether an authentication success notification has been received or not. If YES in step S547, the process proceeds to step S548. On the other hand, if NO at step S547, the videophone execution process TA ends. Here, assuming that an authentication success notification has been received, the process proceeds to step S548.

  In step S548, a videophone image display process TA is performed. In the videophone image display processing TA, the control unit 610 generates the videophone image G200 of FIG. 16 described above using the VDP 632 and causes the display unit 630 to display the videophone image G200. Since the videophone image G200 has been described above, detailed description thereof will not be repeated. Then, the process of step S548 ends.

In communication terminal apparatus B, the process proceeds to step S568 after the process of step S567.
In step S568, a videophone image display process TB is performed. In the video phone image display process TB, the control unit 610 uses the VDP 632 to generate the video phone image G200 of FIG. 16 described above and causes the display unit 630 to display the video phone image G200. Since the videophone image G200 has been described above, detailed description thereof will not be repeated. Then, the process of step S568 ends.

In the communication terminal device A, the process proceeds to step S549 after the process of step S548.
In step S549, communication process T is performed. Since communication process T is the same as the process of step S249 in FIG. 8, detailed description will not be repeated.

In communication terminal apparatus B, the process proceeds to step S569 after the process of step S568.
In step S569, a communication process T is performed. Since communication process T is the same as the process of step S249 in FIG. 8, detailed description will not be repeated.

  By performing communication processing T in each of communication terminal apparatus A and communication terminal apparatus B, it becomes possible to make a videophone call between communication terminal apparatus A and communication terminal apparatus B.

  Therefore, also in the present embodiment in which the management server 800A is not used, it is possible to make a videophone call between the communication terminal device A and the communication terminal device B, as in the first embodiment. That is, each of communication terminal apparatus A and communication terminal apparatus B can make a videophone call through one network 70.

  Therefore, also in the present embodiment in which the management server 800A is not used, each of the communication terminal device A and the communication terminal device B does not use the telephone network 60, as in the first embodiment. It is possible to make a videophone call via 70. Therefore, when performing a videophone call, there is an effect that communication using the network can be performed efficiently.

  In the present embodiment, as in the first embodiment, each of the mobile terminal device A and the mobile terminal device B can be operated by a simple operation in which the mobile terminal device A makes a call to the mobile terminal device B. The communication code is generated, and the generated communication code is transmitted to the corresponding communication terminal device.

  Then, each of the communication terminal device A and the communication terminal device B performs a process using the network name and the communication code of the own device, so that the videophone is transmitted between the communication terminal device A and the communication terminal device B. Can be performed. Therefore, there is an effect that a videophone can be easily performed without performing a complicated operation.

  Further, in the present embodiment, similarly to the first embodiment, it is possible to make a videophone call without using the imaging unit 578 provided in the mobile terminal device 500. In other words, in this embodiment, a videophone call can be made using an inexpensive portable terminal device having only a calling function, not an expensive camera-equipped portable terminal device. Communication terminal device 600 used for a videophone is a general display-integrated PC that does not have a special hardware configuration. Therefore, it is possible to make a videophone call with an inexpensive system.

Also in this embodiment, the processing for paying the fee can be performed. In this case, since the process described in FIG. 17 is performed, detailed description will not be repeated.
(Function block diagram)
Next, functional block diagrams of the control unit 510 and the control unit 610 in the present invention will be described.

  FIG. 23 is a functional block diagram of control unit 510 and control unit 610 in the first embodiment of the present invention. Referring to FIG. 23, control unit 510 includes a generation unit 511 and a provision unit 512. Control unit 610 includes an acquisition unit 611 and a transmission unit 612.

  Next, the operation of each part in the first embodiment of the present invention will be described. The generation unit 511 generates a communication code including the identification information of the own device and the identification information of the mobile terminal device to be communicated. The providing unit 512 provides the communication code to the corresponding communication terminal device.

  The acquisition unit 611 acquires a communication code from the corresponding mobile terminal device. The transmitting unit 612 transmits videophone request data including the network address of the own device and the acquired communication code to the network 70.

  Note that all or part of the generation unit 511 and the provision unit 512 included in the control unit 510 may be configured by hardware. All or part of the acquisition unit 611 and the transmission unit 612 included in the control unit 610 may be configured by hardware.

  FIG. 24 is a functional block diagram of the control unit 510 of the first and second portable terminal devices and the control unit 610 of the first and second communication terminal devices in the second embodiment of the present invention. Referring to FIG. 24, control unit 510 of the first mobile terminal device includes a first generation unit 513 and a first provision unit 514. The control unit 510 of the second portable terminal device includes a second generation unit 515 and a second provision unit 516.

  The control unit 610 of the first communication terminal apparatus includes a first acquisition unit 613, a second network name generation unit 614, and a communication unit 615. The control unit 610 of the second communication terminal apparatus includes a second acquisition unit 616 and a first network name generation unit 617.

  Next, the operation of each part in the second embodiment of the present invention will be described. The 1st production | generation part 513 produces | generates the 1st communication code containing the identification information of an own apparatus, and the identification information of a 2nd portable terminal device. The 1st provision part 514 gives a 1st communication code to a 1st communication terminal device.

  The second generation unit 515 generates a second communication code including the identification information of the own device and the identification information of the first portable terminal device. The second provision unit 516 gives the second communication code to the second communication terminal device.

  The first acquisition unit 613 acquires the first communication code from the first portable terminal device. The second acquisition unit 616 acquires the second communication code from the second portable terminal device. The first network name generation unit 617 is a communication network for other devices to communicate with the own device based on the network name of the own device and the identification information of the second portable terminal device included in the second communication code. Generate a name.

  The second network name generation unit 614 generates a communication network name based on the network name of the second communication terminal device and the identification information of the second portable terminal device included in the first communication code. The communication unit 615 performs communication of main information using the network 70 with the second communication terminal device based on the generated communication network name.

  Note that all or part of the first generation unit 513 and the first provision unit 514 included in the control unit 510 of the first mobile terminal device may be configured by hardware. In addition, all or part of the second generation unit 515 and the second provision unit 516 included in the control unit 510 of the second mobile terminal device may be configured by hardware.

  Moreover, all or part of the first acquisition unit 613, the second network name generation unit 614, and the communication unit 615 included in the control unit 610 of the first communication terminal apparatus may be configured by hardware. Moreover, all or part of the second acquisition unit 616 and the first network name generation unit 617 included in the control unit 610 of the second communication terminal apparatus may be configured by hardware.

  The embodiment disclosed this time should be considered as illustrative in all points and not restrictive. The scope of the present invention is defined by the terms of the claims, rather than the description above, and is intended to include any modifications within the scope and meaning equivalent to the terms of the claims.

It is a figure which shows the structure of the network system in this Embodiment. It is the figure which showed the external appearance of the portable terminal device from the front. It is the block diagram which showed the internal structure of the portable terminal device. It is the block diagram which showed the internal structure of the communication terminal device. It is the block diagram which showed the internal structure of the information processing server. It is the block diagram which showed the internal structure of the management server. 5 is a flowchart of a call process M. It is a flowchart of the process performed by the video telephone process M, the video telephone process T, and a management server. It is a figure which shows the communication code as an example. It is a figure which shows the image displayed on a display part. It is a figure which shows the videophone request data as an example. It is a figure which shows the image displayed on a display part. It is a figure which shows the communication code as an example. It is a figure which shows the videophone request data as an example. It is a figure which shows the authentication success image as an example. It is a figure which shows the videophone image as an example. It is a flowchart of settlement process SA, settlement process TA, and settlement process SB. It is a figure which shows the charge display image as an example. It is a figure which shows the structure of the network system in this Embodiment. It is a flowchart of the process performed by the videophone process M and a communication terminal device. It is a flowchart of the process performed by server registration process TB and a DDNS server. It is a flowchart of videophone execution processing TA and videophone execution processing TB. It is a functional block diagram of two different control parts in the 1st embodiment of the present invention. It is a functional block diagram of the control part of the 1st and 2nd portable terminal device and the control part of a 1st and 2nd communication terminal device in the 2nd Embodiment of this invention.

Explanation of symbols

  50 communication unit, 70 network, 180, 181, 180A, 180B program, 500 portable terminal device, 510, 610, 710, 810 control unit, 520, 620, 720, 820 storage unit, 530, 630 display unit, 540 input unit 555, 555A recording medium, 600 communication terminal device, 700 information processing server, 800A management server, 900 DDNS server, 1000, 1000A network system.

Claims (6)

First and second portable terminal devices that can communicate with the first network, and first and second communications that can communicate with the second network and correspond to the first and second portable terminal devices, respectively. A communication system including a terminal device,
The first portable terminal device is:
First generation means for generating a first communication code including identification information of the device itself and identification information of the second portable terminal device;
First providing means for giving the first communication code to the first communication terminal device;
The second portable terminal device is
Second generation means for generating a second communication code including identification information of the device itself and identification information of the first portable terminal device;
Second providing means for giving the second communication code to the second communication terminal device;
The first communication terminal device is:
Comprising first acquisition means for acquiring the first communication code from the first portable terminal device;
The second communication terminal device
Second acquisition means for acquiring the second communication code from the second portable terminal device;
A first network that generates a communication network name for another device to communicate with the own device based on the network name of the own device and the identification information of the second portable terminal device included in the second communication code Name generation means,
The first communication terminal device further includes:
Storage means for storing a network name of the second communication terminal device;
Second network name generation means for generating the communication network name based on the network name of the second communication terminal device and the identification information of the second portable terminal device included in the first communication code;
A communication system comprising: the second communication terminal device and communication means for communicating main information using the second network based on the generated communication network name.   The communication system according to claim 1, wherein the main information is image and audio information. The communication means of the first communication terminal device transmits its own network address to the second communication terminal device,
The second communication terminal device further includes:
Receiving means for receiving the network address of the device;
2. The communication system according to claim 1, further comprising: an information communication unit configured to perform communication of the main information using the first communication terminal device and the second network based on the received network address of the own device. .   The identification information of the first portable terminal device used by the second generation unit to generate the second communication code is obtained by the second portable terminal device via the first network. The communication system according to claim 1, wherein the communication system is information received from one mobile terminal device.   The each of the first communication code and the second communication code further includes communication establishment necessary information necessary for establishing communication between the first and second communication terminal apparatuses. Communications system.   2. The communication system according to claim 1, wherein each of the first communication code and the second communication code includes time limit information indicating a time limit during which communication between the first and second communication terminal apparatuses is possible.

Images